INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:39580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48102 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:14:38,894 - lava_callback - INFO - Received callback for node 69cf06699e2394c38fe00f08 2026-04-05 00:14:38,901 - lava_callback - INFO - Starting async job submit for node 69cf06699e2394c38fe00f08 INFO: 172.21.0.1:48114 - "POST /node/69cf06699e2394c38fe00f08 HTTP/1.0" 202 Accepted 2026-04-05 00:14:38,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:14:38,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06699e2394c38fe00f08 HTTP/1.1" 200 None 2026-04-05 00:14:38,930 - lava_callback - DEBUG - Processing node 69cf06699e2394c38fe00f08: baseline-arm64-clabbe 2026-04-05 00:14:38,931 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf06699e2394c38fe00f08 2026-04-05 00:14:38,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:14:38,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06699e2394c38fe00f08 HTTP/1.1" 200 None 2026-04-05 00:14:38,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:14:38,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-05 00:14:38,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:14:39,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf06699e2394c38fe00f08 HTTP/1.1" 200 None 2026-04-05 00:14:39,030 - lava_callback - ERROR - Error processing callback for node 69cf06699e2394c38fe00f08: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58874 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:34:09,609 - lava_callback - INFO - Received callback for node 69d1ad8faa48d6fae7bb088b INFO: 172.21.0.1:58882 - "POST /node/69d1ad8faa48d6fae7bb088b HTTP/1.0" 202 Accepted 2026-04-05 00:34:09,616 - lava_callback - INFO - Starting async job submit for node 69d1ad8faa48d6fae7bb088b 2026-04-05 00:34:09,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:34:09,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1ad8faa48d6fae7bb088b HTTP/1.1" 200 None 2026-04-05 00:34:09,668 - lava_callback - DEBUG - Processing node 69d1ad8faa48d6fae7bb088b: baseline-arm 2026-04-05 00:34:09,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:34:10,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:34:10,058 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d1ad8faa48d6fae7bb088b/log.txt.gz 2026-04-05 00:34:10,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:34:10,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:34:10,367 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d1ad8faa48d6fae7bb088b/lava-logs.yaml 2026-04-05 00:34:10,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:34:10,510 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:34:10,512 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d1ad8faa48d6fae7bb088b/lava_callback.json.gz 2026-04-05 00:34:10,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:34:10,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1ad8faa48d6fae7bb088b HTTP/1.1" 200 None 2026-04-05 00:34:10,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:34:10,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa27aa48d6fae7bb04bb HTTP/1.1" 200 None 2026-04-05 00:34:10,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:34:10,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1ad8faa48d6fae7bb088b HTTP/1.1" 200 None 2026-04-05 00:34:10,609 - lava_callback - INFO - Completed processing callback for node 69d1ad8faa48d6fae7bb088b INFO: 172.21.0.1:58060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53458 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:34:39,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:34:39,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37648 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:36:29,990 - lava_callback - INFO - Received callback for node 69cf0b839e2394c38fe0135a INFO: 172.21.0.1:45812 - "POST /node/69cf0b839e2394c38fe0135a HTTP/1.0" 202 Accepted 2026-04-05 00:36:29,998 - lava_callback - INFO - Starting async job submit for node 69cf0b839e2394c38fe0135a 2026-04-05 00:36:30,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:36:30,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0b839e2394c38fe0135a HTTP/1.1" 200 None 2026-04-05 00:36:30,030 - lava_callback - DEBUG - Processing node 69cf0b839e2394c38fe0135a: baseline-arm-baylibre 2026-04-05 00:36:30,031 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0b839e2394c38fe0135a 2026-04-05 00:36:30,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:36:30,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0b839e2394c38fe0135a HTTP/1.1" 200 None 2026-04-05 00:36:30,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:36:30,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 00:36:30,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:36:30,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0b839e2394c38fe0135a HTTP/1.1" 200 None 2026-04-05 00:36:30,122 - lava_callback - ERROR - Error processing callback for node 69cf0b839e2394c38fe0135a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36746 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:37:09,950 - lava_callback - INFO - Received callback for node 69cf0ba89e2394c38fe01389 INFO: 172.21.0.1:38456 - "POST /node/69cf0ba89e2394c38fe01389 HTTP/1.0" 202 Accepted 2026-04-05 00:37:09,955 - lava_callback - INFO - Starting async job submit for node 69cf0ba89e2394c38fe01389 2026-04-05 00:37:09,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:37:09,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0ba89e2394c38fe01389 HTTP/1.1" 200 None 2026-04-05 00:37:09,972 - lava_callback - DEBUG - Processing node 69cf0ba89e2394c38fe01389: baseline-arm-baylibre 2026-04-05 00:37:09,972 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0ba89e2394c38fe01389 2026-04-05 00:37:09,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:37:09,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0ba89e2394c38fe01389 HTTP/1.1" 200 None 2026-04-05 00:37:09,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:37:10,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 00:37:10,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:37:10,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0ba89e2394c38fe01389 HTTP/1.1" 200 None 2026-04-05 00:37:10,030 - lava_callback - ERROR - Error processing callback for node 69cf0ba89e2394c38fe01389: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49740 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:38:00,022 - lava_callback - INFO - Received callback for node 69cf0bd19e2394c38fe013a3 INFO: 172.21.0.1:41214 - "POST /node/69cf0bd19e2394c38fe013a3 HTTP/1.0" 202 Accepted 2026-04-05 00:38:00,028 - lava_callback - INFO - Starting async job submit for node 69cf0bd19e2394c38fe013a3 2026-04-05 00:38:00,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:38:00,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0bd19e2394c38fe013a3 HTTP/1.1" 200 None 2026-04-05 00:38:00,046 - lava_callback - DEBUG - Processing node 69cf0bd19e2394c38fe013a3: baseline-arm-clabbe 2026-04-05 00:38:00,046 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0bd19e2394c38fe013a3 2026-04-05 00:38:00,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:38:00,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0bd19e2394c38fe013a3 HTTP/1.1" 200 None 2026-04-05 00:38:00,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:38:00,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 00:38:00,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:38:00,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0bd19e2394c38fe013a3 HTTP/1.1" 200 None 2026-04-05 00:38:00,129 - lava_callback - ERROR - Error processing callback for node 69cf0bd19e2394c38fe013a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59848 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:38:20,075 - lava_callback - INFO - Received callback for node 69cf0bf59e2394c38fe013d6 INFO: 172.21.0.1:53700 - "POST /node/69cf0bf59e2394c38fe013d6 HTTP/1.0" 202 Accepted 2026-04-05 00:38:20,082 - lava_callback - INFO - Starting async job submit for node 69cf0bf59e2394c38fe013d6 2026-04-05 00:38:20,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:38:20,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0bf59e2394c38fe013d6 HTTP/1.1" 200 None 2026-04-05 00:38:20,099 - lava_callback - DEBUG - Processing node 69cf0bf59e2394c38fe013d6: baseline-arm-clabbe 2026-04-05 00:38:20,099 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0bf59e2394c38fe013d6 2026-04-05 00:38:20,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:38:20,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0bf59e2394c38fe013d6 HTTP/1.1" 200 None 2026-04-05 00:38:20,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:38:20,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 00:38:20,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:38:20,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0bf59e2394c38fe013d6 HTTP/1.1" 200 None 2026-04-05 00:38:20,166 - lava_callback - ERROR - Error processing callback for node 69cf0bf59e2394c38fe013d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35092 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:39:00,069 - lava_callback - INFO - Received callback for node 69cf0c1b9e2394c38fe01407 INFO: 172.21.0.1:54638 - "POST /node/69cf0c1b9e2394c38fe01407 HTTP/1.0" 202 Accepted 2026-04-05 00:39:00,075 - lava_callback - INFO - Starting async job submit for node 69cf0c1b9e2394c38fe01407 2026-04-05 00:39:00,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:39:00,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0c1b9e2394c38fe01407 HTTP/1.1" 200 None 2026-04-05 00:39:00,099 - lava_callback - DEBUG - Processing node 69cf0c1b9e2394c38fe01407: baseline-arm-clabbe 2026-04-05 00:39:00,099 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0c1b9e2394c38fe01407 2026-04-05 00:39:00,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:39:00,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0c1b9e2394c38fe01407 HTTP/1.1" 200 None 2026-04-05 00:39:00,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:39:00,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 00:39:00,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:39:00,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0c1b9e2394c38fe01407 HTTP/1.1" 200 None 2026-04-05 00:39:00,173 - lava_callback - ERROR - Error processing callback for node 69cf0c1b9e2394c38fe01407: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35120 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:39:30,075 - lava_callback - INFO - Received callback for node 69cf0c3e9e2394c38fe0142d INFO: 172.21.0.1:35500 - "POST /node/69cf0c3e9e2394c38fe0142d HTTP/1.0" 202 Accepted 2026-04-05 00:39:30,085 - lava_callback - INFO - Starting async job submit for node 69cf0c3e9e2394c38fe0142d 2026-04-05 00:39:30,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:39:30,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0c3e9e2394c38fe0142d HTTP/1.1" 200 None 2026-04-05 00:39:30,102 - lava_callback - DEBUG - Processing node 69cf0c3e9e2394c38fe0142d: baseline-arm-baylibre 2026-04-05 00:39:30,102 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0c3e9e2394c38fe0142d 2026-04-05 00:39:30,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:39:30,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0c3e9e2394c38fe0142d HTTP/1.1" 200 None 2026-04-05 00:39:30,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:39:30,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 00:39:30,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:39:30,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0c3e9e2394c38fe0142d HTTP/1.1" 200 None 2026-04-05 00:39:30,166 - lava_callback - ERROR - Error processing callback for node 69cf0c3e9e2394c38fe0142d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49026 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:40:20,062 - lava_callback - INFO - Received callback for node 69cf0c6b9e2394c38fe0144a INFO: 172.21.0.1:58616 - "POST /node/69cf0c6b9e2394c38fe0144a HTTP/1.0" 202 Accepted 2026-04-05 00:40:20,071 - lava_callback - INFO - Starting async job submit for node 69cf0c6b9e2394c38fe0144a 2026-04-05 00:40:20,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:40:20,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0c6b9e2394c38fe0144a HTTP/1.1" 200 None 2026-04-05 00:40:20,099 - lava_callback - DEBUG - Processing node 69cf0c6b9e2394c38fe0144a: baseline-arm-clabbe 2026-04-05 00:40:20,100 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0c6b9e2394c38fe0144a 2026-04-05 00:40:20,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:40:20,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0c6b9e2394c38fe0144a HTTP/1.1" 200 None 2026-04-05 00:40:20,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:40:20,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 00:40:20,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:40:20,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0c6b9e2394c38fe0144a HTTP/1.1" 200 None 2026-04-05 00:40:20,207 - lava_callback - ERROR - Error processing callback for node 69cf0c6b9e2394c38fe0144a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41860 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:40:47,105 - lava_callback - INFO - Received callback for node 69d1af77aa48d6fae7bb096b INFO: 172.21.0.1:41874 - "POST /node/69d1af77aa48d6fae7bb096b HTTP/1.0" 202 Accepted 2026-04-05 00:40:47,112 - lava_callback - INFO - Starting async job submit for node 69d1af77aa48d6fae7bb096b 2026-04-05 00:40:47,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:40:47,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af77aa48d6fae7bb096b HTTP/1.1" 200 None 2026-04-05 00:40:47,133 - lava_callback - DEBUG - Processing node 69d1af77aa48d6fae7bb096b: baseline-arm 2026-04-05 00:40:47,139 - lava_callback - WARNING - Failed to upload log 2026-04-05 00:40:47,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:40:47,290 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:40:47,292 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d1af77aa48d6fae7bb096b/lava-logs.yaml 2026-04-05 00:40:47,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:40:47,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:40:47,478 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d1af77aa48d6fae7bb096b/lava_callback.json.gz 2026-04-05 00:40:47,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:40:47,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af77aa48d6fae7bb096b HTTP/1.1" 200 None 2026-04-05 00:40:47,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:40:47,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:40:47,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:40:47,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af77aa48d6fae7bb096b HTTP/1.1" 200 None 2026-04-05 00:40:47,617 - lava_callback - INFO - Completed processing callback for node 69d1af77aa48d6fae7bb096b INFO: 172.21.0.1:53266 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:40:57,219 - lava_callback - INFO - Received callback for node 69d1af7baa48d6fae7bb0977 INFO: 172.21.0.1:53282 - "POST /node/69d1af7baa48d6fae7bb0977 HTTP/1.0" 202 Accepted 2026-04-05 00:40:57,266 - lava_callback - INFO - Starting async job submit for node 69d1af7baa48d6fae7bb0977 2026-04-05 00:40:57,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:40:57,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af7baa48d6fae7bb0977 HTTP/1.1" 200 None 2026-04-05 00:40:57,298 - lava_callback - DEBUG - Processing node 69d1af7baa48d6fae7bb0977: baseline-arm 2026-04-05 00:40:57,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:40:57,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:40:57,677 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d1af7baa48d6fae7bb0977/log.txt.gz 2026-04-05 00:40:57,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:40:57,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:40:57,967 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d1af7baa48d6fae7bb0977/lava-logs.yaml 2026-04-05 00:40:57,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:40:58,149 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:40:58,151 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d1af7baa48d6fae7bb0977/lava_callback.json.gz 2026-04-05 00:40:58,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:40:58,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af7baa48d6fae7bb0977 HTTP/1.1" 200 None 2026-04-05 00:40:58,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:40:58,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:40:58,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:40:58,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af7baa48d6fae7bb0977 HTTP/1.1" 200 None 2026-04-05 00:40:58,240 - lava_callback - INFO - Completed processing callback for node 69d1af7baa48d6fae7bb0977 2026-04-05 00:41:00,171 - lava_callback - INFO - Received callback for node 69cf0c959e2394c38fe01456 INFO: 172.21.0.1:51912 - "POST /node/69cf0c959e2394c38fe01456 HTTP/1.0" 202 Accepted 2026-04-05 00:41:00,177 - lava_callback - INFO - Starting async job submit for node 69cf0c959e2394c38fe01456 2026-04-05 00:41:00,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:00,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0c959e2394c38fe01456 HTTP/1.1" 200 None 2026-04-05 00:41:00,197 - lava_callback - DEBUG - Processing node 69cf0c959e2394c38fe01456: baseline-arm-clabbe 2026-04-05 00:41:00,197 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0c959e2394c38fe01456 2026-04-05 00:41:00,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:00,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0c959e2394c38fe01456 HTTP/1.1" 200 None 2026-04-05 00:41:00,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:00,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 00:41:00,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:00,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0c959e2394c38fe01456 HTTP/1.1" 200 None 2026-04-05 00:41:00,252 - lava_callback - ERROR - Error processing callback for node 69cf0c959e2394c38fe01456: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 00:41:04,907 - lava_callback - INFO - Received callback for node 69d1af78aa48d6fae7bb096e INFO: 172.21.0.1:51916 - "POST /node/69d1af78aa48d6fae7bb096e HTTP/1.0" 202 Accepted 2026-04-05 00:41:04,961 - lava_callback - INFO - Starting async job submit for node 69d1af78aa48d6fae7bb096e 2026-04-05 00:41:04,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:05,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af78aa48d6fae7bb096e HTTP/1.1" 200 None 2026-04-05 00:41:05,015 - lava_callback - DEBUG - Processing node 69d1af78aa48d6fae7bb096e: baseline-arm 2026-04-05 00:41:05,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:41:05,294 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:41:05,297 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d1af78aa48d6fae7bb096e/log.txt.gz 2026-04-05 00:41:05,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:41:05,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:41:05,625 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d1af78aa48d6fae7bb096e/lava-logs.yaml 2026-04-05 00:41:05,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:41:05,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:41:05,777 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d1af78aa48d6fae7bb096e/lava_callback.json.gz 2026-04-05 00:41:05,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:05,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af78aa48d6fae7bb096e HTTP/1.1" 200 None 2026-04-05 00:41:05,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:05,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:41:05,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:05,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af78aa48d6fae7bb096e HTTP/1.1" 200 None 2026-04-05 00:41:05,890 - lava_callback - INFO - Completed processing callback for node 69d1af78aa48d6fae7bb096e INFO: 172.21.0.1:51928 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:41:09,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:09,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39460 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:41:25,361 - lava_callback - INFO - Received callback for node 69d1af91aa48d6fae7bb09f5 INFO: 172.21.0.1:36590 - "POST /node/69d1af91aa48d6fae7bb09f5 HTTP/1.0" 202 Accepted 2026-04-05 00:41:25,412 - lava_callback - INFO - Starting async job submit for node 69d1af91aa48d6fae7bb09f5 2026-04-05 00:41:25,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:25,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af91aa48d6fae7bb09f5 HTTP/1.1" 200 None 2026-04-05 00:41:25,479 - lava_callback - DEBUG - Processing node 69d1af91aa48d6fae7bb09f5: baseline-arm-clabbe 2026-04-05 00:41:25,616 - lava_callback - WARNING - Failed to upload log 2026-04-05 00:41:25,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:41:25,886 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:41:25,889 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69d1af91aa48d6fae7bb09f5/lava-logs.yaml 2026-04-05 00:41:25,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:41:26,026 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:41:26,028 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69d1af91aa48d6fae7bb09f5/lava_callback.json.gz 2026-04-05 00:41:26,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:26,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af91aa48d6fae7bb09f5 HTTP/1.1" 200 None 2026-04-05 00:41:26,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:26,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:41:26,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:26,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af91aa48d6fae7bb09f5 HTTP/1.1" 200 None 2026-04-05 00:41:26,279 - lava_callback - INFO - Completed processing callback for node 69d1af91aa48d6fae7bb09f5 INFO: 172.21.0.1:36604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42576 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:41:39,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:39,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-05 00:41:42,110 - lava_callback - INFO - Received callback for node 69d1af77aa48d6fae7bb0968 INFO: 172.21.0.1:47740 - "POST /node/69d1af77aa48d6fae7bb0968 HTTP/1.0" 202 Accepted 2026-04-05 00:41:42,116 - lava_callback - INFO - Starting async job submit for node 69d1af77aa48d6fae7bb0968 2026-04-05 00:41:42,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:42,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af77aa48d6fae7bb0968 HTTP/1.1" 200 None 2026-04-05 00:41:42,159 - lava_callback - DEBUG - Processing node 69d1af77aa48d6fae7bb0968: baseline-arm 2026-04-05 00:41:42,283 - lava_callback - INFO - Received callback for node 69d1af7aaa48d6fae7bb0974 2026-04-05 00:41:42,304 - lava_callback - INFO - Starting async job submit for node 69d1af7aaa48d6fae7bb0974 INFO: 172.21.0.1:47754 - "POST /node/69d1af7aaa48d6fae7bb0974 HTTP/1.0" 202 Accepted 2026-04-05 00:41:42,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:42,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:41:42,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af7aaa48d6fae7bb0974 HTTP/1.1" 200 None 2026-04-05 00:41:42,394 - lava_callback - DEBUG - Processing node 69d1af7aaa48d6fae7bb0974: baseline-arm 2026-04-05 00:41:42,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:41:42,646 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d1af77aa48d6fae7bb0968/log.txt.gz 2026-04-05 00:41:42,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:41:42,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:41:42,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:41:42,943 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d1af7aaa48d6fae7bb0974/log.txt.gz 2026-04-05 00:41:43,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:41:43,080 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d1af77aa48d6fae7bb0968/lava-logs.yaml 2026-04-05 00:41:43,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:41:43,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:41:43,311 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:41:43,314 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d1af77aa48d6fae7bb0968/lava_callback.json.gz 2026-04-05 00:41:43,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:43,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af77aa48d6fae7bb0968 HTTP/1.1" 200 None 2026-04-05 00:41:43,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:43,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:41:43,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:41:43,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:43,381 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d1af7aaa48d6fae7bb0974/lava-logs.yaml 2026-04-05 00:41:43,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:41:43,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af77aa48d6fae7bb0968 HTTP/1.1" 200 None 2026-04-05 00:41:43,410 - lava_callback - INFO - Completed processing callback for node 69d1af77aa48d6fae7bb0968 2026-04-05 00:41:43,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:41:43,604 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d1af7aaa48d6fae7bb0974/lava_callback.json.gz 2026-04-05 00:41:43,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:43,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af7aaa48d6fae7bb0974 HTTP/1.1" 200 None 2026-04-05 00:41:43,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:43,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:41:43,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:43,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af7aaa48d6fae7bb0974 HTTP/1.1" 200 None 2026-04-05 00:41:43,704 - lava_callback - INFO - Completed processing callback for node 69d1af7aaa48d6fae7bb0974 INFO: 172.21.0.1:47770 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:41:50,372 - lava_callback - INFO - Received callback for node 69d1af9caa48d6fae7bb0a23 2026-04-05 00:41:50,409 - lava_callback - INFO - Received callback for node 69d1af88aa48d6fae7bb099b INFO: 172.21.0.1:58886 - "POST /node/69d1af88aa48d6fae7bb099b HTTP/1.0" 202 Accepted 2026-04-05 00:41:50,421 - lava_callback - INFO - Starting async job submit for node 69d1af88aa48d6fae7bb099b INFO: 172.21.0.1:58872 - "POST /node/69d1af9caa48d6fae7bb0a23 HTTP/1.0" 202 Accepted 2026-04-05 00:41:50,422 - lava_callback - INFO - Starting async job submit for node 69d1af9caa48d6fae7bb0a23 2026-04-05 00:41:50,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:50,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:50,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af88aa48d6fae7bb099b HTTP/1.1" 200 None 2026-04-05 00:41:50,495 - lava_callback - DEBUG - Processing node 69d1af88aa48d6fae7bb099b: baseline-arm-broonie 2026-04-05 00:41:50,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af9caa48d6fae7bb0a23 HTTP/1.1" 200 None 2026-04-05 00:41:50,561 - lava_callback - DEBUG - Processing node 69d1af9caa48d6fae7bb0a23: baseline-arm-pengutronix 2026-04-05 00:41:50,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:41:50,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:41:51,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:41:51,080 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d1af88aa48d6fae7bb099b/log.txt.gz 2026-04-05 00:41:51,103 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:41:51,134 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d1af9caa48d6fae7bb0a23/log.txt.gz 2026-04-05 00:41:51,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:41:51,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:41:51,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:41:51,482 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d1af9caa48d6fae7bb0a23/lava-logs.yaml 2026-04-05 00:41:51,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:41:51,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:41:51,499 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d1af88aa48d6fae7bb099b/lava-logs.yaml 2026-04-05 00:41:51,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:41:51,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:41:51,632 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d1af9caa48d6fae7bb0a23/lava_callback.json.gz 2026-04-05 00:41:51,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:41:51,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:51,661 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d1af88aa48d6fae7bb099b/lava_callback.json.gz 2026-04-05 00:41:51,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:51,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af88aa48d6fae7bb099b HTTP/1.1" 200 None 2026-04-05 00:41:51,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af9caa48d6fae7bb0a23 HTTP/1.1" 200 None 2026-04-05 00:41:51,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:51,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:51,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:41:51,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:41:51,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:51,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:51,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af88aa48d6fae7bb099b HTTP/1.1" 200 None 2026-04-05 00:41:51,766 - lava_callback - INFO - Completed processing callback for node 69d1af88aa48d6fae7bb099b 2026-04-05 00:41:51,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af9caa48d6fae7bb0a23 HTTP/1.1" 200 None 2026-04-05 00:41:51,771 - lava_callback - INFO - Completed processing callback for node 69d1af9caa48d6fae7bb0a23 INFO: 172.21.0.1:58902 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:41:57,365 - lava_callback - INFO - Received callback for node 69d1af99aa48d6fae7bb0a14 INFO: 172.21.0.1:58908 - "POST /node/69d1af99aa48d6fae7bb0a14 HTTP/1.0" 202 Accepted 2026-04-05 00:41:57,372 - lava_callback - INFO - Starting async job submit for node 69d1af99aa48d6fae7bb0a14 2026-04-05 00:41:57,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:57,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af99aa48d6fae7bb0a14 HTTP/1.1" 200 None 2026-04-05 00:41:57,408 - lava_callback - DEBUG - Processing node 69d1af99aa48d6fae7bb0a14: baseline-arm-pengutronix 2026-04-05 00:41:57,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:41:57,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:41:57,699 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d1af99aa48d6fae7bb0a14/log.txt.gz 2026-04-05 00:41:57,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:41:57,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:41:57,968 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d1af99aa48d6fae7bb0a14/lava-logs.yaml 2026-04-05 00:41:57,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:41:58,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:41:58,117 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d1af99aa48d6fae7bb0a14/lava_callback.json.gz 2026-04-05 00:41:58,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:58,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af99aa48d6fae7bb0a14 HTTP/1.1" 200 None 2026-04-05 00:41:58,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:58,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:41:58,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:58,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af99aa48d6fae7bb0a14 HTTP/1.1" 200 None 2026-04-05 00:41:58,198 - lava_callback - INFO - Completed processing callback for node 69d1af99aa48d6fae7bb0a14 2026-04-05 00:41:58,531 - lava_callback - INFO - Received callback for node 69d1af9aaa48d6fae7bb0a1b INFO: 172.21.0.1:58924 - "POST /node/69d1af9aaa48d6fae7bb0a1b HTTP/1.0" 202 Accepted 2026-04-05 00:41:58,537 - lava_callback - INFO - Starting async job submit for node 69d1af9aaa48d6fae7bb0a1b 2026-04-05 00:41:58,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:58,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af9aaa48d6fae7bb0a1b HTTP/1.1" 200 None 2026-04-05 00:41:58,573 - lava_callback - DEBUG - Processing node 69d1af9aaa48d6fae7bb0a1b: baseline-arm-pengutronix 2026-04-05 00:41:58,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:41:58,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:41:58,845 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d1af9aaa48d6fae7bb0a1b/log.txt.gz 2026-04-05 00:41:58,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:41:59,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:41:59,154 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d1af9aaa48d6fae7bb0a1b/lava-logs.yaml 2026-04-05 00:41:59,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:41:59,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:41:59,337 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69d1af9aaa48d6fae7bb0a1b/lava_callback.json.gz 2026-04-05 00:41:59,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:59,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af9aaa48d6fae7bb0a1b HTTP/1.1" 200 None 2026-04-05 00:41:59,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:59,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:41:59,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:41:59,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af9aaa48d6fae7bb0a1b HTTP/1.1" 200 None 2026-04-05 00:41:59,445 - lava_callback - INFO - Completed processing callback for node 69d1af9aaa48d6fae7bb0a1b 2026-04-05 00:42:00,154 - lava_callback - INFO - Received callback for node 69cf0cc69e2394c38fe01484 INFO: 172.21.0.1:48200 - "POST /node/69cf0cc69e2394c38fe01484 HTTP/1.0" 202 Accepted 2026-04-05 00:42:00,160 - lava_callback - INFO - Starting async job submit for node 69cf0cc69e2394c38fe01484 2026-04-05 00:42:00,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:42:00,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0cc69e2394c38fe01484 HTTP/1.1" 200 None 2026-04-05 00:42:00,180 - lava_callback - DEBUG - Processing node 69cf0cc69e2394c38fe01484: baseline-arm-clabbe 2026-04-05 00:42:00,180 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0cc69e2394c38fe01484 2026-04-05 00:42:00,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:42:00,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0cc69e2394c38fe01484 HTTP/1.1" 200 None 2026-04-05 00:42:00,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:42:00,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 00:42:00,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:42:00,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0cc69e2394c38fe01484 HTTP/1.1" 200 None 2026-04-05 00:42:00,240 - lava_callback - ERROR - Error processing callback for node 69cf0cc69e2394c38fe01484: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48204 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:42:09,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:42:09,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-05 00:42:11,539 - lava_callback - INFO - Received callback for node 69d1af8baa48d6fae7bb09a2 INFO: 172.21.0.1:58484 - "POST /node/69d1af8baa48d6fae7bb09a2 HTTP/1.0" 202 Accepted 2026-04-05 00:42:11,545 - lava_callback - INFO - Starting async job submit for node 69d1af8baa48d6fae7bb09a2 2026-04-05 00:42:11,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:42:11,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af8baa48d6fae7bb09a2 HTTP/1.1" 200 None 2026-04-05 00:42:11,583 - lava_callback - DEBUG - Processing node 69d1af8baa48d6fae7bb09a2: baseline-arm-broonie 2026-04-05 00:42:11,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:42:11,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:42:11,974 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d1af8baa48d6fae7bb09a2/log.txt.gz 2026-04-05 00:42:12,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:42:12,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:42:12,330 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d1af8baa48d6fae7bb09a2/lava-logs.yaml 2026-04-05 00:42:12,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:42:12,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:42:12,513 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d1af8baa48d6fae7bb09a2/lava_callback.json.gz 2026-04-05 00:42:12,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:42:12,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af8baa48d6fae7bb09a2 HTTP/1.1" 200 None 2026-04-05 00:42:12,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:42:12,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:42:12,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:42:12,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af8baa48d6fae7bb09a2 HTTP/1.1" 200 None 2026-04-05 00:42:12,614 - lava_callback - INFO - Completed processing callback for node 69d1af8baa48d6fae7bb09a2 INFO: 172.21.0.1:58492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47614 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:42:35,038 - lava_callback - INFO - Received callback for node 69d1af95aa48d6fae7bb0a06 INFO: 172.21.0.1:60694 - "POST /node/69d1af95aa48d6fae7bb0a06 HTTP/1.0" 202 Accepted 2026-04-05 00:42:35,045 - lava_callback - INFO - Starting async job submit for node 69d1af95aa48d6fae7bb0a06 2026-04-05 00:42:35,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:42:35,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af95aa48d6fae7bb0a06 HTTP/1.1" 200 None 2026-04-05 00:42:35,096 - lava_callback - DEBUG - Processing node 69d1af95aa48d6fae7bb0a06: baseline-arm-kontron 2026-04-05 00:42:35,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:42:35,446 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:42:35,448 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d1af95aa48d6fae7bb0a06/log.txt.gz 2026-04-05 00:42:35,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:42:35,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:42:35,793 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d1af95aa48d6fae7bb0a06/lava-logs.yaml 2026-04-05 00:42:35,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:42:35,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:42:35,954 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d1af95aa48d6fae7bb0a06/lava_callback.json.gz 2026-04-05 00:42:35,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:42:36,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af95aa48d6fae7bb0a06 HTTP/1.1" 200 None 2026-04-05 00:42:36,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:42:36,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:42:36,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:42:36,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af95aa48d6fae7bb0a06 HTTP/1.1" 200 None 2026-04-05 00:42:36,055 - lava_callback - INFO - Completed processing callback for node 69d1af95aa48d6fae7bb0a06 2026-04-05 00:42:36,264 - lava_callback - INFO - Received callback for node 69d1af96aa48d6fae7bb0a09 INFO: 172.21.0.1:60704 - "POST /node/69d1af96aa48d6fae7bb0a09 HTTP/1.0" 202 Accepted 2026-04-05 00:42:36,271 - lava_callback - INFO - Starting async job submit for node 69d1af96aa48d6fae7bb0a09 2026-04-05 00:42:36,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:42:36,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af96aa48d6fae7bb0a09 HTTP/1.1" 200 None 2026-04-05 00:42:36,316 - lava_callback - DEBUG - Processing node 69d1af96aa48d6fae7bb0a09: baseline-arm-kontron 2026-04-05 00:42:36,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:60710 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:42:36,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:42:36,628 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d1af96aa48d6fae7bb0a09/log.txt.gz 2026-04-05 00:42:36,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:42:36,902 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:42:36,904 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d1af96aa48d6fae7bb0a09/lava-logs.yaml 2026-04-05 00:42:36,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:42:37,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:42:37,048 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69d1af96aa48d6fae7bb0a09/lava_callback.json.gz 2026-04-05 00:42:37,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:42:37,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af96aa48d6fae7bb0a09 HTTP/1.1" 200 None 2026-04-05 00:42:37,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:42:37,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:42:37,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:42:37,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af96aa48d6fae7bb0a09 HTTP/1.1" 200 None 2026-04-05 00:42:37,127 - lava_callback - INFO - Completed processing callback for node 69d1af96aa48d6fae7bb0a09 2026-04-05 00:42:39,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:42:39,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33994 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:43:22,359 - lava_callback - INFO - Received callback for node 69d1afaeaa48d6fae7bb0a77 INFO: 172.21.0.1:45252 - "POST /node/69d1afaeaa48d6fae7bb0a77 HTTP/1.0" 202 Accepted 2026-04-05 00:43:22,366 - lava_callback - INFO - Starting async job submit for node 69d1afaeaa48d6fae7bb0a77 2026-04-05 00:43:22,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:43:22,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1afaeaa48d6fae7bb0a77 HTTP/1.1" 200 None 2026-04-05 00:43:22,418 - lava_callback - DEBUG - Processing node 69d1afaeaa48d6fae7bb0a77: ltp-dio 2026-04-05 00:43:22,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:43:22,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:43:22,970 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69d1afaeaa48d6fae7bb0a77/log.txt.gz 2026-04-05 00:43:23,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:43:23,410 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:43:23,412 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69d1afaeaa48d6fae7bb0a77/lava-logs.yaml 2026-04-05 00:43:23,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:43:23,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:43:23,616 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69d1afaeaa48d6fae7bb0a77/lava_callback.json.gz 2026-04-05 00:43:23,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:43:23,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1afaeaa48d6fae7bb0a77 HTTP/1.1" 200 None 2026-04-05 00:43:23,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:43:23,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:43:23,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:43:23,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1afaeaa48d6fae7bb0a77 HTTP/1.1" 200 None 2026-04-05 00:43:23,715 - lava_callback - INFO - Completed processing callback for node 69d1afaeaa48d6fae7bb0a77 INFO: 172.21.0.1:45268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40652 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:43:39,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:43:39,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46806 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:43:58,998 - lava_callback - INFO - Received callback for node 69d1b044aa48d6fae7bb0b63 INFO: 172.21.0.1:46816 - "POST /node/69d1b044aa48d6fae7bb0b63 HTTP/1.0" 202 Accepted 2026-04-05 00:43:59,006 - lava_callback - INFO - Starting async job submit for node 69d1b044aa48d6fae7bb0b63 2026-04-05 00:43:59,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:43:59,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b044aa48d6fae7bb0b63 HTTP/1.1" 200 None 2026-04-05 00:43:59,027 - lava_callback - DEBUG - Processing node 69d1b044aa48d6fae7bb0b63: baseline-arm 2026-04-05 00:43:59,033 - lava_callback - WARNING - Failed to upload log 2026-04-05 00:43:59,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:43:59,186 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:43:59,188 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d1b044aa48d6fae7bb0b63/lava-logs.yaml 2026-04-05 00:43:59,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:43:59,390 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:43:59,392 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d1b044aa48d6fae7bb0b63/lava_callback.json.gz 2026-04-05 00:43:59,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:43:59,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b044aa48d6fae7bb0b63 HTTP/1.1" 200 None 2026-04-05 00:43:59,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:43:59,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:43:59,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:43:59,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b044aa48d6fae7bb0b63 HTTP/1.1" 200 None 2026-04-05 00:43:59,465 - lava_callback - INFO - Completed processing callback for node 69d1b044aa48d6fae7bb0b63 INFO: 172.21.0.1:40872 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:44:09,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:44:09,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-05 00:44:10,060 - lava_callback - INFO - Received callback for node 69d1b003aa48d6fae7bb0b36 INFO: 172.21.0.1:36618 - "POST /node/69d1b003aa48d6fae7bb0b36 HTTP/1.0" 202 Accepted 2026-04-05 00:44:10,066 - lava_callback - INFO - Starting async job submit for node 69d1b003aa48d6fae7bb0b36 2026-04-05 00:44:10,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:44:10,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b003aa48d6fae7bb0b36 HTTP/1.1" 200 None 2026-04-05 00:44:10,126 - lava_callback - DEBUG - Processing node 69d1b003aa48d6fae7bb0b36: baseline-arm-broonie 2026-04-05 00:44:10,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:44:10,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:44:10,527 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d1b003aa48d6fae7bb0b36/log.txt.gz 2026-04-05 00:44:10,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:44:10,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:44:10,893 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d1b003aa48d6fae7bb0b36/lava-logs.yaml 2026-04-05 00:44:10,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:44:11,062 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:44:11,064 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d1b003aa48d6fae7bb0b36/lava_callback.json.gz 2026-04-05 00:44:11,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:44:11,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b003aa48d6fae7bb0b36 HTTP/1.1" 200 None 2026-04-05 00:44:11,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:44:11,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:44:11,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:44:11,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b003aa48d6fae7bb0b36 HTTP/1.1" 200 None 2026-04-05 00:44:11,167 - lava_callback - INFO - Completed processing callback for node 69d1b003aa48d6fae7bb0b36 INFO: 172.21.0.1:36632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36646 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:44:20,964 - lava_callback - INFO - Received callback for node 69d1b044aa48d6fae7bb0b66 INFO: 172.21.0.1:39780 - "POST /node/69d1b044aa48d6fae7bb0b66 HTTP/1.0" 202 Accepted 2026-04-05 00:44:20,973 - lava_callback - INFO - Starting async job submit for node 69d1b044aa48d6fae7bb0b66 2026-04-05 00:44:20,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:44:21,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b044aa48d6fae7bb0b66 HTTP/1.1" 200 None 2026-04-05 00:44:21,008 - lava_callback - DEBUG - Processing node 69d1b044aa48d6fae7bb0b66: baseline-x86 2026-04-05 00:44:21,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:44:21,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:44:21,436 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d1b044aa48d6fae7bb0b66/log.txt.gz 2026-04-05 00:44:21,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:44:21,770 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:44:21,772 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d1b044aa48d6fae7bb0b66/lava-logs.yaml 2026-04-05 00:44:21,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:44:21,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:44:21,936 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d1b044aa48d6fae7bb0b66/lava_callback.json.gz 2026-04-05 00:44:21,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:44:21,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b044aa48d6fae7bb0b66 HTTP/1.1" 200 None 2026-04-05 00:44:21,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:44:22,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa40aa48d6fae7bb04de HTTP/1.1" 200 None 2026-04-05 00:44:22,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:44:22,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b044aa48d6fae7bb0b66 HTTP/1.1" 200 None 2026-04-05 00:44:22,044 - lava_callback - INFO - Completed processing callback for node 69d1b044aa48d6fae7bb0b66 INFO: 172.21.0.1:39794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39796 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:44:27,864 - lava_callback - INFO - Received callback for node 69d1b047aa48d6fae7bb0b6f INFO: 172.21.0.1:39812 - "POST /node/69d1b047aa48d6fae7bb0b6f HTTP/1.0" 202 Accepted 2026-04-05 00:44:27,873 - lava_callback - INFO - Starting async job submit for node 69d1b047aa48d6fae7bb0b6f 2026-04-05 00:44:27,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:44:27,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b047aa48d6fae7bb0b6f HTTP/1.1" 200 None 2026-04-05 00:44:27,928 - lava_callback - DEBUG - Processing node 69d1b047aa48d6fae7bb0b6f: baseline-x86 2026-04-05 00:44:28,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:44:28,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:44:28,292 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d1b047aa48d6fae7bb0b6f/log.txt.gz 2026-04-05 00:44:28,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:44:28,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:44:28,692 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d1b047aa48d6fae7bb0b6f/lava-logs.yaml 2026-04-05 00:44:28,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:44:28,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:44:28,914 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d1b047aa48d6fae7bb0b6f/lava_callback.json.gz 2026-04-05 00:44:28,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:44:28,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b047aa48d6fae7bb0b6f HTTP/1.1" 200 None 2026-04-05 00:44:28,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:44:28,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa40aa48d6fae7bb04de HTTP/1.1" 200 None 2026-04-05 00:44:28,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:44:28,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b047aa48d6fae7bb0b6f HTTP/1.1" 200 None 2026-04-05 00:44:28,997 - lava_callback - INFO - Completed processing callback for node 69d1b047aa48d6fae7bb0b6f INFO: 172.21.0.1:36690 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:44:39,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:44:39,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46614 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:45:11,893 - lava_callback - INFO - Received callback for node 69d1afadaa48d6fae7bb0a74 INFO: 172.21.0.1:56762 - "POST /node/69d1afadaa48d6fae7bb0a74 HTTP/1.0" 202 Accepted 2026-04-05 00:45:11,901 - lava_callback - INFO - Starting async job submit for node 69d1afadaa48d6fae7bb0a74 2026-04-05 00:45:11,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:45:11,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1afadaa48d6fae7bb0a74 HTTP/1.1" 200 None 2026-04-05 00:45:11,949 - lava_callback - DEBUG - Processing node 69d1afadaa48d6fae7bb0a74: ltp-cve 2026-04-05 00:45:12,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:45:12,504 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:45:12,506 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69d1afadaa48d6fae7bb0a74/log.txt.gz 2026-04-05 00:45:12,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:45:13,022 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:45:13,025 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69d1afadaa48d6fae7bb0a74/lava-logs.yaml 2026-04-05 00:45:13,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:45:13,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:45:13,270 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69d1afadaa48d6fae7bb0a74/lava_callback.json.gz 2026-04-05 00:45:13,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:45:13,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1afadaa48d6fae7bb0a74 HTTP/1.1" 200 None 2026-04-05 00:45:13,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:45:13,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:45:13,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:45:13,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1afadaa48d6fae7bb0a74 HTTP/1.1" 200 None 2026-04-05 00:45:13,382 - lava_callback - INFO - Completed processing callback for node 69d1afadaa48d6fae7bb0a74 2026-04-05 00:45:13,485 - lava_callback - INFO - Received callback for node 69d1afb0aa48d6fae7bb0a7b INFO: 172.21.0.1:56772 - "POST /node/69d1afb0aa48d6fae7bb0a7b HTTP/1.0" 202 Accepted 2026-04-05 00:45:13,496 - lava_callback - INFO - Starting async job submit for node 69d1afb0aa48d6fae7bb0a7b 2026-04-05 00:45:13,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:45:13,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1afb0aa48d6fae7bb0a7b HTTP/1.1" 200 None 2026-04-05 00:45:13,563 - lava_callback - DEBUG - Processing node 69d1afb0aa48d6fae7bb0a7b: ltp-fs_bind 2026-04-05 00:45:13,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:45:14,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:45:14,115 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69d1afb0aa48d6fae7bb0a7b/log.txt.gz 2026-04-05 00:45:14,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:45:14,545 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:45:14,548 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69d1afb0aa48d6fae7bb0a7b/lava-logs.yaml 2026-04-05 00:45:14,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:45:14,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:45:14,734 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69d1afb0aa48d6fae7bb0a7b/lava_callback.json.gz 2026-04-05 00:45:14,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:45:14,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1afb0aa48d6fae7bb0a7b HTTP/1.1" 200 None 2026-04-05 00:45:14,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:45:14,776 - lava_callback - INFO - Received callback for node 69d1b045aa48d6fae7bb0b69 INFO: 172.21.0.1:56774 - "POST /node/69d1b045aa48d6fae7bb0b69 HTTP/1.0" 202 Accepted 2026-04-05 00:45:14,782 - lava_callback - INFO - Starting async job submit for node 69d1b045aa48d6fae7bb0b69 2026-04-05 00:45:14,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:45:14,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:45:14,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:45:14,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b045aa48d6fae7bb0b69 HTTP/1.1" 200 None 2026-04-05 00:45:14,819 - lava_callback - DEBUG - Processing node 69d1b045aa48d6fae7bb0b69: baseline-x86 2026-04-05 00:45:14,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1afb0aa48d6fae7bb0a7b HTTP/1.1" 200 None 2026-04-05 00:45:14,905 - lava_callback - INFO - Completed processing callback for node 69d1afb0aa48d6fae7bb0a7b INFO: 172.21.0.1:56790 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 00:45:15,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:45:15,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:45:15,332 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d1b045aa48d6fae7bb0b69/log.txt.gz 2026-04-05 00:45:15,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:45:15,708 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:45:15,711 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d1b045aa48d6fae7bb0b69/lava-logs.yaml 2026-04-05 00:45:15,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:45:15,902 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:45:15,905 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d1b045aa48d6fae7bb0b69/lava_callback.json.gz 2026-04-05 00:45:15,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:45:15,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b045aa48d6fae7bb0b69 HTTP/1.1" 200 None 2026-04-05 00:45:15,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:45:15,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa40aa48d6fae7bb04de HTTP/1.1" 200 None 2026-04-05 00:45:15,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:45:15,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b045aa48d6fae7bb0b69 HTTP/1.1" 200 None 2026-04-05 00:45:15,999 - lava_callback - INFO - Completed processing callback for node 69d1b045aa48d6fae7bb0b69 INFO: 172.21.0.1:56792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36866 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:45:30,461 - lava_callback - INFO - Received callback for node 69d1afb4aa48d6fae7bb0a9e INFO: 172.21.0.1:56366 - "POST /node/69d1afb4aa48d6fae7bb0a9e HTTP/1.0" 202 Accepted 2026-04-05 00:45:30,469 - lava_callback - INFO - Starting async job submit for node 69d1afb4aa48d6fae7bb0a9e 2026-04-05 00:45:30,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:45:30,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1afb4aa48d6fae7bb0a9e HTTP/1.1" 200 None 2026-04-05 00:45:30,513 - lava_callback - DEBUG - Processing node 69d1afb4aa48d6fae7bb0a9e: ltp-ipc 2026-04-05 00:45:30,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:45:31,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:45:31,099 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69d1afb4aa48d6fae7bb0a9e/log.txt.gz 2026-04-05 00:45:31,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:45:31,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:45:31,609 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69d1afb4aa48d6fae7bb0a9e/lava-logs.yaml 2026-04-05 00:45:31,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:45:31,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:45:31,806 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69d1afb4aa48d6fae7bb0a9e/lava_callback.json.gz 2026-04-05 00:45:31,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:45:31,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1afb4aa48d6fae7bb0a9e HTTP/1.1" 200 None 2026-04-05 00:45:31,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:45:31,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:45:31,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:45:31,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1afb4aa48d6fae7bb0a9e HTTP/1.1" 200 None 2026-04-05 00:45:31,911 - lava_callback - INFO - Completed processing callback for node 69d1afb4aa48d6fae7bb0a9e 2026-04-05 00:45:33,048 - lava_callback - INFO - Received callback for node 69d1afb8aa48d6fae7bb0aad INFO: 172.21.0.1:56378 - "POST /node/69d1afb8aa48d6fae7bb0aad HTTP/1.0" 202 Accepted 2026-04-05 00:45:33,055 - lava_callback - INFO - Starting async job submit for node 69d1afb8aa48d6fae7bb0aad 2026-04-05 00:45:33,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:45:33,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1afb8aa48d6fae7bb0aad HTTP/1.1" 200 None 2026-04-05 00:45:33,099 - lava_callback - DEBUG - Processing node 69d1afb8aa48d6fae7bb0aad: ltp-syscalls 2026-04-05 00:45:33,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:45:34,129 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:45:34,132 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69d1afb8aa48d6fae7bb0aad/log.txt.gz 2026-04-05 00:45:34,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:45:34,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:45:34,918 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69d1afb8aa48d6fae7bb0aad/lava-logs.yaml 2026-04-05 00:45:34,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:45:35,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:45:35,112 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69d1afb8aa48d6fae7bb0aad/lava_callback.json.gz 2026-04-05 00:45:35,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:45:35,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1afb8aa48d6fae7bb0aad HTTP/1.1" 200 None 2026-04-05 00:45:35,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:45:35,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:45:35,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:45:35,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1afb8aa48d6fae7bb0aad HTTP/1.1" 200 None 2026-04-05 00:45:35,232 - lava_callback - INFO - Completed processing callback for node 69d1afb8aa48d6fae7bb0aad INFO: 172.21.0.1:56384 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:45:39,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:45:39,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:53722 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:45:52,097 - lava_callback - INFO - Received callback for node 69d1afb5aa48d6fae7bb0aa1 INFO: 172.21.0.1:34776 - "POST /node/69d1afb5aa48d6fae7bb0aa1 HTTP/1.0" 202 Accepted 2026-04-05 00:45:52,111 - lava_callback - INFO - Starting async job submit for node 69d1afb5aa48d6fae7bb0aa1 2026-04-05 00:45:52,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:45:52,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1afb5aa48d6fae7bb0aa1 HTTP/1.1" 200 None 2026-04-05 00:45:52,223 - lava_callback - DEBUG - Processing node 69d1afb5aa48d6fae7bb0aa1: ltp-pty 2026-04-05 00:45:52,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:45:53,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:45:53,301 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69d1afb5aa48d6fae7bb0aa1/log.txt.gz 2026-04-05 00:45:53,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:45:54,188 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:45:54,191 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69d1afb5aa48d6fae7bb0aa1/lava-logs.yaml 2026-04-05 00:45:54,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:45:54,378 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:45:54,380 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69d1afb5aa48d6fae7bb0aa1/lava_callback.json.gz 2026-04-05 00:45:54,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:45:54,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1afb5aa48d6fae7bb0aa1 HTTP/1.1" 200 None 2026-04-05 00:45:54,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:45:54,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:45:54,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:45:54,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1afb5aa48d6fae7bb0aa1 HTTP/1.1" 200 None 2026-04-05 00:45:54,522 - lava_callback - INFO - Completed processing callback for node 69d1afb5aa48d6fae7bb0aa1 INFO: 172.21.0.1:34782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55946 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:46:09,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:46:09,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-05 00:46:09,570 - lava_callback - INFO - Received callback for node 69d1b048aa48d6fae7bb0b7b INFO: 172.21.0.1:55960 - "POST /node/69d1b048aa48d6fae7bb0b7b HTTP/1.0" 202 Accepted 2026-04-05 00:46:09,579 - lava_callback - INFO - Starting async job submit for node 69d1b048aa48d6fae7bb0b7b 2026-04-05 00:46:09,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:46:09,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b048aa48d6fae7bb0b7b HTTP/1.1" 200 None 2026-04-05 00:46:09,623 - lava_callback - DEBUG - Processing node 69d1b048aa48d6fae7bb0b7b: baseline-x86 2026-04-05 00:46:10,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:46:10,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:46:10,348 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d1b048aa48d6fae7bb0b7b/log.txt.gz 2026-04-05 00:46:10,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:46:11,167 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:46:11,169 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d1b048aa48d6fae7bb0b7b/lava-logs.yaml 2026-04-05 00:46:11,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:46:11,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:46:11,310 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d1b048aa48d6fae7bb0b7b/lava_callback.json.gz 2026-04-05 00:46:11,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:46:11,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b048aa48d6fae7bb0b7b HTTP/1.1" 200 None 2026-04-05 00:46:11,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:46:11,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa40aa48d6fae7bb04de HTTP/1.1" 200 None 2026-04-05 00:46:11,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:46:11,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b048aa48d6fae7bb0b7b HTTP/1.1" 200 None 2026-04-05 00:46:11,426 - lava_callback - INFO - Completed processing callback for node 69d1b048aa48d6fae7bb0b7b INFO: 172.21.0.1:45896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41656 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:46:39,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:46:39,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48164 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:47:10,516 - lava_callback - INFO - Received callback for node 69cf0e009e2394c38fe014c8 INFO: 172.21.0.1:59102 - "POST /node/69cf0e009e2394c38fe014c8 HTTP/1.0" 202 Accepted 2026-04-05 00:47:10,525 - lava_callback - INFO - Starting async job submit for node 69cf0e009e2394c38fe014c8 2026-04-05 00:47:10,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:47:10,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e009e2394c38fe014c8 HTTP/1.1" 200 None 2026-04-05 00:47:10,556 - lava_callback - DEBUG - Processing node 69cf0e009e2394c38fe014c8: baseline-arm-baylibre 2026-04-05 00:47:10,556 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0e009e2394c38fe014c8 2026-04-05 00:47:10,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:47:10,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e009e2394c38fe014c8 HTTP/1.1" 200 None 2026-04-05 00:47:10,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:47:10,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 00:47:10,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:47:10,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0e009e2394c38fe014c8 HTTP/1.1" 200 None 2026-04-05 00:47:10,649 - lava_callback - ERROR - Error processing callback for node 69cf0e009e2394c38fe014c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37222 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:48:10,532 - lava_callback - INFO - Received callback for node 69cf0e3e9e2394c38fe014fb INFO: 172.21.0.1:57134 - "POST /node/69cf0e3e9e2394c38fe014fb HTTP/1.0" 202 Accepted 2026-04-05 00:48:10,541 - lava_callback - INFO - Starting async job submit for node 69cf0e3e9e2394c38fe014fb 2026-04-05 00:48:10,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:48:10,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e3e9e2394c38fe014fb HTTP/1.1" 200 None 2026-04-05 00:48:10,564 - lava_callback - DEBUG - Processing node 69cf0e3e9e2394c38fe014fb: baseline-arm-baylibre 2026-04-05 00:48:10,564 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0e3e9e2394c38fe014fb 2026-04-05 00:48:10,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:48:10,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e3e9e2394c38fe014fb HTTP/1.1" 200 None 2026-04-05 00:48:10,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:48:10,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 00:48:10,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:48:10,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0e3e9e2394c38fe014fb HTTP/1.1" 200 None 2026-04-05 00:48:10,645 - lava_callback - ERROR - Error processing callback for node 69cf0e3e9e2394c38fe014fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50518 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:49:10,602 - lava_callback - INFO - Received callback for node 69cf0e779e2394c38fe01534 INFO: 172.21.0.1:42806 - "POST /node/69cf0e779e2394c38fe01534 HTTP/1.0" 202 Accepted 2026-04-05 00:49:10,610 - lava_callback - INFO - Starting async job submit for node 69cf0e779e2394c38fe01534 2026-04-05 00:49:10,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:10,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e779e2394c38fe01534 HTTP/1.1" 200 None 2026-04-05 00:49:10,643 - lava_callback - DEBUG - Processing node 69cf0e779e2394c38fe01534: baseline-arm-baylibre 2026-04-05 00:49:10,644 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0e779e2394c38fe01534 2026-04-05 00:49:10,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:10,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e779e2394c38fe01534 HTTP/1.1" 200 None 2026-04-05 00:49:10,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:10,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 00:49:10,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:10,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0e779e2394c38fe01534 HTTP/1.1" 200 None 2026-04-05 00:49:10,746 - lava_callback - ERROR - Error processing callback for node 69cf0e779e2394c38fe01534: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 00:49:11,304 - lava_callback - INFO - Received callback for node 69cf0e789e2394c38fe0154d INFO: 172.21.0.1:42822 - "POST /node/69cf0e789e2394c38fe0154d HTTP/1.0" 202 Accepted 2026-04-05 00:49:11,313 - lava_callback - INFO - Starting async job submit for node 69cf0e789e2394c38fe0154d 2026-04-05 00:49:11,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:11,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e789e2394c38fe0154d HTTP/1.1" 200 None 2026-04-05 00:49:11,338 - lava_callback - DEBUG - Processing node 69cf0e789e2394c38fe0154d: baseline-arm-baylibre 2026-04-05 00:49:11,338 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0e789e2394c38fe0154d 2026-04-05 00:49:11,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:11,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e789e2394c38fe0154d HTTP/1.1" 200 None 2026-04-05 00:49:11,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:11,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 00:49:11,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:11,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0e789e2394c38fe0154d HTTP/1.1" 200 None 2026-04-05 00:49:11,423 - lava_callback - ERROR - Error processing callback for node 69cf0e789e2394c38fe0154d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 00:49:12,000 - lava_callback - INFO - Received callback for node 69cf0e739e2394c38fe01526 INFO: 172.21.0.1:42826 - "POST /node/69cf0e739e2394c38fe01526 HTTP/1.0" 202 Accepted 2026-04-05 00:49:12,008 - lava_callback - INFO - Starting async job submit for node 69cf0e739e2394c38fe01526 2026-04-05 00:49:12,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:12,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e739e2394c38fe01526 HTTP/1.1" 200 None 2026-04-05 00:49:12,025 - lava_callback - DEBUG - Processing node 69cf0e739e2394c38fe01526: baseline-arm-baylibre 2026-04-05 00:49:12,026 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0e739e2394c38fe01526 2026-04-05 00:49:12,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:12,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e739e2394c38fe01526 HTTP/1.1" 200 None 2026-04-05 00:49:12,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:12,046 - lava_callback - INFO - Received callback for node 69d1afb7aa48d6fae7bb0aaa INFO: 172.21.0.1:42836 - "POST /node/69d1afb7aa48d6fae7bb0aaa HTTP/1.0" 202 Accepted 2026-04-05 00:49:12,057 - lava_callback - INFO - Starting async job submit for node 69d1afb7aa48d6fae7bb0aaa 2026-04-05 00:49:12,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:12,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 00:49:12,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:12,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1afb7aa48d6fae7bb0aaa HTTP/1.1" 200 None 2026-04-05 00:49:12,116 - lava_callback - DEBUG - Processing node 69d1afb7aa48d6fae7bb0aaa: ltp-smoke 2026-04-05 00:49:12,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0e739e2394c38fe01526 HTTP/1.1" 200 None 2026-04-05 00:49:12,163 - lava_callback - ERROR - Error processing callback for node 69cf0e739e2394c38fe01526: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 00:49:12,699 - lava_callback - INFO - Received callback for node 69cf0e799e2394c38fe01550 INFO: 172.21.0.1:42846 - "POST /node/69cf0e799e2394c38fe01550 HTTP/1.0" 202 Accepted 2026-04-05 00:49:12,722 - lava_callback - INFO - Starting async job submit for node 69cf0e799e2394c38fe01550 2026-04-05 00:49:12,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:12,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:49:12,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e799e2394c38fe01550 HTTP/1.1" 200 None 2026-04-05 00:49:12,787 - lava_callback - DEBUG - Processing node 69cf0e799e2394c38fe01550: baseline-arm-baylibre 2026-04-05 00:49:12,788 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0e799e2394c38fe01550 2026-04-05 00:49:12,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:12,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e799e2394c38fe01550 HTTP/1.1" 200 None 2026-04-05 00:49:12,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:12,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 00:49:12,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:12,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0e799e2394c38fe01550 HTTP/1.1" 200 None 2026-04-05 00:49:12,894 - lava_callback - ERROR - Error processing callback for node 69cf0e799e2394c38fe01550: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 00:49:13,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:49:13,087 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d1afb7aa48d6fae7bb0aaa/log.txt.gz 2026-04-05 00:49:13,412 - lava_callback - INFO - Received callback for node 69cf0e7b9e2394c38fe01553 INFO: 172.21.0.1:42854 - "POST /node/69cf0e7b9e2394c38fe01553 HTTP/1.0" 202 Accepted 2026-04-05 00:49:13,422 - lava_callback - INFO - Starting async job submit for node 69cf0e7b9e2394c38fe01553 2026-04-05 00:49:13,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:13,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:49:13,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e7b9e2394c38fe01553 HTTP/1.1" 200 None 2026-04-05 00:49:13,459 - lava_callback - DEBUG - Processing node 69cf0e7b9e2394c38fe01553: baseline-arm-baylibre 2026-04-05 00:49:13,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0e7b9e2394c38fe01553 2026-04-05 00:49:13,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:13,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e7b9e2394c38fe01553 HTTP/1.1" 200 None 2026-04-05 00:49:13,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:13,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 00:49:13,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:13,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0e7b9e2394c38fe01553 HTTP/1.1" 200 None 2026-04-05 00:49:13,543 - lava_callback - ERROR - Error processing callback for node 69cf0e7b9e2394c38fe01553: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 00:49:13,651 - lava_callback - INFO - Received callback for node 69d1afbaaa48d6fae7bb0ab4 INFO: 172.21.0.1:42870 - "POST /node/69d1afbaaa48d6fae7bb0ab4 HTTP/1.0" 202 Accepted 2026-04-05 00:49:13,665 - lava_callback - INFO - Starting async job submit for node 69d1afbaaa48d6fae7bb0ab4 2026-04-05 00:49:13,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:13,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1afbaaa48d6fae7bb0ab4 HTTP/1.1" 200 None 2026-04-05 00:49:13,780 - lava_callback - DEBUG - Processing node 69d1afbaaa48d6fae7bb0ab4: ltp-syscalls-ipc 2026-04-05 00:49:14,026 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:49:14,039 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d1afb7aa48d6fae7bb0aaa/lava-logs.yaml 2026-04-05 00:49:14,116 - lava_callback - INFO - Received callback for node 69cf0e7e9e2394c38fe0155e 2026-04-05 00:49:14,128 - lava_callback - INFO - Starting async job submit for node 69cf0e7e9e2394c38fe0155e INFO: 172.21.0.1:42884 - "POST /node/69cf0e7e9e2394c38fe0155e HTTP/1.0" 202 Accepted 2026-04-05 00:49:14,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:14,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:49:14,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e7e9e2394c38fe0155e HTTP/1.1" 200 None 2026-04-05 00:49:14,252 - lava_callback - DEBUG - Processing node 69cf0e7e9e2394c38fe0155e: baseline-arm-baylibre 2026-04-05 00:49:14,252 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0e7e9e2394c38fe0155e 2026-04-05 00:49:14,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:14,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e7e9e2394c38fe0155e HTTP/1.1" 200 None 2026-04-05 00:49:14,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:14,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 00:49:14,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:14,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:49:14,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0e7e9e2394c38fe0155e HTTP/1.1" 200 None 2026-04-05 00:49:14,493 - lava_callback - ERROR - Error processing callback for node 69cf0e7e9e2394c38fe0155e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 00:49:14,789 - lava_callback - INFO - Received callback for node 69cf0e809e2394c38fe01561 INFO: 172.21.0.1:42890 - "POST /node/69cf0e809e2394c38fe01561 HTTP/1.0" 202 Accepted 2026-04-05 00:49:14,799 - lava_callback - INFO - Starting async job submit for node 69cf0e809e2394c38fe01561 2026-04-05 00:49:14,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:14,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e809e2394c38fe01561 HTTP/1.1" 200 None 2026-04-05 00:49:14,832 - lava_callback - DEBUG - Processing node 69cf0e809e2394c38fe01561: baseline-arm-baylibre 2026-04-05 00:49:14,832 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0e809e2394c38fe01561 2026-04-05 00:49:14,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:14,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e809e2394c38fe01561 HTTP/1.1" 200 None 2026-04-05 00:49:14,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:14,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 00:49:14,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:14,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0e809e2394c38fe01561 HTTP/1.1" 200 None 2026-04-05 00:49:14,946 - lava_callback - ERROR - Error processing callback for node 69cf0e809e2394c38fe01561: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 00:49:15,015 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:49:15,017 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d1afbaaa48d6fae7bb0ab4/log.txt.gz 2026-04-05 00:49:15,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:49:15,089 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d1afb7aa48d6fae7bb0aaa/lava_callback.json.gz INFO: 172.21.0.1:42902 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 00:49:15,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:15,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1afb7aa48d6fae7bb0aaa HTTP/1.1" 200 None 2026-04-05 00:49:15,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:15,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:49:15,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:15,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:49:15,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1afb7aa48d6fae7bb0aaa HTTP/1.1" 200 None 2026-04-05 00:49:15,484 - lava_callback - INFO - Completed processing callback for node 69d1afb7aa48d6fae7bb0aaa 2026-04-05 00:49:16,117 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:49:16,119 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d1afbaaa48d6fae7bb0ab4/lava-logs.yaml 2026-04-05 00:49:16,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:49:16,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:49:16,295 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69d1afbaaa48d6fae7bb0ab4/lava_callback.json.gz 2026-04-05 00:49:16,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:16,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1afbaaa48d6fae7bb0ab4 HTTP/1.1" 200 None 2026-04-05 00:49:16,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:16,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:49:16,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:16,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1afbaaa48d6fae7bb0ab4 HTTP/1.1" 200 None 2026-04-05 00:49:16,405 - lava_callback - INFO - Completed processing callback for node 69d1afbaaa48d6fae7bb0ab4 INFO: 172.21.0.1:42906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57630 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:49:32,169 - lava_callback - INFO - Received callback for node 69d1afbcaa48d6fae7bb0ab7 INFO: 172.21.0.1:44994 - "POST /node/69d1afbcaa48d6fae7bb0ab7 HTTP/1.0" 202 Accepted 2026-04-05 00:49:32,181 - lava_callback - INFO - Starting async job submit for node 69d1afbcaa48d6fae7bb0ab7 2026-04-05 00:49:32,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:32,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1afbcaa48d6fae7bb0ab7 HTTP/1.1" 200 None 2026-04-05 00:49:32,255 - lava_callback - DEBUG - Processing node 69d1afbcaa48d6fae7bb0ab7: ltp-timers 2026-04-05 00:49:32,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:49:33,370 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:49:33,372 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69d1afbcaa48d6fae7bb0ab7/log.txt.gz 2026-04-05 00:49:33,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:49:34,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:49:34,779 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69d1afbcaa48d6fae7bb0ab7/lava-logs.yaml 2026-04-05 00:49:34,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:49:35,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:49:35,651 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69d1afbcaa48d6fae7bb0ab7/lava_callback.json.gz 2026-04-05 00:49:35,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:35,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1afbcaa48d6fae7bb0ab7 HTTP/1.1" 200 None 2026-04-05 00:49:35,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:35,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:49:35,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:35,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1afbcaa48d6fae7bb0ab7 HTTP/1.1" 200 None 2026-04-05 00:49:35,797 - lava_callback - INFO - Completed processing callback for node 69d1afbcaa48d6fae7bb0ab7 INFO: 172.21.0.1:45000 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:49:39,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:39,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-05 00:49:40,634 - lava_callback - INFO - Received callback for node 69cf0e969e2394c38fe0159b INFO: 172.21.0.1:54088 - "POST /node/69cf0e969e2394c38fe0159b HTTP/1.0" 202 Accepted 2026-04-05 00:49:40,643 - lava_callback - INFO - Starting async job submit for node 69cf0e969e2394c38fe0159b 2026-04-05 00:49:40,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:40,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e969e2394c38fe0159b HTTP/1.1" 200 None 2026-04-05 00:49:40,676 - lava_callback - DEBUG - Processing node 69cf0e969e2394c38fe0159b: baseline-arm-clabbe 2026-04-05 00:49:40,677 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0e969e2394c38fe0159b 2026-04-05 00:49:40,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:40,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e969e2394c38fe0159b HTTP/1.1" 200 None 2026-04-05 00:49:40,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:40,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 00:49:40,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:40,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0e969e2394c38fe0159b HTTP/1.1" 200 None 2026-04-05 00:49:40,805 - lava_callback - ERROR - Error processing callback for node 69cf0e969e2394c38fe0159b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 00:49:41,325 - lava_callback - INFO - Received callback for node 69cf0e999e2394c38fe015a6 INFO: 172.21.0.1:54096 - "POST /node/69cf0e999e2394c38fe015a6 HTTP/1.0" 202 Accepted 2026-04-05 00:49:41,333 - lava_callback - INFO - Starting async job submit for node 69cf0e999e2394c38fe015a6 2026-04-05 00:49:41,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:41,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e999e2394c38fe015a6 HTTP/1.1" 200 None 2026-04-05 00:49:41,363 - lava_callback - DEBUG - Processing node 69cf0e999e2394c38fe015a6: baseline-arm-clabbe 2026-04-05 00:49:41,363 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0e999e2394c38fe015a6 2026-04-05 00:49:41,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:41,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e999e2394c38fe015a6 HTTP/1.1" 200 None 2026-04-05 00:49:41,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:41,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 00:49:41,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:41,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0e999e2394c38fe015a6 HTTP/1.1" 200 None 2026-04-05 00:49:41,461 - lava_callback - ERROR - Error processing callback for node 69cf0e999e2394c38fe015a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 00:49:42,024 - lava_callback - INFO - Received callback for node 69cf0e9b9e2394c38fe015b1 INFO: 172.21.0.1:54106 - "POST /node/69cf0e9b9e2394c38fe015b1 HTTP/1.0" 202 Accepted 2026-04-05 00:49:42,032 - lava_callback - INFO - Starting async job submit for node 69cf0e9b9e2394c38fe015b1 2026-04-05 00:49:42,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:42,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e9b9e2394c38fe015b1 HTTP/1.1" 200 None 2026-04-05 00:49:42,065 - lava_callback - DEBUG - Processing node 69cf0e9b9e2394c38fe015b1: baseline-arm-clabbe 2026-04-05 00:49:42,066 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0e9b9e2394c38fe015b1 2026-04-05 00:49:42,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:42,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e9b9e2394c38fe015b1 HTTP/1.1" 200 None 2026-04-05 00:49:42,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:42,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 00:49:42,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:42,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0e9b9e2394c38fe015b1 HTTP/1.1" 200 None 2026-04-05 00:49:42,150 - lava_callback - ERROR - Error processing callback for node 69cf0e9b9e2394c38fe015b1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 00:49:42,715 - lava_callback - INFO - Received callback for node 69cf0e9d9e2394c38fe015b4 INFO: 172.21.0.1:54108 - "POST /node/69cf0e9d9e2394c38fe015b4 HTTP/1.0" 202 Accepted 2026-04-05 00:49:42,724 - lava_callback - INFO - Starting async job submit for node 69cf0e9d9e2394c38fe015b4 2026-04-05 00:49:42,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:42,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e9d9e2394c38fe015b4 HTTP/1.1" 200 None 2026-04-05 00:49:42,756 - lava_callback - DEBUG - Processing node 69cf0e9d9e2394c38fe015b4: baseline-arm-clabbe 2026-04-05 00:49:42,757 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0e9d9e2394c38fe015b4 2026-04-05 00:49:42,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:42,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e9d9e2394c38fe015b4 HTTP/1.1" 200 None 2026-04-05 00:49:42,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:42,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 00:49:42,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:42,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0e9d9e2394c38fe015b4 HTTP/1.1" 200 None 2026-04-05 00:49:42,848 - lava_callback - ERROR - Error processing callback for node 69cf0e9d9e2394c38fe015b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 00:49:43,418 - lava_callback - INFO - Received callback for node 69cf0e9e9e2394c38fe015b7 INFO: 172.21.0.1:54122 - "POST /node/69cf0e9e9e2394c38fe015b7 HTTP/1.0" 202 Accepted 2026-04-05 00:49:43,427 - lava_callback - INFO - Starting async job submit for node 69cf0e9e9e2394c38fe015b7 2026-04-05 00:49:43,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:43,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e9e9e2394c38fe015b7 HTTP/1.1" 200 None 2026-04-05 00:49:43,459 - lava_callback - DEBUG - Processing node 69cf0e9e9e2394c38fe015b7: baseline-arm-clabbe 2026-04-05 00:49:43,460 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0e9e9e2394c38fe015b7 2026-04-05 00:49:43,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:43,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0e9e9e2394c38fe015b7 HTTP/1.1" 200 None 2026-04-05 00:49:43,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:43,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 00:49:43,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:43,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0e9e9e2394c38fe015b7 HTTP/1.1" 200 None 2026-04-05 00:49:43,557 - lava_callback - ERROR - Error processing callback for node 69cf0e9e9e2394c38fe015b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 00:49:44,131 - lava_callback - INFO - Received callback for node 69cf0ea29e2394c38fe015c0 INFO: 172.21.0.1:54128 - "POST /node/69cf0ea29e2394c38fe015c0 HTTP/1.0" 202 Accepted 2026-04-05 00:49:44,140 - lava_callback - INFO - Starting async job submit for node 69cf0ea29e2394c38fe015c0 2026-04-05 00:49:44,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:44,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0ea29e2394c38fe015c0 HTTP/1.1" 200 None 2026-04-05 00:49:44,167 - lava_callback - DEBUG - Processing node 69cf0ea29e2394c38fe015c0: baseline-arm-clabbe 2026-04-05 00:49:44,168 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0ea29e2394c38fe015c0 2026-04-05 00:49:44,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:44,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0ea29e2394c38fe015c0 HTTP/1.1" 200 None 2026-04-05 00:49:44,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:44,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 00:49:44,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:49:44,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0ea29e2394c38fe015c0 HTTP/1.1" 200 None 2026-04-05 00:49:44,269 - lava_callback - ERROR - Error processing callback for node 69cf0ea29e2394c38fe015c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37724 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:50:30,706 - lava_callback - INFO - Received callback for node 69cf0ec39e2394c38fe0161b INFO: 172.21.0.1:48006 - "POST /node/69cf0ec39e2394c38fe0161b HTTP/1.0" 202 Accepted 2026-04-05 00:50:30,716 - lava_callback - INFO - Starting async job submit for node 69cf0ec39e2394c38fe0161b 2026-04-05 00:50:30,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:50:30,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0ec39e2394c38fe0161b HTTP/1.1" 200 None 2026-04-05 00:50:30,744 - lava_callback - DEBUG - Processing node 69cf0ec39e2394c38fe0161b: baseline-arm-baylibre 2026-04-05 00:50:30,744 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0ec39e2394c38fe0161b 2026-04-05 00:50:30,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:50:30,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0ec39e2394c38fe0161b HTTP/1.1" 200 None 2026-04-05 00:50:30,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:50:30,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 00:50:30,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:50:30,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0ec39e2394c38fe0161b HTTP/1.1" 200 None 2026-04-05 00:50:30,843 - lava_callback - ERROR - Error processing callback for node 69cf0ec39e2394c38fe0161b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 00:50:32,081 - lava_callback - INFO - Received callback for node 69d1afbdaa48d6fae7bb0aba INFO: 172.21.0.1:48014 - "POST /node/69d1afbdaa48d6fae7bb0aba HTTP/1.0" 202 Accepted 2026-04-05 00:50:32,091 - lava_callback - INFO - Starting async job submit for node 69d1afbdaa48d6fae7bb0aba 2026-04-05 00:50:32,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:50:32,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1afbdaa48d6fae7bb0aba HTTP/1.1" 200 None 2026-04-05 00:50:32,200 - lava_callback - DEBUG - Processing node 69d1afbdaa48d6fae7bb0aba: ltp-watchqueue 2026-04-05 00:50:32,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:50:33,870 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:50:33,872 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69d1afbdaa48d6fae7bb0aba/log.txt.gz 2026-04-05 00:50:34,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:50:35,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:50:35,875 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69d1afbdaa48d6fae7bb0aba/lava-logs.yaml 2026-04-05 00:50:35,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:48026 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:50:37,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:50:37,261 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69d1afbdaa48d6fae7bb0aba/lava_callback.json.gz 2026-04-05 00:50:37,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:50:37,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1afbdaa48d6fae7bb0aba HTTP/1.1" 200 None 2026-04-05 00:50:37,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:50:37,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:50:37,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:50:37,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1afbdaa48d6fae7bb0aba HTTP/1.1" 200 None 2026-04-05 00:50:37,418 - lava_callback - INFO - Completed processing callback for node 69d1afbdaa48d6fae7bb0aba 2026-04-05 00:50:39,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:50:39,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53090 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:51:50,525 - lava_callback - INFO - Received callback for node 69d1ad90aa48d6fae7bb088e INFO: 172.21.0.1:55750 - "POST /node/69d1ad90aa48d6fae7bb088e HTTP/1.0" 202 Accepted 2026-04-05 00:51:50,533 - lava_callback - INFO - Starting async job submit for node 69d1ad90aa48d6fae7bb088e 2026-04-05 00:51:50,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:51:50,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1ad90aa48d6fae7bb088e HTTP/1.1" 200 None 2026-04-05 00:51:50,635 - lava_callback - DEBUG - Processing node 69d1ad90aa48d6fae7bb088e: ltp-smoke 2026-04-05 00:51:51,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:51:52,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:51:52,725 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d1ad90aa48d6fae7bb088e/log.txt.gz 2026-04-05 00:51:53,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:51:54,506 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:51:54,509 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d1ad90aa48d6fae7bb088e/lava-logs.yaml 2026-04-05 00:51:54,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:51:55,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:51:55,808 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d1ad90aa48d6fae7bb088e/lava_callback.json.gz 2026-04-05 00:51:56,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:51:56,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1ad90aa48d6fae7bb088e HTTP/1.1" 200 None 2026-04-05 00:51:56,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:51:56,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa27aa48d6fae7bb04bb HTTP/1.1" 200 None 2026-04-05 00:51:56,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:51:56,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1ad90aa48d6fae7bb088e HTTP/1.1" 200 None 2026-04-05 00:51:56,280 - lava_callback - INFO - Completed processing callback for node 69d1ad90aa48d6fae7bb088e INFO: 172.21.0.1:55762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38004 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:52:09,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:52:09,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43738 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:53:12,154 - lava_callback - INFO - Received callback for node 69d1b16daa48d6fae7bb0cc1 INFO: 172.21.0.1:40260 - "POST /node/69d1b16daa48d6fae7bb0cc1 HTTP/1.0" 202 Accepted 2026-04-05 00:53:12,163 - lava_callback - INFO - Starting async job submit for node 69d1b16daa48d6fae7bb0cc1 2026-04-05 00:53:12,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:53:12,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b16daa48d6fae7bb0cc1 HTTP/1.1" 200 None 2026-04-05 00:53:12,212 - lava_callback - DEBUG - Processing node 69d1b16daa48d6fae7bb0cc1: ltp-controllers 2026-04-05 00:53:12,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:53:14,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:53:14,033 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69d1b16daa48d6fae7bb0cc1/log.txt.gz 2026-04-05 00:53:14,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:40274 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 00:53:15,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:53:15,382 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69d1b16daa48d6fae7bb0cc1/lava-logs.yaml 2026-04-05 00:53:15,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:53:16,238 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:53:16,240 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69d1b16daa48d6fae7bb0cc1/lava_callback.json.gz 2026-04-05 00:53:16,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:53:16,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b16daa48d6fae7bb0cc1 HTTP/1.1" 200 None 2026-04-05 00:53:16,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:53:16,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:53:16,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:53:16,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b16daa48d6fae7bb0cc1 HTTP/1.1" 200 None 2026-04-05 00:53:16,424 - lava_callback - INFO - Completed processing callback for node 69d1b16daa48d6fae7bb0cc1 INFO: 172.21.0.1:40282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42272 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:53:31,031 - lava_callback - INFO - Received callback for node 69d1b25daa48d6fae7bb0d92 INFO: 172.21.0.1:47134 - "POST /node/69d1b25daa48d6fae7bb0d92 HTTP/1.0" 202 Accepted 2026-04-05 00:53:31,044 - lava_callback - INFO - Starting async job submit for node 69d1b25daa48d6fae7bb0d92 2026-04-05 00:53:31,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:53:31,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b25daa48d6fae7bb0d92 HTTP/1.1" 200 None 2026-04-05 00:53:31,095 - lava_callback - DEBUG - Processing node 69d1b25daa48d6fae7bb0d92: baseline-arm64 2026-04-05 00:53:31,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:53:32,102 - lava_callback - INFO - Received callback for node 69d1b194aa48d6fae7bb0ceb INFO: 172.21.0.1:47146 - "POST /node/69d1b194aa48d6fae7bb0ceb HTTP/1.0" 202 Accepted 2026-04-05 00:53:32,112 - lava_callback - INFO - Starting async job submit for node 69d1b194aa48d6fae7bb0ceb 2026-04-05 00:53:32,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:53:32,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b194aa48d6fae7bb0ceb HTTP/1.1" 200 None 2026-04-05 00:53:32,167 - lava_callback - DEBUG - Processing node 69d1b194aa48d6fae7bb0ceb: ltp-fsx 2026-04-05 00:53:32,186 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:53:32,229 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b25daa48d6fae7bb0d92/log.txt.gz 2026-04-05 00:53:32,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:53:32,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:53:33,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:53:33,488 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b25daa48d6fae7bb0d92/lava-logs.yaml 2026-04-05 00:53:33,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:53:33,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:53:33,755 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69d1b194aa48d6fae7bb0ceb/log.txt.gz 2026-04-05 00:53:34,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:53:34,584 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:53:34,586 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b25daa48d6fae7bb0d92/lava_callback.json.gz 2026-04-05 00:53:34,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:53:34,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b25daa48d6fae7bb0d92 HTTP/1.1" 200 None 2026-04-05 00:53:34,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:53:34,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:53:34,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:53:34,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b25daa48d6fae7bb0d92 HTTP/1.1" 200 None 2026-04-05 00:53:34,716 - lava_callback - INFO - Completed processing callback for node 69d1b25daa48d6fae7bb0d92 2026-04-05 00:53:35,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:53:35,423 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69d1b194aa48d6fae7bb0ceb/lava-logs.yaml 2026-04-05 00:53:35,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:53:36,311 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:53:36,313 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69d1b194aa48d6fae7bb0ceb/lava_callback.json.gz 2026-04-05 00:53:36,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:53:36,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b194aa48d6fae7bb0ceb HTTP/1.1" 200 None 2026-04-05 00:53:36,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:53:36,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:53:36,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:53:36,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b194aa48d6fae7bb0ceb HTTP/1.1" 200 None 2026-04-05 00:53:36,444 - lava_callback - INFO - Completed processing callback for node 69d1b194aa48d6fae7bb0ceb INFO: 172.21.0.1:47152 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:53:37,161 - lava_callback - INFO - Received callback for node 69d1b271aa48d6fae7bb0dce INFO: 172.21.0.1:47162 - "POST /node/69d1b271aa48d6fae7bb0dce HTTP/1.0" 202 Accepted 2026-04-05 00:53:37,171 - lava_callback - INFO - Starting async job submit for node 69d1b271aa48d6fae7bb0dce 2026-04-05 00:53:37,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:53:37,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b271aa48d6fae7bb0dce HTTP/1.1" 200 None 2026-04-05 00:53:37,221 - lava_callback - DEBUG - Processing node 69d1b271aa48d6fae7bb0dce: baseline-arm64 2026-04-05 00:53:37,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:53:38,541 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:53:38,543 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b271aa48d6fae7bb0dce/log.txt.gz 2026-04-05 00:53:38,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:53:38,676 - lava_callback - INFO - Received callback for node 69d1b28aaa48d6fae7bb0e1d INFO: 172.21.0.1:47174 - "POST /node/69d1b28aaa48d6fae7bb0e1d HTTP/1.0" 202 Accepted 2026-04-05 00:53:38,686 - lava_callback - INFO - Starting async job submit for node 69d1b28aaa48d6fae7bb0e1d 2026-04-05 00:53:38,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:53:38,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b28aaa48d6fae7bb0e1d HTTP/1.1" 200 None 2026-04-05 00:53:38,715 - lava_callback - DEBUG - Processing node 69d1b28aaa48d6fae7bb0e1d: baseline-nfs-arm64 2026-04-05 00:53:38,718 - lava_callback - WARNING - Failed to upload log 2026-04-05 00:53:38,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:53:39,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:53:39,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-05 00:53:39,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:53:39,515 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b271aa48d6fae7bb0dce/lava-logs.yaml 2026-04-05 00:53:39,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:53:39,587 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:53:39,590 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b28aaa48d6fae7bb0e1d/lava-logs.yaml 2026-04-05 00:53:39,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:53:40,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:53:40,548 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b271aa48d6fae7bb0dce/lava_callback.json.gz 2026-04-05 00:53:40,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:53:40,581 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:53:40,586 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b28aaa48d6fae7bb0e1d/lava_callback.json.gz 2026-04-05 00:53:40,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:53:40,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b271aa48d6fae7bb0dce HTTP/1.1" 200 None 2026-04-05 00:53:40,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:53:40,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b28aaa48d6fae7bb0e1d HTTP/1.1" 200 None 2026-04-05 00:53:40,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:53:40,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:53:40,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:53:40,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:53:40,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:53:40,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b271aa48d6fae7bb0dce HTTP/1.1" 200 None 2026-04-05 00:53:40,684 - lava_callback - INFO - Completed processing callback for node 69d1b271aa48d6fae7bb0dce 2026-04-05 00:53:40,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b28aaa48d6fae7bb0e1d HTTP/1.1" 200 None 2026-04-05 00:53:40,707 - lava_callback - INFO - Completed processing callback for node 69d1b28aaa48d6fae7bb0e1d INFO: 172.21.0.1:60196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44592 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:54:00,834 - lava_callback - INFO - Received callback for node 69d1b25faa48d6fae7bb0d98 INFO: 172.21.0.1:44478 - "POST /node/69d1b25faa48d6fae7bb0d98 HTTP/1.0" 202 Accepted 2026-04-05 00:54:00,844 - lava_callback - INFO - Starting async job submit for node 69d1b25faa48d6fae7bb0d98 2026-04-05 00:54:00,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:00,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b25faa48d6fae7bb0d98 HTTP/1.1" 200 None 2026-04-05 00:54:00,908 - lava_callback - DEBUG - Processing node 69d1b25faa48d6fae7bb0d98: baseline-arm64 2026-04-05 00:54:01,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:54:02,380 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:54:02,383 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b25faa48d6fae7bb0d98/log.txt.gz 2026-04-05 00:54:02,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:54:03,616 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:54:03,618 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b25faa48d6fae7bb0d98/lava-logs.yaml 2026-04-05 00:54:03,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:54:04,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:54:04,485 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b25faa48d6fae7bb0d98/lava_callback.json.gz 2026-04-05 00:54:04,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:04,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b25faa48d6fae7bb0d98 HTTP/1.1" 200 None 2026-04-05 00:54:04,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:04,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:54:04,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:04,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b25faa48d6fae7bb0d98 HTTP/1.1" 200 None 2026-04-05 00:54:04,605 - lava_callback - INFO - Completed processing callback for node 69d1b25faa48d6fae7bb0d98 INFO: 172.21.0.1:44490 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:54:09,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:09,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-05 00:54:10,554 - lava_callback - INFO - Received callback for node 69d1b233aa48d6fae7bb0d6a INFO: 172.21.0.1:57412 - "POST /node/69d1b233aa48d6fae7bb0d6a HTTP/1.0" 202 Accepted 2026-04-05 00:54:10,564 - lava_callback - INFO - Starting async job submit for node 69d1b233aa48d6fae7bb0d6a 2026-04-05 00:54:10,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:10,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b233aa48d6fae7bb0d6a HTTP/1.1" 200 None 2026-04-05 00:54:10,637 - lava_callback - DEBUG - Processing node 69d1b233aa48d6fae7bb0d6a: baseline-arm-broonie 2026-04-05 00:54:10,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:54:11,646 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:54:11,649 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d1b233aa48d6fae7bb0d6a/log.txt.gz 2026-04-05 00:54:11,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:54:12,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:54:12,585 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d1b233aa48d6fae7bb0d6a/lava-logs.yaml 2026-04-05 00:54:12,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:54:13,051 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:54:13,053 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69d1b233aa48d6fae7bb0d6a/lava_callback.json.gz 2026-04-05 00:54:13,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:13,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b233aa48d6fae7bb0d6a HTTP/1.1" 200 None 2026-04-05 00:54:13,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:13,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:54:13,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:13,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b233aa48d6fae7bb0d6a HTTP/1.1" 200 None 2026-04-05 00:54:13,173 - lava_callback - INFO - Completed processing callback for node 69d1b233aa48d6fae7bb0d6a INFO: 172.21.0.1:57424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33306 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:54:30,982 - lava_callback - INFO - Received callback for node 69cf0fc39e2394c38fe017fb INFO: 172.21.0.1:43560 - "POST /node/69cf0fc39e2394c38fe017fb HTTP/1.0" 202 Accepted 2026-04-05 00:54:30,991 - lava_callback - INFO - Starting async job submit for node 69cf0fc39e2394c38fe017fb 2026-04-05 00:54:30,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:31,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0fc39e2394c38fe017fb HTTP/1.1" 200 None 2026-04-05 00:54:31,014 - lava_callback - DEBUG - Processing node 69cf0fc39e2394c38fe017fb: baseline-arm64-baylibre 2026-04-05 00:54:31,014 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0fc39e2394c38fe017fb 2026-04-05 00:54:31,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:31,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0fc39e2394c38fe017fb HTTP/1.1" 200 None 2026-04-05 00:54:31,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:31,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-05 00:54:31,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:31,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0fc39e2394c38fe017fb HTTP/1.1" 200 None 2026-04-05 00:54:31,088 - lava_callback - ERROR - Error processing callback for node 69cf0fc39e2394c38fe017fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 00:54:35,812 - lava_callback - INFO - Received callback for node 69d1b2b6aa48d6fae7bb0e97 INFO: 172.21.0.1:43562 - "POST /node/69d1b2b6aa48d6fae7bb0e97 HTTP/1.0" 202 Accepted 2026-04-05 00:54:35,822 - lava_callback - INFO - Starting async job submit for node 69d1b2b6aa48d6fae7bb0e97 2026-04-05 00:54:35,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:35,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2b6aa48d6fae7bb0e97 HTTP/1.1" 200 None 2026-04-05 00:54:35,841 - lava_callback - DEBUG - Processing node 69d1b2b6aa48d6fae7bb0e97: baseline-arm 2026-04-05 00:54:35,847 - lava_callback - WARNING - Failed to upload log 2026-04-05 00:54:35,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:54:35,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:54:36,001 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d1b2b6aa48d6fae7bb0e97/lava-logs.yaml 2026-04-05 00:54:36,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:54:36,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:54:36,161 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d1b2b6aa48d6fae7bb0e97/lava_callback.json.gz 2026-04-05 00:54:36,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:36,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2b6aa48d6fae7bb0e97 HTTP/1.1" 200 None 2026-04-05 00:54:36,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:36,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:54:36,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:36,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b2b6aa48d6fae7bb0e97 HTTP/1.1" 200 None 2026-04-05 00:54:36,254 - lava_callback - INFO - Completed processing callback for node 69d1b2b6aa48d6fae7bb0e97 INFO: 172.21.0.1:43578 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:54:39,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:39,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47284 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:54:48,064 - lava_callback - INFO - Received callback for node 69d1b25daa48d6fae7bb0d95 INFO: 172.21.0.1:47288 - "POST /node/69d1b25daa48d6fae7bb0d95 HTTP/1.0" 202 Accepted 2026-04-05 00:54:48,071 - lava_callback - INFO - Starting async job submit for node 69d1b25daa48d6fae7bb0d95 2026-04-05 00:54:48,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:48,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b25daa48d6fae7bb0d95 HTTP/1.1" 200 None 2026-04-05 00:54:48,112 - lava_callback - DEBUG - Processing node 69d1b25daa48d6fae7bb0d95: baseline-arm64 2026-04-05 00:54:48,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:54:48,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:54:48,653 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b25daa48d6fae7bb0d95/log.txt.gz 2026-04-05 00:54:48,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:54:49,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:54:49,056 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b25daa48d6fae7bb0d95/lava-logs.yaml 2026-04-05 00:54:49,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:54:49,191 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:54:49,193 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b25daa48d6fae7bb0d95/lava_callback.json.gz 2026-04-05 00:54:49,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:49,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b25daa48d6fae7bb0d95 HTTP/1.1" 200 None 2026-04-05 00:54:49,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:49,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:54:49,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:49,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b25daa48d6fae7bb0d95 HTTP/1.1" 200 None 2026-04-05 00:54:49,279 - lava_callback - INFO - Completed processing callback for node 69d1b25daa48d6fae7bb0d95 2026-04-05 00:54:50,897 - lava_callback - INFO - Received callback for node 69cf0fc79e2394c38fe01804 INFO: 172.21.0.1:35164 - "POST /node/69cf0fc79e2394c38fe01804 HTTP/1.0" 202 Accepted 2026-04-05 00:54:50,906 - lava_callback - INFO - Starting async job submit for node 69cf0fc79e2394c38fe01804 2026-04-05 00:54:50,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:50,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0fc79e2394c38fe01804 HTTP/1.1" 200 None 2026-04-05 00:54:50,922 - lava_callback - DEBUG - Processing node 69cf0fc79e2394c38fe01804: baseline-arm64-baylibre 2026-04-05 00:54:50,923 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0fc79e2394c38fe01804 2026-04-05 00:54:50,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:50,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0fc79e2394c38fe01804 HTTP/1.1" 200 None 2026-04-05 00:54:50,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:50,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-05 00:54:50,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:50,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0fc79e2394c38fe01804 HTTP/1.1" 200 None 2026-04-05 00:54:50,994 - lava_callback - ERROR - Error processing callback for node 69cf0fc79e2394c38fe01804: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 00:54:52,184 - lava_callback - INFO - Received callback for node 69d1b1e1aa48d6fae7bb0d26 INFO: 172.21.0.1:35174 - "POST /node/69d1b1e1aa48d6fae7bb0d26 HTTP/1.0" 202 Accepted 2026-04-05 00:54:52,195 - lava_callback - INFO - Starting async job submit for node 69d1b1e1aa48d6fae7bb0d26 2026-04-05 00:54:52,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:52,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b1e1aa48d6fae7bb0d26 HTTP/1.1" 200 None 2026-04-05 00:54:52,262 - lava_callback - DEBUG - Processing node 69d1b1e1aa48d6fae7bb0d26: ltp-sched 2026-04-05 00:54:52,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:54:52,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:54:52,924 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69d1b1e1aa48d6fae7bb0d26/log.txt.gz 2026-04-05 00:54:53,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:54:53,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:54:53,401 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69d1b1e1aa48d6fae7bb0d26/lava-logs.yaml 2026-04-05 00:54:53,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:54:53,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:54:53,598 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69d1b1e1aa48d6fae7bb0d26/lava_callback.json.gz 2026-04-05 00:54:53,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:53,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b1e1aa48d6fae7bb0d26 HTTP/1.1" 200 None 2026-04-05 00:54:53,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:53,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:54:53,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:54:53,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b1e1aa48d6fae7bb0d26 HTTP/1.1" 200 None 2026-04-05 00:54:53,705 - lava_callback - INFO - Completed processing callback for node 69d1b1e1aa48d6fae7bb0d26 INFO: 172.21.0.1:35178 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:55:00,806 - lava_callback - INFO - Received callback for node 69cf0fd89e2394c38fe01837 INFO: 172.21.0.1:58890 - "POST /node/69cf0fd89e2394c38fe01837 HTTP/1.0" 202 Accepted 2026-04-05 00:55:00,813 - lava_callback - INFO - Starting async job submit for node 69cf0fd89e2394c38fe01837 2026-04-05 00:55:00,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:00,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0fd89e2394c38fe01837 HTTP/1.1" 200 None 2026-04-05 00:55:00,833 - lava_callback - DEBUG - Processing node 69cf0fd89e2394c38fe01837: baseline-arm64-clabbe 2026-04-05 00:55:00,833 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0fd89e2394c38fe01837 2026-04-05 00:55:00,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:00,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0fd89e2394c38fe01837 HTTP/1.1" 200 None 2026-04-05 00:55:00,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:00,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-05 00:55:00,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:00,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0fd89e2394c38fe01837 HTTP/1.1" 200 None 2026-04-05 00:55:00,892 - lava_callback - ERROR - Error processing callback for node 69cf0fd89e2394c38fe01837: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 00:55:01,580 - lava_callback - INFO - Received callback for node 69cf0fd99e2394c38fe0183f INFO: 172.21.0.1:58896 - "POST /node/69cf0fd99e2394c38fe0183f HTTP/1.0" 202 Accepted 2026-04-05 00:55:01,586 - lava_callback - INFO - Starting async job submit for node 69cf0fd99e2394c38fe0183f 2026-04-05 00:55:01,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:01,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0fd99e2394c38fe0183f HTTP/1.1" 200 None 2026-04-05 00:55:01,604 - lava_callback - DEBUG - Processing node 69cf0fd99e2394c38fe0183f: baseline-arm64-clabbe 2026-04-05 00:55:01,604 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0fd99e2394c38fe0183f 2026-04-05 00:55:01,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:01,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0fd99e2394c38fe0183f HTTP/1.1" 200 None 2026-04-05 00:55:01,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:01,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-05 00:55:01,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:01,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0fd99e2394c38fe0183f HTTP/1.1" 200 None 2026-04-05 00:55:01,668 - lava_callback - ERROR - Error processing callback for node 69cf0fd99e2394c38fe0183f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 00:55:02,285 - lava_callback - INFO - Received callback for node 69cf0fda9e2394c38fe01842 INFO: 172.21.0.1:58900 - "POST /node/69cf0fda9e2394c38fe01842 HTTP/1.0" 202 Accepted 2026-04-05 00:55:02,294 - lava_callback - INFO - Starting async job submit for node 69cf0fda9e2394c38fe01842 2026-04-05 00:55:02,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:02,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0fda9e2394c38fe01842 HTTP/1.1" 200 None 2026-04-05 00:55:02,321 - lava_callback - DEBUG - Processing node 69cf0fda9e2394c38fe01842: baseline-arm64-clabbe 2026-04-05 00:55:02,322 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0fda9e2394c38fe01842 2026-04-05 00:55:02,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:02,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0fda9e2394c38fe01842 HTTP/1.1" 200 None 2026-04-05 00:55:02,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:02,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-05 00:55:02,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:02,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0fda9e2394c38fe01842 HTTP/1.1" 200 None 2026-04-05 00:55:02,387 - lava_callback - ERROR - Error processing callback for node 69cf0fda9e2394c38fe01842: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 00:55:02,983 - lava_callback - INFO - Received callback for node 69cf0fdb9e2394c38fe01845 INFO: 172.21.0.1:58916 - "POST /node/69cf0fdb9e2394c38fe01845 HTTP/1.0" 202 Accepted 2026-04-05 00:55:02,990 - lava_callback - INFO - Starting async job submit for node 69cf0fdb9e2394c38fe01845 2026-04-05 00:55:02,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:03,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0fdb9e2394c38fe01845 HTTP/1.1" 200 None 2026-04-05 00:55:03,007 - lava_callback - DEBUG - Processing node 69cf0fdb9e2394c38fe01845: baseline-arm64-clabbe 2026-04-05 00:55:03,007 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0fdb9e2394c38fe01845 2026-04-05 00:55:03,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:03,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0fdb9e2394c38fe01845 HTTP/1.1" 200 None 2026-04-05 00:55:03,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:03,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-05 00:55:03,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:03,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0fdb9e2394c38fe01845 HTTP/1.1" 200 None 2026-04-05 00:55:03,060 - lava_callback - ERROR - Error processing callback for node 69cf0fdb9e2394c38fe01845: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 00:55:03,711 - lava_callback - INFO - Received callback for node 69cf0fdd9e2394c38fe0187f INFO: 172.21.0.1:58922 - "POST /node/69cf0fdd9e2394c38fe0187f HTTP/1.0" 202 Accepted 2026-04-05 00:55:03,717 - lava_callback - INFO - Starting async job submit for node 69cf0fdd9e2394c38fe0187f 2026-04-05 00:55:03,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:03,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0fdd9e2394c38fe0187f HTTP/1.1" 200 None 2026-04-05 00:55:03,736 - lava_callback - DEBUG - Processing node 69cf0fdd9e2394c38fe0187f: baseline-arm64-clabbe 2026-04-05 00:55:03,737 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0fdd9e2394c38fe0187f 2026-04-05 00:55:03,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:03,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0fdd9e2394c38fe0187f HTTP/1.1" 200 None 2026-04-05 00:55:03,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:03,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-05 00:55:03,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:03,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0fdd9e2394c38fe0187f HTTP/1.1" 200 None 2026-04-05 00:55:03,811 - lava_callback - ERROR - Error processing callback for node 69cf0fdd9e2394c38fe0187f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 00:55:04,440 - lava_callback - INFO - Received callback for node 69cf0fde9e2394c38fe01882 INFO: 172.21.0.1:58928 - "POST /node/69cf0fde9e2394c38fe01882 HTTP/1.0" 202 Accepted 2026-04-05 00:55:04,450 - lava_callback - INFO - Starting async job submit for node 69cf0fde9e2394c38fe01882 2026-04-05 00:55:04,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:04,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0fde9e2394c38fe01882 HTTP/1.1" 200 None 2026-04-05 00:55:04,475 - lava_callback - DEBUG - Processing node 69cf0fde9e2394c38fe01882: baseline-arm64-clabbe 2026-04-05 00:55:04,475 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf0fde9e2394c38fe01882 2026-04-05 00:55:04,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:04,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf0fde9e2394c38fe01882 HTTP/1.1" 200 None 2026-04-05 00:55:04,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:04,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-05 00:55:04,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:04,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf0fde9e2394c38fe01882 HTTP/1.1" 200 None 2026-04-05 00:55:04,602 - lava_callback - ERROR - Error processing callback for node 69cf0fde9e2394c38fe01882: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58932 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:55:06,910 - lava_callback - INFO - Received callback for node 69d1b2beaa48d6fae7bb0ecd INFO: 172.21.0.1:58940 - "POST /node/69d1b2beaa48d6fae7bb0ecd HTTP/1.0" 202 Accepted 2026-04-05 00:55:06,957 - lava_callback - INFO - Starting async job submit for node 69d1b2beaa48d6fae7bb0ecd 2026-04-05 00:55:06,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:07,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2beaa48d6fae7bb0ecd HTTP/1.1" 200 None 2026-04-05 00:55:07,006 - lava_callback - DEBUG - Processing node 69d1b2beaa48d6fae7bb0ecd: baseline-arm64-clabbe 2026-04-05 00:55:07,114 - lava_callback - WARNING - Failed to upload log 2026-04-05 00:55:07,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:55:07,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:55:07,340 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69d1b2beaa48d6fae7bb0ecd/lava-logs.yaml 2026-04-05 00:55:07,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:55:07,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:55:07,457 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69d1b2beaa48d6fae7bb0ecd/lava_callback.json.gz 2026-04-05 00:55:07,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:07,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2beaa48d6fae7bb0ecd HTTP/1.1" 200 None 2026-04-05 00:55:07,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:07,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:55:07,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:07,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b2beaa48d6fae7bb0ecd HTTP/1.1" 200 None 2026-04-05 00:55:07,629 - lava_callback - INFO - Completed processing callback for node 69d1b2beaa48d6fae7bb0ecd 2026-04-05 00:55:09,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:09,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-05 00:55:10,418 - lava_callback - INFO - Received callback for node 69d1b2a9aa48d6fae7bb0e6b INFO: 172.21.0.1:37470 - "POST /node/69d1b2a9aa48d6fae7bb0e6b HTTP/1.0" 202 Accepted 2026-04-05 00:55:10,425 - lava_callback - INFO - Starting async job submit for node 69d1b2a9aa48d6fae7bb0e6b 2026-04-05 00:55:10,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:10,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2a9aa48d6fae7bb0e6b HTTP/1.1" 200 None 2026-04-05 00:55:10,467 - lava_callback - DEBUG - Processing node 69d1b2a9aa48d6fae7bb0e6b: baseline-arm64-broonie 2026-04-05 00:55:10,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:55:10,811 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:55:10,813 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1b2a9aa48d6fae7bb0e6b/log.txt.gz 2026-04-05 00:55:10,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:55:11,154 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:55:11,157 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1b2a9aa48d6fae7bb0e6b/lava-logs.yaml 2026-04-05 00:55:11,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:55:11,307 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:55:11,308 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1b2a9aa48d6fae7bb0e6b/lava_callback.json.gz 2026-04-05 00:55:11,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:11,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2a9aa48d6fae7bb0e6b HTTP/1.1" 200 None 2026-04-05 00:55:11,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:11,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:55:11,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:11,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b2a9aa48d6fae7bb0e6b HTTP/1.1" 200 None 2026-04-05 00:55:11,418 - lava_callback - INFO - Completed processing callback for node 69d1b2a9aa48d6fae7bb0e6b INFO: 172.21.0.1:37484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37494 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:55:25,085 - lava_callback - INFO - Received callback for node 69d1b2c7aa48d6fae7bb0ee4 INFO: 172.21.0.1:60700 - "POST /node/69d1b2c7aa48d6fae7bb0ee4 HTTP/1.0" 202 Accepted 2026-04-05 00:55:25,098 - lava_callback - INFO - Starting async job submit for node 69d1b2c7aa48d6fae7bb0ee4 2026-04-05 00:55:25,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:25,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2c7aa48d6fae7bb0ee4 HTTP/1.1" 200 None 2026-04-05 00:55:25,182 - lava_callback - DEBUG - Processing node 69d1b2c7aa48d6fae7bb0ee4: baseline-arm64-foundriesio 2026-04-05 00:55:25,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:55:25,575 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:55:25,577 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d1b2c7aa48d6fae7bb0ee4/log.txt.gz 2026-04-05 00:55:25,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:55:25,983 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:55:25,985 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d1b2c7aa48d6fae7bb0ee4/lava-logs.yaml 2026-04-05 00:55:25,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:55:26,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:55:26,142 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d1b2c7aa48d6fae7bb0ee4/lava_callback.json.gz 2026-04-05 00:55:26,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:26,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2c7aa48d6fae7bb0ee4 HTTP/1.1" 200 None 2026-04-05 00:55:26,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:26,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:55:26,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:26,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b2c7aa48d6fae7bb0ee4 HTTP/1.1" 200 None 2026-04-05 00:55:26,282 - lava_callback - INFO - Completed processing callback for node 69d1b2c7aa48d6fae7bb0ee4 INFO: 172.21.0.1:60712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60718 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:55:30,341 - lava_callback - INFO - Received callback for node 69d1b2b3aa48d6fae7bb0e8a INFO: 172.21.0.1:53730 - "POST /node/69d1b2b3aa48d6fae7bb0e8a HTTP/1.0" 202 Accepted 2026-04-05 00:55:30,348 - lava_callback - INFO - Starting async job submit for node 69d1b2b3aa48d6fae7bb0e8a 2026-04-05 00:55:30,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:30,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2b3aa48d6fae7bb0e8a HTTP/1.1" 200 None 2026-04-05 00:55:30,401 - lava_callback - DEBUG - Processing node 69d1b2b3aa48d6fae7bb0e8a: baseline-arm64-broonie 2026-04-05 00:55:30,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:55:31,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:55:31,013 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1b2b3aa48d6fae7bb0e8a/log.txt.gz 2026-04-05 00:55:31,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:55:31,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:55:31,385 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1b2b3aa48d6fae7bb0e8a/lava-logs.yaml 2026-04-05 00:55:31,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:55:31,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:55:31,554 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1b2b3aa48d6fae7bb0e8a/lava_callback.json.gz 2026-04-05 00:55:31,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:31,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2b3aa48d6fae7bb0e8a HTTP/1.1" 200 None 2026-04-05 00:55:31,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:31,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:55:31,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:31,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b2b3aa48d6fae7bb0e8a HTTP/1.1" 200 None 2026-04-05 00:55:31,649 - lava_callback - INFO - Completed processing callback for node 69d1b2b3aa48d6fae7bb0e8a 2026-04-05 00:55:33,096 - lava_callback - INFO - Received callback for node 69d1b2c4aa48d6fae7bb0edc INFO: 172.21.0.1:53734 - "POST /node/69d1b2c4aa48d6fae7bb0edc HTTP/1.0" 202 Accepted 2026-04-05 00:55:33,102 - lava_callback - INFO - Starting async job submit for node 69d1b2c4aa48d6fae7bb0edc 2026-04-05 00:55:33,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:33,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2c4aa48d6fae7bb0edc HTTP/1.1" 200 None 2026-04-05 00:55:33,148 - lava_callback - DEBUG - Processing node 69d1b2c4aa48d6fae7bb0edc: baseline-arm64-pengutronix 2026-04-05 00:55:33,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:55:33,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:55:33,503 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d1b2c4aa48d6fae7bb0edc/log.txt.gz 2026-04-05 00:55:33,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:55:33,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:55:33,846 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d1b2c4aa48d6fae7bb0edc/lava-logs.yaml 2026-04-05 00:55:33,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:55:34,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:55:34,016 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d1b2c4aa48d6fae7bb0edc/lava_callback.json.gz 2026-04-05 00:55:34,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:34,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2c4aa48d6fae7bb0edc HTTP/1.1" 200 None 2026-04-05 00:55:34,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:34,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:55:34,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:34,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b2c4aa48d6fae7bb0edc HTTP/1.1" 200 None 2026-04-05 00:55:34,122 - lava_callback - INFO - Completed processing callback for node 69d1b2c4aa48d6fae7bb0edc INFO: 172.21.0.1:53748 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:55:38,331 - lava_callback - INFO - Received callback for node 69d1b2c5aa48d6fae7bb0edf INFO: 172.21.0.1:53752 - "POST /node/69d1b2c5aa48d6fae7bb0edf HTTP/1.0" 202 Accepted 2026-04-05 00:55:38,338 - lava_callback - INFO - Starting async job submit for node 69d1b2c5aa48d6fae7bb0edf 2026-04-05 00:55:38,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:38,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2c5aa48d6fae7bb0edf HTTP/1.1" 200 None 2026-04-05 00:55:38,379 - lava_callback - DEBUG - Processing node 69d1b2c5aa48d6fae7bb0edf: baseline-arm64-pengutronix 2026-04-05 00:55:38,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:55:38,794 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:55:38,796 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d1b2c5aa48d6fae7bb0edf/log.txt.gz 2026-04-05 00:55:38,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:55:39,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:55:39,145 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d1b2c5aa48d6fae7bb0edf/lava-logs.yaml 2026-04-05 00:55:39,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:55:39,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:55:39,321 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69d1b2c5aa48d6fae7bb0edf/lava_callback.json.gz 2026-04-05 00:55:39,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:39,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2c5aa48d6fae7bb0edf HTTP/1.1" 200 None 2026-04-05 00:55:39,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:39,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:55:39,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:39,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b2c5aa48d6fae7bb0edf HTTP/1.1" 200 None 2026-04-05 00:55:39,424 - lava_callback - INFO - Completed processing callback for node 69d1b2c5aa48d6fae7bb0edf 2026-04-05 00:55:39,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:39,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:50262 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:55:55,536 - lava_callback - INFO - Received callback for node 69d1b2c1aa48d6fae7bb0ed6 INFO: 172.21.0.1:42124 - "POST /node/69d1b2c1aa48d6fae7bb0ed6 HTTP/1.0" 202 Accepted 2026-04-05 00:55:55,542 - lava_callback - INFO - Starting async job submit for node 69d1b2c1aa48d6fae7bb0ed6 2026-04-05 00:55:55,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:55,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2c1aa48d6fae7bb0ed6 HTTP/1.1" 200 None 2026-04-05 00:55:55,604 - lava_callback - DEBUG - Processing node 69d1b2c1aa48d6fae7bb0ed6: baseline-arm64-kontron 2026-04-05 00:55:55,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:55:56,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:55:56,069 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d1b2c1aa48d6fae7bb0ed6/log.txt.gz 2026-04-05 00:55:56,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:55:56,407 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:55:56,409 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d1b2c1aa48d6fae7bb0ed6/lava-logs.yaml 2026-04-05 00:55:56,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:42132 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:55:56,553 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:55:56,555 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d1b2c1aa48d6fae7bb0ed6/lava_callback.json.gz 2026-04-05 00:55:56,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:56,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2c1aa48d6fae7bb0ed6 HTTP/1.1" 200 None 2026-04-05 00:55:56,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:56,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:55:56,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:56,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b2c1aa48d6fae7bb0ed6 HTTP/1.1" 200 None 2026-04-05 00:55:56,653 - lava_callback - INFO - Completed processing callback for node 69d1b2c1aa48d6fae7bb0ed6 2026-04-05 00:55:56,786 - lava_callback - INFO - Received callback for node 69d1b2c3aa48d6fae7bb0ed9 INFO: 172.21.0.1:42136 - "POST /node/69d1b2c3aa48d6fae7bb0ed9 HTTP/1.0" 202 Accepted 2026-04-05 00:55:56,797 - lava_callback - INFO - Starting async job submit for node 69d1b2c3aa48d6fae7bb0ed9 2026-04-05 00:55:56,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:56,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2c3aa48d6fae7bb0ed9 HTTP/1.1" 200 None 2026-04-05 00:55:56,876 - lava_callback - DEBUG - Processing node 69d1b2c3aa48d6fae7bb0ed9: baseline-arm64-kontron 2026-04-05 00:55:57,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:55:57,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:55:57,302 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d1b2c3aa48d6fae7bb0ed9/log.txt.gz 2026-04-05 00:55:57,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:55:57,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:55:57,702 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d1b2c3aa48d6fae7bb0ed9/lava-logs.yaml 2026-04-05 00:55:57,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:55:57,868 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:55:57,870 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-69d1b2c3aa48d6fae7bb0ed9/lava_callback.json.gz 2026-04-05 00:55:57,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:57,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2c3aa48d6fae7bb0ed9 HTTP/1.1" 200 None 2026-04-05 00:55:57,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:57,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:55:57,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:57,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b2c3aa48d6fae7bb0ed9 HTTP/1.1" 200 None 2026-04-05 00:55:57,972 - lava_callback - INFO - Completed processing callback for node 69d1b2c3aa48d6fae7bb0ed9 2026-04-05 00:55:59,038 - lava_callback - INFO - Received callback for node 69d1b26caa48d6fae7bb0dc8 INFO: 172.21.0.1:42148 - "POST /node/69d1b26caa48d6fae7bb0dc8 HTTP/1.0" 202 Accepted 2026-04-05 00:55:59,045 - lava_callback - INFO - Starting async job submit for node 69d1b26caa48d6fae7bb0dc8 2026-04-05 00:55:59,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:55:59,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b26caa48d6fae7bb0dc8 HTTP/1.1" 200 None 2026-04-05 00:55:59,092 - lava_callback - DEBUG - Processing node 69d1b26caa48d6fae7bb0dc8: baseline-arm64 2026-04-05 00:55:59,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:55:59,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:55:59,741 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b26caa48d6fae7bb0dc8/log.txt.gz 2026-04-05 00:55:59,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:00,204 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:00,206 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b26caa48d6fae7bb0dc8/lava-logs.yaml 2026-04-05 00:56:00,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:00,368 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:00,369 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b26caa48d6fae7bb0dc8/lava_callback.json.gz 2026-04-05 00:56:00,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:00,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b26caa48d6fae7bb0dc8 HTTP/1.1" 200 None 2026-04-05 00:56:00,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:00,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:56:00,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:00,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b26caa48d6fae7bb0dc8 HTTP/1.1" 200 None 2026-04-05 00:56:00,461 - lava_callback - INFO - Completed processing callback for node 69d1b26caa48d6fae7bb0dc8 2026-04-05 00:56:04,104 - lava_callback - INFO - Received callback for node 69d1b263aa48d6fae7bb0d9f INFO: 172.21.0.1:43556 - "POST /node/69d1b263aa48d6fae7bb0d9f HTTP/1.0" 202 Accepted 2026-04-05 00:56:04,111 - lava_callback - INFO - Starting async job submit for node 69d1b263aa48d6fae7bb0d9f 2026-04-05 00:56:04,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:04,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b263aa48d6fae7bb0d9f HTTP/1.1" 200 None 2026-04-05 00:56:04,169 - lava_callback - DEBUG - Processing node 69d1b263aa48d6fae7bb0d9f: baseline-arm64 2026-04-05 00:56:04,333 - lava_callback - WARNING - Failed to upload log 2026-04-05 00:56:04,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:04,558 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:04,560 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b263aa48d6fae7bb0d9f/lava-logs.yaml 2026-04-05 00:56:04,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:04,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:04,677 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b263aa48d6fae7bb0d9f/lava_callback.json.gz 2026-04-05 00:56:04,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:04,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b263aa48d6fae7bb0d9f HTTP/1.1" 200 None 2026-04-05 00:56:04,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:04,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:56:04,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:04,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b263aa48d6fae7bb0d9f HTTP/1.1" 200 None 2026-04-05 00:56:04,823 - lava_callback - INFO - Completed processing callback for node 69d1b263aa48d6fae7bb0d9f INFO: 172.21.0.1:43558 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:56:06,736 - lava_callback - INFO - Received callback for node 69d1b272aa48d6fae7bb0dd1 INFO: 172.21.0.1:43566 - "POST /node/69d1b272aa48d6fae7bb0dd1 HTTP/1.0" 202 Accepted 2026-04-05 00:56:06,743 - lava_callback - INFO - Starting async job submit for node 69d1b272aa48d6fae7bb0dd1 2026-04-05 00:56:06,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:06,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b272aa48d6fae7bb0dd1 HTTP/1.1" 200 None 2026-04-05 00:56:06,799 - lava_callback - DEBUG - Processing node 69d1b272aa48d6fae7bb0dd1: baseline-arm64 2026-04-05 00:56:07,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:07,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:07,196 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b272aa48d6fae7bb0dd1/log.txt.gz 2026-04-05 00:56:07,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:07,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:07,567 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b272aa48d6fae7bb0dd1/lava-logs.yaml 2026-04-05 00:56:07,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:07,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:07,736 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b272aa48d6fae7bb0dd1/lava_callback.json.gz 2026-04-05 00:56:07,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:07,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b272aa48d6fae7bb0dd1 HTTP/1.1" 200 None 2026-04-05 00:56:07,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:07,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:56:07,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:07,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b272aa48d6fae7bb0dd1 HTTP/1.1" 200 None 2026-04-05 00:56:07,845 - lava_callback - INFO - Completed processing callback for node 69d1b272aa48d6fae7bb0dd1 2026-04-05 00:56:08,336 - lava_callback - INFO - Received callback for node 69d1b265aa48d6fae7bb0db9 INFO: 172.21.0.1:43572 - "POST /node/69d1b265aa48d6fae7bb0db9 HTTP/1.0" 202 Accepted 2026-04-05 00:56:08,343 - lava_callback - INFO - Starting async job submit for node 69d1b265aa48d6fae7bb0db9 2026-04-05 00:56:08,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:08,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b265aa48d6fae7bb0db9 HTTP/1.1" 200 None 2026-04-05 00:56:08,395 - lava_callback - DEBUG - Processing node 69d1b265aa48d6fae7bb0db9: baseline-arm64 2026-04-05 00:56:08,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:08,718 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:08,720 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b265aa48d6fae7bb0db9/log.txt.gz 2026-04-05 00:56:08,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:09,027 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:09,029 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b265aa48d6fae7bb0db9/lava-logs.yaml 2026-04-05 00:56:09,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:09,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:09,182 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b265aa48d6fae7bb0db9/lava_callback.json.gz 2026-04-05 00:56:09,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:09,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b265aa48d6fae7bb0db9 HTTP/1.1" 200 None 2026-04-05 00:56:09,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:09,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:56:09,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:09,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b265aa48d6fae7bb0db9 HTTP/1.1" 200 None 2026-04-05 00:56:09,358 - lava_callback - INFO - Completed processing callback for node 69d1b265aa48d6fae7bb0db9 2026-04-05 00:56:09,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:09,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-05 00:56:12,769 - lava_callback - INFO - Received callback for node 69d1b276aa48d6fae7bb0dd7 INFO: 172.21.0.1:59374 - "POST /node/69d1b276aa48d6fae7bb0dd7 HTTP/1.0" 202 Accepted 2026-04-05 00:56:12,776 - lava_callback - INFO - Starting async job submit for node 69d1b276aa48d6fae7bb0dd7 2026-04-05 00:56:12,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:12,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b276aa48d6fae7bb0dd7 HTTP/1.1" 200 None 2026-04-05 00:56:12,815 - lava_callback - DEBUG - Processing node 69d1b276aa48d6fae7bb0dd7: baseline-arm64 2026-04-05 00:56:13,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:13,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:13,209 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b276aa48d6fae7bb0dd7/log.txt.gz 2026-04-05 00:56:13,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:13,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:13,573 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b276aa48d6fae7bb0dd7/lava-logs.yaml 2026-04-05 00:56:13,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:13,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:13,733 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b276aa48d6fae7bb0dd7/lava_callback.json.gz 2026-04-05 00:56:13,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:13,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b276aa48d6fae7bb0dd7 HTTP/1.1" 200 None 2026-04-05 00:56:13,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:13,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:56:13,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:13,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b276aa48d6fae7bb0dd7 HTTP/1.1" 200 None 2026-04-05 00:56:13,814 - lava_callback - INFO - Completed processing callback for node 69d1b276aa48d6fae7bb0dd7 INFO: 172.21.0.1:59376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55164 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:56:29,681 - lava_callback - INFO - Received callback for node 69d1b286aa48d6fae7bb0e17 INFO: 172.21.0.1:55176 - "POST /node/69d1b286aa48d6fae7bb0e17 HTTP/1.0" 202 Accepted 2026-04-05 00:56:29,689 - lava_callback - INFO - Starting async job submit for node 69d1b286aa48d6fae7bb0e17 2026-04-05 00:56:29,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:29,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b286aa48d6fae7bb0e17 HTTP/1.1" 200 None 2026-04-05 00:56:29,730 - lava_callback - DEBUG - Processing node 69d1b286aa48d6fae7bb0e17: baseline-nfs-arm64 2026-04-05 00:56:30,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:30,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:30,436 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b286aa48d6fae7bb0e17/log.txt.gz 2026-04-05 00:56:30,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:31,022 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:31,024 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b286aa48d6fae7bb0e17/lava-logs.yaml 2026-04-05 00:56:31,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:31,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:31,204 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b286aa48d6fae7bb0e17/lava_callback.json.gz 2026-04-05 00:56:31,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:31,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b286aa48d6fae7bb0e17 HTTP/1.1" 200 None 2026-04-05 00:56:31,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:31,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:56:31,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:31,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b286aa48d6fae7bb0e17 HTTP/1.1" 200 None 2026-04-05 00:56:31,295 - lava_callback - INFO - Completed processing callback for node 69d1b286aa48d6fae7bb0e17 2026-04-05 00:56:32,066 - lava_callback - INFO - Received callback for node 69d1b2b6aa48d6fae7bb0e99 INFO: 172.21.0.1:48196 - "POST /node/69d1b2b6aa48d6fae7bb0e99 HTTP/1.0" 202 Accepted 2026-04-05 00:56:32,073 - lava_callback - INFO - Starting async job submit for node 69d1b2b6aa48d6fae7bb0e99 2026-04-05 00:56:32,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:32,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2b6aa48d6fae7bb0e99 HTTP/1.1" 200 None 2026-04-05 00:56:32,111 - lava_callback - DEBUG - Processing node 69d1b2b6aa48d6fae7bb0e99: baseline-arm64-broonie 2026-04-05 00:56:32,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:32,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:32,501 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1b2b6aa48d6fae7bb0e99/log.txt.gz 2026-04-05 00:56:32,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:32,782 - lava_callback - INFO - Received callback for node 69d1b288aa48d6fae7bb0e1a INFO: 172.21.0.1:48212 - "POST /node/69d1b288aa48d6fae7bb0e1a HTTP/1.0" 202 Accepted 2026-04-05 00:56:32,789 - lava_callback - INFO - Starting async job submit for node 69d1b288aa48d6fae7bb0e1a 2026-04-05 00:56:32,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:32,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b288aa48d6fae7bb0e1a HTTP/1.1" 200 None 2026-04-05 00:56:32,832 - lava_callback - DEBUG - Processing node 69d1b288aa48d6fae7bb0e1a: baseline-nfs-arm64 2026-04-05 00:56:32,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:32,909 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1b2b6aa48d6fae7bb0e99/lava-logs.yaml 2026-04-05 00:56:32,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:33,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:33,302 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1b2b6aa48d6fae7bb0e99/lava_callback.json.gz 2026-04-05 00:56:33,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:33,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2b6aa48d6fae7bb0e99 HTTP/1.1" 200 None 2026-04-05 00:56:33,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:33,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:33,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:56:33,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:33,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b2b6aa48d6fae7bb0e99 HTTP/1.1" 200 None 2026-04-05 00:56:33,529 - lava_callback - INFO - Completed processing callback for node 69d1b2b6aa48d6fae7bb0e99 2026-04-05 00:56:33,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:33,726 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b288aa48d6fae7bb0e1a/log.txt.gz 2026-04-05 00:56:34,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:34,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:34,339 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b288aa48d6fae7bb0e1a/lava-logs.yaml 2026-04-05 00:56:34,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:34,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:34,582 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b288aa48d6fae7bb0e1a/lava_callback.json.gz 2026-04-05 00:56:34,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:34,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b288aa48d6fae7bb0e1a HTTP/1.1" 200 None 2026-04-05 00:56:34,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:34,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:56:34,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:34,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b288aa48d6fae7bb0e1a HTTP/1.1" 200 None 2026-04-05 00:56:34,674 - lava_callback - INFO - Completed processing callback for node 69d1b288aa48d6fae7bb0e1a INFO: 172.21.0.1:48218 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:56:39,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:39,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-05 00:56:40,523 - lava_callback - INFO - Received callback for node 69d1b28faa48d6fae7bb0e2a INFO: 172.21.0.1:39024 - "POST /node/69d1b28faa48d6fae7bb0e2a HTTP/1.0" 202 Accepted 2026-04-05 00:56:40,530 - lava_callback - INFO - Starting async job submit for node 69d1b28faa48d6fae7bb0e2a 2026-04-05 00:56:40,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:40,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b28faa48d6fae7bb0e2a HTTP/1.1" 200 None 2026-04-05 00:56:40,571 - lava_callback - DEBUG - Processing node 69d1b28faa48d6fae7bb0e2a: baseline-nfs-arm64 2026-04-05 00:56:40,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:41,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:41,059 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b28faa48d6fae7bb0e2a/log.txt.gz 2026-04-05 00:56:41,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:41,516 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:41,518 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b28faa48d6fae7bb0e2a/lava-logs.yaml 2026-04-05 00:56:41,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:41,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:41,749 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b28faa48d6fae7bb0e2a/lava_callback.json.gz 2026-04-05 00:56:41,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:41,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b28faa48d6fae7bb0e2a HTTP/1.1" 200 None 2026-04-05 00:56:41,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:41,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:56:41,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:41,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b28faa48d6fae7bb0e2a HTTP/1.1" 200 None 2026-04-05 00:56:41,958 - lava_callback - INFO - Completed processing callback for node 69d1b28faa48d6fae7bb0e2a 2026-04-05 00:56:43,516 - lava_callback - INFO - Received callback for node 69d1b282aa48d6fae7bb0e11 INFO: 172.21.0.1:39038 - "POST /node/69d1b282aa48d6fae7bb0e11 HTTP/1.0" 202 Accepted 2026-04-05 00:56:43,524 - lava_callback - INFO - Starting async job submit for node 69d1b282aa48d6fae7bb0e11 2026-04-05 00:56:43,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:43,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b282aa48d6fae7bb0e11 HTTP/1.1" 200 None 2026-04-05 00:56:43,573 - lava_callback - DEBUG - Processing node 69d1b282aa48d6fae7bb0e11: baseline-nfs-arm64 2026-04-05 00:56:43,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:44,066 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:44,068 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b282aa48d6fae7bb0e11/log.txt.gz 2026-04-05 00:56:44,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:44,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:44,463 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b282aa48d6fae7bb0e11/lava-logs.yaml 2026-04-05 00:56:44,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:44,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:44,610 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b282aa48d6fae7bb0e11/lava_callback.json.gz 2026-04-05 00:56:44,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:44,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b282aa48d6fae7bb0e11 HTTP/1.1" 200 None 2026-04-05 00:56:44,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:44,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:56:44,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:44,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b282aa48d6fae7bb0e11 HTTP/1.1" 200 None 2026-04-05 00:56:44,702 - lava_callback - INFO - Completed processing callback for node 69d1b282aa48d6fae7bb0e11 2026-04-05 00:56:45,570 - lava_callback - INFO - Received callback for node 69d1b27eaa48d6fae7bb0de7 INFO: 172.21.0.1:39042 - "POST /node/69d1b27eaa48d6fae7bb0de7 HTTP/1.0" 202 Accepted 2026-04-05 00:56:45,581 - lava_callback - INFO - Starting async job submit for node 69d1b27eaa48d6fae7bb0de7 2026-04-05 00:56:45,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:45,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b27eaa48d6fae7bb0de7 HTTP/1.1" 200 None 2026-04-05 00:56:45,638 - lava_callback - DEBUG - Processing node 69d1b27eaa48d6fae7bb0de7: baseline-nfs-arm64 2026-04-05 00:56:46,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:46,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:46,160 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b27eaa48d6fae7bb0de7/log.txt.gz 2026-04-05 00:56:46,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:39058 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:56:46,642 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:46,644 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b27eaa48d6fae7bb0de7/lava-logs.yaml 2026-04-05 00:56:46,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:46,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:46,828 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b27eaa48d6fae7bb0de7/lava_callback.json.gz 2026-04-05 00:56:46,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:46,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b27eaa48d6fae7bb0de7 HTTP/1.1" 200 None 2026-04-05 00:56:46,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:46,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:56:46,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:46,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b27eaa48d6fae7bb0de7 HTTP/1.1" 200 None 2026-04-05 00:56:46,948 - lava_callback - INFO - Completed processing callback for node 69d1b27eaa48d6fae7bb0de7 2026-04-05 00:56:50,553 - lava_callback - INFO - Received callback for node 69d1af79aa48d6fae7bb0971 INFO: 172.21.0.1:53530 - "POST /node/69d1af79aa48d6fae7bb0971 HTTP/1.0" 202 Accepted 2026-04-05 00:56:50,561 - lava_callback - INFO - Starting async job submit for node 69d1af79aa48d6fae7bb0971 2026-04-05 00:56:50,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:50,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af79aa48d6fae7bb0971 HTTP/1.1" 200 None 2026-04-05 00:56:50,655 - lava_callback - DEBUG - Processing node 69d1af79aa48d6fae7bb0971: baseline-arm 2026-04-05 00:56:51,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:51,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:51,486 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d1af79aa48d6fae7bb0971/log.txt.gz 2026-04-05 00:56:51,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:52,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:52,146 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d1af79aa48d6fae7bb0971/lava-logs.yaml 2026-04-05 00:56:52,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:56:52,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:56:52,330 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d1af79aa48d6fae7bb0971/lava_callback.json.gz DEBUG: Setup failed for 69d1af79aa48d6fae7bb0971. Transitting job node result: incomplete -> fail 2026-04-05 00:56:52,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:52,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1af79aa48d6fae7bb0971 HTTP/1.1" 200 None 2026-04-05 00:56:52,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:52,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 00:56:52,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:56:52,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1af79aa48d6fae7bb0971 HTTP/1.1" 200 None 2026-04-05 00:56:52,605 - lava_callback - INFO - Completed processing callback for node 69d1af79aa48d6fae7bb0971 INFO: 172.21.0.1:53536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39026 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:57:09,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:57:09,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:33574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34636 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:57:27,321 - lava_callback - INFO - Received callback for node 69d1b261aa48d6fae7bb0d9b INFO: 172.21.0.1:34648 - "POST /node/69d1b261aa48d6fae7bb0d9b HTTP/1.0" 202 Accepted 2026-04-05 00:57:27,327 - lava_callback - INFO - Starting async job submit for node 69d1b261aa48d6fae7bb0d9b 2026-04-05 00:57:27,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:57:27,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b261aa48d6fae7bb0d9b HTTP/1.1" 200 None 2026-04-05 00:57:27,364 - lava_callback - DEBUG - Processing node 69d1b261aa48d6fae7bb0d9b: baseline-arm64 2026-04-05 00:57:27,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:57:27,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:57:27,736 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b261aa48d6fae7bb0d9b/log.txt.gz INFO: 172.21.0.1:34650 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:57:27,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:57:28,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:57:28,086 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b261aa48d6fae7bb0d9b/lava-logs.yaml 2026-04-05 00:57:28,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:57:28,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:57:28,268 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b261aa48d6fae7bb0d9b/lava_callback.json.gz 2026-04-05 00:57:28,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:57:28,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b261aa48d6fae7bb0d9b HTTP/1.1" 200 None 2026-04-05 00:57:28,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:57:28,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:57:28,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:57:28,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b261aa48d6fae7bb0d9b HTTP/1.1" 200 None 2026-04-05 00:57:28,454 - lava_callback - INFO - Completed processing callback for node 69d1b261aa48d6fae7bb0d9b INFO: 172.21.0.1:60400 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:57:39,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:57:39,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59208 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:57:50,545 - lava_callback - INFO - Received callback for node 69d1b2b1aa48d6fae7bb0e85 INFO: 172.21.0.1:39304 - "POST /node/69d1b2b1aa48d6fae7bb0e85 HTTP/1.0" 202 Accepted 2026-04-05 00:57:50,552 - lava_callback - INFO - Starting async job submit for node 69d1b2b1aa48d6fae7bb0e85 2026-04-05 00:57:50,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:57:50,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2b1aa48d6fae7bb0e85 HTTP/1.1" 200 None 2026-04-05 00:57:50,598 - lava_callback - DEBUG - Processing node 69d1b2b1aa48d6fae7bb0e85: baseline-arm64-broonie 2026-04-05 00:57:50,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:57:51,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:57:51,020 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1b2b1aa48d6fae7bb0e85/log.txt.gz 2026-04-05 00:57:51,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:57:51,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:57:51,499 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1b2b1aa48d6fae7bb0e85/lava-logs.yaml 2026-04-05 00:57:51,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:57:51,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:57:51,680 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1b2b1aa48d6fae7bb0e85/lava_callback.json.gz 2026-04-05 00:57:51,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:57:51,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2b1aa48d6fae7bb0e85 HTTP/1.1" 200 None 2026-04-05 00:57:51,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:57:51,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:57:51,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:57:51,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b2b1aa48d6fae7bb0e85 HTTP/1.1" 200 None 2026-04-05 00:57:51,773 - lava_callback - INFO - Completed processing callback for node 69d1b2b1aa48d6fae7bb0e85 INFO: 172.21.0.1:39312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36686 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:58:09,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:58:09,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47032 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:58:44,745 - lava_callback - INFO - Received callback for node 69d1b26aaa48d6fae7bb0dc5 INFO: 172.21.0.1:55708 - "POST /node/69d1b26aaa48d6fae7bb0dc5 HTTP/1.0" 202 Accepted 2026-04-05 00:58:44,752 - lava_callback - INFO - Starting async job submit for node 69d1b26aaa48d6fae7bb0dc5 2026-04-05 00:58:44,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:58:44,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b26aaa48d6fae7bb0dc5 HTTP/1.1" 200 None 2026-04-05 00:58:44,788 - lava_callback - DEBUG - Processing node 69d1b26aaa48d6fae7bb0dc5: baseline-arm64 2026-04-05 00:58:44,869 - lava_callback - INFO - Received callback for node 69d1b278aa48d6fae7bb0dda INFO: 172.21.0.1:55718 - "POST /node/69d1b278aa48d6fae7bb0dda HTTP/1.0" 202 Accepted 2026-04-05 00:58:44,896 - lava_callback - INFO - Starting async job submit for node 69d1b278aa48d6fae7bb0dda 2026-04-05 00:58:44,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:58:45,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b278aa48d6fae7bb0dda HTTP/1.1" 200 None 2026-04-05 00:58:45,044 - lava_callback - DEBUG - Processing node 69d1b278aa48d6fae7bb0dda: baseline-arm64 2026-04-05 00:58:45,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:58:45,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:58:45,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:58:45,734 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b278aa48d6fae7bb0dda/log.txt.gz 2026-04-05 00:58:45,766 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:58:45,804 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b26aaa48d6fae7bb0dc5/log.txt.gz 2026-04-05 00:58:46,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:58:46,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:58:46,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:58:46,427 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b278aa48d6fae7bb0dda/lava-logs.yaml 2026-04-05 00:58:46,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:55730 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:58:46,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:58:46,520 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b26aaa48d6fae7bb0dc5/lava-logs.yaml 2026-04-05 00:58:46,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:58:46,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:58:46,622 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b278aa48d6fae7bb0dda/lava_callback.json.gz 2026-04-05 00:58:46,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:58:46,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b278aa48d6fae7bb0dda HTTP/1.1" 200 None 2026-04-05 00:58:46,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:58:46,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:58:46,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:58:46,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:58:46,708 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b26aaa48d6fae7bb0dc5/lava_callback.json.gz 2026-04-05 00:58:46,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b278aa48d6fae7bb0dda HTTP/1.1" 200 None 2026-04-05 00:58:46,743 - lava_callback - INFO - Completed processing callback for node 69d1b278aa48d6fae7bb0dda 2026-04-05 00:58:46,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:58:46,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b26aaa48d6fae7bb0dc5 HTTP/1.1" 200 None 2026-04-05 00:58:46,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:58:46,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:58:46,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:58:46,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b26aaa48d6fae7bb0dc5 HTTP/1.1" 200 None 2026-04-05 00:58:46,874 - lava_callback - INFO - Completed processing callback for node 69d1b26aaa48d6fae7bb0dc5 INFO: 172.21.0.1:51110 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:58:59,842 - lava_callback - INFO - Received callback for node 69d1b27aaa48d6fae7bb0ddd INFO: 172.21.0.1:59848 - "POST /node/69d1b27aaa48d6fae7bb0ddd HTTP/1.0" 202 Accepted 2026-04-05 00:58:59,849 - lava_callback - INFO - Starting async job submit for node 69d1b27aaa48d6fae7bb0ddd 2026-04-05 00:58:59,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:58:59,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b27aaa48d6fae7bb0ddd HTTP/1.1" 200 None 2026-04-05 00:58:59,885 - lava_callback - DEBUG - Processing node 69d1b27aaa48d6fae7bb0ddd: baseline-arm64 2026-04-05 00:59:00,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:59:00,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:59:00,300 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b27aaa48d6fae7bb0ddd/log.txt.gz 2026-04-05 00:59:00,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:59:00,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:59:00,699 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b27aaa48d6fae7bb0ddd/lava-logs.yaml 2026-04-05 00:59:00,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:59:00,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:59:00,844 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b27aaa48d6fae7bb0ddd/lava_callback.json.gz 2026-04-05 00:59:00,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:00,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b27aaa48d6fae7bb0ddd HTTP/1.1" 200 None 2026-04-05 00:59:00,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:00,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:59:00,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:00,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b27aaa48d6fae7bb0ddd HTTP/1.1" 200 None 2026-04-05 00:59:00,934 - lava_callback - INFO - Completed processing callback for node 69d1b27aaa48d6fae7bb0ddd 2026-04-05 00:59:01,112 - lava_callback - INFO - Received callback for node 69d1b26faa48d6fae7bb0dcb INFO: 172.21.0.1:59850 - "POST /node/69d1b26faa48d6fae7bb0dcb HTTP/1.0" 202 Accepted 2026-04-05 00:59:01,120 - lava_callback - INFO - Starting async job submit for node 69d1b26faa48d6fae7bb0dcb 2026-04-05 00:59:01,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:01,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b26faa48d6fae7bb0dcb HTTP/1.1" 200 None 2026-04-05 00:59:01,166 - lava_callback - DEBUG - Processing node 69d1b26faa48d6fae7bb0dcb: baseline-arm64 2026-04-05 00:59:01,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:59:01,894 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:59:01,896 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b26faa48d6fae7bb0dcb/log.txt.gz 2026-04-05 00:59:02,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:59:02,410 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:59:02,412 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b26faa48d6fae7bb0dcb/lava-logs.yaml 2026-04-05 00:59:02,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:59:02,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:59:02,605 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b26faa48d6fae7bb0dcb/lava_callback.json.gz 2026-04-05 00:59:02,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:02,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b26faa48d6fae7bb0dcb HTTP/1.1" 200 None 2026-04-05 00:59:02,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:02,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:59:02,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:02,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b26faa48d6fae7bb0dcb HTTP/1.1" 200 None 2026-04-05 00:59:02,797 - lava_callback - INFO - Completed processing callback for node 69d1b26faa48d6fae7bb0dcb INFO: 172.21.0.1:59860 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:59:09,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:09,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-05 00:59:11,164 - lava_callback - INFO - Received callback for node 69cf10ca9e2394c38fe01a34 INFO: 172.21.0.1:40182 - "POST /node/69cf10ca9e2394c38fe01a34 HTTP/1.0" 202 Accepted 2026-04-05 00:59:11,170 - lava_callback - INFO - Starting async job submit for node 69cf10ca9e2394c38fe01a34 2026-04-05 00:59:11,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:11,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf10ca9e2394c38fe01a34 HTTP/1.1" 200 None 2026-04-05 00:59:11,186 - lava_callback - DEBUG - Processing node 69cf10ca9e2394c38fe01a34: baseline-arm-baylibre 2026-04-05 00:59:11,186 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf10ca9e2394c38fe01a34 2026-04-05 00:59:11,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:11,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf10ca9e2394c38fe01a34 HTTP/1.1" 200 None 2026-04-05 00:59:11,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:11,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 00:59:11,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:11,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf10ca9e2394c38fe01a34 HTTP/1.1" 200 None 2026-04-05 00:59:11,242 - lava_callback - ERROR - Error processing callback for node 69cf10ca9e2394c38fe01a34: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-05 00:59:11,257 - lava_callback - INFO - Received callback for node 69d1b292aa48d6fae7bb0e31 INFO: 172.21.0.1:40186 - "POST /node/69d1b292aa48d6fae7bb0e31 HTTP/1.0" 202 Accepted 2026-04-05 00:59:11,278 - lava_callback - INFO - Starting async job submit for node 69d1b292aa48d6fae7bb0e31 2026-04-05 00:59:11,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:11,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b292aa48d6fae7bb0e31 HTTP/1.1" 200 None 2026-04-05 00:59:11,338 - lava_callback - DEBUG - Processing node 69d1b292aa48d6fae7bb0e31: baseline-nfs-arm64 2026-04-05 00:59:11,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:59:11,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:59:11,853 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b292aa48d6fae7bb0e31/log.txt.gz 2026-04-05 00:59:12,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:59:12,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:59:12,295 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b292aa48d6fae7bb0e31/lava-logs.yaml 2026-04-05 00:59:12,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:59:12,446 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:59:12,448 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b292aa48d6fae7bb0e31/lava_callback.json.gz 2026-04-05 00:59:12,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:12,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b292aa48d6fae7bb0e31 HTTP/1.1" 200 None 2026-04-05 00:59:12,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:12,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:59:12,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:12,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b292aa48d6fae7bb0e31 HTTP/1.1" 200 None 2026-04-05 00:59:12,534 - lava_callback - INFO - Completed processing callback for node 69d1b292aa48d6fae7bb0e31 2026-04-05 00:59:13,607 - lava_callback - INFO - Received callback for node 69d1b268aa48d6fae7bb0dc2 INFO: 172.21.0.1:40198 - "POST /node/69d1b268aa48d6fae7bb0dc2 HTTP/1.0" 202 Accepted 2026-04-05 00:59:13,614 - lava_callback - INFO - Starting async job submit for node 69d1b268aa48d6fae7bb0dc2 2026-04-05 00:59:13,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:13,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b268aa48d6fae7bb0dc2 HTTP/1.1" 200 None 2026-04-05 00:59:13,652 - lava_callback - DEBUG - Processing node 69d1b268aa48d6fae7bb0dc2: baseline-arm64 2026-04-05 00:59:13,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:59:14,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:59:14,078 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b268aa48d6fae7bb0dc2/log.txt.gz 2026-04-05 00:59:14,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:59:14,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:59:14,487 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b268aa48d6fae7bb0dc2/lava-logs.yaml 2026-04-05 00:59:14,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:59:14,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:59:14,662 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b268aa48d6fae7bb0dc2/lava_callback.json.gz 2026-04-05 00:59:14,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:14,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b268aa48d6fae7bb0dc2 HTTP/1.1" 200 None 2026-04-05 00:59:14,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:14,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:59:14,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:14,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b268aa48d6fae7bb0dc2 HTTP/1.1" 200 None 2026-04-05 00:59:14,771 - lava_callback - INFO - Completed processing callback for node 69d1b268aa48d6fae7bb0dc2 INFO: 172.21.0.1:40206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40216 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:59:26,260 - lava_callback - INFO - Received callback for node 69d1b294aa48d6fae7bb0e3d INFO: 172.21.0.1:60620 - "POST /node/69d1b294aa48d6fae7bb0e3d HTTP/1.0" 202 Accepted 2026-04-05 00:59:26,267 - lava_callback - INFO - Starting async job submit for node 69d1b294aa48d6fae7bb0e3d 2026-04-05 00:59:26,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:26,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b294aa48d6fae7bb0e3d HTTP/1.1" 200 None 2026-04-05 00:59:26,317 - lava_callback - DEBUG - Processing node 69d1b294aa48d6fae7bb0e3d: baseline-nfs-arm64 INFO: 172.21.0.1:60628 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:59:26,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:59:26,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:59:26,923 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b294aa48d6fae7bb0e3d/log.txt.gz 2026-04-05 00:59:27,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:59:27,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:59:27,375 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b294aa48d6fae7bb0e3d/lava-logs.yaml 2026-04-05 00:59:27,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:59:27,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:59:27,534 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b294aa48d6fae7bb0e3d/lava_callback.json.gz 2026-04-05 00:59:27,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:27,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b294aa48d6fae7bb0e3d HTTP/1.1" 200 None 2026-04-05 00:59:27,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:27,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:59:27,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:27,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b294aa48d6fae7bb0e3d HTTP/1.1" 200 None 2026-04-05 00:59:27,624 - lava_callback - INFO - Completed processing callback for node 69d1b294aa48d6fae7bb0e3d INFO: 172.21.0.1:60642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43948 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:59:39,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:39,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-05 00:59:41,142 - lava_callback - INFO - Received callback for node 69cf10fa9e2394c38fe01a67 INFO: 172.21.0.1:34526 - "POST /node/69cf10fa9e2394c38fe01a67 HTTP/1.0" 202 Accepted 2026-04-05 00:59:41,151 - lava_callback - INFO - Starting async job submit for node 69cf10fa9e2394c38fe01a67 2026-04-05 00:59:41,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:41,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf10fa9e2394c38fe01a67 HTTP/1.1" 200 None 2026-04-05 00:59:41,169 - lava_callback - DEBUG - Processing node 69cf10fa9e2394c38fe01a67: baseline-arm-clabbe 2026-04-05 00:59:41,169 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf10fa9e2394c38fe01a67 2026-04-05 00:59:41,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:41,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf10fa9e2394c38fe01a67 HTTP/1.1" 200 None 2026-04-05 00:59:41,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:41,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 00:59:41,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:41,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf10fa9e2394c38fe01a67 HTTP/1.1" 200 None 2026-04-05 00:59:41,237 - lava_callback - ERROR - Error processing callback for node 69cf10fa9e2394c38fe01a67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34530 - "GET / HTTP/1.0" 200 OK 2026-04-05 00:59:47,178 - lava_callback - INFO - Received callback for node 69d1b046aa48d6fae7bb0b6c INFO: 172.21.0.1:34540 - "POST /node/69d1b046aa48d6fae7bb0b6c HTTP/1.0" 202 Accepted 2026-04-05 00:59:47,185 - lava_callback - INFO - Starting async job submit for node 69d1b046aa48d6fae7bb0b6c 2026-04-05 00:59:47,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:47,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b046aa48d6fae7bb0b6c HTTP/1.1" 200 None 2026-04-05 00:59:47,245 - lava_callback - DEBUG - Processing node 69d1b046aa48d6fae7bb0b6c: baseline-x86 2026-04-05 00:59:48,030 - lava_callback - INFO - Received callback for node 69d1b28baa48d6fae7bb0e20 INFO: 172.21.0.1:34552 - "POST /node/69d1b28baa48d6fae7bb0e20 HTTP/1.0" 202 Accepted 2026-04-05 00:59:48,064 - lava_callback - INFO - Starting async job submit for node 69d1b28baa48d6fae7bb0e20 2026-04-05 00:59:48,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:48,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:59:48,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b28baa48d6fae7bb0e20 HTTP/1.1" 200 None 2026-04-05 00:59:48,190 - lava_callback - DEBUG - Processing node 69d1b28baa48d6fae7bb0e20: baseline-nfs-arm64 2026-04-05 00:59:48,452 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:59:48,484 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d1b046aa48d6fae7bb0b6c/log.txt.gz 2026-04-05 00:59:48,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:59:48,860 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:59:48,914 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b28baa48d6fae7bb0e20/log.txt.gz 2026-04-05 00:59:49,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:59:49,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:59:49,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:59:49,647 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b28baa48d6fae7bb0e20/lava-logs.yaml 2026-04-05 00:59:49,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:59:49,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:59:49,747 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d1b046aa48d6fae7bb0b6c/lava-logs.yaml 2026-04-05 00:59:49,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 00:59:49,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:59:49,858 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b28baa48d6fae7bb0e20/lava_callback.json.gz 2026-04-05 00:59:49,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:49,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b28baa48d6fae7bb0e20 HTTP/1.1" 200 None 2026-04-05 00:59:49,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:49,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 00:59:49,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:49,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b28baa48d6fae7bb0e20 HTTP/1.1" 200 None 2026-04-05 00:59:49,971 - lava_callback - INFO - Completed processing callback for node 69d1b28baa48d6fae7bb0e20 2026-04-05 00:59:50,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 00:59:50,016 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d1b046aa48d6fae7bb0b6c/lava_callback.json.gz DEBUG: Setup failed for 69d1b046aa48d6fae7bb0b6c. Transitting job node result: incomplete -> fail 2026-04-05 00:59:50,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:50,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b046aa48d6fae7bb0b6c HTTP/1.1" 200 None 2026-04-05 00:59:50,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:50,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa40aa48d6fae7bb04de HTTP/1.1" 200 None 2026-04-05 00:59:50,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 00:59:50,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b046aa48d6fae7bb0b6c HTTP/1.1" 200 None 2026-04-05 00:59:50,344 - lava_callback - INFO - Completed processing callback for node 69d1b046aa48d6fae7bb0b6c INFO: 172.21.0.1:34076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35722 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:00:09,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:00:09,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41920 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:00:48,167 - lava_callback - INFO - Received callback for node 69d1b2c8aa48d6fae7bb0ee7 INFO: 172.21.0.1:41932 - "POST /node/69d1b2c8aa48d6fae7bb0ee7 HTTP/1.0" 202 Accepted 2026-04-05 01:00:48,177 - lava_callback - INFO - Starting async job submit for node 69d1b2c8aa48d6fae7bb0ee7 2026-04-05 01:00:48,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:00:48,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2c8aa48d6fae7bb0ee7 HTTP/1.1" 200 None 2026-04-05 01:00:48,246 - lava_callback - DEBUG - Processing node 69d1b2c8aa48d6fae7bb0ee7: baseline-arm64-foundriesio 2026-04-05 01:00:49,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:00:49,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:00:49,693 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d1b2c8aa48d6fae7bb0ee7/log.txt.gz 2026-04-05 01:00:50,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:00:50,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:00:50,846 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d1b2c8aa48d6fae7bb0ee7/lava-logs.yaml 2026-04-05 01:00:50,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:00:51,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:00:51,076 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d1b2c8aa48d6fae7bb0ee7/lava_callback.json.gz DEBUG: Setup failed for 69d1b2c8aa48d6fae7bb0ee7. Transitting job node result: incomplete -> fail 2026-04-05 01:00:51,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:00:51,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2c8aa48d6fae7bb0ee7 HTTP/1.1" 200 None 2026-04-05 01:00:51,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:00:51,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:00:51,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:00:51,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b2c8aa48d6fae7bb0ee7 HTTP/1.1" 200 None 2026-04-05 01:00:51,387 - lava_callback - INFO - Completed processing callback for node 69d1b2c8aa48d6fae7bb0ee7 INFO: 172.21.0.1:44292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50664 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:01:09,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:01:09,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40426 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:01:21,145 - lava_callback - INFO - Received callback for node 69cf11569e2394c38fe01aae INFO: 172.21.0.1:60150 - "POST /node/69cf11569e2394c38fe01aae HTTP/1.0" 202 Accepted 2026-04-05 01:01:21,154 - lava_callback - INFO - Starting async job submit for node 69cf11569e2394c38fe01aae 2026-04-05 01:01:21,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:01:21,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf11569e2394c38fe01aae HTTP/1.1" 200 None 2026-04-05 01:01:21,175 - lava_callback - DEBUG - Processing node 69cf11569e2394c38fe01aae: baseline-arm-clabbe 2026-04-05 01:01:21,176 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf11569e2394c38fe01aae 2026-04-05 01:01:21,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:01:21,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf11569e2394c38fe01aae HTTP/1.1" 200 None 2026-04-05 01:01:21,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:01:21,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 01:01:21,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:01:21,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf11569e2394c38fe01aae HTTP/1.1" 200 None 2026-04-05 01:01:21,245 - lava_callback - ERROR - Error processing callback for node 69cf11569e2394c38fe01aae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60160 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:01:29,730 - lava_callback - INFO - Received callback for node 69d1b267aa48d6fae7bb0dbd INFO: 172.21.0.1:41782 - "POST /node/69d1b267aa48d6fae7bb0dbd HTTP/1.0" 202 Accepted 2026-04-05 01:01:29,739 - lava_callback - INFO - Starting async job submit for node 69d1b267aa48d6fae7bb0dbd 2026-04-05 01:01:29,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:01:29,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b267aa48d6fae7bb0dbd HTTP/1.1" 200 None 2026-04-05 01:01:29,826 - lava_callback - DEBUG - Processing node 69d1b267aa48d6fae7bb0dbd: baseline-arm64 2026-04-05 01:01:30,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:01:30,314 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:01:30,315 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b267aa48d6fae7bb0dbd/log.txt.gz 2026-04-05 01:01:30,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:01:30,718 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:01:30,720 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b267aa48d6fae7bb0dbd/lava-logs.yaml 2026-04-05 01:01:30,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:01:30,861 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:01:30,862 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b267aa48d6fae7bb0dbd/lava_callback.json.gz 2026-04-05 01:01:30,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:01:30,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b267aa48d6fae7bb0dbd HTTP/1.1" 200 None 2026-04-05 01:01:30,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:01:30,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:01:30,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:01:30,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b267aa48d6fae7bb0dbd HTTP/1.1" 200 None 2026-04-05 01:01:30,935 - lava_callback - INFO - Completed processing callback for node 69d1b267aa48d6fae7bb0dbd INFO: 172.21.0.1:41792 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:01:39,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:01:39,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39244 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:01:47,491 - lava_callback - INFO - Received callback for node 69d1b280aa48d6fae7bb0ded INFO: 172.21.0.1:39250 - "POST /node/69d1b280aa48d6fae7bb0ded HTTP/1.0" 202 Accepted 2026-04-05 01:01:47,500 - lava_callback - INFO - Starting async job submit for node 69d1b280aa48d6fae7bb0ded 2026-04-05 01:01:47,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:01:47,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b280aa48d6fae7bb0ded HTTP/1.1" 200 None 2026-04-05 01:01:47,549 - lava_callback - DEBUG - Processing node 69d1b280aa48d6fae7bb0ded: baseline-nfs-arm64 2026-04-05 01:01:48,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:01:48,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:01:48,214 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b280aa48d6fae7bb0ded/log.txt.gz 2026-04-05 01:01:48,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:01:48,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:01:48,723 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b280aa48d6fae7bb0ded/lava-logs.yaml 2026-04-05 01:01:48,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:01:48,901 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:01:48,903 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b280aa48d6fae7bb0ded/lava_callback.json.gz 2026-04-05 01:01:48,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:01:48,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b280aa48d6fae7bb0ded HTTP/1.1" 200 None 2026-04-05 01:01:48,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:01:48,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:01:48,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:01:49,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b280aa48d6fae7bb0ded HTTP/1.1" 200 None 2026-04-05 01:01:49,014 - lava_callback - INFO - Completed processing callback for node 69d1b280aa48d6fae7bb0ded 2026-04-05 01:01:52,561 - lava_callback - INFO - Received callback for node 69d1b399aa48d6fae7bb1053 INFO: 172.21.0.1:42130 - "POST /node/69d1b399aa48d6fae7bb1053 HTTP/1.0" 202 Accepted 2026-04-05 01:01:52,568 - lava_callback - INFO - Starting async job submit for node 69d1b399aa48d6fae7bb1053 2026-04-05 01:01:52,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:01:52,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b399aa48d6fae7bb1053 HTTP/1.1" 200 None 2026-04-05 01:01:52,622 - lava_callback - DEBUG - Processing node 69d1b399aa48d6fae7bb1053: ltp-cap_bounds 2026-04-05 01:01:53,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:01:53,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:01:53,142 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69d1b399aa48d6fae7bb1053/log.txt.gz 2026-04-05 01:01:53,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:01:53,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:01:53,605 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69d1b399aa48d6fae7bb1053/lava-logs.yaml 2026-04-05 01:01:53,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:01:53,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:01:53,788 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69d1b399aa48d6fae7bb1053/lava_callback.json.gz 2026-04-05 01:01:53,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:01:53,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b399aa48d6fae7bb1053 HTTP/1.1" 200 None 2026-04-05 01:01:53,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:01:53,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 01:01:53,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:01:53,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b399aa48d6fae7bb1053 HTTP/1.1" 200 None 2026-04-05 01:01:53,877 - lava_callback - INFO - Completed processing callback for node 69d1b399aa48d6fae7bb1053 INFO: 172.21.0.1:42140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43888 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:02:09,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:02:09,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47772 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:03:12,209 - lava_callback - INFO - Received callback for node 69d1afb2aa48d6fae7bb0a9b INFO: 172.21.0.1:59496 - "POST /node/69d1afb2aa48d6fae7bb0a9b HTTP/1.0" 202 Accepted 2026-04-05 01:03:12,261 - lava_callback - INFO - Starting async job submit for node 69d1afb2aa48d6fae7bb0a9b 2026-04-05 01:03:12,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:03:12,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1afb2aa48d6fae7bb0a9b HTTP/1.1" 200 None 2026-04-05 01:03:12,319 - lava_callback - DEBUG - Processing node 69d1afb2aa48d6fae7bb0a9b: ltp-input 2026-04-05 01:03:12,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:03:12,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:03:12,610 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69d1afb2aa48d6fae7bb0a9b/log.txt.gz 2026-04-05 01:03:12,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:03:13,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:03:13,040 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69d1afb2aa48d6fae7bb0a9b/lava-logs.yaml 2026-04-05 01:03:13,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:03:13,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:03:13,205 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69d1afb2aa48d6fae7bb0a9b/lava_callback.json.gz 2026-04-05 01:03:13,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:03:13,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1afb2aa48d6fae7bb0a9b HTTP/1.1" 200 None 2026-04-05 01:03:13,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:03:13,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 01:03:13,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:03:13,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1afb2aa48d6fae7bb0a9b HTTP/1.1" 200 None 2026-04-05 01:03:13,375 - lava_callback - INFO - Completed processing callback for node 69d1afb2aa48d6fae7bb0a9b INFO: 172.21.0.1:59498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47452 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:03:39,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:03:39,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-05 01:03:44,382 - lava_callback - INFO - Received callback for node 69d1b27caa48d6fae7bb0de4 INFO: 172.21.0.1:57856 - "POST /node/69d1b27caa48d6fae7bb0de4 HTTP/1.0" 202 Accepted 2026-04-05 01:03:44,395 - lava_callback - INFO - Starting async job submit for node 69d1b27caa48d6fae7bb0de4 2026-04-05 01:03:44,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:03:44,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b27caa48d6fae7bb0de4 HTTP/1.1" 200 None 2026-04-05 01:03:44,490 - lava_callback - DEBUG - Processing node 69d1b27caa48d6fae7bb0de4: baseline-arm64 2026-04-05 01:03:45,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:03:45,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:03:45,289 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b27caa48d6fae7bb0de4/log.txt.gz 2026-04-05 01:03:45,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:03:46,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:03:46,071 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b27caa48d6fae7bb0de4/lava-logs.yaml 2026-04-05 01:03:46,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:03:46,276 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:03:46,279 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b27caa48d6fae7bb0de4/lava_callback.json.gz DEBUG: Setup failed for 69d1b27caa48d6fae7bb0de4. Transitting job node result: incomplete -> fail 2026-04-05 01:03:46,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:03:46,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b27caa48d6fae7bb0de4 HTTP/1.1" 200 None 2026-04-05 01:03:46,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:03:46,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:03:46,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:03:46,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b27caa48d6fae7bb0de4 HTTP/1.1" 200 None INFO: 172.21.0.1:57870 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:03:46,656 - lava_callback - INFO - Completed processing callback for node 69d1b27caa48d6fae7bb0de4 INFO: 172.21.0.1:49290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38702 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:04:09,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:04:09,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55480 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:05:01,405 - lava_callback - INFO - Received callback for node 69cf123a9e2394c38fe01b37 INFO: 172.21.0.1:34556 - "POST /node/69cf123a9e2394c38fe01b37 HTTP/1.0" 202 Accepted 2026-04-05 01:05:01,414 - lava_callback - INFO - Starting async job submit for node 69cf123a9e2394c38fe01b37 2026-04-05 01:05:01,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:05:01,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf123a9e2394c38fe01b37 HTTP/1.1" 200 None 2026-04-05 01:05:01,441 - lava_callback - DEBUG - Processing node 69cf123a9e2394c38fe01b37: baseline-arm-clabbe 2026-04-05 01:05:01,441 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf123a9e2394c38fe01b37 2026-04-05 01:05:01,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:05:01,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf123a9e2394c38fe01b37 HTTP/1.1" 200 None 2026-04-05 01:05:01,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:05:01,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 01:05:01,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:05:01,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf123a9e2394c38fe01b37 HTTP/1.1" 200 None 2026-04-05 01:05:01,536 - lava_callback - ERROR - Error processing callback for node 69cf123a9e2394c38fe01b37: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51860 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:05:20,363 - lava_callback - INFO - Received callback for node 69d1b28daa48d6fae7bb0e23 INFO: 172.21.0.1:52116 - "POST /node/69d1b28daa48d6fae7bb0e23 HTTP/1.0" 202 Accepted 2026-04-05 01:05:20,375 - lava_callback - INFO - Starting async job submit for node 69d1b28daa48d6fae7bb0e23 2026-04-05 01:05:20,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:05:20,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b28daa48d6fae7bb0e23 HTTP/1.1" 200 None 2026-04-05 01:05:20,440 - lava_callback - DEBUG - Processing node 69d1b28daa48d6fae7bb0e23: baseline-nfs-arm64 2026-04-05 01:05:21,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:05:21,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:05:21,358 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b28daa48d6fae7bb0e23/log.txt.gz 2026-04-05 01:05:21,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:05:22,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:05:22,014 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b28daa48d6fae7bb0e23/lava-logs.yaml 2026-04-05 01:05:22,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:05:22,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:05:22,471 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b28daa48d6fae7bb0e23/lava_callback.json.gz 2026-04-05 01:05:22,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:05:22,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b28daa48d6fae7bb0e23 HTTP/1.1" 200 None 2026-04-05 01:05:22,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:05:22,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:05:22,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:05:22,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b28daa48d6fae7bb0e23 HTTP/1.1" 200 None 2026-04-05 01:05:22,696 - lava_callback - INFO - Completed processing callback for node 69d1b28daa48d6fae7bb0e23 INFO: 172.21.0.1:52124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38208 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:05:39,075 - lava_callback - INFO - Received callback for node 69d1b274aa48d6fae7bb0dd4 INFO: 172.21.0.1:38214 - "POST /node/69d1b274aa48d6fae7bb0dd4 HTTP/1.0" 202 Accepted 2026-04-05 01:05:39,085 - lava_callback - INFO - Starting async job submit for node 69d1b274aa48d6fae7bb0dd4 2026-04-05 01:05:39,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:05:39,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b274aa48d6fae7bb0dd4 HTTP/1.1" 200 None 2026-04-05 01:05:39,139 - lava_callback - DEBUG - Processing node 69d1b274aa48d6fae7bb0dd4: baseline-arm64 2026-04-05 01:05:39,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:05:39,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:05:39,820 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b274aa48d6fae7bb0dd4/log.txt.gz 2026-04-05 01:05:39,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:05:39,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-05 01:05:40,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:05:40,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:05:40,377 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b274aa48d6fae7bb0dd4/lava-logs.yaml 2026-04-05 01:05:40,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:05:40,541 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:05:40,543 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1b274aa48d6fae7bb0dd4/lava_callback.json.gz 2026-04-05 01:05:40,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:05:40,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b274aa48d6fae7bb0dd4 HTTP/1.1" 200 None 2026-04-05 01:05:40,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:05:40,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:05:40,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:05:40,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b274aa48d6fae7bb0dd4 HTTP/1.1" 200 None 2026-04-05 01:05:40,715 - lava_callback - INFO - Completed processing callback for node 69d1b274aa48d6fae7bb0dd4 INFO: 172.21.0.1:40664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58566 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:06:09,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:06:09,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58394 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:08:18,770 - lava_callback - INFO - Received callback for node 69d1b5f1aa48d6fae7bb1331 INFO: 172.21.0.1:58396 - "POST /node/69d1b5f1aa48d6fae7bb1331 HTTP/1.0" 202 Accepted 2026-04-05 01:08:18,776 - lava_callback - INFO - Starting async job submit for node 69d1b5f1aa48d6fae7bb1331 2026-04-05 01:08:18,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:08:18,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b5f1aa48d6fae7bb1331 HTTP/1.1" 200 None 2026-04-05 01:08:18,794 - lava_callback - DEBUG - Processing node 69d1b5f1aa48d6fae7bb1331: baseline-nfs-arm64 2026-04-05 01:08:18,796 - lava_callback - WARNING - Failed to upload log 2026-04-05 01:08:18,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:08:19,270 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:08:19,272 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b5f1aa48d6fae7bb1331/lava-logs.yaml 2026-04-05 01:08:19,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:08:19,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:08:19,421 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b5f1aa48d6fae7bb1331/lava_callback.json.gz 2026-04-05 01:08:19,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:08:19,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b5f1aa48d6fae7bb1331 HTTP/1.1" 200 None 2026-04-05 01:08:19,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:08:19,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:08:19,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:08:19,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b5f1aa48d6fae7bb1331 HTTP/1.1" 200 None 2026-04-05 01:08:19,493 - lava_callback - INFO - Completed processing callback for node 69d1b5f1aa48d6fae7bb1331 2026-04-05 01:08:21,598 - lava_callback - INFO - Received callback for node 69cf12f69e2394c38fe01ba0 INFO: 172.21.0.1:40214 - "POST /node/69cf12f69e2394c38fe01ba0 HTTP/1.0" 202 Accepted 2026-04-05 01:08:21,607 - lava_callback - INFO - Starting async job submit for node 69cf12f69e2394c38fe01ba0 2026-04-05 01:08:21,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:08:21,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf12f69e2394c38fe01ba0 HTTP/1.1" 200 None 2026-04-05 01:08:21,632 - lava_callback - DEBUG - Processing node 69cf12f69e2394c38fe01ba0: baseline-arm-clabbe 2026-04-05 01:08:21,633 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf12f69e2394c38fe01ba0 2026-04-05 01:08:21,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:08:21,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf12f69e2394c38fe01ba0 HTTP/1.1" 200 None 2026-04-05 01:08:21,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:08:21,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 01:08:21,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:08:21,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf12f69e2394c38fe01ba0 HTTP/1.1" 200 None 2026-04-05 01:08:21,713 - lava_callback - ERROR - Error processing callback for node 69cf12f69e2394c38fe01ba0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46618 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:08:39,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:08:39,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48152 - "GET /node/698629a1177ca0f097bd214d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52782 - "GET /node/693fbc1a0d8ce4018da9e45d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57914 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:11:41,701 - lava_callback - INFO - Received callback for node 69cf13c39e2394c38fe01c0c INFO: 172.21.0.1:41740 - "POST /node/69cf13c39e2394c38fe01c0c HTTP/1.0" 202 Accepted 2026-04-05 01:11:41,706 - lava_callback - INFO - Starting async job submit for node 69cf13c39e2394c38fe01c0c 2026-04-05 01:11:41,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:11:41,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf13c39e2394c38fe01c0c HTTP/1.1" 200 None 2026-04-05 01:11:41,723 - lava_callback - DEBUG - Processing node 69cf13c39e2394c38fe01c0c: baseline-arm-clabbe 2026-04-05 01:11:41,723 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf13c39e2394c38fe01c0c 2026-04-05 01:11:41,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:11:41,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf13c39e2394c38fe01c0c HTTP/1.1" 200 None 2026-04-05 01:11:41,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:11:41,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 01:11:41,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:11:41,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf13c39e2394c38fe01c0c HTTP/1.1" 200 None 2026-04-05 01:11:41,809 - lava_callback - ERROR - Error processing callback for node 69cf13c39e2394c38fe01c0c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50470 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:13:32,742 - lava_callback - INFO - Received callback for node 69d1b6c2aa48d6fae7bb1413 INFO: 172.21.0.1:44352 - "POST /node/69d1b6c2aa48d6fae7bb1413 HTTP/1.0" 202 Accepted 2026-04-05 01:13:32,748 - lava_callback - INFO - Starting async job submit for node 69d1b6c2aa48d6fae7bb1413 2026-04-05 01:13:32,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:13:32,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b6c2aa48d6fae7bb1413 HTTP/1.1" 200 None 2026-04-05 01:13:32,790 - lava_callback - DEBUG - Processing node 69d1b6c2aa48d6fae7bb1413: baseline-arm64-broonie 2026-04-05 01:13:33,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:13:33,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:13:33,223 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1b6c2aa48d6fae7bb1413/log.txt.gz 2026-04-05 01:13:33,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:13:33,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:13:33,748 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1b6c2aa48d6fae7bb1413/lava-logs.yaml 2026-04-05 01:13:33,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:13:33,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:13:33,933 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1b6c2aa48d6fae7bb1413/lava_callback.json.gz 2026-04-05 01:13:33,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:13:33,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b6c2aa48d6fae7bb1413 HTTP/1.1" 200 None 2026-04-05 01:13:33,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:13:33,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:13:33,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:13:34,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b6c2aa48d6fae7bb1413 HTTP/1.1" 200 None 2026-04-05 01:13:34,026 - lava_callback - INFO - Completed processing callback for node 69d1b6c2aa48d6fae7bb1413 INFO: 172.21.0.1:44366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44378 - "GET /node/69903ab8985e4efca431da5c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44388 - "GET /node/6956343f16d33f8361befefa%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-05 01:13:39,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:13:40,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33064 - "GET /node/6990370a985e4efca431ccb0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33080 - "GET /node/694971f4d45a0a86fbe2461a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44358 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:15:10,983 - lava_callback - INFO - Received callback for node 69d1b284aa48d6fae7bb0e14 INFO: 172.21.0.1:35924 - "POST /node/69d1b284aa48d6fae7bb0e14 HTTP/1.0" 202 Accepted 2026-04-05 01:15:10,996 - lava_callback - INFO - Starting async job submit for node 69d1b284aa48d6fae7bb0e14 2026-04-05 01:15:11,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:15:11,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b284aa48d6fae7bb0e14 HTTP/1.1" 200 None 2026-04-05 01:15:11,059 - lava_callback - DEBUG - Processing node 69d1b284aa48d6fae7bb0e14: baseline-nfs-arm64 2026-04-05 01:15:12,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:15:12,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:15:12,362 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b284aa48d6fae7bb0e14/log.txt.gz 2026-04-05 01:15:13,030 - lava_callback - INFO - Received callback for node 69d1b2b8aa48d6fae7bb0e9d INFO: 172.21.0.1:35928 - "POST /node/69d1b2b8aa48d6fae7bb0e9d HTTP/1.0" 202 Accepted 2026-04-05 01:15:13,050 - lava_callback - INFO - Starting async job submit for node 69d1b2b8aa48d6fae7bb0e9d 2026-04-05 01:15:13,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:15:13,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2b8aa48d6fae7bb0e9d HTTP/1.1" 200 None 2026-04-05 01:15:13,178 - lava_callback - DEBUG - Processing node 69d1b2b8aa48d6fae7bb0e9d: baseline-arm64-broonie 2026-04-05 01:15:13,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:15:13,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:15:13,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:15:13,520 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1b2b8aa48d6fae7bb0e9d/log.txt.gz 2026-04-05 01:15:13,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:15:13,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:15:13,637 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b284aa48d6fae7bb0e14/lava-logs.yaml 2026-04-05 01:15:13,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:15:13,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:15:13,788 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1b2b8aa48d6fae7bb0e9d/lava-logs.yaml 2026-04-05 01:15:13,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:15:13,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:15:13,915 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1b284aa48d6fae7bb0e14/lava_callback.json.gz 2026-04-05 01:15:13,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:15:13,980 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1b2b8aa48d6fae7bb0e9d/lava_callback.json.gz 2026-04-05 01:15:14,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 DEBUG: Setup failed for 69d1b284aa48d6fae7bb0e14. Transitting job node result: incomplete -> fail 2026-04-05 01:15:14,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:15:14,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2b8aa48d6fae7bb0e9d HTTP/1.1" 200 None 2026-04-05 01:15:14,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:15:14,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b284aa48d6fae7bb0e14 HTTP/1.1" 200 None 2026-04-05 01:15:14,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:15:14,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:15:14,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:15:14,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:15:14,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:15:14,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b284aa48d6fae7bb0e14 HTTP/1.1" 200 None 2026-04-05 01:15:14,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b2b8aa48d6fae7bb0e9d HTTP/1.1" 200 None 2026-04-05 01:15:14,298 - lava_callback - INFO - Completed processing callback for node 69d1b2b8aa48d6fae7bb0e9d 2026-04-05 01:15:14,335 - lava_callback - INFO - Completed processing callback for node 69d1b284aa48d6fae7bb0e14 2026-04-05 01:15:14,345 - lava_callback - INFO - Received callback for node 69d1b2b9aa48d6fae7bb0ea0 INFO: 172.21.0.1:35934 - "POST /node/69d1b2b9aa48d6fae7bb0ea0 HTTP/1.0" 202 Accepted 2026-04-05 01:15:14,361 - lava_callback - INFO - Starting async job submit for node 69d1b2b9aa48d6fae7bb0ea0 2026-04-05 01:15:14,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:15:14,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2b9aa48d6fae7bb0ea0 HTTP/1.1" 200 None 2026-04-05 01:15:14,420 - lava_callback - DEBUG - Processing node 69d1b2b9aa48d6fae7bb0ea0: baseline-arm64-broonie 2026-04-05 01:15:14,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:15:14,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:15:14,714 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1b2b9aa48d6fae7bb0ea0/log.txt.gz 2026-04-05 01:15:14,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:15:14,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:15:14,962 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1b2b9aa48d6fae7bb0ea0/lava-logs.yaml 2026-04-05 01:15:14,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:15:15,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:15:15,082 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1b2b9aa48d6fae7bb0ea0/lava_callback.json.gz 2026-04-05 01:15:15,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:15:15,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b2b9aa48d6fae7bb0ea0 HTTP/1.1" 200 None 2026-04-05 01:15:15,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:15:15,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:15:15,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:15:15,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b2b9aa48d6fae7bb0ea0 HTTP/1.1" 200 None INFO: 172.21.0.1:35942 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 01:15:15,223 - lava_callback - INFO - Completed processing callback for node 69d1b2b9aa48d6fae7bb0ea0 INFO: 172.21.0.1:35952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41662 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:15:40,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:15:40,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58226 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:15:48,585 - lava_callback - INFO - Received callback for node 69d1b7b6aa48d6fae7bb14e7 INFO: 172.21.0.1:58234 - "POST /node/69d1b7b6aa48d6fae7bb14e7 HTTP/1.0" 202 Accepted 2026-04-05 01:15:48,590 - lava_callback - INFO - Starting async job submit for node 69d1b7b6aa48d6fae7bb14e7 2026-04-05 01:15:48,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:15:48,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b7b6aa48d6fae7bb14e7 HTTP/1.1" 200 None 2026-04-05 01:15:48,609 - lava_callback - DEBUG - Processing node 69d1b7b6aa48d6fae7bb14e7: baseline-arm 2026-04-05 01:15:48,614 - lava_callback - WARNING - Failed to upload log 2026-04-05 01:15:48,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:15:48,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:15:48,734 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d1b7b6aa48d6fae7bb14e7/lava-logs.yaml 2026-04-05 01:15:48,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:15:48,858 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:15:48,860 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d1b7b6aa48d6fae7bb14e7/lava_callback.json.gz 2026-04-05 01:15:48,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:15:48,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b7b6aa48d6fae7bb14e7 HTTP/1.1" 200 None 2026-04-05 01:15:48,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:15:48,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 01:15:48,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:15:48,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b7b6aa48d6fae7bb14e7 HTTP/1.1" 200 None 2026-04-05 01:15:48,926 - lava_callback - INFO - Completed processing callback for node 69d1b7b6aa48d6fae7bb14e7 INFO: 172.21.0.1:54366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41064 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:16:10,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:16:10,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43678 - "GET /node/6941554d459ff5fc64d2d585%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43684 - "GET /node/69541a5a9c6929bd9fb70d4f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38784 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:24:32,467 - lava_callback - INFO - Received callback for node 69d1b5c5aa48d6fae7bb12eb INFO: 172.21.0.1:60678 - "POST /node/69d1b5c5aa48d6fae7bb12eb HTTP/1.0" 202 Accepted 2026-04-05 01:24:32,474 - lava_callback - INFO - Starting async job submit for node 69d1b5c5aa48d6fae7bb12eb 2026-04-05 01:24:32,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:24:32,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b5c5aa48d6fae7bb12eb HTTP/1.1" 200 None 2026-04-05 01:24:32,595 - lava_callback - DEBUG - Processing node 69d1b5c5aa48d6fae7bb12eb: ltp-smoke 2026-04-05 01:24:33,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:24:33,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:24:33,317 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d1b5c5aa48d6fae7bb12eb/log.txt.gz 2026-04-05 01:24:33,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:24:33,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:24:33,853 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d1b5c5aa48d6fae7bb12eb/lava-logs.yaml 2026-04-05 01:24:33,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:24:34,036 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:24:34,038 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d1b5c5aa48d6fae7bb12eb/lava_callback.json.gz 2026-04-05 01:24:34,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:24:34,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1b5c5aa48d6fae7bb12eb HTTP/1.1" 200 None 2026-04-05 01:24:34,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:24:34,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa27aa48d6fae7bb04bb HTTP/1.1" 200 None 2026-04-05 01:24:34,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:24:34,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1b5c5aa48d6fae7bb12eb HTTP/1.1" 200 None 2026-04-05 01:24:34,374 - lava_callback - INFO - Completed processing callback for node 69d1b5c5aa48d6fae7bb12eb INFO: 172.21.0.1:60680 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:24:40,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:24:40,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51392 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:27:33,112 - lava_callback - INFO - Received callback for node 69d1ba38aa48d6fae7bb169e INFO: 172.21.0.1:37156 - "POST /node/69d1ba38aa48d6fae7bb169e HTTP/1.0" 202 Accepted 2026-04-05 01:27:33,123 - lava_callback - INFO - Starting async job submit for node 69d1ba38aa48d6fae7bb169e 2026-04-05 01:27:33,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:27:33,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1ba38aa48d6fae7bb169e HTTP/1.1" 200 None 2026-04-05 01:27:33,196 - lava_callback - DEBUG - Processing node 69d1ba38aa48d6fae7bb169e: baseline-arm64 2026-04-05 01:27:33,361 - lava_callback - WARNING - Failed to upload log 2026-04-05 01:27:33,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:27:33,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:27:33,635 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1ba38aa48d6fae7bb169e/lava-logs.yaml 2026-04-05 01:27:33,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:27:33,755 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:27:33,756 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1ba38aa48d6fae7bb169e/lava_callback.json.gz 2026-04-05 01:27:33,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:27:33,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1ba38aa48d6fae7bb169e HTTP/1.1" 200 None 2026-04-05 01:27:33,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:27:33,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:27:33,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:27:33,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1ba38aa48d6fae7bb169e HTTP/1.1" 200 None 2026-04-05 01:27:33,913 - lava_callback - INFO - Completed processing callback for node 69d1ba38aa48d6fae7bb169e INFO: 172.21.0.1:37160 - "GET /node/69869e682de8e2dea3666ec3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37168 - "GET /node/693b070bfee8383e92b70a60%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37172 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:27:40,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:27:40,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56668 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:28:27,259 - lava_callback - INFO - Received callback for node 69d1ba81aa48d6fae7bb16cf INFO: 172.21.0.1:56678 - "POST /node/69d1ba81aa48d6fae7bb16cf HTTP/1.0" 202 Accepted 2026-04-05 01:28:27,266 - lava_callback - INFO - Starting async job submit for node 69d1ba81aa48d6fae7bb16cf 2026-04-05 01:28:27,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:28:27,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1ba81aa48d6fae7bb16cf HTTP/1.1" 200 None 2026-04-05 01:28:27,314 - lava_callback - DEBUG - Processing node 69d1ba81aa48d6fae7bb16cf: baseline-arm64 2026-04-05 01:28:27,512 - lava_callback - WARNING - Failed to upload log 2026-04-05 01:28:27,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:28:27,795 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:28:27,796 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1ba81aa48d6fae7bb16cf/lava-logs.yaml 2026-04-05 01:28:27,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:28:27,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:28:27,938 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1ba81aa48d6fae7bb16cf/lava_callback.json.gz 2026-04-05 01:28:27,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:28:27,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1ba81aa48d6fae7bb16cf HTTP/1.1" 200 None 2026-04-05 01:28:27,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:28:27,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:28:27,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:28:28,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1ba81aa48d6fae7bb16cf HTTP/1.1" 200 None 2026-04-05 01:28:28,084 - lava_callback - INFO - Completed processing callback for node 69d1ba81aa48d6fae7bb16cf INFO: 172.21.0.1:56684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45248 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:28:40,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:28:40,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50322 - "GET /node/69a46f74a327b98156690295%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50326 - "GET /node/6983ed40969566dcb0d29ac3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54656 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:31:16,911 - lava_callback - INFO - Received callback for node 69d1bb03aa48d6fae7bb1744 INFO: 172.21.0.1:54670 - "POST /node/69d1bb03aa48d6fae7bb1744 HTTP/1.0" 202 Accepted 2026-04-05 01:31:16,919 - lava_callback - INFO - Starting async job submit for node 69d1bb03aa48d6fae7bb1744 2026-04-05 01:31:16,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:31:16,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bb03aa48d6fae7bb1744 HTTP/1.1" 200 None 2026-04-05 01:31:16,963 - lava_callback - DEBUG - Processing node 69d1bb03aa48d6fae7bb1744: baseline-arm64 2026-04-05 01:31:17,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:31:17,464 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:31:17,466 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1bb03aa48d6fae7bb1744/log.txt.gz 2026-04-05 01:31:17,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:31:17,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:31:17,867 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1bb03aa48d6fae7bb1744/lava-logs.yaml 2026-04-05 01:31:17,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:31:18,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:31:18,032 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1bb03aa48d6fae7bb1744/lava_callback.json.gz 2026-04-05 01:31:18,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:31:18,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bb03aa48d6fae7bb1744 HTTP/1.1" 200 None 2026-04-05 01:31:18,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:31:18,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:31:18,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:31:18,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1bb03aa48d6fae7bb1744 HTTP/1.1" 200 None 2026-04-05 01:31:18,129 - lava_callback - INFO - Completed processing callback for node 69d1bb03aa48d6fae7bb1744 INFO: 172.21.0.1:52426 - "GET /node/694a29482060d3d847920ff4%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52440 - "GET /node/698b678d0a16aea5a0dc75b8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:52446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39072 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:31:40,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:31:40,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45428 - "GET /node/693fc8fc575bc060ce1498f2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45440 - "GET /node/69b19ae4a26b422765ba37dc%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45448 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:33:30,386 - lava_callback - INFO - Received callback for node 69d1bb68aa48d6fae7bb1785 INFO: 172.21.0.1:54424 - "POST /node/69d1bb68aa48d6fae7bb1785 HTTP/1.0" 202 Accepted 2026-04-05 01:33:30,393 - lava_callback - INFO - Starting async job submit for node 69d1bb68aa48d6fae7bb1785 2026-04-05 01:33:30,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:33:30,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bb68aa48d6fae7bb1785 HTTP/1.1" 200 None 2026-04-05 01:33:30,437 - lava_callback - DEBUG - Processing node 69d1bb68aa48d6fae7bb1785: baseline-arm64 2026-04-05 01:33:30,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:33:31,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:33:31,057 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1bb68aa48d6fae7bb1785/log.txt.gz 2026-04-05 01:33:31,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:33:31,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:33:31,539 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1bb68aa48d6fae7bb1785/lava-logs.yaml 2026-04-05 01:33:31,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:33:31,714 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:33:31,716 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1bb68aa48d6fae7bb1785/lava_callback.json.gz 2026-04-05 01:33:31,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:33:31,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bb68aa48d6fae7bb1785 HTTP/1.1" 200 None 2026-04-05 01:33:31,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:33:31,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:33:31,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:33:31,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1bb68aa48d6fae7bb1785 HTTP/1.1" 200 None 2026-04-05 01:33:31,873 - lava_callback - INFO - Completed processing callback for node 69d1bb68aa48d6fae7bb1785 INFO: 172.21.0.1:54430 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:33:40,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:33:40,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51034 - "GET /node/69865c67177ca0f097bd4522%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51042 - "GET /node/69936fd8cebe99dd8e068b14%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44728 - "GET /node/69a4e2367caa0b8e1b59deed%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44730 - "GET /node/698a40c822b4cc0f227b05b6%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44732 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:36:03,204 - lava_callback - INFO - Received callback for node 69d1bc2baa48d6fae7bb180a INFO: 172.21.0.1:57658 - "POST /node/69d1bc2baa48d6fae7bb180a HTTP/1.0" 202 Accepted 2026-04-05 01:36:03,213 - lava_callback - INFO - Starting async job submit for node 69d1bc2baa48d6fae7bb180a 2026-04-05 01:36:03,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:36:03,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bc2baa48d6fae7bb180a HTTP/1.1" 200 None 2026-04-05 01:36:03,284 - lava_callback - DEBUG - Processing node 69d1bc2baa48d6fae7bb180a: baseline-x86 2026-04-05 01:36:03,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:36:03,858 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:36:03,861 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69d1bc2baa48d6fae7bb180a/log.txt.gz 2026-04-05 01:36:04,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:36:04,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:36:04,442 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69d1bc2baa48d6fae7bb180a/lava-logs.yaml 2026-04-05 01:36:04,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:36:04,594 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:36:04,596 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69d1bc2baa48d6fae7bb180a/lava_callback.json.gz 2026-04-05 01:36:04,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:36:04,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bc2baa48d6fae7bb180a HTTP/1.1" 200 None 2026-04-05 01:36:04,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:36:04,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa40aa48d6fae7bb04de HTTP/1.1" 200 None 2026-04-05 01:36:04,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:36:04,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1bc2baa48d6fae7bb180a HTTP/1.1" 200 None 2026-04-05 01:36:04,673 - lava_callback - INFO - Completed processing callback for node 69d1bc2baa48d6fae7bb180a INFO: 172.21.0.1:57670 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:36:10,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:36:10,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33960 - "GET /node/69b284304bce73bcf02346e9%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33966 - "GET /node/69b7fc2f113612b7716bc5e0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51198 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:38:05,183 - lava_callback - INFO - Received callback for node 69d1bc47aa48d6fae7bb1815 INFO: 172.21.0.1:40618 - "POST /node/69d1bc47aa48d6fae7bb1815 HTTP/1.0" 202 Accepted 2026-04-05 01:38:05,196 - lava_callback - INFO - Starting async job submit for node 69d1bc47aa48d6fae7bb1815 2026-04-05 01:38:05,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:38:05,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bc47aa48d6fae7bb1815 HTTP/1.1" 200 None 2026-04-05 01:38:05,297 - lava_callback - DEBUG - Processing node 69d1bc47aa48d6fae7bb1815: baseline-arm64-foundriesio 2026-04-05 01:38:06,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:40626 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:38:06,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:38:06,660 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d1bc47aa48d6fae7bb1815/log.txt.gz 2026-04-05 01:38:07,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:38:07,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:38:07,779 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d1bc47aa48d6fae7bb1815/lava-logs.yaml 2026-04-05 01:38:07,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:38:08,027 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:38:08,029 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d1bc47aa48d6fae7bb1815/lava_callback.json.gz DEBUG: 69d1bc47aa48d6fae7bb1815 Transitting job node result: pass -> incomplete 2026-04-05 01:38:08,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:38:08,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bc47aa48d6fae7bb1815 HTTP/1.1" 200 None 2026-04-05 01:38:08,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:38:08,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:38:08,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:38:08,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1bc47aa48d6fae7bb1815 HTTP/1.1" 200 None 2026-04-05 01:38:08,189 - lava_callback - INFO - Completed processing callback for node 69d1bc47aa48d6fae7bb1815 2026-04-05 01:38:10,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:38:10,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-05 01:38:13,353 - lava_callback - INFO - Received callback for node 69cf19f69e2394c38fe01f39 INFO: 172.21.0.1:36538 - "POST /node/69cf19f69e2394c38fe01f39 HTTP/1.0" 202 Accepted 2026-04-05 01:38:13,359 - lava_callback - INFO - Starting async job submit for node 69cf19f69e2394c38fe01f39 2026-04-05 01:38:13,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:38:13,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf19f69e2394c38fe01f39 HTTP/1.1" 200 None 2026-04-05 01:38:13,390 - lava_callback - DEBUG - Processing node 69cf19f69e2394c38fe01f39: baseline-arm-baylibre 2026-04-05 01:38:13,390 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf19f69e2394c38fe01f39 2026-04-05 01:38:13,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:38:13,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf19f69e2394c38fe01f39 HTTP/1.1" 200 None 2026-04-05 01:38:13,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:38:13,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-05 01:38:13,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:38:13,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf19f69e2394c38fe01f39 HTTP/1.1" 200 None 2026-04-05 01:38:13,465 - lava_callback - ERROR - Error processing callback for node 69cf19f69e2394c38fe01f39: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56304 - "GET /node/698b8f230a16aea5a0dc8eda%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56308 - "GET /node/693e7bf93c8f1be6d3cf0c0b%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38038 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:38:53,298 - lava_callback - INFO - Received callback for node 69cf1a1c9e2394c38fe01f5d INFO: 172.21.0.1:46456 - "POST /node/69cf1a1c9e2394c38fe01f5d HTTP/1.0" 202 Accepted 2026-04-05 01:38:53,304 - lava_callback - INFO - Starting async job submit for node 69cf1a1c9e2394c38fe01f5d 2026-04-05 01:38:53,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:38:53,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1a1c9e2394c38fe01f5d HTTP/1.1" 200 None 2026-04-05 01:38:53,320 - lava_callback - DEBUG - Processing node 69cf1a1c9e2394c38fe01f5d: baseline-arm-baylibre 2026-04-05 01:38:53,320 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf1a1c9e2394c38fe01f5d 2026-04-05 01:38:53,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:38:53,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1a1c9e2394c38fe01f5d HTTP/1.1" 200 None 2026-04-05 01:38:53,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:38:53,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-05 01:38:53,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:38:53,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf1a1c9e2394c38fe01f5d HTTP/1.1" 200 None 2026-04-05 01:38:53,381 - lava_callback - ERROR - Error processing callback for node 69cf1a1c9e2394c38fe01f5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51092 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:40:53,894 - lava_callback - INFO - Received callback for node 69d1bcadaa48d6fae7bb1881 INFO: 172.21.0.1:52216 - "POST /node/69d1bcadaa48d6fae7bb1881 HTTP/1.0" 202 Accepted 2026-04-05 01:40:53,901 - lava_callback - INFO - Starting async job submit for node 69d1bcadaa48d6fae7bb1881 2026-04-05 01:40:53,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:40:53,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bcadaa48d6fae7bb1881 HTTP/1.1" 200 None 2026-04-05 01:40:53,945 - lava_callback - DEBUG - Processing node 69d1bcadaa48d6fae7bb1881: ltp-input 2026-04-05 01:40:54,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:40:54,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:40:54,593 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69d1bcadaa48d6fae7bb1881/log.txt.gz 2026-04-05 01:40:54,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:40:55,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:40:55,049 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69d1bcadaa48d6fae7bb1881/lava-logs.yaml 2026-04-05 01:40:55,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:40:55,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:40:55,237 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69d1bcadaa48d6fae7bb1881/lava_callback.json.gz 2026-04-05 01:40:55,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:40:55,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bcadaa48d6fae7bb1881 HTTP/1.1" 200 None 2026-04-05 01:40:55,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:40:55,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 01:40:55,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:40:55,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1bcadaa48d6fae7bb1881 HTTP/1.1" 200 None 2026-04-05 01:40:55,334 - lava_callback - INFO - Completed processing callback for node 69d1bcadaa48d6fae7bb1881 INFO: 172.21.0.1:52218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35578 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:41:10,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:41:10,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-05 01:41:12,648 - lava_callback - INFO - Received callback for node 69d1bd9baa48d6fae7bb1982 INFO: 172.21.0.1:45462 - "POST /node/69d1bd9baa48d6fae7bb1982 HTTP/1.0" 202 Accepted 2026-04-05 01:41:12,656 - lava_callback - INFO - Starting async job submit for node 69d1bd9baa48d6fae7bb1982 2026-04-05 01:41:12,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:41:12,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bd9baa48d6fae7bb1982 HTTP/1.1" 200 None 2026-04-05 01:41:12,680 - lava_callback - DEBUG - Processing node 69d1bd9baa48d6fae7bb1982: baseline-nfs-arm64 2026-04-05 01:41:12,681 - lava_callback - WARNING - Failed to upload log 2026-04-05 01:41:12,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:41:12,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:41:12,812 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1bd9baa48d6fae7bb1982/lava-logs.yaml 2026-04-05 01:41:12,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:41:12,928 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:41:12,930 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1bd9baa48d6fae7bb1982/lava_callback.json.gz 2026-04-05 01:41:12,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:41:12,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bd9baa48d6fae7bb1982 HTTP/1.1" 200 None 2026-04-05 01:41:12,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:41:12,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:41:12,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:41:12,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1bd9baa48d6fae7bb1982 HTTP/1.1" 200 None 2026-04-05 01:41:12,992 - lava_callback - INFO - Completed processing callback for node 69d1bd9baa48d6fae7bb1982 2026-04-05 01:41:13,456 - lava_callback - INFO - Received callback for node 69cf1aaf9e2394c38fe01fc9 INFO: 172.21.0.1:45474 - "POST /node/69cf1aaf9e2394c38fe01fc9 HTTP/1.0" 202 Accepted 2026-04-05 01:41:13,462 - lava_callback - INFO - Starting async job submit for node 69cf1aaf9e2394c38fe01fc9 2026-04-05 01:41:13,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:41:13,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1aaf9e2394c38fe01fc9 HTTP/1.1" 200 None 2026-04-05 01:41:13,485 - lava_callback - DEBUG - Processing node 69cf1aaf9e2394c38fe01fc9: baseline-arm-baylibre 2026-04-05 01:41:13,485 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf1aaf9e2394c38fe01fc9 2026-04-05 01:41:13,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:41:13,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1aaf9e2394c38fe01fc9 HTTP/1.1" 200 None 2026-04-05 01:41:13,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:41:13,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-05 01:41:13,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:41:13,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf1aaf9e2394c38fe01fc9 HTTP/1.1" 200 None 2026-04-05 01:41:13,544 - lava_callback - ERROR - Error processing callback for node 69cf1aaf9e2394c38fe01fc9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40130 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:41:40,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:41:40,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49550 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:41:53,442 - lava_callback - INFO - Received callback for node 69cf1ad79e2394c38fe01fdf INFO: 172.21.0.1:37332 - "POST /node/69cf1ad79e2394c38fe01fdf HTTP/1.0" 202 Accepted 2026-04-05 01:41:53,448 - lava_callback - INFO - Starting async job submit for node 69cf1ad79e2394c38fe01fdf 2026-04-05 01:41:53,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:41:53,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1ad79e2394c38fe01fdf HTTP/1.1" 200 None 2026-04-05 01:41:53,463 - lava_callback - DEBUG - Processing node 69cf1ad79e2394c38fe01fdf: baseline-arm-baylibre 2026-04-05 01:41:53,463 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf1ad79e2394c38fe01fdf 2026-04-05 01:41:53,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:41:53,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1ad79e2394c38fe01fdf HTTP/1.1" 200 None 2026-04-05 01:41:53,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:41:53,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-05 01:41:53,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:41:53,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf1ad79e2394c38fe01fdf HTTP/1.1" 200 None 2026-04-05 01:41:53,520 - lava_callback - ERROR - Error processing callback for node 69cf1ad79e2394c38fe01fdf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41054 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:43:03,315 - lava_callback - INFO - Received callback for node 69cf1b209e2394c38fe02022 INFO: 172.21.0.1:44260 - "POST /node/69cf1b209e2394c38fe02022 HTTP/1.0" 202 Accepted 2026-04-05 01:43:03,320 - lava_callback - INFO - Starting async job submit for node 69cf1b209e2394c38fe02022 2026-04-05 01:43:03,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:43:03,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1b209e2394c38fe02022 HTTP/1.1" 200 None 2026-04-05 01:43:03,342 - lava_callback - DEBUG - Processing node 69cf1b209e2394c38fe02022: baseline-arm-clabbe 2026-04-05 01:43:03,342 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf1b209e2394c38fe02022 2026-04-05 01:43:03,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:43:03,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1b209e2394c38fe02022 HTTP/1.1" 200 None 2026-04-05 01:43:03,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:43:03,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-05 01:43:03,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:43:03,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf1b209e2394c38fe02022 HTTP/1.1" 200 None 2026-04-05 01:43:03,397 - lava_callback - ERROR - Error processing callback for node 69cf1b209e2394c38fe02022: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54860 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:44:40,562 - lava_callback - INFO - Received callback for node 69d1bcb7aa48d6fae7bb1899 INFO: 172.21.0.1:58314 - "POST /node/69d1bcb7aa48d6fae7bb1899 HTTP/1.0" 202 Accepted 2026-04-05 01:44:40,570 - lava_callback - INFO - Starting async job submit for node 69d1bcb7aa48d6fae7bb1899 2026-04-05 01:44:40,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:44:40,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bcb7aa48d6fae7bb1899 HTTP/1.1" 200 None 2026-04-05 01:44:40,624 - lava_callback - DEBUG - Processing node 69d1bcb7aa48d6fae7bb1899: baseline-arm64 2026-04-05 01:44:41,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:44:41,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:44:41,168 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1bcb7aa48d6fae7bb1899/log.txt.gz 2026-04-05 01:44:41,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:44:41,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:44:41,595 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1bcb7aa48d6fae7bb1899/lava-logs.yaml 2026-04-05 01:44:41,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:44:41,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:44:41,766 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1bcb7aa48d6fae7bb1899/lava_callback.json.gz DEBUG: Setup failed for 69d1bcb7aa48d6fae7bb1899. Transitting job node result: incomplete -> fail 2026-04-05 01:44:41,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:44:41,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bcb7aa48d6fae7bb1899 HTTP/1.1" 200 None 2026-04-05 01:44:41,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:44:41,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:44:41,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:44:41,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1bcb7aa48d6fae7bb1899 HTTP/1.1" 200 None 2026-04-05 01:44:41,982 - lava_callback - INFO - Completed processing callback for node 69d1bcb7aa48d6fae7bb1899 INFO: 172.21.0.1:58328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53348 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:45:10,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:45:10,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48978 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:45:29,429 - lava_callback - INFO - Received callback for node 69d1bae1aa48d6fae7bb1712 INFO: 172.21.0.1:48992 - "POST /node/69d1bae1aa48d6fae7bb1712 HTTP/1.0" 202 Accepted 2026-04-05 01:45:29,436 - lava_callback - INFO - Starting async job submit for node 69d1bae1aa48d6fae7bb1712 2026-04-05 01:45:29,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:45:29,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bae1aa48d6fae7bb1712 HTTP/1.1" 200 None 2026-04-05 01:45:29,514 - lava_callback - DEBUG - Processing node 69d1bae1aa48d6fae7bb1712: baseline-arm 2026-04-05 01:45:30,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:45:30,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:45:30,213 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d1bae1aa48d6fae7bb1712/log.txt.gz 2026-04-05 01:45:30,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:45:30,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:45:30,834 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d1bae1aa48d6fae7bb1712/lava-logs.yaml 2026-04-05 01:45:30,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:45:31,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:45:31,069 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d1bae1aa48d6fae7bb1712/lava_callback.json.gz DEBUG: Setup failed for 69d1bae1aa48d6fae7bb1712. Transitting job node result: incomplete -> fail 2026-04-05 01:45:31,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:45:31,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bae1aa48d6fae7bb1712 HTTP/1.1" 200 None 2026-04-05 01:45:31,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:45:31,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 01:45:31,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:45:31,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1bae1aa48d6fae7bb1712 HTTP/1.1" 200 None 2026-04-05 01:45:31,400 - lava_callback - INFO - Completed processing callback for node 69d1bae1aa48d6fae7bb1712 INFO: 172.21.0.1:60624 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:45:40,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:45:40,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43028 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:46:12,219 - lava_callback - INFO - Received callback for node 69d1be4eaa48d6fae7bb1a17 INFO: 172.21.0.1:41620 - "POST /node/69d1be4eaa48d6fae7bb1a17 HTTP/1.0" 202 Accepted 2026-04-05 01:46:12,225 - lava_callback - INFO - Starting async job submit for node 69d1be4eaa48d6fae7bb1a17 2026-04-05 01:46:12,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:46:12,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1be4eaa48d6fae7bb1a17 HTTP/1.1" 200 None 2026-04-05 01:46:12,265 - lava_callback - DEBUG - Processing node 69d1be4eaa48d6fae7bb1a17: baseline-arm64-broonie 2026-04-05 01:46:12,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:46:12,639 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:46:12,641 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1be4eaa48d6fae7bb1a17/log.txt.gz 2026-04-05 01:46:12,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:46:12,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:46:13,000 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1be4eaa48d6fae7bb1a17/lava-logs.yaml 2026-04-05 01:46:13,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:46:13,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:46:13,182 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1be4eaa48d6fae7bb1a17/lava_callback.json.gz 2026-04-05 01:46:13,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:46:13,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1be4eaa48d6fae7bb1a17 HTTP/1.1" 200 None 2026-04-05 01:46:13,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:46:13,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:46:13,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:46:13,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1be4eaa48d6fae7bb1a17 HTTP/1.1" 200 None 2026-04-05 01:46:13,280 - lava_callback - INFO - Completed processing callback for node 69d1be4eaa48d6fae7bb1a17 INFO: 172.21.0.1:41632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47830 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:46:33,750 - lava_callback - INFO - Received callback for node 69cf1bf69e2394c38fe020ff INFO: 172.21.0.1:57386 - "POST /node/69cf1bf69e2394c38fe020ff HTTP/1.0" 202 Accepted 2026-04-05 01:46:33,759 - lava_callback - INFO - Starting async job submit for node 69cf1bf69e2394c38fe020ff 2026-04-05 01:46:33,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:46:33,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1bf69e2394c38fe020ff HTTP/1.1" 200 None 2026-04-05 01:46:33,776 - lava_callback - DEBUG - Processing node 69cf1bf69e2394c38fe020ff: baseline-arm-baylibre 2026-04-05 01:46:33,776 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf1bf69e2394c38fe020ff 2026-04-05 01:46:33,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:46:33,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1bf69e2394c38fe020ff HTTP/1.1" 200 None 2026-04-05 01:46:33,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:46:33,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-05 01:46:33,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:46:33,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf1bf69e2394c38fe020ff HTTP/1.1" 200 None 2026-04-05 01:46:33,839 - lava_callback - ERROR - Error processing callback for node 69cf1bf69e2394c38fe020ff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57392 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:46:40,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:46:40,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51440 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:47:13,745 - lava_callback - INFO - Received callback for node 69cf1c1a9e2394c38fe0211a INFO: 172.21.0.1:52776 - "POST /node/69cf1c1a9e2394c38fe0211a HTTP/1.0" 202 Accepted 2026-04-05 01:47:13,751 - lava_callback - INFO - Starting async job submit for node 69cf1c1a9e2394c38fe0211a 2026-04-05 01:47:13,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:47:13,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1c1a9e2394c38fe0211a HTTP/1.1" 200 None 2026-04-05 01:47:13,767 - lava_callback - DEBUG - Processing node 69cf1c1a9e2394c38fe0211a: baseline-arm-baylibre 2026-04-05 01:47:13,767 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf1c1a9e2394c38fe0211a 2026-04-05 01:47:13,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:47:13,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1c1a9e2394c38fe0211a HTTP/1.1" 200 None 2026-04-05 01:47:13,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:47:13,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-05 01:47:13,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:47:13,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf1c1a9e2394c38fe0211a HTTP/1.1" 200 None 2026-04-05 01:47:13,826 - lava_callback - ERROR - Error processing callback for node 69cf1c1a9e2394c38fe0211a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50124 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:47:53,904 - lava_callback - INFO - Received callback for node 69cf1c439e2394c38fe0213b INFO: 172.21.0.1:44650 - "POST /node/69cf1c439e2394c38fe0213b HTTP/1.0" 202 Accepted 2026-04-05 01:47:53,912 - lava_callback - INFO - Starting async job submit for node 69cf1c439e2394c38fe0213b 2026-04-05 01:47:53,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:47:53,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1c439e2394c38fe0213b HTTP/1.1" 200 None 2026-04-05 01:47:53,935 - lava_callback - DEBUG - Processing node 69cf1c439e2394c38fe0213b: baseline-arm64-baylibre 2026-04-05 01:47:53,936 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf1c439e2394c38fe0213b 2026-04-05 01:47:53,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:47:53,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1c439e2394c38fe0213b HTTP/1.1" 200 None 2026-04-05 01:47:53,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:47:53,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 01:47:53,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:47:54,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf1c439e2394c38fe0213b HTTP/1.1" 200 None 2026-04-05 01:47:54,015 - lava_callback - ERROR - Error processing callback for node 69cf1c439e2394c38fe0213b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58804 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:49:13,877 - lava_callback - INFO - Received callback for node 69cf1c8e9e2394c38fe02187 INFO: 172.21.0.1:32964 - "POST /node/69cf1c8e9e2394c38fe02187 HTTP/1.0" 202 Accepted 2026-04-05 01:49:13,883 - lava_callback - INFO - Starting async job submit for node 69cf1c8e9e2394c38fe02187 2026-04-05 01:49:13,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:49:13,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1c8e9e2394c38fe02187 HTTP/1.1" 200 None 2026-04-05 01:49:13,900 - lava_callback - DEBUG - Processing node 69cf1c8e9e2394c38fe02187: baseline-arm64-baylibre 2026-04-05 01:49:13,900 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf1c8e9e2394c38fe02187 2026-04-05 01:49:13,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:49:13,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1c8e9e2394c38fe02187 HTTP/1.1" 200 None 2026-04-05 01:49:13,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:49:13,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 01:49:13,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:49:13,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf1c8e9e2394c38fe02187 HTTP/1.1" 200 None 2026-04-05 01:49:13,953 - lava_callback - ERROR - Error processing callback for node 69cf1c8e9e2394c38fe02187: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55644 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:49:49,161 - lava_callback - INFO - Received callback for node 69d1bd1eaa48d6fae7bb18ef INFO: 172.21.0.1:55650 - "POST /node/69d1bd1eaa48d6fae7bb18ef HTTP/1.0" 202 Accepted 2026-04-05 01:49:49,168 - lava_callback - INFO - Starting async job submit for node 69d1bd1eaa48d6fae7bb18ef 2026-04-05 01:49:49,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:49:49,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bd1eaa48d6fae7bb18ef HTTP/1.1" 200 None 2026-04-05 01:49:49,218 - lava_callback - DEBUG - Processing node 69d1bd1eaa48d6fae7bb18ef: baseline-nfs-arm64 2026-04-05 01:49:49,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:49:49,948 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:49:49,950 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1bd1eaa48d6fae7bb18ef/log.txt.gz 2026-04-05 01:49:50,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:49:50,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:49:50,517 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1bd1eaa48d6fae7bb18ef/lava-logs.yaml 2026-04-05 01:49:50,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:49:50,718 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:49:50,720 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1bd1eaa48d6fae7bb18ef/lava_callback.json.gz 2026-04-05 01:49:50,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:49:50,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bd1eaa48d6fae7bb18ef HTTP/1.1" 200 None 2026-04-05 01:49:50,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:49:50,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:49:50,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:49:50,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1bd1eaa48d6fae7bb18ef HTTP/1.1" 200 None 2026-04-05 01:49:50,874 - lava_callback - INFO - Completed processing callback for node 69d1bd1eaa48d6fae7bb18ef INFO: 172.21.0.1:44496 - "GET /node/693e7f453c8f1be6d3cf198e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:44498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36812 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:50:10,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:50:10,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54488 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:50:21,283 - lava_callback - INFO - Received callback for node 69d1bd56aa48d6fae7bb1948 INFO: 172.21.0.1:50458 - "POST /node/69d1bd56aa48d6fae7bb1948 HTTP/1.0" 202 Accepted 2026-04-05 01:50:21,290 - lava_callback - INFO - Starting async job submit for node 69d1bd56aa48d6fae7bb1948 2026-04-05 01:50:21,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:50:21,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bd56aa48d6fae7bb1948 HTTP/1.1" 200 None 2026-04-05 01:50:21,342 - lava_callback - DEBUG - Processing node 69d1bd56aa48d6fae7bb1948: baseline-arm64 2026-04-05 01:50:21,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:50:22,109 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:50:22,111 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1bd56aa48d6fae7bb1948/log.txt.gz 2026-04-05 01:50:22,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:50:22,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:50:22,614 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1bd56aa48d6fae7bb1948/lava-logs.yaml 2026-04-05 01:50:22,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:50:22,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:50:22,777 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1bd56aa48d6fae7bb1948/lava_callback.json.gz 2026-04-05 01:50:22,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:50:22,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bd56aa48d6fae7bb1948 HTTP/1.1" 200 None 2026-04-05 01:50:22,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:50:22,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:50:22,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:50:22,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1bd56aa48d6fae7bb1948 HTTP/1.1" 200 None 2026-04-05 01:50:22,915 - lava_callback - INFO - Completed processing callback for node 69d1bd56aa48d6fae7bb1948 INFO: 172.21.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50484 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:50:34,008 - lava_callback - INFO - Received callback for node 69cf1cd79e2394c38fe021bf INFO: 172.21.0.1:39050 - "POST /node/69cf1cd79e2394c38fe021bf HTTP/1.0" 202 Accepted 2026-04-05 01:50:34,014 - lava_callback - INFO - Starting async job submit for node 69cf1cd79e2394c38fe021bf 2026-04-05 01:50:34,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:50:34,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1cd79e2394c38fe021bf HTTP/1.1" 200 None 2026-04-05 01:50:34,032 - lava_callback - DEBUG - Processing node 69cf1cd79e2394c38fe021bf: baseline-arm64-baylibre 2026-04-05 01:50:34,032 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf1cd79e2394c38fe021bf 2026-04-05 01:50:34,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:50:34,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1cd79e2394c38fe021bf HTTP/1.1" 200 None 2026-04-05 01:50:34,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:50:34,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 01:50:34,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:50:34,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf1cd79e2394c38fe021bf HTTP/1.1" 200 None 2026-04-05 01:50:34,091 - lava_callback - ERROR - Error processing callback for node 69cf1cd79e2394c38fe021bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39064 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:50:40,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:50:40,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33894 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:51:33,998 - lava_callback - INFO - Received callback for node 69cf1d229e2394c38fe021f4 INFO: 172.21.0.1:49834 - "POST /node/69cf1d229e2394c38fe021f4 HTTP/1.0" 202 Accepted 2026-04-05 01:51:34,004 - lava_callback - INFO - Starting async job submit for node 69cf1d229e2394c38fe021f4 2026-04-05 01:51:34,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:51:34,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1d229e2394c38fe021f4 HTTP/1.1" 200 None 2026-04-05 01:51:34,020 - lava_callback - DEBUG - Processing node 69cf1d229e2394c38fe021f4: baseline-arm64-baylibre 2026-04-05 01:51:34,021 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf1d229e2394c38fe021f4 2026-04-05 01:51:34,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:51:34,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1d229e2394c38fe021f4 HTTP/1.1" 200 None 2026-04-05 01:51:34,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:51:34,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 01:51:34,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:51:34,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf1d229e2394c38fe021f4 HTTP/1.1" 200 None 2026-04-05 01:51:34,076 - lava_callback - ERROR - Error processing callback for node 69cf1d229e2394c38fe021f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54544 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:51:48,372 - lava_callback - INFO - Received callback for node 69d1bfe9aa48d6fae7bb1bab INFO: 172.21.0.1:54556 - "POST /node/69d1bfe9aa48d6fae7bb1bab HTTP/1.0" 202 Accepted 2026-04-05 01:51:48,379 - lava_callback - INFO - Starting async job submit for node 69d1bfe9aa48d6fae7bb1bab 2026-04-05 01:51:48,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:51:48,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bfe9aa48d6fae7bb1bab HTTP/1.1" 200 None 2026-04-05 01:51:48,455 - lava_callback - DEBUG - Processing node 69d1bfe9aa48d6fae7bb1bab: baseline-arm64 2026-04-05 01:51:48,623 - lava_callback - WARNING - Failed to upload log 2026-04-05 01:51:48,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:51:48,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:51:48,890 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1bfe9aa48d6fae7bb1bab/lava-logs.yaml 2026-04-05 01:51:48,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:51:49,048 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:51:49,050 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1bfe9aa48d6fae7bb1bab/lava_callback.json.gz 2026-04-05 01:51:49,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:51:49,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bfe9aa48d6fae7bb1bab HTTP/1.1" 200 None 2026-04-05 01:51:49,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:51:49,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:51:49,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:51:49,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1bfe9aa48d6fae7bb1bab HTTP/1.1" 200 None 2026-04-05 01:51:49,252 - lava_callback - INFO - Completed processing callback for node 69d1bfe9aa48d6fae7bb1bab INFO: 172.21.0.1:34456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41882 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:52:10,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:52:10,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40706 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:52:48,215 - lava_callback - INFO - Received callback for node 69d1c02eaa48d6fae7bb1bdc INFO: 172.21.0.1:40722 - "POST /node/69d1c02eaa48d6fae7bb1bdc HTTP/1.0" 202 Accepted 2026-04-05 01:52:48,222 - lava_callback - INFO - Starting async job submit for node 69d1c02eaa48d6fae7bb1bdc 2026-04-05 01:52:48,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:52:48,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c02eaa48d6fae7bb1bdc HTTP/1.1" 200 None 2026-04-05 01:52:48,270 - lava_callback - DEBUG - Processing node 69d1c02eaa48d6fae7bb1bdc: baseline-arm64 2026-04-05 01:52:48,489 - lava_callback - WARNING - Failed to upload log 2026-04-05 01:52:48,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:52:48,794 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:52:48,796 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1c02eaa48d6fae7bb1bdc/lava-logs.yaml 2026-04-05 01:52:48,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:52:48,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:52:48,921 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1c02eaa48d6fae7bb1bdc/lava_callback.json.gz 2026-04-05 01:52:48,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:52:48,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c02eaa48d6fae7bb1bdc HTTP/1.1" 200 None 2026-04-05 01:52:48,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:52:48,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:52:48,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:52:49,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c02eaa48d6fae7bb1bdc HTTP/1.1" 200 None 2026-04-05 01:52:49,084 - lava_callback - INFO - Completed processing callback for node 69d1c02eaa48d6fae7bb1bdc 2026-04-05 01:52:54,082 - lava_callback - INFO - Received callback for node 69cf1d6b9e2394c38fe0222d INFO: 172.21.0.1:49344 - "POST /node/69cf1d6b9e2394c38fe0222d HTTP/1.0" 202 Accepted 2026-04-05 01:52:54,088 - lava_callback - INFO - Starting async job submit for node 69cf1d6b9e2394c38fe0222d 2026-04-05 01:52:54,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:52:54,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1d6b9e2394c38fe0222d HTTP/1.1" 200 None 2026-04-05 01:52:54,105 - lava_callback - DEBUG - Processing node 69cf1d6b9e2394c38fe0222d: baseline-arm64-baylibre 2026-04-05 01:52:54,105 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf1d6b9e2394c38fe0222d 2026-04-05 01:52:54,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:52:54,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1d6b9e2394c38fe0222d HTTP/1.1" 200 None 2026-04-05 01:52:54,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:52:54,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 01:52:54,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:52:54,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf1d6b9e2394c38fe0222d HTTP/1.1" 200 None 2026-04-05 01:52:54,157 - lava_callback - ERROR - Error processing callback for node 69cf1d6b9e2394c38fe0222d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42854 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:53:10,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:53:10,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40458 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:54:03,949 - lava_callback - INFO - Received callback for node 69cf1db59e2394c38fe0226c INFO: 172.21.0.1:47122 - "POST /node/69cf1db59e2394c38fe0226c HTTP/1.0" 202 Accepted 2026-04-05 01:54:03,955 - lava_callback - INFO - Starting async job submit for node 69cf1db59e2394c38fe0226c 2026-04-05 01:54:03,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:54:03,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1db59e2394c38fe0226c HTTP/1.1" 200 None 2026-04-05 01:54:03,976 - lava_callback - DEBUG - Processing node 69cf1db59e2394c38fe0226c: baseline-arm64-clabbe 2026-04-05 01:54:03,976 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf1db59e2394c38fe0226c 2026-04-05 01:54:03,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:54:03,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1db59e2394c38fe0226c HTTP/1.1" 200 None 2026-04-05 01:54:03,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:54:04,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 01:54:04,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:54:04,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf1db59e2394c38fe0226c HTTP/1.1" 200 None 2026-04-05 01:54:04,040 - lava_callback - ERROR - Error processing callback for node 69cf1db59e2394c38fe0226c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47400 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:54:19,961 - lava_callback - INFO - Received callback for node 69d1c076aa48d6fae7bb1c01 INFO: 172.21.0.1:58344 - "POST /node/69d1c076aa48d6fae7bb1c01 HTTP/1.0" 202 Accepted 2026-04-05 01:54:19,970 - lava_callback - INFO - Starting async job submit for node 69d1c076aa48d6fae7bb1c01 2026-04-05 01:54:20,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:54:20,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c076aa48d6fae7bb1c01 HTTP/1.1" 200 None 2026-04-05 01:54:20,021 - lava_callback - DEBUG - Processing node 69d1c076aa48d6fae7bb1c01: baseline-arm64 2026-04-05 01:54:20,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:54:20,790 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:54:20,792 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1c076aa48d6fae7bb1c01/log.txt.gz 2026-04-05 01:54:21,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:54:21,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:54:21,521 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1c076aa48d6fae7bb1c01/lava-logs.yaml 2026-04-05 01:54:21,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:54:21,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:54:21,715 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1c076aa48d6fae7bb1c01/lava_callback.json.gz 2026-04-05 01:54:21,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:54:21,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c076aa48d6fae7bb1c01 HTTP/1.1" 200 None 2026-04-05 01:54:21,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:54:21,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:54:21,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:54:21,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c076aa48d6fae7bb1c01 HTTP/1.1" 200 None 2026-04-05 01:54:21,899 - lava_callback - INFO - Completed processing callback for node 69d1c076aa48d6fae7bb1c01 INFO: 172.21.0.1:58350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34032 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:54:40,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:54:40,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56936 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:55:24,209 - lava_callback - INFO - Received callback for node 69cf1df89e2394c38fe022d3 INFO: 172.21.0.1:55232 - "POST /node/69cf1df89e2394c38fe022d3 HTTP/1.0" 202 Accepted 2026-04-05 01:55:24,218 - lava_callback - INFO - Starting async job submit for node 69cf1df89e2394c38fe022d3 2026-04-05 01:55:24,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:55:24,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1df89e2394c38fe022d3 HTTP/1.1" 200 None 2026-04-05 01:55:24,246 - lava_callback - DEBUG - Processing node 69cf1df89e2394c38fe022d3: baseline-arm64-clabbe 2026-04-05 01:55:24,246 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf1df89e2394c38fe022d3 2026-04-05 01:55:24,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:55:24,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1df89e2394c38fe022d3 HTTP/1.1" 200 None 2026-04-05 01:55:24,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:55:24,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 01:55:24,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:55:24,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf1df89e2394c38fe022d3 HTTP/1.1" 200 None 2026-04-05 01:55:24,328 - lava_callback - ERROR - Error processing callback for node 69cf1df89e2394c38fe022d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55242 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:55:33,456 - lava_callback - INFO - Received callback for node 69d1c0fdaa48d6fae7bb1ca7 INFO: 172.21.0.1:34736 - "POST /node/69d1c0fdaa48d6fae7bb1ca7 HTTP/1.0" 202 Accepted 2026-04-05 01:55:33,462 - lava_callback - INFO - Starting async job submit for node 69d1c0fdaa48d6fae7bb1ca7 2026-04-05 01:55:33,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:55:33,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c0fdaa48d6fae7bb1ca7 HTTP/1.1" 200 None 2026-04-05 01:55:33,480 - lava_callback - DEBUG - Processing node 69d1c0fdaa48d6fae7bb1ca7: baseline-nfs-arm64 2026-04-05 01:55:33,481 - lava_callback - WARNING - Failed to upload log 2026-04-05 01:55:33,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:55:33,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:55:33,615 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1c0fdaa48d6fae7bb1ca7/lava-logs.yaml 2026-04-05 01:55:33,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:55:33,741 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:55:33,743 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1c0fdaa48d6fae7bb1ca7/lava_callback.json.gz 2026-04-05 01:55:33,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:55:33,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c0fdaa48d6fae7bb1ca7 HTTP/1.1" 200 None 2026-04-05 01:55:33,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:55:33,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:55:33,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:55:33,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c0fdaa48d6fae7bb1ca7 HTTP/1.1" 200 None 2026-04-05 01:55:33,823 - lava_callback - INFO - Completed processing callback for node 69d1c0fdaa48d6fae7bb1ca7 INFO: 172.21.0.1:34738 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:55:37,809 - lava_callback - INFO - Received callback for node 69d1c0ccaa48d6fae7bb1c51 INFO: 172.21.0.1:34750 - "POST /node/69d1c0ccaa48d6fae7bb1c51 HTTP/1.0" 202 Accepted 2026-04-05 01:55:37,818 - lava_callback - INFO - Starting async job submit for node 69d1c0ccaa48d6fae7bb1c51 2026-04-05 01:55:37,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:55:37,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c0ccaa48d6fae7bb1c51 HTTP/1.1" 200 None 2026-04-05 01:55:37,884 - lava_callback - DEBUG - Processing node 69d1c0ccaa48d6fae7bb1c51: baseline-arm64-foundriesio 2026-04-05 01:55:38,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:55:38,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:55:38,581 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d1c0ccaa48d6fae7bb1c51/log.txt.gz 2026-04-05 01:55:38,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:55:39,087 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:55:39,089 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d1c0ccaa48d6fae7bb1c51/lava-logs.yaml 2026-04-05 01:55:39,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 01:55:39,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 01:55:39,277 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69d1c0ccaa48d6fae7bb1c51/lava_callback.json.gz 2026-04-05 01:55:39,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:55:39,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c0ccaa48d6fae7bb1c51 HTTP/1.1" 200 None 2026-04-05 01:55:39,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:55:39,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 01:55:39,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:55:39,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c0ccaa48d6fae7bb1c51 HTTP/1.1" 200 None 2026-04-05 01:55:39,361 - lava_callback - INFO - Completed processing callback for node 69d1c0ccaa48d6fae7bb1c51 2026-04-05 01:55:40,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:55:40,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37684 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:56:23,985 - lava_callback - INFO - Received callback for node 69cf1e449e2394c38fe02302 INFO: 172.21.0.1:44350 - "POST /node/69cf1e449e2394c38fe02302 HTTP/1.0" 202 Accepted 2026-04-05 01:56:23,991 - lava_callback - INFO - Starting async job submit for node 69cf1e449e2394c38fe02302 2026-04-05 01:56:23,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:56:24,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1e449e2394c38fe02302 HTTP/1.1" 200 None 2026-04-05 01:56:24,019 - lava_callback - DEBUG - Processing node 69cf1e449e2394c38fe02302: baseline-arm64-clabbe 2026-04-05 01:56:24,019 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf1e449e2394c38fe02302 2026-04-05 01:56:24,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:56:24,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1e449e2394c38fe02302 HTTP/1.1" 200 None 2026-04-05 01:56:24,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:56:24,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 01:56:24,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:56:24,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf1e449e2394c38fe02302 HTTP/1.1" 200 None 2026-04-05 01:56:24,084 - lava_callback - ERROR - Error processing callback for node 69cf1e449e2394c38fe02302: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54366 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:57:44,118 - lava_callback - INFO - Received callback for node 69cf1e8d9e2394c38fe02348 INFO: 172.21.0.1:38250 - "POST /node/69cf1e8d9e2394c38fe02348 HTTP/1.0" 202 Accepted 2026-04-05 01:57:44,127 - lava_callback - INFO - Starting async job submit for node 69cf1e8d9e2394c38fe02348 2026-04-05 01:57:44,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:57:44,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1e8d9e2394c38fe02348 HTTP/1.1" 200 None 2026-04-05 01:57:44,142 - lava_callback - DEBUG - Processing node 69cf1e8d9e2394c38fe02348: baseline-arm64-clabbe 2026-04-05 01:57:44,142 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf1e8d9e2394c38fe02348 2026-04-05 01:57:44,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:57:44,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1e8d9e2394c38fe02348 HTTP/1.1" 200 None 2026-04-05 01:57:44,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:57:44,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 01:57:44,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:57:44,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf1e8d9e2394c38fe02348 HTTP/1.1" 200 None 2026-04-05 01:57:44,228 - lava_callback - ERROR - Error processing callback for node 69cf1e8d9e2394c38fe02348: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46094 - "GET /node/694880329214b49387169859%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:36786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48390 - "GET / HTTP/1.0" 200 OK 2026-04-05 01:59:04,111 - lava_callback - INFO - Received callback for node 69cf1ed99e2394c38fe02368 INFO: 172.21.0.1:49876 - "POST /node/69cf1ed99e2394c38fe02368 HTTP/1.0" 202 Accepted 2026-04-05 01:59:04,118 - lava_callback - INFO - Starting async job submit for node 69cf1ed99e2394c38fe02368 2026-04-05 01:59:04,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:59:04,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1ed99e2394c38fe02368 HTTP/1.1" 200 None 2026-04-05 01:59:04,134 - lava_callback - DEBUG - Processing node 69cf1ed99e2394c38fe02368: baseline-arm64-clabbe 2026-04-05 01:59:04,134 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf1ed99e2394c38fe02368 2026-04-05 01:59:04,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:59:04,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1ed99e2394c38fe02368 HTTP/1.1" 200 None 2026-04-05 01:59:04,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:59:04,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 01:59:04,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 01:59:04,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf1ed99e2394c38fe02368 HTTP/1.1" 200 None 2026-04-05 01:59:04,203 - lava_callback - ERROR - Error processing callback for node 69cf1ed99e2394c38fe02368: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56598 - "GET /node/69861d61177ca0f097bd176a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56614 - "GET /node/698e2af7952a14bf500e419c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43828 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:00:14,635 - lava_callback - INFO - Received callback for node 69d1c1cfaa48d6fae7bb1d63 INFO: 172.21.0.1:36694 - "POST /node/69d1c1cfaa48d6fae7bb1d63 HTTP/1.0" 202 Accepted 2026-04-05 02:00:14,642 - lava_callback - INFO - Starting async job submit for node 69d1c1cfaa48d6fae7bb1d63 2026-04-05 02:00:14,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:00:14,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c1cfaa48d6fae7bb1d63 HTTP/1.1" 200 None 2026-04-05 02:00:14,694 - lava_callback - DEBUG - Processing node 69d1c1cfaa48d6fae7bb1d63: baseline-arm64-broonie 2026-04-05 02:00:15,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:36710 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 02:00:15,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:00:15,167 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1c1cfaa48d6fae7bb1d63/log.txt.gz 2026-04-05 02:00:15,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:00:15,590 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:00:15,593 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1c1cfaa48d6fae7bb1d63/lava-logs.yaml 2026-04-05 02:00:15,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:00:15,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:00:15,771 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1c1cfaa48d6fae7bb1d63/lava_callback.json.gz 2026-04-05 02:00:15,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:00:15,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c1cfaa48d6fae7bb1d63 HTTP/1.1" 200 None 2026-04-05 02:00:15,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:00:15,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 02:00:15,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:00:15,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c1cfaa48d6fae7bb1d63 HTTP/1.1" 200 None 2026-04-05 02:00:15,877 - lava_callback - INFO - Completed processing callback for node 69d1c1cfaa48d6fae7bb1d63 INFO: 172.21.0.1:36720 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:00:24,498 - lava_callback - INFO - Received callback for node 69cf1f229e2394c38fe023ae INFO: 172.21.0.1:58060 - "POST /node/69cf1f229e2394c38fe023ae HTTP/1.0" 202 Accepted 2026-04-05 02:00:24,504 - lava_callback - INFO - Starting async job submit for node 69cf1f229e2394c38fe023ae 2026-04-05 02:00:24,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:00:24,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1f229e2394c38fe023ae HTTP/1.1" 200 None 2026-04-05 02:00:24,520 - lava_callback - DEBUG - Processing node 69cf1f229e2394c38fe023ae: baseline-arm64-clabbe 2026-04-05 02:00:24,520 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf1f229e2394c38fe023ae 2026-04-05 02:00:24,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:00:24,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1f229e2394c38fe023ae HTTP/1.1" 200 None 2026-04-05 02:00:24,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:00:24,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 02:00:24,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:00:24,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf1f229e2394c38fe023ae HTTP/1.1" 200 None 2026-04-05 02:00:24,574 - lava_callback - ERROR - Error processing callback for node 69cf1f229e2394c38fe023ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33232 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:00:40,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:00:40,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35106 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:01:24,251 - lava_callback - INFO - Received callback for node 69cf1f609e2394c38fe023e3 INFO: 172.21.0.1:37252 - "POST /node/69cf1f609e2394c38fe023e3 HTTP/1.0" 202 Accepted 2026-04-05 02:01:24,257 - lava_callback - INFO - Starting async job submit for node 69cf1f609e2394c38fe023e3 2026-04-05 02:01:24,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:01:24,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1f609e2394c38fe023e3 HTTP/1.1" 200 None 2026-04-05 02:01:24,273 - lava_callback - DEBUG - Processing node 69cf1f609e2394c38fe023e3: baseline-arm-clabbe 2026-04-05 02:01:24,273 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf1f609e2394c38fe023e3 2026-04-05 02:01:24,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:01:24,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1f609e2394c38fe023e3 HTTP/1.1" 200 None 2026-04-05 02:01:24,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:01:24,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-05 02:01:24,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:01:24,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf1f609e2394c38fe023e3 HTTP/1.1" 200 None 2026-04-05 02:01:24,328 - lava_callback - ERROR - Error processing callback for node 69cf1f609e2394c38fe023e3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52346 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:02:24,287 - lava_callback - INFO - Received callback for node 69cf1fa89e2394c38fe02421 INFO: 172.21.0.1:58924 - "POST /node/69cf1fa89e2394c38fe02421 HTTP/1.0" 202 Accepted 2026-04-05 02:02:24,293 - lava_callback - INFO - Starting async job submit for node 69cf1fa89e2394c38fe02421 2026-04-05 02:02:24,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:02:24,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1fa89e2394c38fe02421 HTTP/1.1" 200 None 2026-04-05 02:02:24,311 - lava_callback - DEBUG - Processing node 69cf1fa89e2394c38fe02421: baseline-arm-clabbe 2026-04-05 02:02:24,311 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf1fa89e2394c38fe02421 2026-04-05 02:02:24,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:02:24,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1fa89e2394c38fe02421 HTTP/1.1" 200 None 2026-04-05 02:02:24,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:02:24,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-05 02:02:24,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:02:24,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf1fa89e2394c38fe02421 HTTP/1.1" 200 None 2026-04-05 02:02:24,374 - lava_callback - ERROR - Error processing callback for node 69cf1fa89e2394c38fe02421: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36592 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:02:53,829 - lava_callback - INFO - Received callback for node 69d1c17caa48d6fae7bb1d30 INFO: 172.21.0.1:51094 - "POST /node/69d1c17caa48d6fae7bb1d30 HTTP/1.0" 202 Accepted 2026-04-05 02:02:53,837 - lava_callback - INFO - Starting async job submit for node 69d1c17caa48d6fae7bb1d30 2026-04-05 02:02:53,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:02:53,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c17caa48d6fae7bb1d30 HTTP/1.1" 200 None 2026-04-05 02:02:53,896 - lava_callback - DEBUG - Processing node 69d1c17caa48d6fae7bb1d30: baseline-arm64 2026-04-05 02:02:54,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:02:54,466 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:02:54,468 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1c17caa48d6fae7bb1d30/log.txt.gz 2026-04-05 02:02:54,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:02:54,901 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:02:54,903 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1c17caa48d6fae7bb1d30/lava-logs.yaml 2026-04-05 02:02:54,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:02:55,066 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:02:55,068 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1c17caa48d6fae7bb1d30/lava_callback.json.gz DEBUG: Setup failed for 69d1c17caa48d6fae7bb1d30. Transitting job node result: incomplete -> fail 2026-04-05 02:02:55,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:02:55,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c17caa48d6fae7bb1d30 HTTP/1.1" 200 None 2026-04-05 02:02:55,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:02:55,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 02:02:55,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:02:55,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c17caa48d6fae7bb1d30 HTTP/1.1" 200 None 2026-04-05 02:02:55,296 - lava_callback - INFO - Completed processing callback for node 69d1c17caa48d6fae7bb1d30 INFO: 172.21.0.1:51100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53184 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:03:10,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:03:10,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51692 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:03:44,411 - lava_callback - INFO - Received callback for node 69cf1fec9e2394c38fe02455 INFO: 172.21.0.1:34132 - "POST /node/69cf1fec9e2394c38fe02455 HTTP/1.0" 202 Accepted 2026-04-05 02:03:44,417 - lava_callback - INFO - Starting async job submit for node 69cf1fec9e2394c38fe02455 2026-04-05 02:03:44,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:03:44,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1fec9e2394c38fe02455 HTTP/1.1" 200 None 2026-04-05 02:03:44,437 - lava_callback - DEBUG - Processing node 69cf1fec9e2394c38fe02455: baseline-arm-clabbe 2026-04-05 02:03:44,438 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf1fec9e2394c38fe02455 2026-04-05 02:03:44,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:03:44,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf1fec9e2394c38fe02455 HTTP/1.1" 200 None 2026-04-05 02:03:44,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:03:44,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-05 02:03:44,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:03:44,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf1fec9e2394c38fe02455 HTTP/1.1" 200 None 2026-04-05 02:03:44,509 - lava_callback - ERROR - Error processing callback for node 69cf1fec9e2394c38fe02455: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47778 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:04:04,401 - lava_callback - INFO - Received callback for node 69cf200e9e2394c38fe0247b INFO: 172.21.0.1:38122 - "POST /node/69cf200e9e2394c38fe0247b HTTP/1.0" 202 Accepted 2026-04-05 02:04:04,407 - lava_callback - INFO - Starting async job submit for node 69cf200e9e2394c38fe0247b 2026-04-05 02:04:04,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:04:04,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf200e9e2394c38fe0247b HTTP/1.1" 200 None 2026-04-05 02:04:04,422 - lava_callback - DEBUG - Processing node 69cf200e9e2394c38fe0247b: baseline-arm-clabbe 2026-04-05 02:04:04,423 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf200e9e2394c38fe0247b 2026-04-05 02:04:04,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:04:04,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf200e9e2394c38fe0247b HTTP/1.1" 200 None 2026-04-05 02:04:04,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:04:04,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-05 02:04:04,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:04:04,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf200e9e2394c38fe0247b HTTP/1.1" 200 None 2026-04-05 02:04:04,497 - lava_callback - ERROR - Error processing callback for node 69cf200e9e2394c38fe0247b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46850 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:04:32,947 - lava_callback - INFO - Received callback for node 69d1c2c6aa48d6fae7bb1df3 INFO: 172.21.0.1:38346 - "POST /node/69d1c2c6aa48d6fae7bb1df3 HTTP/1.0" 202 Accepted 2026-04-05 02:04:32,955 - lava_callback - INFO - Starting async job submit for node 69d1c2c6aa48d6fae7bb1df3 2026-04-05 02:04:32,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:04:33,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c2c6aa48d6fae7bb1df3 HTTP/1.1" 200 None 2026-04-05 02:04:33,012 - lava_callback - DEBUG - Processing node 69d1c2c6aa48d6fae7bb1df3: baseline-arm64-broonie 2026-04-05 02:04:33,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:04:33,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:04:33,479 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1c2c6aa48d6fae7bb1df3/log.txt.gz 2026-04-05 02:04:33,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:04:33,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:04:33,841 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1c2c6aa48d6fae7bb1df3/lava-logs.yaml 2026-04-05 02:04:33,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:04:33,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:04:33,988 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69d1c2c6aa48d6fae7bb1df3/lava_callback.json.gz 2026-04-05 02:04:34,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:04:34,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c2c6aa48d6fae7bb1df3 HTTP/1.1" 200 None 2026-04-05 02:04:34,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:04:34,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 02:04:34,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:04:34,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c2c6aa48d6fae7bb1df3 HTTP/1.1" 200 None 2026-04-05 02:04:34,071 - lava_callback - INFO - Completed processing callback for node 69d1c2c6aa48d6fae7bb1df3 INFO: 172.21.0.1:38360 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:04:40,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:04:40,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49860 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:07:22,141 - lava_callback - INFO - Received callback for node 69d1bf30aa48d6fae7bb1abe INFO: 172.21.0.1:39106 - "POST /node/69d1bf30aa48d6fae7bb1abe HTTP/1.0" 202 Accepted 2026-04-05 02:07:22,149 - lava_callback - INFO - Starting async job submit for node 69d1bf30aa48d6fae7bb1abe 2026-04-05 02:07:22,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:07:22,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bf30aa48d6fae7bb1abe HTTP/1.1" 200 None 2026-04-05 02:07:22,209 - lava_callback - DEBUG - Processing node 69d1bf30aa48d6fae7bb1abe: baseline-nfs-arm64 2026-04-05 02:07:23,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:07:23,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:07:23,569 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1bf30aa48d6fae7bb1abe/log.txt.gz 2026-04-05 02:07:24,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:07:24,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:07:24,573 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1bf30aa48d6fae7bb1abe/lava-logs.yaml 2026-04-05 02:07:24,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:07:24,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:07:24,778 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1bf30aa48d6fae7bb1abe/lava_callback.json.gz DEBUG: Setup failed for 69d1bf30aa48d6fae7bb1abe. Transitting job node result: incomplete -> fail 2026-04-05 02:07:24,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:07:24,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bf30aa48d6fae7bb1abe HTTP/1.1" 200 None 2026-04-05 02:07:24,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:07:24,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 02:07:24,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:07:24,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1bf30aa48d6fae7bb1abe HTTP/1.1" 200 None 2026-04-05 02:07:25,012 - lava_callback - INFO - Completed processing callback for node 69d1bf30aa48d6fae7bb1abe INFO: 172.21.0.1:39118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46692 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:07:40,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:07:40,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44956 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:08:13,272 - lava_callback - INFO - Received callback for node 69d1bfe7aa48d6fae7bb1ba8 INFO: 172.21.0.1:59220 - "POST /node/69d1bfe7aa48d6fae7bb1ba8 HTTP/1.0" 202 Accepted 2026-04-05 02:08:13,280 - lava_callback - INFO - Starting async job submit for node 69d1bfe7aa48d6fae7bb1ba8 2026-04-05 02:08:13,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:08:13,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bfe7aa48d6fae7bb1ba8 HTTP/1.1" 200 None 2026-04-05 02:08:13,423 - lava_callback - DEBUG - Processing node 69d1bfe7aa48d6fae7bb1ba8: ltp-smoke 2026-04-05 02:08:14,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:08:14,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:08:14,281 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69d1bfe7aa48d6fae7bb1ba8/log.txt.gz 2026-04-05 02:08:14,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:08:14,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:08:14,776 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69d1bfe7aa48d6fae7bb1ba8/lava-logs.yaml 2026-04-05 02:08:14,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:08:14,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:08:14,941 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69d1bfe7aa48d6fae7bb1ba8/lava_callback.json.gz 2026-04-05 02:08:15,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:08:15,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1bfe7aa48d6fae7bb1ba8 HTTP/1.1" 200 None 2026-04-05 02:08:15,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:08:15,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa27aa48d6fae7bb04bb HTTP/1.1" 200 None 2026-04-05 02:08:15,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:08:15,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1bfe7aa48d6fae7bb1ba8 HTTP/1.1" 200 None INFO: 172.21.0.1:59230 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 02:08:15,263 - lava_callback - INFO - Completed processing callback for node 69d1bfe7aa48d6fae7bb1ba8 INFO: 172.21.0.1:59234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56706 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:08:40,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:08:40,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48298 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:09:07,979 - lava_callback - INFO - Received callback for node 69d1c40daa48d6fae7bb1ec2 INFO: 172.21.0.1:48304 - "POST /node/69d1c40daa48d6fae7bb1ec2 HTTP/1.0" 202 Accepted 2026-04-05 02:09:07,986 - lava_callback - INFO - Starting async job submit for node 69d1c40daa48d6fae7bb1ec2 2026-04-05 02:09:08,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:09:08,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c40daa48d6fae7bb1ec2 HTTP/1.1" 200 None 2026-04-05 02:09:08,035 - lava_callback - DEBUG - Processing node 69d1c40daa48d6fae7bb1ec2: baseline-arm64 2026-04-05 02:09:08,195 - lava_callback - WARNING - Failed to upload log 2026-04-05 02:09:08,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:09:08,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:09:08,488 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1c40daa48d6fae7bb1ec2/lava-logs.yaml 2026-04-05 02:09:08,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:09:08,644 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:09:08,646 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1c40daa48d6fae7bb1ec2/lava_callback.json.gz 2026-04-05 02:09:08,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:09:08,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c40daa48d6fae7bb1ec2 HTTP/1.1" 200 None 2026-04-05 02:09:08,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:09:08,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 02:09:08,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:09:08,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c40daa48d6fae7bb1ec2 HTTP/1.1" 200 None 2026-04-05 02:09:08,845 - lava_callback - INFO - Completed processing callback for node 69d1c40daa48d6fae7bb1ec2 2026-04-05 02:09:10,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:09:10,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40970 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:09:35,060 - lava_callback - INFO - Received callback for node 69cf214f9e2394c38fe025a8 INFO: 172.21.0.1:49256 - "POST /node/69cf214f9e2394c38fe025a8 HTTP/1.0" 202 Accepted 2026-04-05 02:09:35,065 - lava_callback - INFO - Starting async job submit for node 69cf214f9e2394c38fe025a8 2026-04-05 02:09:35,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:09:35,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf214f9e2394c38fe025a8 HTTP/1.1" 200 None 2026-04-05 02:09:35,082 - lava_callback - DEBUG - Processing node 69cf214f9e2394c38fe025a8: baseline-arm64-baylibre 2026-04-05 02:09:35,082 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf214f9e2394c38fe025a8 2026-04-05 02:09:35,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:09:35,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf214f9e2394c38fe025a8 HTTP/1.1" 200 None 2026-04-05 02:09:35,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:09:35,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 02:09:35,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:09:35,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf214f9e2394c38fe025a8 HTTP/1.1" 200 None 2026-04-05 02:09:35,140 - lava_callback - ERROR - Error processing callback for node 69cf214f9e2394c38fe025a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33308 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:10:28,521 - lava_callback - INFO - Received callback for node 69d1c455aa48d6fae7bb1ef9 INFO: 172.21.0.1:33324 - "POST /node/69d1c455aa48d6fae7bb1ef9 HTTP/1.0" 202 Accepted 2026-04-05 02:10:28,528 - lava_callback - INFO - Starting async job submit for node 69d1c455aa48d6fae7bb1ef9 2026-04-05 02:10:28,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:10:28,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c455aa48d6fae7bb1ef9 HTTP/1.1" 200 None 2026-04-05 02:10:28,573 - lava_callback - DEBUG - Processing node 69d1c455aa48d6fae7bb1ef9: baseline-arm64 2026-04-05 02:10:28,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:10:28,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:10:28,868 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1c455aa48d6fae7bb1ef9/log.txt.gz INFO: 172.21.0.1:33330 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:10:28,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:10:29,123 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:10:29,125 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1c455aa48d6fae7bb1ef9/lava-logs.yaml 2026-04-05 02:10:29,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:10:29,250 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:10:29,252 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1c455aa48d6fae7bb1ef9/lava_callback.json.gz 2026-04-05 02:10:29,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:10:29,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c455aa48d6fae7bb1ef9 HTTP/1.1" 200 None 2026-04-05 02:10:29,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:10:29,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 02:10:29,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:10:29,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c455aa48d6fae7bb1ef9 HTTP/1.1" 200 None 2026-04-05 02:10:29,421 - lava_callback - INFO - Completed processing callback for node 69d1c455aa48d6fae7bb1ef9 INFO: 172.21.0.1:42116 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:10:40,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:10:40,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51494 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:11:55,149 - lava_callback - INFO - Received callback for node 69cf21e39e2394c38fe02628 INFO: 172.21.0.1:56796 - "POST /node/69cf21e39e2394c38fe02628 HTTP/1.0" 202 Accepted 2026-04-05 02:11:55,156 - lava_callback - INFO - Starting async job submit for node 69cf21e39e2394c38fe02628 2026-04-05 02:11:55,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:11:55,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf21e39e2394c38fe02628 HTTP/1.1" 200 None 2026-04-05 02:11:55,179 - lava_callback - DEBUG - Processing node 69cf21e39e2394c38fe02628: baseline-arm64-baylibre 2026-04-05 02:11:55,179 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf21e39e2394c38fe02628 2026-04-05 02:11:55,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:11:55,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf21e39e2394c38fe02628 HTTP/1.1" 200 None 2026-04-05 02:11:55,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:11:55,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 02:11:55,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:11:55,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf21e39e2394c38fe02628 HTTP/1.1" 200 None 2026-04-05 02:11:55,236 - lava_callback - ERROR - Error processing callback for node 69cf21e39e2394c38fe02628: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43854 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 02:13:15,211 - lava_callback - INFO - Received callback for node 69cf22299e2394c38fe02664 INFO: 172.21.0.1:43864 - "POST /node/69cf22299e2394c38fe02664 HTTP/1.0" 202 Accepted 2026-04-05 02:13:15,217 - lava_callback - INFO - Starting async job submit for node 69cf22299e2394c38fe02664 2026-04-05 02:13:15,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:13:15,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf22299e2394c38fe02664 HTTP/1.1" 200 None 2026-04-05 02:13:15,234 - lava_callback - DEBUG - Processing node 69cf22299e2394c38fe02664: baseline-arm64-baylibre 2026-04-05 02:13:15,235 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf22299e2394c38fe02664 2026-04-05 02:13:15,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:13:15,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf22299e2394c38fe02664 HTTP/1.1" 200 None 2026-04-05 02:13:15,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:13:15,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 02:13:15,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:13:15,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf22299e2394c38fe02664 HTTP/1.1" 200 None 2026-04-05 02:13:15,295 - lava_callback - ERROR - Error processing callback for node 69cf22299e2394c38fe02664: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50048 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:14:26,320 - lava_callback - INFO - Received callback for node 69d1c304aa48d6fae7bb1e00 INFO: 172.21.0.1:44448 - "POST /node/69d1c304aa48d6fae7bb1e00 HTTP/1.0" 202 Accepted 2026-04-05 02:14:26,327 - lava_callback - INFO - Starting async job submit for node 69d1c304aa48d6fae7bb1e00 2026-04-05 02:14:26,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:14:26,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c304aa48d6fae7bb1e00 HTTP/1.1" 200 None 2026-04-05 02:14:26,375 - lava_callback - DEBUG - Processing node 69d1c304aa48d6fae7bb1e00: baseline-nfs-arm64 INFO: 172.21.0.1:44452 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:14:26,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:14:27,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:14:27,054 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1c304aa48d6fae7bb1e00/log.txt.gz 2026-04-05 02:14:27,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:14:27,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:14:27,550 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1c304aa48d6fae7bb1e00/lava-logs.yaml 2026-04-05 02:14:27,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:14:27,763 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:14:27,766 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1c304aa48d6fae7bb1e00/lava_callback.json.gz 2026-04-05 02:14:27,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:14:27,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c304aa48d6fae7bb1e00 HTTP/1.1" 200 None 2026-04-05 02:14:27,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:14:27,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 02:14:27,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:14:27,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c304aa48d6fae7bb1e00 HTTP/1.1" 200 None 2026-04-05 02:14:27,926 - lava_callback - INFO - Completed processing callback for node 69d1c304aa48d6fae7bb1e00 INFO: 172.21.0.1:44460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46758 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:14:40,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:14:40,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-05 02:14:46,426 - lava_callback - INFO - Received callback for node 69d1c523aa48d6fae7bb1f9c INFO: 172.21.0.1:48238 - "POST /node/69d1c523aa48d6fae7bb1f9c HTTP/1.0" 202 Accepted 2026-04-05 02:14:46,433 - lava_callback - INFO - Starting async job submit for node 69d1c523aa48d6fae7bb1f9c 2026-04-05 02:14:46,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:14:46,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c523aa48d6fae7bb1f9c HTTP/1.1" 200 None 2026-04-05 02:14:46,477 - lava_callback - DEBUG - Processing node 69d1c523aa48d6fae7bb1f9c: baseline-arm64 INFO: 172.21.0.1:48244 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:14:46,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:14:47,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:14:47,112 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1c523aa48d6fae7bb1f9c/log.txt.gz 2026-04-05 02:14:47,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:14:47,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:14:47,573 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1c523aa48d6fae7bb1f9c/lava-logs.yaml 2026-04-05 02:14:47,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:14:47,741 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:14:47,743 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1c523aa48d6fae7bb1f9c/lava_callback.json.gz 2026-04-05 02:14:47,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:14:47,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c523aa48d6fae7bb1f9c HTTP/1.1" 200 None 2026-04-05 02:14:47,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:14:47,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 02:14:47,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:14:47,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c523aa48d6fae7bb1f9c HTTP/1.1" 200 None 2026-04-05 02:14:47,902 - lava_callback - INFO - Completed processing callback for node 69d1c523aa48d6fae7bb1f9c INFO: 172.21.0.1:40700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60492 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:15:10,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:15:10,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55848 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:15:29,558 - lava_callback - INFO - Received callback for node 69d1c341aa48d6fae7bb1e23 INFO: 172.21.0.1:55850 - "POST /node/69d1c341aa48d6fae7bb1e23 HTTP/1.0" 202 Accepted 2026-04-05 02:15:29,565 - lava_callback - INFO - Starting async job submit for node 69d1c341aa48d6fae7bb1e23 2026-04-05 02:15:29,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:15:29,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c341aa48d6fae7bb1e23 HTTP/1.1" 200 None 2026-04-05 02:15:29,605 - lava_callback - DEBUG - Processing node 69d1c341aa48d6fae7bb1e23: baseline-arm64 2026-04-05 02:15:30,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:15:30,322 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:15:30,324 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1c341aa48d6fae7bb1e23/log.txt.gz 2026-04-05 02:15:30,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:15:30,923 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:15:30,926 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1c341aa48d6fae7bb1e23/lava-logs.yaml 2026-04-05 02:15:30,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:15:31,134 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:15:31,136 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1c341aa48d6fae7bb1e23/lava_callback.json.gz 2026-04-05 02:15:31,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:15:31,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c341aa48d6fae7bb1e23 HTTP/1.1" 200 None 2026-04-05 02:15:31,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:15:31,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 02:15:31,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:15:31,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c341aa48d6fae7bb1e23 HTTP/1.1" 200 None 2026-04-05 02:15:31,281 - lava_callback - INFO - Completed processing callback for node 69d1c341aa48d6fae7bb1e23 INFO: 172.21.0.1:53892 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:15:40,158 - lava_callback - INFO - Received callback for node 69d1c205aa48d6fae7bb1d75 INFO: 172.21.0.1:33946 - "POST /node/69d1c205aa48d6fae7bb1d75 HTTP/1.0" 202 Accepted 2026-04-05 02:15:40,170 - lava_callback - INFO - Starting async job submit for node 69d1c205aa48d6fae7bb1d75 2026-04-05 02:15:40,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:15:40,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c205aa48d6fae7bb1d75 HTTP/1.1" 200 None 2026-04-05 02:15:40,274 - lava_callback - DEBUG - Processing node 69d1c205aa48d6fae7bb1d75: baseline-arm 2026-04-05 02:15:40,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:15:40,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-05 02:15:41,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:15:41,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:15:41,168 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d1c205aa48d6fae7bb1d75/log.txt.gz 2026-04-05 02:15:41,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:15:41,744 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:15:41,747 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d1c205aa48d6fae7bb1d75/lava-logs.yaml 2026-04-05 02:15:41,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:15:41,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:15:41,939 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d1c205aa48d6fae7bb1d75/lava_callback.json.gz DEBUG: Setup failed for 69d1c205aa48d6fae7bb1d75. Transitting job node result: incomplete -> fail 2026-04-05 02:15:42,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:15:42,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c205aa48d6fae7bb1d75 HTTP/1.1" 200 None 2026-04-05 02:15:42,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:15:42,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 02:15:42,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:15:42,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c205aa48d6fae7bb1d75 HTTP/1.1" 200 None 2026-04-05 02:15:42,210 - lava_callback - INFO - Completed processing callback for node 69d1c205aa48d6fae7bb1d75 INFO: 172.21.0.1:33948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49404 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:16:10,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:16:10,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34802 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 02:16:15,380 - lava_callback - INFO - Received callback for node 69cf22df9e2394c38fe026eb INFO: 172.21.0.1:34814 - "POST /node/69cf22df9e2394c38fe026eb HTTP/1.0" 202 Accepted 2026-04-05 02:16:15,385 - lava_callback - INFO - Starting async job submit for node 69cf22df9e2394c38fe026eb 2026-04-05 02:16:15,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:16:15,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf22df9e2394c38fe026eb HTTP/1.1" 200 None 2026-04-05 02:16:15,406 - lava_callback - DEBUG - Processing node 69cf22df9e2394c38fe026eb: baseline-arm64-baylibre 2026-04-05 02:16:15,406 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf22df9e2394c38fe026eb 2026-04-05 02:16:15,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:16:15,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf22df9e2394c38fe026eb HTTP/1.1" 200 None 2026-04-05 02:16:15,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:16:15,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 02:16:15,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:16:15,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf22df9e2394c38fe026eb HTTP/1.1" 200 None 2026-04-05 02:16:15,478 - lava_callback - ERROR - Error processing callback for node 69cf22df9e2394c38fe026eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45304 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:17:35,434 - lava_callback - INFO - Received callback for node 69cf232a9e2394c38fe0270e INFO: 172.21.0.1:44396 - "POST /node/69cf232a9e2394c38fe0270e HTTP/1.0" 202 Accepted 2026-04-05 02:17:35,441 - lava_callback - INFO - Starting async job submit for node 69cf232a9e2394c38fe0270e 2026-04-05 02:17:35,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:17:35,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf232a9e2394c38fe0270e HTTP/1.1" 200 None 2026-04-05 02:17:35,466 - lava_callback - DEBUG - Processing node 69cf232a9e2394c38fe0270e: baseline-arm64-baylibre 2026-04-05 02:17:35,466 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf232a9e2394c38fe0270e 2026-04-05 02:17:35,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:17:35,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf232a9e2394c38fe0270e HTTP/1.1" 200 None 2026-04-05 02:17:35,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:17:35,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 02:17:35,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:17:35,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf232a9e2394c38fe0270e HTTP/1.1" 200 None 2026-04-05 02:17:35,526 - lava_callback - ERROR - Error processing callback for node 69cf232a9e2394c38fe0270e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36244 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 02:20:15,651 - lava_callback - INFO - Received callback for node 69cf23dc9e2394c38fe027a1 INFO: 172.21.0.1:36248 - "POST /node/69cf23dc9e2394c38fe027a1 HTTP/1.0" 202 Accepted 2026-04-05 02:20:15,657 - lava_callback - INFO - Starting async job submit for node 69cf23dc9e2394c38fe027a1 2026-04-05 02:20:15,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:20:15,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf23dc9e2394c38fe027a1 HTTP/1.1" 200 None 2026-04-05 02:20:15,673 - lava_callback - DEBUG - Processing node 69cf23dc9e2394c38fe027a1: baseline-arm64-baylibre 2026-04-05 02:20:15,674 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf23dc9e2394c38fe027a1 2026-04-05 02:20:15,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:20:15,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf23dc9e2394c38fe027a1 HTTP/1.1" 200 None 2026-04-05 02:20:15,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:20:15,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 02:20:15,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:20:15,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf23dc9e2394c38fe027a1 HTTP/1.1" 200 None 2026-04-05 02:20:15,733 - lava_callback - ERROR - Error processing callback for node 69cf23dc9e2394c38fe027a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58164 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:21:45,222 - lava_callback - INFO - Received callback for node 69cf24259e2394c38fe027fa INFO: 172.21.0.1:36530 - "POST /node/69cf24259e2394c38fe027fa HTTP/1.0" 202 Accepted 2026-04-05 02:21:45,229 - lava_callback - INFO - Starting async job submit for node 69cf24259e2394c38fe027fa 2026-04-05 02:21:45,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:21:45,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf24259e2394c38fe027fa HTTP/1.1" 200 None 2026-04-05 02:21:45,245 - lava_callback - DEBUG - Processing node 69cf24259e2394c38fe027fa: baseline-arm64-clabbe 2026-04-05 02:21:45,245 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf24259e2394c38fe027fa 2026-04-05 02:21:45,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:21:45,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf24259e2394c38fe027fa HTTP/1.1" 200 None 2026-04-05 02:21:45,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:21:45,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 02:21:45,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:21:45,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf24259e2394c38fe027fa HTTP/1.1" 200 None 2026-04-05 02:21:45,296 - lava_callback - ERROR - Error processing callback for node 69cf24259e2394c38fe027fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36866 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:22:45,305 - lava_callback - INFO - Received callback for node 69cf246b9e2394c38fe02847 INFO: 172.21.0.1:39302 - "POST /node/69cf246b9e2394c38fe02847 HTTP/1.0" 202 Accepted 2026-04-05 02:22:45,311 - lava_callback - INFO - Starting async job submit for node 69cf246b9e2394c38fe02847 2026-04-05 02:22:45,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:22:45,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf246b9e2394c38fe02847 HTTP/1.1" 200 None 2026-04-05 02:22:45,327 - lava_callback - DEBUG - Processing node 69cf246b9e2394c38fe02847: baseline-arm64-clabbe 2026-04-05 02:22:45,328 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf246b9e2394c38fe02847 2026-04-05 02:22:45,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:22:45,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf246b9e2394c38fe02847 HTTP/1.1" 200 None 2026-04-05 02:22:45,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:22:45,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 02:22:45,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:22:45,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf246b9e2394c38fe02847 HTTP/1.1" 200 None 2026-04-05 02:22:45,383 - lava_callback - ERROR - Error processing callback for node 69cf246b9e2394c38fe02847: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59266 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:24:05,495 - lava_callback - INFO - Received callback for node 69cf24b59e2394c38fe02872 INFO: 172.21.0.1:36264 - "POST /node/69cf24b59e2394c38fe02872 HTTP/1.0" 202 Accepted 2026-04-05 02:24:05,504 - lava_callback - INFO - Starting async job submit for node 69cf24b59e2394c38fe02872 2026-04-05 02:24:05,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:24:05,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf24b59e2394c38fe02872 HTTP/1.1" 200 None 2026-04-05 02:24:05,526 - lava_callback - DEBUG - Processing node 69cf24b59e2394c38fe02872: baseline-arm64-clabbe 2026-04-05 02:24:05,526 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf24b59e2394c38fe02872 2026-04-05 02:24:05,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:24:05,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf24b59e2394c38fe02872 HTTP/1.1" 200 None 2026-04-05 02:24:05,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:24:05,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 02:24:05,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:24:05,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf24b59e2394c38fe02872 HTTP/1.1" 200 None 2026-04-05 02:24:05,592 - lava_callback - ERROR - Error processing callback for node 69cf24b59e2394c38fe02872: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47560 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:25:25,489 - lava_callback - INFO - Received callback for node 69cf25039e2394c38fe028ad INFO: 172.21.0.1:49986 - "POST /node/69cf25039e2394c38fe028ad HTTP/1.0" 202 Accepted 2026-04-05 02:25:25,495 - lava_callback - INFO - Starting async job submit for node 69cf25039e2394c38fe028ad 2026-04-05 02:25:25,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:25:25,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf25039e2394c38fe028ad HTTP/1.1" 200 None 2026-04-05 02:25:25,510 - lava_callback - DEBUG - Processing node 69cf25039e2394c38fe028ad: baseline-arm64-clabbe 2026-04-05 02:25:25,511 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf25039e2394c38fe028ad 2026-04-05 02:25:25,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:25:25,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf25039e2394c38fe028ad HTTP/1.1" 200 None 2026-04-05 02:25:25,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:25:25,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 02:25:25,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:25:25,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf25039e2394c38fe028ad HTTP/1.1" 200 None 2026-04-05 02:25:25,568 - lava_callback - ERROR - Error processing callback for node 69cf25039e2394c38fe028ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33270 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:26:25,453 - lava_callback - INFO - Received callback for node 69cf25499e2394c38fe028ed INFO: 172.21.0.1:43992 - "POST /node/69cf25499e2394c38fe028ed HTTP/1.0" 202 Accepted 2026-04-05 02:26:25,459 - lava_callback - INFO - Starting async job submit for node 69cf25499e2394c38fe028ed 2026-04-05 02:26:25,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:26:25,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf25499e2394c38fe028ed HTTP/1.1" 200 None 2026-04-05 02:26:25,476 - lava_callback - DEBUG - Processing node 69cf25499e2394c38fe028ed: baseline-arm64-clabbe 2026-04-05 02:26:25,477 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf25499e2394c38fe028ed 2026-04-05 02:26:25,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:26:25,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf25499e2394c38fe028ed HTTP/1.1" 200 None 2026-04-05 02:26:25,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:26:25,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 02:26:25,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:26:25,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf25499e2394c38fe028ed HTTP/1.1" 200 None 2026-04-05 02:26:25,542 - lava_callback - ERROR - Error processing callback for node 69cf25499e2394c38fe028ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37192 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:27:22,689 - lava_callback - INFO - Received callback for node 69d1c6d1aa48d6fae7bb207b INFO: 172.21.0.1:45720 - "POST /node/69d1c6d1aa48d6fae7bb207b HTTP/1.0" 202 Accepted 2026-04-05 02:27:22,697 - lava_callback - INFO - Starting async job submit for node 69d1c6d1aa48d6fae7bb207b 2026-04-05 02:27:22,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:27:22,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c6d1aa48d6fae7bb207b HTTP/1.1" 200 None 2026-04-05 02:27:22,767 - lava_callback - DEBUG - Processing node 69d1c6d1aa48d6fae7bb207b: baseline-arm64 2026-04-05 02:27:23,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:27:23,366 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:27:23,368 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1c6d1aa48d6fae7bb207b/log.txt.gz 2026-04-05 02:27:23,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:27:23,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:27:23,907 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1c6d1aa48d6fae7bb207b/lava-logs.yaml 2026-04-05 02:27:23,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:27:24,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:27:24,110 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1c6d1aa48d6fae7bb207b/lava_callback.json.gz DEBUG: Setup failed for 69d1c6d1aa48d6fae7bb207b. Transitting job node result: incomplete -> fail 2026-04-05 02:27:24,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:27:24,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c6d1aa48d6fae7bb207b HTTP/1.1" 200 None 2026-04-05 02:27:24,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:27:24,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 02:27:24,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:27:24,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c6d1aa48d6fae7bb207b HTTP/1.1" 200 None 2026-04-05 02:27:24,331 - lava_callback - INFO - Completed processing callback for node 69d1c6d1aa48d6fae7bb207b INFO: 172.21.0.1:45726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32882 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:27:40,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:27:40,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59262 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:28:45,625 - lava_callback - INFO - Received callback for node 69cf25d39e2394c38fe02975 INFO: 172.21.0.1:37484 - "POST /node/69cf25d39e2394c38fe02975 HTTP/1.0" 202 Accepted 2026-04-05 02:28:45,631 - lava_callback - INFO - Starting async job submit for node 69cf25d39e2394c38fe02975 2026-04-05 02:28:45,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:28:45,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf25d39e2394c38fe02975 HTTP/1.1" 200 None 2026-04-05 02:28:45,648 - lava_callback - DEBUG - Processing node 69cf25d39e2394c38fe02975: baseline-arm64-clabbe 2026-04-05 02:28:45,648 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf25d39e2394c38fe02975 2026-04-05 02:28:45,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:28:45,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf25d39e2394c38fe02975 HTTP/1.1" 200 None 2026-04-05 02:28:45,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:28:45,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 02:28:45,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:28:45,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf25d39e2394c38fe02975 HTTP/1.1" 200 None 2026-04-05 02:28:45,712 - lava_callback - ERROR - Error processing callback for node 69cf25d39e2394c38fe02975: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43432 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 02:32:16,238 - lava_callback - INFO - Received callback for node 69cf26a29e2394c38fe029f8 INFO: 172.21.0.1:43446 - "POST /node/69cf26a29e2394c38fe029f8 HTTP/1.0" 202 Accepted 2026-04-05 02:32:16,245 - lava_callback - INFO - Starting async job submit for node 69cf26a29e2394c38fe029f8 2026-04-05 02:32:16,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:32:16,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf26a29e2394c38fe029f8 HTTP/1.1" 200 None 2026-04-05 02:32:16,267 - lava_callback - DEBUG - Processing node 69cf26a29e2394c38fe029f8: baseline-arm64-baylibre 2026-04-05 02:32:16,267 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf26a29e2394c38fe029f8 2026-04-05 02:32:16,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:32:16,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf26a29e2394c38fe029f8 HTTP/1.1" 200 None 2026-04-05 02:32:16,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:32:16,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-05 02:32:16,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:32:16,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf26a29e2394c38fe029f8 HTTP/1.1" 200 None 2026-04-05 02:32:16,366 - lava_callback - ERROR - Error processing callback for node 69cf26a29e2394c38fe029f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46610 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:33:56,330 - lava_callback - INFO - Received callback for node 69cf27099e2394c38fe02a4e INFO: 172.21.0.1:46566 - "POST /node/69cf27099e2394c38fe02a4e HTTP/1.0" 202 Accepted 2026-04-05 02:33:56,335 - lava_callback - INFO - Starting async job submit for node 69cf27099e2394c38fe02a4e 2026-04-05 02:33:56,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:33:56,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf27099e2394c38fe02a4e HTTP/1.1" 200 None 2026-04-05 02:33:56,351 - lava_callback - DEBUG - Processing node 69cf27099e2394c38fe02a4e: baseline-arm64-baylibre 2026-04-05 02:33:56,352 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf27099e2394c38fe02a4e 2026-04-05 02:33:56,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:33:56,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf27099e2394c38fe02a4e HTTP/1.1" 200 None 2026-04-05 02:33:56,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:33:56,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-05 02:33:56,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:33:56,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf27099e2394c38fe02a4e HTTP/1.1" 200 None 2026-04-05 02:33:56,413 - lava_callback - ERROR - Error processing callback for node 69cf27099e2394c38fe02a4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43750 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:34:56,306 - lava_callback - INFO - Received callback for node 69cf274e9e2394c38fe02a99 INFO: 172.21.0.1:47612 - "POST /node/69cf274e9e2394c38fe02a99 HTTP/1.0" 202 Accepted 2026-04-05 02:34:56,311 - lava_callback - INFO - Starting async job submit for node 69cf274e9e2394c38fe02a99 2026-04-05 02:34:56,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:34:56,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf274e9e2394c38fe02a99 HTTP/1.1" 200 None 2026-04-05 02:34:56,330 - lava_callback - DEBUG - Processing node 69cf274e9e2394c38fe02a99: baseline-arm64-baylibre 2026-04-05 02:34:56,330 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf274e9e2394c38fe02a99 2026-04-05 02:34:56,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:34:56,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf274e9e2394c38fe02a99 HTTP/1.1" 200 None 2026-04-05 02:34:56,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:34:56,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-05 02:34:56,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:34:56,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf274e9e2394c38fe02a99 HTTP/1.1" 200 None 2026-04-05 02:34:56,394 - lava_callback - ERROR - Error processing callback for node 69cf274e9e2394c38fe02a99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35270 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:36:42,433 - lava_callback - INFO - Received callback for node 69d1c829aa48d6fae7bb2191 INFO: 172.21.0.1:44756 - "POST /node/69d1c829aa48d6fae7bb2191 HTTP/1.0" 202 Accepted 2026-04-05 02:36:42,442 - lava_callback - INFO - Starting async job submit for node 69d1c829aa48d6fae7bb2191 2026-04-05 02:36:42,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:36:42,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c829aa48d6fae7bb2191 HTTP/1.1" 200 None 2026-04-05 02:36:42,505 - lava_callback - DEBUG - Processing node 69d1c829aa48d6fae7bb2191: baseline-nfs-arm64 2026-04-05 02:36:43,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:36:43,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:36:43,337 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1c829aa48d6fae7bb2191/log.txt.gz 2026-04-05 02:36:43,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:36:43,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:36:43,802 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1c829aa48d6fae7bb2191/lava-logs.yaml 2026-04-05 02:36:43,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:36:43,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:36:43,982 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1c829aa48d6fae7bb2191/lava_callback.json.gz 2026-04-05 02:36:44,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:36:44,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c829aa48d6fae7bb2191 HTTP/1.1" 200 None 2026-04-05 02:36:44,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:36:44,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 02:36:44,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:36:44,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c829aa48d6fae7bb2191 HTTP/1.1" 200 None 2026-04-05 02:36:44,113 - lava_callback - INFO - Completed processing callback for node 69d1c829aa48d6fae7bb2191 2026-04-05 02:36:45,889 - lava_callback - INFO - Received callback for node 69d1c86baa48d6fae7bb21b3 INFO: 172.21.0.1:44764 - "POST /node/69d1c86baa48d6fae7bb21b3 HTTP/1.0" 202 Accepted 2026-04-05 02:36:45,896 - lava_callback - INFO - Starting async job submit for node 69d1c86baa48d6fae7bb21b3 2026-04-05 02:36:45,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:36:45,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c86baa48d6fae7bb21b3 HTTP/1.1" 200 None 2026-04-05 02:36:45,937 - lava_callback - DEBUG - Processing node 69d1c86baa48d6fae7bb21b3: baseline-arm64 2026-04-05 02:36:46,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:44778 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:36:46,582 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:36:46,584 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1c86baa48d6fae7bb21b3/log.txt.gz 2026-04-05 02:36:46,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:36:47,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:36:47,067 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1c86baa48d6fae7bb21b3/lava-logs.yaml 2026-04-05 02:36:47,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:36:47,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:36:47,270 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69d1c86baa48d6fae7bb21b3/lava_callback.json.gz 2026-04-05 02:36:47,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:36:47,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c86baa48d6fae7bb21b3 HTTP/1.1" 200 None 2026-04-05 02:36:47,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:36:47,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 02:36:47,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:36:47,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c86baa48d6fae7bb21b3 HTTP/1.1" 200 None 2026-04-05 02:36:47,417 - lava_callback - INFO - Completed processing callback for node 69d1c86baa48d6fae7bb21b3 INFO: 172.21.0.1:55944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49894 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:37:10,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:37:10,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52508 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 02:37:16,404 - lava_callback - INFO - Received callback for node 69cf27da9e2394c38fe02b2f INFO: 172.21.0.1:52522 - "POST /node/69cf27da9e2394c38fe02b2f HTTP/1.0" 202 Accepted 2026-04-05 02:37:16,410 - lava_callback - INFO - Starting async job submit for node 69cf27da9e2394c38fe02b2f 2026-04-05 02:37:16,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:37:16,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf27da9e2394c38fe02b2f HTTP/1.1" 200 None 2026-04-05 02:37:16,425 - lava_callback - DEBUG - Processing node 69cf27da9e2394c38fe02b2f: baseline-arm64-baylibre 2026-04-05 02:37:16,426 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf27da9e2394c38fe02b2f 2026-04-05 02:37:16,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:37:16,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf27da9e2394c38fe02b2f HTTP/1.1" 200 None 2026-04-05 02:37:16,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:37:16,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-05 02:37:16,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:37:16,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf27da9e2394c38fe02b2f HTTP/1.1" 200 None 2026-04-05 02:37:16,476 - lava_callback - ERROR - Error processing callback for node 69cf27da9e2394c38fe02b2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38998 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:39:36,782 - lava_callback - INFO - Received callback for node 69cf28679e2394c38fe02b99 INFO: 172.21.0.1:39002 - "POST /node/69cf28679e2394c38fe02b99 HTTP/1.0" 202 Accepted 2026-04-05 02:39:36,791 - lava_callback - INFO - Starting async job submit for node 69cf28679e2394c38fe02b99 2026-04-05 02:39:36,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:39:36,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf28679e2394c38fe02b99 HTTP/1.1" 200 None 2026-04-05 02:39:36,807 - lava_callback - DEBUG - Processing node 69cf28679e2394c38fe02b99: baseline-arm64-baylibre 2026-04-05 02:39:36,808 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf28679e2394c38fe02b99 2026-04-05 02:39:36,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:39:36,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf28679e2394c38fe02b99 HTTP/1.1" 200 None 2026-04-05 02:39:36,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:39:36,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-05 02:39:36,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:39:36,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf28679e2394c38fe02b99 HTTP/1.1" 200 None 2026-04-05 02:39:36,870 - lava_callback - ERROR - Error processing callback for node 69cf28679e2394c38fe02b99: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39292 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:40:57,023 - lava_callback - INFO - Received callback for node 69cf28ad9e2394c38fe02bcf INFO: 172.21.0.1:39304 - "POST /node/69cf28ad9e2394c38fe02bcf HTTP/1.0" 202 Accepted 2026-04-05 02:40:57,029 - lava_callback - INFO - Starting async job submit for node 69cf28ad9e2394c38fe02bcf 2026-04-05 02:40:57,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:40:57,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf28ad9e2394c38fe02bcf HTTP/1.1" 200 None 2026-04-05 02:40:57,044 - lava_callback - DEBUG - Processing node 69cf28ad9e2394c38fe02bcf: baseline-arm64-baylibre 2026-04-05 02:40:57,044 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf28ad9e2394c38fe02bcf 2026-04-05 02:40:57,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:40:57,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf28ad9e2394c38fe02bcf HTTP/1.1" 200 None 2026-04-05 02:40:57,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:40:57,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-05 02:40:57,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:40:57,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf28ad9e2394c38fe02bcf HTTP/1.1" 200 None 2026-04-05 02:40:57,111 - lava_callback - ERROR - Error processing callback for node 69cf28ad9e2394c38fe02bcf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43792 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:41:19,093 - lava_callback - INFO - Received callback for node 69d1c71baa48d6fae7bb2093 INFO: 172.21.0.1:43794 - "POST /node/69d1c71baa48d6fae7bb2093 HTTP/1.0" 202 Accepted 2026-04-05 02:41:19,101 - lava_callback - INFO - Starting async job submit for node 69d1c71baa48d6fae7bb2093 2026-04-05 02:41:19,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:41:19,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c71baa48d6fae7bb2093 HTTP/1.1" 200 None 2026-04-05 02:41:19,170 - lava_callback - DEBUG - Processing node 69d1c71baa48d6fae7bb2093: baseline-nfs-arm64 2026-04-05 02:41:20,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:41:20,744 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:41:20,746 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1c71baa48d6fae7bb2093/log.txt.gz 2026-04-05 02:41:21,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:41:21,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:41:21,640 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1c71baa48d6fae7bb2093/lava-logs.yaml 2026-04-05 02:41:21,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:41:21,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:41:21,855 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1c71baa48d6fae7bb2093/lava_callback.json.gz DEBUG: Setup failed for 69d1c71baa48d6fae7bb2093. Transitting job node result: incomplete -> fail 2026-04-05 02:41:21,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:41:21,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c71baa48d6fae7bb2093 HTTP/1.1" 200 None 2026-04-05 02:41:21,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:41:21,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 02:41:21,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:41:22,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c71baa48d6fae7bb2093 HTTP/1.1" 200 None 2026-04-05 02:41:22,101 - lava_callback - INFO - Completed processing callback for node 69d1c71baa48d6fae7bb2093 INFO: 172.21.0.1:40540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54324 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:41:40,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:41:40,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37614 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:43:06,335 - lava_callback - INFO - Received callback for node 69cf29369e2394c38fe02c6f INFO: 172.21.0.1:36494 - "POST /node/69cf29369e2394c38fe02c6f HTTP/1.0" 202 Accepted 2026-04-05 02:43:06,341 - lava_callback - INFO - Starting async job submit for node 69cf29369e2394c38fe02c6f 2026-04-05 02:43:06,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:43:06,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf29369e2394c38fe02c6f HTTP/1.1" 200 None 2026-04-05 02:43:06,357 - lava_callback - DEBUG - Processing node 69cf29369e2394c38fe02c6f: baseline-arm64-clabbe 2026-04-05 02:43:06,357 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf29369e2394c38fe02c6f 2026-04-05 02:43:06,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:43:06,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf29369e2394c38fe02c6f HTTP/1.1" 200 None 2026-04-05 02:43:06,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:43:06,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-05 02:43:06,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:43:06,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf29369e2394c38fe02c6f HTTP/1.1" 200 None 2026-04-05 02:43:06,416 - lava_callback - ERROR - Error processing callback for node 69cf29369e2394c38fe02c6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49566 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:44:26,402 - lava_callback - INFO - Received callback for node 69cf297b9e2394c38fe02c9a INFO: 172.21.0.1:53574 - "POST /node/69cf297b9e2394c38fe02c9a HTTP/1.0" 202 Accepted 2026-04-05 02:44:26,411 - lava_callback - INFO - Starting async job submit for node 69cf297b9e2394c38fe02c9a 2026-04-05 02:44:26,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:44:26,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf297b9e2394c38fe02c9a HTTP/1.1" 200 None 2026-04-05 02:44:26,429 - lava_callback - DEBUG - Processing node 69cf297b9e2394c38fe02c9a: baseline-arm64-clabbe 2026-04-05 02:44:26,429 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf297b9e2394c38fe02c9a 2026-04-05 02:44:26,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:44:26,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf297b9e2394c38fe02c9a HTTP/1.1" 200 None 2026-04-05 02:44:26,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:44:26,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-05 02:44:26,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:44:26,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf297b9e2394c38fe02c9a HTTP/1.1" 200 None 2026-04-05 02:44:26,487 - lava_callback - ERROR - Error processing callback for node 69cf297b9e2394c38fe02c9a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41840 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:45:35,142 - lava_callback - INFO - Received callback for node 69d1c8a9aa48d6fae7bb21d4 INFO: 172.21.0.1:45044 - "POST /node/69d1c8a9aa48d6fae7bb21d4 HTTP/1.0" 202 Accepted 2026-04-05 02:45:35,149 - lava_callback - INFO - Starting async job submit for node 69d1c8a9aa48d6fae7bb21d4 2026-04-05 02:45:35,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:45:35,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c8a9aa48d6fae7bb21d4 HTTP/1.1" 200 None 2026-04-05 02:45:35,224 - lava_callback - DEBUG - Processing node 69d1c8a9aa48d6fae7bb21d4: baseline-arm 2026-04-05 02:45:35,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:45:36,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:45:36,134 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69d1c8a9aa48d6fae7bb21d4/log.txt.gz INFO: 172.21.0.1:45056 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:45:36,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:45:36,779 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:45:36,782 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69d1c8a9aa48d6fae7bb21d4/lava-logs.yaml 2026-04-05 02:45:36,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 02:45:36,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 02:45:36,972 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69d1c8a9aa48d6fae7bb21d4/lava_callback.json.gz DEBUG: Setup failed for 69d1c8a9aa48d6fae7bb21d4. Transitting job node result: incomplete -> fail 2026-04-05 02:45:37,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:45:37,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1c8a9aa48d6fae7bb21d4 HTTP/1.1" 200 None 2026-04-05 02:45:37,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:45:37,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa22aa48d6fae7bb04b5 HTTP/1.1" 200 None 2026-04-05 02:45:37,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:45:37,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1c8a9aa48d6fae7bb21d4 HTTP/1.1" 200 None 2026-04-05 02:45:37,234 - lava_callback - INFO - Completed processing callback for node 69d1c8a9aa48d6fae7bb21d4 2026-04-05 02:45:40,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:45:40,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34912 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:46:46,513 - lava_callback - INFO - Received callback for node 69cf2a059e2394c38fe02d0b INFO: 172.21.0.1:46046 - "POST /node/69cf2a059e2394c38fe02d0b HTTP/1.0" 202 Accepted 2026-04-05 02:46:46,519 - lava_callback - INFO - Starting async job submit for node 69cf2a059e2394c38fe02d0b 2026-04-05 02:46:46,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:46:46,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2a059e2394c38fe02d0b HTTP/1.1" 200 None 2026-04-05 02:46:46,535 - lava_callback - DEBUG - Processing node 69cf2a059e2394c38fe02d0b: baseline-arm64-clabbe 2026-04-05 02:46:46,535 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf2a059e2394c38fe02d0b 2026-04-05 02:46:46,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:46052 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:46:46,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2a059e2394c38fe02d0b HTTP/1.1" 200 None 2026-04-05 02:46:46,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:46:46,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-05 02:46:46,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:46:46,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf2a059e2394c38fe02d0b HTTP/1.1" 200 None 2026-04-05 02:46:46,601 - lava_callback - ERROR - Error processing callback for node 69cf2a059e2394c38fe02d0b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49446 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:47:46,567 - lava_callback - INFO - Received callback for node 69cf2a489e2394c38fe02d5a INFO: 172.21.0.1:49452 - "POST /node/69cf2a489e2394c38fe02d5a HTTP/1.0" 202 Accepted 2026-04-05 02:47:46,573 - lava_callback - INFO - Starting async job submit for node 69cf2a489e2394c38fe02d5a 2026-04-05 02:47:46,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:47:46,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2a489e2394c38fe02d5a HTTP/1.1" 200 None 2026-04-05 02:47:46,590 - lava_callback - DEBUG - Processing node 69cf2a489e2394c38fe02d5a: baseline-arm64-clabbe 2026-04-05 02:47:46,590 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf2a489e2394c38fe02d5a 2026-04-05 02:47:46,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:47:46,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2a489e2394c38fe02d5a HTTP/1.1" 200 None 2026-04-05 02:47:46,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:47:46,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-05 02:47:46,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:47:46,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf2a489e2394c38fe02d5a HTTP/1.1" 200 None 2026-04-05 02:47:46,654 - lava_callback - ERROR - Error processing callback for node 69cf2a489e2394c38fe02d5a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48580 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:49:06,639 - lava_callback - INFO - Received callback for node 69cf2a8f9e2394c38fe02d95 INFO: 172.21.0.1:48590 - "POST /node/69cf2a8f9e2394c38fe02d95 HTTP/1.0" 202 Accepted 2026-04-05 02:49:06,644 - lava_callback - INFO - Starting async job submit for node 69cf2a8f9e2394c38fe02d95 2026-04-05 02:49:06,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:49:06,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2a8f9e2394c38fe02d95 HTTP/1.1" 200 None 2026-04-05 02:49:06,673 - lava_callback - DEBUG - Processing node 69cf2a8f9e2394c38fe02d95: baseline-arm64-clabbe 2026-04-05 02:49:06,674 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf2a8f9e2394c38fe02d95 2026-04-05 02:49:06,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:49:06,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2a8f9e2394c38fe02d95 HTTP/1.1" 200 None 2026-04-05 02:49:06,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:49:06,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-05 02:49:06,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:49:06,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf2a8f9e2394c38fe02d95 HTTP/1.1" 200 None 2026-04-05 02:49:06,732 - lava_callback - ERROR - Error processing callback for node 69cf2a8f9e2394c38fe02d95: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42730 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:50:06,811 - lava_callback - INFO - Received callback for node 69cf2ad39e2394c38fe02de4 INFO: 172.21.0.1:42736 - "POST /node/69cf2ad39e2394c38fe02de4 HTTP/1.0" 202 Accepted 2026-04-05 02:50:06,816 - lava_callback - INFO - Starting async job submit for node 69cf2ad39e2394c38fe02de4 2026-04-05 02:50:06,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:50:06,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2ad39e2394c38fe02de4 HTTP/1.1" 200 None 2026-04-05 02:50:06,832 - lava_callback - DEBUG - Processing node 69cf2ad39e2394c38fe02de4: baseline-arm64-clabbe 2026-04-05 02:50:06,832 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf2ad39e2394c38fe02de4 2026-04-05 02:50:06,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:50:06,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2ad39e2394c38fe02de4 HTTP/1.1" 200 None 2026-04-05 02:50:06,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:50:06,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-05 02:50:06,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:50:06,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf2ad39e2394c38fe02de4 HTTP/1.1" 200 None 2026-04-05 02:50:06,886 - lava_callback - ERROR - Error processing callback for node 69cf2ad39e2394c38fe02de4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:56:57,545 - lava_callback - INFO - Received callback for node 69cf2c759e2394c38fe02f84 INFO: 172.21.0.1:36936 - "POST /node/69cf2c759e2394c38fe02f84 HTTP/1.0" 202 Accepted 2026-04-05 02:56:57,551 - lava_callback - INFO - Starting async job submit for node 69cf2c759e2394c38fe02f84 2026-04-05 02:56:57,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:56:57,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2c759e2394c38fe02f84 HTTP/1.1" 200 None 2026-04-05 02:56:57,567 - lava_callback - DEBUG - Processing node 69cf2c759e2394c38fe02f84: baseline-arm-baylibre 2026-04-05 02:56:57,567 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf2c759e2394c38fe02f84 2026-04-05 02:56:57,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:56:57,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2c759e2394c38fe02f84 HTTP/1.1" 200 None 2026-04-05 02:56:57,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:56:57,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-05 02:56:57,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:56:57,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf2c759e2394c38fe02f84 HTTP/1.1" 200 None 2026-04-05 02:56:57,625 - lava_callback - ERROR - Error processing callback for node 69cf2c759e2394c38fe02f84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47742 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:57:37,497 - lava_callback - INFO - Received callback for node 69cf2c959e2394c38fe02faa INFO: 172.21.0.1:47746 - "POST /node/69cf2c959e2394c38fe02faa HTTP/1.0" 202 Accepted 2026-04-05 02:57:37,503 - lava_callback - INFO - Starting async job submit for node 69cf2c959e2394c38fe02faa 2026-04-05 02:57:37,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:57:37,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2c959e2394c38fe02faa HTTP/1.1" 200 None 2026-04-05 02:57:37,524 - lava_callback - DEBUG - Processing node 69cf2c959e2394c38fe02faa: baseline-arm-baylibre 2026-04-05 02:57:37,524 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf2c959e2394c38fe02faa 2026-04-05 02:57:37,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:57:37,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2c959e2394c38fe02faa HTTP/1.1" 200 None 2026-04-05 02:57:37,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:57:37,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-05 02:57:37,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:57:37,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf2c959e2394c38fe02faa HTTP/1.1" 200 None 2026-04-05 02:57:37,585 - lava_callback - ERROR - Error processing callback for node 69cf2c959e2394c38fe02faa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47912 - "GET / HTTP/1.0" 200 OK 2026-04-05 02:59:17,607 - lava_callback - INFO - Received callback for node 69cf2cfa9e2394c38fe0302e INFO: 172.21.0.1:47922 - "POST /node/69cf2cfa9e2394c38fe0302e HTTP/1.0" 202 Accepted 2026-04-05 02:59:17,613 - lava_callback - INFO - Starting async job submit for node 69cf2cfa9e2394c38fe0302e 2026-04-05 02:59:17,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:59:17,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2cfa9e2394c38fe0302e HTTP/1.1" 200 None 2026-04-05 02:59:17,630 - lava_callback - DEBUG - Processing node 69cf2cfa9e2394c38fe0302e: baseline-arm-baylibre 2026-04-05 02:59:17,630 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf2cfa9e2394c38fe0302e 2026-04-05 02:59:17,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:59:17,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2cfa9e2394c38fe0302e HTTP/1.1" 200 None 2026-04-05 02:59:17,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:59:17,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-05 02:59:17,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 02:59:17,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf2cfa9e2394c38fe0302e HTTP/1.1" 200 None 2026-04-05 02:59:17,687 - lava_callback - ERROR - Error processing callback for node 69cf2cfa9e2394c38fe0302e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52060 - "GET / HTTP/1.0" 200 OK 2026-04-05 03:00:17,636 - lava_callback - INFO - Received callback for node 69cf2d3a9e2394c38fe0306b INFO: 172.21.0.1:52068 - "POST /node/69cf2d3a9e2394c38fe0306b HTTP/1.0" 202 Accepted 2026-04-05 03:00:17,641 - lava_callback - INFO - Starting async job submit for node 69cf2d3a9e2394c38fe0306b 2026-04-05 03:00:17,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:00:17,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2d3a9e2394c38fe0306b HTTP/1.1" 200 None 2026-04-05 03:00:17,678 - lava_callback - DEBUG - Processing node 69cf2d3a9e2394c38fe0306b: baseline-arm-baylibre 2026-04-05 03:00:17,678 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf2d3a9e2394c38fe0306b 2026-04-05 03:00:17,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:00:17,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2d3a9e2394c38fe0306b HTTP/1.1" 200 None 2026-04-05 03:00:17,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:00:17,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-05 03:00:17,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:00:17,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf2d3a9e2394c38fe0306b HTTP/1.1" 200 None 2026-04-05 03:00:17,735 - lava_callback - ERROR - Error processing callback for node 69cf2d3a9e2394c38fe0306b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56350 - "GET / HTTP/1.0" 200 OK 2026-04-05 03:02:07,383 - lava_callback - INFO - Received callback for node 69cf2d9a9e2394c38fe030e2 INFO: 172.21.0.1:56362 - "POST /node/69cf2d9a9e2394c38fe030e2 HTTP/1.0" 202 Accepted 2026-04-05 03:02:07,390 - lava_callback - INFO - Starting async job submit for node 69cf2d9a9e2394c38fe030e2 2026-04-05 03:02:07,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:02:07,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2d9a9e2394c38fe030e2 HTTP/1.1" 200 None 2026-04-05 03:02:07,405 - lava_callback - DEBUG - Processing node 69cf2d9a9e2394c38fe030e2: baseline-arm-clabbe 2026-04-05 03:02:07,406 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf2d9a9e2394c38fe030e2 2026-04-05 03:02:07,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:02:07,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2d9a9e2394c38fe030e2 HTTP/1.1" 200 None 2026-04-05 03:02:07,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:02:07,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-05 03:02:07,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:02:07,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf2d9a9e2394c38fe030e2 HTTP/1.1" 200 None 2026-04-05 03:02:07,473 - lava_callback - ERROR - Error processing callback for node 69cf2d9a9e2394c38fe030e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35366 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 03:02:16,042 - lava_callback - INFO - Received callback for node 69d1cc0aaa48d6fae7bb244b INFO: 172.21.0.1:35378 - "POST /node/69d1cc0aaa48d6fae7bb244b HTTP/1.0" 202 Accepted 2026-04-05 03:02:16,051 - lava_callback - INFO - Starting async job submit for node 69d1cc0aaa48d6fae7bb244b 2026-04-05 03:02:16,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:02:16,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1cc0aaa48d6fae7bb244b HTTP/1.1" 200 None 2026-04-05 03:02:16,109 - lava_callback - DEBUG - Processing node 69d1cc0aaa48d6fae7bb244b: baseline-nfs-arm64 INFO: 172.21.0.1:35380 - "GET / HTTP/1.0" 200 OK 2026-04-05 03:02:17,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 03:02:17,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 03:02:17,564 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1cc0aaa48d6fae7bb244b/log.txt.gz 2026-04-05 03:02:18,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 03:02:18,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 03:02:18,626 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1cc0aaa48d6fae7bb244b/lava-logs.yaml 2026-04-05 03:02:18,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-05 03:02:18,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-05 03:02:18,835 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69d1cc0aaa48d6fae7bb244b/lava_callback.json.gz DEBUG: Setup failed for 69d1cc0aaa48d6fae7bb244b. Transitting job node result: incomplete -> fail 2026-04-05 03:02:18,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:02:18,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1cc0aaa48d6fae7bb244b HTTP/1.1" 200 None 2026-04-05 03:02:18,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:02:18,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69d1aa2eaa48d6fae7bb04c4 HTTP/1.1" 200 None 2026-04-05 03:02:18,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:02:18,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69d1cc0aaa48d6fae7bb244b HTTP/1.1" 200 None 2026-04-05 03:02:19,062 - lava_callback - INFO - Completed processing callback for node 69d1cc0aaa48d6fae7bb244b INFO: 172.21.0.1:36162 - "GET / HTTP/1.0" 200 OK 2026-04-05 03:02:27,274 - lava_callback - INFO - Received callback for node 69cf2dba9e2394c38fe03100 INFO: 172.21.0.1:36176 - "POST /node/69cf2dba9e2394c38fe03100 HTTP/1.0" 202 Accepted 2026-04-05 03:02:27,279 - lava_callback - INFO - Starting async job submit for node 69cf2dba9e2394c38fe03100 2026-04-05 03:02:27,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:02:27,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2dba9e2394c38fe03100 HTTP/1.1" 200 None 2026-04-05 03:02:27,295 - lava_callback - DEBUG - Processing node 69cf2dba9e2394c38fe03100: baseline-arm-clabbe 2026-04-05 03:02:27,295 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf2dba9e2394c38fe03100 2026-04-05 03:02:27,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:02:27,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2dba9e2394c38fe03100 HTTP/1.1" 200 None 2026-04-05 03:02:27,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:02:27,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-05 03:02:27,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:02:27,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf2dba9e2394c38fe03100 HTTP/1.1" 200 None 2026-04-05 03:02:27,355 - lava_callback - ERROR - Error processing callback for node 69cf2dba9e2394c38fe03100: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36330 - "GET / HTTP/1.0" 200 OK 2026-04-05 03:02:40,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:02:40,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46398 - "GET / HTTP/1.0" 200 OK 2026-04-05 03:03:07,393 - lava_callback - INFO - Received callback for node 69cf2dda9e2394c38fe03126 INFO: 172.21.0.1:46402 - "POST /node/69cf2dda9e2394c38fe03126 HTTP/1.0" 202 Accepted 2026-04-05 03:03:07,400 - lava_callback - INFO - Starting async job submit for node 69cf2dda9e2394c38fe03126 2026-04-05 03:03:07,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:03:07,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2dda9e2394c38fe03126 HTTP/1.1" 200 None 2026-04-05 03:03:07,416 - lava_callback - DEBUG - Processing node 69cf2dda9e2394c38fe03126: baseline-arm-clabbe 2026-04-05 03:03:07,416 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf2dda9e2394c38fe03126 2026-04-05 03:03:07,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:03:07,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2dda9e2394c38fe03126 HTTP/1.1" 200 None 2026-04-05 03:03:07,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:03:07,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-05 03:03:07,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:03:07,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf2dda9e2394c38fe03126 HTTP/1.1" 200 None 2026-04-05 03:03:07,475 - lava_callback - ERROR - Error processing callback for node 69cf2dda9e2394c38fe03126: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41760 - "GET / HTTP/1.0" 200 OK 2026-04-05 03:03:27,382 - lava_callback - INFO - Received callback for node 69cf2dfb9e2394c38fe0314a INFO: 172.21.0.1:41766 - "POST /node/69cf2dfb9e2394c38fe0314a HTTP/1.0" 202 Accepted 2026-04-05 03:03:27,390 - lava_callback - INFO - Starting async job submit for node 69cf2dfb9e2394c38fe0314a 2026-04-05 03:03:27,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:03:27,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2dfb9e2394c38fe0314a HTTP/1.1" 200 None 2026-04-05 03:03:27,410 - lava_callback - DEBUG - Processing node 69cf2dfb9e2394c38fe0314a: baseline-arm-clabbe 2026-04-05 03:03:27,410 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf2dfb9e2394c38fe0314a 2026-04-05 03:03:27,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:03:27,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2dfb9e2394c38fe0314a HTTP/1.1" 200 None 2026-04-05 03:03:27,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:03:27,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-05 03:03:27,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:03:27,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf2dfb9e2394c38fe0314a HTTP/1.1" 200 None 2026-04-05 03:03:27,464 - lava_callback - ERROR - Error processing callback for node 69cf2dfb9e2394c38fe0314a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39580 - "GET / HTTP/1.0" 200 OK 2026-04-05 03:04:47,492 - lava_callback - INFO - Received callback for node 69cf2e3e9e2394c38fe0318a INFO: 172.21.0.1:39592 - "POST /node/69cf2e3e9e2394c38fe0318a HTTP/1.0" 202 Accepted 2026-04-05 03:04:47,498 - lava_callback - INFO - Starting async job submit for node 69cf2e3e9e2394c38fe0318a 2026-04-05 03:04:47,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:04:47,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2e3e9e2394c38fe0318a HTTP/1.1" 200 None 2026-04-05 03:04:47,519 - lava_callback - DEBUG - Processing node 69cf2e3e9e2394c38fe0318a: baseline-arm-clabbe 2026-04-05 03:04:47,520 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf2e3e9e2394c38fe0318a 2026-04-05 03:04:47,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:04:47,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2e3e9e2394c38fe0318a HTTP/1.1" 200 None 2026-04-05 03:04:47,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:04:47,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-05 03:04:47,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:04:47,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf2e3e9e2394c38fe0318a HTTP/1.1" 200 None 2026-04-05 03:04:47,587 - lava_callback - ERROR - Error processing callback for node 69cf2e3e9e2394c38fe0318a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59624 - "GET / HTTP/1.0" 200 OK 2026-04-05 03:06:27,594 - lava_callback - INFO - Received callback for node 69cf2e9f9e2394c38fe0320f INFO: 172.21.0.1:59638 - "POST /node/69cf2e9f9e2394c38fe0320f HTTP/1.0" 202 Accepted 2026-04-05 03:06:27,602 - lava_callback - INFO - Starting async job submit for node 69cf2e9f9e2394c38fe0320f 2026-04-05 03:06:27,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:06:27,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2e9f9e2394c38fe0320f HTTP/1.1" 200 None 2026-04-05 03:06:27,624 - lava_callback - DEBUG - Processing node 69cf2e9f9e2394c38fe0320f: baseline-arm-clabbe 2026-04-05 03:06:27,624 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf2e9f9e2394c38fe0320f 2026-04-05 03:06:27,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:06:27,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf2e9f9e2394c38fe0320f HTTP/1.1" 200 None 2026-04-05 03:06:27,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:06:27,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-05 03:06:27,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:06:27,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf2e9f9e2394c38fe0320f HTTP/1.1" 200 None 2026-04-05 03:06:27,687 - lava_callback - ERROR - Error processing callback for node 69cf2e9f9e2394c38fe0320f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33780 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:44816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41984 - "GET / HTTP/1.0" 200 OK 2026-04-05 03:41:00,011 - lava_callback - INFO - Received callback for node 69cf36c79e2394c38fe033c8 INFO: 172.21.0.1:45052 - "POST /node/69cf36c79e2394c38fe033c8 HTTP/1.0" 202 Accepted 2026-04-05 03:41:00,016 - lava_callback - INFO - Starting async job submit for node 69cf36c79e2394c38fe033c8 2026-04-05 03:41:00,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:41:00,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf36c79e2394c38fe033c8 HTTP/1.1" 200 None 2026-04-05 03:41:00,038 - lava_callback - DEBUG - Processing node 69cf36c79e2394c38fe033c8: baseline-arm64-baylibre 2026-04-05 03:41:00,038 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf36c79e2394c38fe033c8 2026-04-05 03:41:00,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:41:00,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf36c79e2394c38fe033c8 HTTP/1.1" 200 None 2026-04-05 03:41:00,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:41:00,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-05 03:41:00,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:41:00,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf36c79e2394c38fe033c8 HTTP/1.1" 200 None 2026-04-05 03:41:00,106 - lava_callback - ERROR - Error processing callback for node 69cf36c79e2394c38fe033c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55020 - "GET / HTTP/1.0" 200 OK 2026-04-05 03:45:00,180 - lava_callback - INFO - Received callback for node 69cf37b89e2394c38fe03409 INFO: 172.21.0.1:48760 - "POST /node/69cf37b89e2394c38fe03409 HTTP/1.0" 202 Accepted 2026-04-05 03:45:00,186 - lava_callback - INFO - Starting async job submit for node 69cf37b89e2394c38fe03409 2026-04-05 03:45:00,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:45:00,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf37b89e2394c38fe03409 HTTP/1.1" 200 None 2026-04-05 03:45:00,203 - lava_callback - DEBUG - Processing node 69cf37b89e2394c38fe03409: baseline-arm64-baylibre 2026-04-05 03:45:00,203 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf37b89e2394c38fe03409 2026-04-05 03:45:00,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:45:00,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf37b89e2394c38fe03409 HTTP/1.1" 200 None 2026-04-05 03:45:00,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:45:00,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-05 03:45:00,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:45:00,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf37b89e2394c38fe03409 HTTP/1.1" 200 None 2026-04-05 03:45:00,254 - lava_callback - ERROR - Error processing callback for node 69cf37b89e2394c38fe03409: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39990 - "GET / HTTP/1.0" 200 OK 2026-04-05 03:46:20,365 - lava_callback - INFO - Received callback for node 69cf37fc9e2394c38fe03445 INFO: 172.21.0.1:53962 - "POST /node/69cf37fc9e2394c38fe03445 HTTP/1.0" 202 Accepted 2026-04-05 03:46:20,370 - lava_callback - INFO - Starting async job submit for node 69cf37fc9e2394c38fe03445 2026-04-05 03:46:20,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:46:20,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf37fc9e2394c38fe03445 HTTP/1.1" 200 None 2026-04-05 03:46:20,388 - lava_callback - DEBUG - Processing node 69cf37fc9e2394c38fe03445: baseline-arm64-baylibre 2026-04-05 03:46:20,389 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf37fc9e2394c38fe03445 2026-04-05 03:46:20,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:46:20,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf37fc9e2394c38fe03445 HTTP/1.1" 200 None 2026-04-05 03:46:20,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:46:20,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-05 03:46:20,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:46:20,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf37fc9e2394c38fe03445 HTTP/1.1" 200 None 2026-04-05 03:46:20,464 - lava_callback - ERROR - Error processing callback for node 69cf37fc9e2394c38fe03445: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58560 - "GET / HTTP/1.0" 200 OK 2026-04-05 03:47:20,252 - lava_callback - INFO - Received callback for node 69cf38419e2394c38fe0347b INFO: 172.21.0.1:55010 - "POST /node/69cf38419e2394c38fe0347b HTTP/1.0" 202 Accepted 2026-04-05 03:47:20,261 - lava_callback - INFO - Starting async job submit for node 69cf38419e2394c38fe0347b 2026-04-05 03:47:20,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:47:20,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf38419e2394c38fe0347b HTTP/1.1" 200 None 2026-04-05 03:47:20,277 - lava_callback - DEBUG - Processing node 69cf38419e2394c38fe0347b: baseline-arm64-baylibre 2026-04-05 03:47:20,277 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf38419e2394c38fe0347b 2026-04-05 03:47:20,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:47:20,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf38419e2394c38fe0347b HTTP/1.1" 200 None 2026-04-05 03:47:20,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:47:20,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-05 03:47:20,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:47:20,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf38419e2394c38fe0347b HTTP/1.1" 200 None 2026-04-05 03:47:20,347 - lava_callback - ERROR - Error processing callback for node 69cf38419e2394c38fe0347b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35050 - "GET / HTTP/1.0" 200 OK 2026-04-05 03:49:00,368 - lava_callback - INFO - Received callback for node 69cf38aa9e2394c38fe034bb INFO: 172.21.0.1:50952 - "POST /node/69cf38aa9e2394c38fe034bb HTTP/1.0" 202 Accepted 2026-04-05 03:49:00,374 - lava_callback - INFO - Starting async job submit for node 69cf38aa9e2394c38fe034bb 2026-04-05 03:49:00,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:49:00,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf38aa9e2394c38fe034bb HTTP/1.1" 200 None 2026-04-05 03:49:00,389 - lava_callback - DEBUG - Processing node 69cf38aa9e2394c38fe034bb: baseline-arm64-baylibre 2026-04-05 03:49:00,390 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf38aa9e2394c38fe034bb 2026-04-05 03:49:00,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:49:00,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf38aa9e2394c38fe034bb HTTP/1.1" 200 None 2026-04-05 03:49:00,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:49:00,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-05 03:49:00,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:49:00,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf38aa9e2394c38fe034bb HTTP/1.1" 200 None 2026-04-05 03:49:00,478 - lava_callback - ERROR - Error processing callback for node 69cf38aa9e2394c38fe034bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43990 - "GET / HTTP/1.0" 200 OK 2026-04-05 03:51:20,414 - lava_callback - INFO - Received callback for node 69cf39239e2394c38fe034f3 INFO: 172.21.0.1:46516 - "POST /node/69cf39239e2394c38fe034f3 HTTP/1.0" 202 Accepted 2026-04-05 03:51:20,420 - lava_callback - INFO - Starting async job submit for node 69cf39239e2394c38fe034f3 2026-04-05 03:51:20,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:51:20,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf39239e2394c38fe034f3 HTTP/1.1" 200 None 2026-04-05 03:51:20,436 - lava_callback - DEBUG - Processing node 69cf39239e2394c38fe034f3: baseline-arm64-baylibre 2026-04-05 03:51:20,436 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf39239e2394c38fe034f3 2026-04-05 03:51:20,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:51:20,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf39239e2394c38fe034f3 HTTP/1.1" 200 None 2026-04-05 03:51:20,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:51:20,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-05 03:51:20,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:51:20,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf39239e2394c38fe034f3 HTTP/1.1" 200 None 2026-04-05 03:51:20,501 - lava_callback - ERROR - Error processing callback for node 69cf39239e2394c38fe034f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46380 - "GET / HTTP/1.0" 200 OK 2026-04-05 03:53:09,953 - lava_callback - INFO - Received callback for node 69cf39a19e2394c38fe03538 INFO: 172.21.0.1:33596 - "POST /node/69cf39a19e2394c38fe03538 HTTP/1.0" 202 Accepted 2026-04-05 03:53:09,959 - lava_callback - INFO - Starting async job submit for node 69cf39a19e2394c38fe03538 2026-04-05 03:53:09,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:53:09,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf39a19e2394c38fe03538 HTTP/1.1" 200 None 2026-04-05 03:53:09,974 - lava_callback - DEBUG - Processing node 69cf39a19e2394c38fe03538: baseline-arm64-clabbe 2026-04-05 03:53:09,975 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf39a19e2394c38fe03538 2026-04-05 03:53:09,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:53:09,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf39a19e2394c38fe03538 HTTP/1.1" 200 None 2026-04-05 03:53:09,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:53:10,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-05 03:53:10,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:53:10,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf39a19e2394c38fe03538 HTTP/1.1" 200 None 2026-04-05 03:53:10,028 - lava_callback - ERROR - Error processing callback for node 69cf39a19e2394c38fe03538: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41780 - "GET / HTTP/1.0" 200 OK 2026-04-05 03:54:29,889 - lava_callback - INFO - Received callback for node 69cf39e89e2394c38fe03571 INFO: 172.21.0.1:38870 - "POST /node/69cf39e89e2394c38fe03571 HTTP/1.0" 202 Accepted 2026-04-05 03:54:29,897 - lava_callback - INFO - Starting async job submit for node 69cf39e89e2394c38fe03571 2026-04-05 03:54:29,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:54:29,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf39e89e2394c38fe03571 HTTP/1.1" 200 None 2026-04-05 03:54:29,916 - lava_callback - DEBUG - Processing node 69cf39e89e2394c38fe03571: baseline-arm64-clabbe 2026-04-05 03:54:29,916 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf39e89e2394c38fe03571 2026-04-05 03:54:29,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:54:29,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf39e89e2394c38fe03571 HTTP/1.1" 200 None 2026-04-05 03:54:29,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:54:29,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-05 03:54:29,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:54:29,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf39e89e2394c38fe03571 HTTP/1.1" 200 None 2026-04-05 03:54:29,988 - lava_callback - ERROR - Error processing callback for node 69cf39e89e2394c38fe03571: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50912 - "GET / HTTP/1.0" 200 OK 2026-04-05 03:56:10,048 - lava_callback - INFO - Received callback for node 69cf3a559e2394c38fe035af INFO: 172.21.0.1:36888 - "POST /node/69cf3a559e2394c38fe035af HTTP/1.0" 202 Accepted 2026-04-05 03:56:10,054 - lava_callback - INFO - Starting async job submit for node 69cf3a559e2394c38fe035af 2026-04-05 03:56:10,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:56:10,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf3a559e2394c38fe035af HTTP/1.1" 200 None 2026-04-05 03:56:10,071 - lava_callback - DEBUG - Processing node 69cf3a559e2394c38fe035af: baseline-arm64-clabbe 2026-04-05 03:56:10,072 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf3a559e2394c38fe035af 2026-04-05 03:56:10,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:56:10,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf3a559e2394c38fe035af HTTP/1.1" 200 None 2026-04-05 03:56:10,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:56:10,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-05 03:56:10,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:56:10,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf3a559e2394c38fe035af HTTP/1.1" 200 None 2026-04-05 03:56:10,140 - lava_callback - ERROR - Error processing callback for node 69cf3a559e2394c38fe035af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35374 - "GET / HTTP/1.0" 200 OK 2026-04-05 03:58:10,172 - lava_callback - INFO - Received callback for node 69cf3acd9e2394c38fe035d7 INFO: 172.21.0.1:43798 - "POST /node/69cf3acd9e2394c38fe035d7 HTTP/1.0" 202 Accepted 2026-04-05 03:58:10,181 - lava_callback - INFO - Starting async job submit for node 69cf3acd9e2394c38fe035d7 2026-04-05 03:58:10,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:58:10,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf3acd9e2394c38fe035d7 HTTP/1.1" 200 None 2026-04-05 03:58:10,200 - lava_callback - DEBUG - Processing node 69cf3acd9e2394c38fe035d7: baseline-arm64-clabbe 2026-04-05 03:58:10,201 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf3acd9e2394c38fe035d7 2026-04-05 03:58:10,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:58:10,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf3acd9e2394c38fe035d7 HTTP/1.1" 200 None 2026-04-05 03:58:10,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:58:10,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-05 03:58:10,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 03:58:10,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf3acd9e2394c38fe035d7 HTTP/1.1" 200 None 2026-04-05 03:58:10,267 - lava_callback - ERROR - Error processing callback for node 69cf3acd9e2394c38fe035d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59446 - "GET / HTTP/1.0" 200 OK 2026-04-05 04:00:10,381 - lava_callback - INFO - Received callback for node 69cf3b459e2394c38fe03617 INFO: 172.21.0.1:51844 - "POST /node/69cf3b459e2394c38fe03617 HTTP/1.0" 202 Accepted 2026-04-05 04:00:10,387 - lava_callback - INFO - Starting async job submit for node 69cf3b459e2394c38fe03617 2026-04-05 04:00:10,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 04:00:10,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf3b459e2394c38fe03617 HTTP/1.1" 200 None 2026-04-05 04:00:10,403 - lava_callback - DEBUG - Processing node 69cf3b459e2394c38fe03617: baseline-arm64-clabbe 2026-04-05 04:00:10,404 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf3b459e2394c38fe03617 2026-04-05 04:00:10,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 04:00:10,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf3b459e2394c38fe03617 HTTP/1.1" 200 None 2026-04-05 04:00:10,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 04:00:10,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-05 04:00:10,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 04:00:10,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf3b459e2394c38fe03617 HTTP/1.1" 200 None 2026-04-05 04:00:10,472 - lava_callback - ERROR - Error processing callback for node 69cf3b459e2394c38fe03617: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44910 - "GET / HTTP/1.0" 200 OK 2026-04-05 04:02:10,290 - lava_callback - INFO - Received callback for node 69cf3bbd9e2394c38fe03654 INFO: 172.21.0.1:35890 - "POST /node/69cf3bbd9e2394c38fe03654 HTTP/1.0" 202 Accepted 2026-04-05 04:02:10,299 - lava_callback - INFO - Starting async job submit for node 69cf3bbd9e2394c38fe03654 2026-04-05 04:02:10,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 04:02:10,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf3bbd9e2394c38fe03654 HTTP/1.1" 200 None 2026-04-05 04:02:10,316 - lava_callback - DEBUG - Processing node 69cf3bbd9e2394c38fe03654: baseline-arm64-clabbe 2026-04-05 04:02:10,316 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf3bbd9e2394c38fe03654 2026-04-05 04:02:10,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 04:02:10,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf3bbd9e2394c38fe03654 HTTP/1.1" 200 None 2026-04-05 04:02:10,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 04:02:10,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-05 04:02:10,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 04:02:10,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf3bbd9e2394c38fe03654 HTTP/1.1" 200 None 2026-04-05 04:02:10,374 - lava_callback - ERROR - Error processing callback for node 69cf3bbd9e2394c38fe03654: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56298 - "GET /node/693f179624745582e399b1fd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56308 - "GET /node/6992691998a8bdb31c39233c%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34106 - "GET /node/693ae714fee8383e92b65026%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32932 - "GET /node/6985de0371989fb14149b2c0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:32940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45678 - "GET /node/698704006e077e4126a7e5db%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45692 - "GET /node/698a84d8d9a1cfa777a23bb5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60732 - "GET /node/698e24c3952a14bf500e3de1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60748 - "GET /node/693f5b720d8ce4018da8c7fd%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58284 - "GET /node/694bd927c19e09af58d49aed%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37456 - "GET /node/693f81610d8ce4018da9687d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37462 - "GET /node/693f72440d8ce4018da936ba%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:49210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34930 - "GET /node/69b7d2c900b80c8ffdcb8a46%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34944 - "GET /node/693af6d1fee8383e92b6bd5d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39710 - "GET /node/69877306e31b58f834f1a894%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:39724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41244 - "GET /node/698af5c33b3beb19e7616e37%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34382 - "GET /node/698a8071d9a1cfa777a232c1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34398 - "GET /node/69114db6f15111fc8ce48603%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34306 - "GET /node/698b071b3b3beb19e7617fa5%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:34312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54626 - "GET /node/695407199c6929bd9fb6f645%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59820 - "GET /node/69485b569214b49387168921%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:59826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51662 - "GET /node/699385facebe99dd8e07025d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53286 - "GET /node/6986111771989fb14149ead3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60092 - "GET /node/698ef49cf0e3ffbba67d2dc0%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:60108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37808 - "GET /node/699366adcebe99dd8e065730%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:56390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42268 - "GET /node/6989388985773790cd34d19f%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-05 04:56:04,048 - lava_callback - INFO - Received callback for node 69cf48599e2394c38fe036ec INFO: 172.21.0.1:40300 - "POST /node/69cf48599e2394c38fe036ec HTTP/1.0" 202 Accepted 2026-04-05 04:56:04,055 - lava_callback - INFO - Starting async job submit for node 69cf48599e2394c38fe036ec 2026-04-05 04:56:04,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 04:56:04,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf48599e2394c38fe036ec HTTP/1.1" 200 None 2026-04-05 04:56:04,076 - lava_callback - DEBUG - Processing node 69cf48599e2394c38fe036ec: baseline-arm-baylibre 2026-04-05 04:56:04,077 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf48599e2394c38fe036ec 2026-04-05 04:56:04,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 04:56:04,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf48599e2394c38fe036ec HTTP/1.1" 200 None 2026-04-05 04:56:04,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 04:56:04,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 04:56:04,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 04:56:04,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf48599e2394c38fe036ec HTTP/1.1" 200 None 2026-04-05 04:56:04,134 - lava_callback - ERROR - Error processing callback for node 69cf48599e2394c38fe036ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50422 - "GET / HTTP/1.0" 200 OK 2026-04-05 04:58:04,114 - lava_callback - INFO - Received callback for node 69cf48cf9e2394c38fe03716 INFO: 172.21.0.1:60580 - "POST /node/69cf48cf9e2394c38fe03716 HTTP/1.0" 202 Accepted 2026-04-05 04:58:04,120 - lava_callback - INFO - Starting async job submit for node 69cf48cf9e2394c38fe03716 2026-04-05 04:58:04,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 04:58:04,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf48cf9e2394c38fe03716 HTTP/1.1" 200 None 2026-04-05 04:58:04,138 - lava_callback - DEBUG - Processing node 69cf48cf9e2394c38fe03716: baseline-arm-baylibre 2026-04-05 04:58:04,139 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf48cf9e2394c38fe03716 2026-04-05 04:58:04,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 04:58:04,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf48cf9e2394c38fe03716 HTTP/1.1" 200 None 2026-04-05 04:58:04,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 04:58:04,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 04:58:04,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 04:58:04,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf48cf9e2394c38fe03716 HTTP/1.1" 200 None 2026-04-05 04:58:04,192 - lava_callback - ERROR - Error processing callback for node 69cf48cf9e2394c38fe03716: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33228 - "GET / HTTP/1.0" 200 OK 2026-04-05 04:59:04,069 - lava_callback - INFO - Received callback for node 69cf490c9e2394c38fe03736 INFO: 172.21.0.1:37288 - "POST /node/69cf490c9e2394c38fe03736 HTTP/1.0" 202 Accepted 2026-04-05 04:59:04,074 - lava_callback - INFO - Starting async job submit for node 69cf490c9e2394c38fe03736 2026-04-05 04:59:04,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 04:59:04,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf490c9e2394c38fe03736 HTTP/1.1" 200 None 2026-04-05 04:59:04,091 - lava_callback - DEBUG - Processing node 69cf490c9e2394c38fe03736: baseline-arm-baylibre 2026-04-05 04:59:04,091 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf490c9e2394c38fe03736 2026-04-05 04:59:04,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 04:59:04,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf490c9e2394c38fe03736 HTTP/1.1" 200 None 2026-04-05 04:59:04,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 04:59:04,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 04:59:04,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 04:59:04,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf490c9e2394c38fe03736 HTTP/1.1" 200 None 2026-04-05 04:59:04,142 - lava_callback - ERROR - Error processing callback for node 69cf490c9e2394c38fe03736: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49696 - "GET /node/69407bde575bc060ce15bc06%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:40436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40680 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:01:04,238 - lava_callback - INFO - Received callback for node 69cf49879e2394c38fe03759 INFO: 172.21.0.1:37318 - "POST /node/69cf49879e2394c38fe03759 HTTP/1.0" 202 Accepted 2026-04-05 05:01:04,243 - lava_callback - INFO - Starting async job submit for node 69cf49879e2394c38fe03759 2026-04-05 05:01:04,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:01:04,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf49879e2394c38fe03759 HTTP/1.1" 200 None 2026-04-05 05:01:04,260 - lava_callback - DEBUG - Processing node 69cf49879e2394c38fe03759: baseline-arm-baylibre 2026-04-05 05:01:04,260 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf49879e2394c38fe03759 2026-04-05 05:01:04,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:01:04,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf49879e2394c38fe03759 HTTP/1.1" 200 None 2026-04-05 05:01:04,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:01:04,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 05:01:04,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:01:04,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf49879e2394c38fe03759 HTTP/1.1" 200 None 2026-04-05 05:01:04,311 - lava_callback - ERROR - Error processing callback for node 69cf49879e2394c38fe03759: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37394 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:02:13,597 - lava_callback - INFO - Received callback for node 69cf49c59e2394c38fe03783 INFO: 172.21.0.1:46864 - "POST /node/69cf49c59e2394c38fe03783 HTTP/1.0" 202 Accepted 2026-04-05 05:02:13,603 - lava_callback - INFO - Starting async job submit for node 69cf49c59e2394c38fe03783 2026-04-05 05:02:13,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:02:13,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf49c59e2394c38fe03783 HTTP/1.1" 200 None 2026-04-05 05:02:13,622 - lava_callback - DEBUG - Processing node 69cf49c59e2394c38fe03783: baseline-arm-clabbe 2026-04-05 05:02:13,622 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf49c59e2394c38fe03783 2026-04-05 05:02:13,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:02:13,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf49c59e2394c38fe03783 HTTP/1.1" 200 None 2026-04-05 05:02:13,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:02:13,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 05:02:13,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:02:13,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf49c59e2394c38fe03783 HTTP/1.1" 200 None 2026-04-05 05:02:13,679 - lava_callback - ERROR - Error processing callback for node 69cf49c59e2394c38fe03783: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48032 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:03:13,630 - lava_callback - INFO - Received callback for node 69cf4a019e2394c38fe037a7 INFO: 172.21.0.1:43598 - "POST /node/69cf4a019e2394c38fe037a7 HTTP/1.0" 202 Accepted 2026-04-05 05:03:13,635 - lava_callback - INFO - Starting async job submit for node 69cf4a019e2394c38fe037a7 2026-04-05 05:03:13,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:03:13,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4a019e2394c38fe037a7 HTTP/1.1" 200 None 2026-04-05 05:03:13,651 - lava_callback - DEBUG - Processing node 69cf4a019e2394c38fe037a7: baseline-arm-clabbe 2026-04-05 05:03:13,652 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4a019e2394c38fe037a7 2026-04-05 05:03:13,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:03:13,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4a019e2394c38fe037a7 HTTP/1.1" 200 None 2026-04-05 05:03:13,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:03:13,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 05:03:13,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:03:13,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4a019e2394c38fe037a7 HTTP/1.1" 200 None 2026-04-05 05:03:13,715 - lava_callback - ERROR - Error processing callback for node 69cf4a019e2394c38fe037a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55904 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:04:13,698 - lava_callback - INFO - Received callback for node 69cf4a3d9e2394c38fe037cd INFO: 172.21.0.1:39110 - "POST /node/69cf4a3d9e2394c38fe037cd HTTP/1.0" 202 Accepted 2026-04-05 05:04:13,703 - lava_callback - INFO - Starting async job submit for node 69cf4a3d9e2394c38fe037cd 2026-04-05 05:04:13,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:04:13,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4a3d9e2394c38fe037cd HTTP/1.1" 200 None 2026-04-05 05:04:13,720 - lava_callback - DEBUG - Processing node 69cf4a3d9e2394c38fe037cd: baseline-arm-clabbe 2026-04-05 05:04:13,720 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4a3d9e2394c38fe037cd 2026-04-05 05:04:13,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:04:13,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4a3d9e2394c38fe037cd HTTP/1.1" 200 None 2026-04-05 05:04:13,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:04:13,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 05:04:13,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:04:13,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4a3d9e2394c38fe037cd HTTP/1.1" 200 None 2026-04-05 05:04:13,793 - lava_callback - ERROR - Error processing callback for node 69cf4a3d9e2394c38fe037cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42328 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:06:13,744 - lava_callback - INFO - Received callback for node 69cf4ab69e2394c38fe037fc INFO: 172.21.0.1:53794 - "POST /node/69cf4ab69e2394c38fe037fc HTTP/1.0" 202 Accepted 2026-04-05 05:06:13,749 - lava_callback - INFO - Starting async job submit for node 69cf4ab69e2394c38fe037fc 2026-04-05 05:06:13,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:06:13,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4ab69e2394c38fe037fc HTTP/1.1" 200 None 2026-04-05 05:06:13,769 - lava_callback - DEBUG - Processing node 69cf4ab69e2394c38fe037fc: baseline-arm-clabbe 2026-04-05 05:06:13,769 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4ab69e2394c38fe037fc 2026-04-05 05:06:13,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:06:13,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4ab69e2394c38fe037fc HTTP/1.1" 200 None 2026-04-05 05:06:13,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:06:13,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 05:06:13,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:06:13,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4ab69e2394c38fe037fc HTTP/1.1" 200 None 2026-04-05 05:06:13,827 - lava_callback - ERROR - Error processing callback for node 69cf4ab69e2394c38fe037fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35642 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:06:53,719 - lava_callback - INFO - Received callback for node 69cf4ada9e2394c38fe03816 INFO: 172.21.0.1:39890 - "POST /node/69cf4ada9e2394c38fe03816 HTTP/1.0" 202 Accepted 2026-04-05 05:06:53,724 - lava_callback - INFO - Starting async job submit for node 69cf4ada9e2394c38fe03816 2026-04-05 05:06:53,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:06:53,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4ada9e2394c38fe03816 HTTP/1.1" 200 None 2026-04-05 05:06:53,741 - lava_callback - DEBUG - Processing node 69cf4ada9e2394c38fe03816: baseline-arm-clabbe 2026-04-05 05:06:53,741 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4ada9e2394c38fe03816 2026-04-05 05:06:53,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:06:53,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4ada9e2394c38fe03816 HTTP/1.1" 200 None 2026-04-05 05:06:53,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:06:53,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 05:06:53,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:06:53,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4ada9e2394c38fe03816 HTTP/1.1" 200 None 2026-04-05 05:06:53,799 - lava_callback - ERROR - Error processing callback for node 69cf4ada9e2394c38fe03816: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54700 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:07:13,839 - lava_callback - INFO - Received callback for node 69cf4afc9e2394c38fe03833 INFO: 172.21.0.1:37394 - "POST /node/69cf4afc9e2394c38fe03833 HTTP/1.0" 202 Accepted 2026-04-05 05:07:13,844 - lava_callback - INFO - Starting async job submit for node 69cf4afc9e2394c38fe03833 2026-04-05 05:07:13,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:07:13,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4afc9e2394c38fe03833 HTTP/1.1" 200 None 2026-04-05 05:07:13,861 - lava_callback - DEBUG - Processing node 69cf4afc9e2394c38fe03833: baseline-arm-clabbe 2026-04-05 05:07:13,861 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4afc9e2394c38fe03833 2026-04-05 05:07:13,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:07:13,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4afc9e2394c38fe03833 HTTP/1.1" 200 None 2026-04-05 05:07:13,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:07:13,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 05:07:13,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:07:13,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4afc9e2394c38fe03833 HTTP/1.1" 200 None 2026-04-05 05:07:13,912 - lava_callback - ERROR - Error processing callback for node 69cf4afc9e2394c38fe03833: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37238 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:09:05,134 - lava_callback - INFO - Received callback for node 69cf4b6d9e2394c38fe0387a INFO: 172.21.0.1:33752 - "POST /node/69cf4b6d9e2394c38fe0387a HTTP/1.0" 202 Accepted 2026-04-05 05:09:05,140 - lava_callback - INFO - Starting async job submit for node 69cf4b6d9e2394c38fe0387a 2026-04-05 05:09:05,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:09:05,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4b6d9e2394c38fe0387a HTTP/1.1" 200 None 2026-04-05 05:09:05,162 - lava_callback - DEBUG - Processing node 69cf4b6d9e2394c38fe0387a: baseline-arm-baylibre 2026-04-05 05:09:05,163 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4b6d9e2394c38fe0387a 2026-04-05 05:09:05,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:09:05,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4b6d9e2394c38fe0387a HTTP/1.1" 200 None 2026-04-05 05:09:05,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:09:05,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 05:09:05,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:09:05,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4b6d9e2394c38fe0387a HTTP/1.1" 200 None 2026-04-05 05:09:05,228 - lava_callback - ERROR - Error processing callback for node 69cf4b6d9e2394c38fe0387a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40716 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:11:04,731 - lava_callback - INFO - Received callback for node 69cf4be49e2394c38fe038e0 INFO: 172.21.0.1:46884 - "POST /node/69cf4be49e2394c38fe038e0 HTTP/1.0" 202 Accepted 2026-04-05 05:11:04,737 - lava_callback - INFO - Starting async job submit for node 69cf4be49e2394c38fe038e0 2026-04-05 05:11:04,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:11:04,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4be49e2394c38fe038e0 HTTP/1.1" 200 None 2026-04-05 05:11:04,753 - lava_callback - DEBUG - Processing node 69cf4be49e2394c38fe038e0: baseline-arm-baylibre 2026-04-05 05:11:04,754 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4be49e2394c38fe038e0 2026-04-05 05:11:04,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:11:04,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4be49e2394c38fe038e0 HTTP/1.1" 200 None 2026-04-05 05:11:04,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:11:04,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 05:11:04,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:11:04,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4be49e2394c38fe038e0 HTTP/1.1" 200 None 2026-04-05 05:11:04,812 - lava_callback - ERROR - Error processing callback for node 69cf4be49e2394c38fe038e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35184 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:11:44,763 - lava_callback - INFO - Received callback for node 69cf4c079e2394c38fe03915 INFO: 172.21.0.1:47032 - "POST /node/69cf4c079e2394c38fe03915 HTTP/1.0" 202 Accepted 2026-04-05 05:11:44,769 - lava_callback - INFO - Starting async job submit for node 69cf4c079e2394c38fe03915 2026-04-05 05:11:44,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:11:44,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4c079e2394c38fe03915 HTTP/1.1" 200 None 2026-04-05 05:11:44,786 - lava_callback - DEBUG - Processing node 69cf4c079e2394c38fe03915: baseline-arm-baylibre 2026-04-05 05:11:44,786 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4c079e2394c38fe03915 2026-04-05 05:11:44,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:11:44,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4c079e2394c38fe03915 HTTP/1.1" 200 None 2026-04-05 05:11:44,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:11:44,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 05:11:44,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:11:44,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4c079e2394c38fe03915 HTTP/1.1" 200 None 2026-04-05 05:11:44,855 - lava_callback - ERROR - Error processing callback for node 69cf4c079e2394c38fe03915: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41698 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:13:34,197 - lava_callback - INFO - Received callback for node 69cf4c709e2394c38fe03976 INFO: 172.21.0.1:41706 - "POST /node/69cf4c709e2394c38fe03976 HTTP/1.0" 202 Accepted 2026-04-05 05:13:34,203 - lava_callback - INFO - Starting async job submit for node 69cf4c709e2394c38fe03976 2026-04-05 05:13:34,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:13:34,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4c709e2394c38fe03976 HTTP/1.1" 200 None 2026-04-05 05:13:34,222 - lava_callback - DEBUG - Processing node 69cf4c709e2394c38fe03976: baseline-arm-clabbe 2026-04-05 05:13:34,222 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4c709e2394c38fe03976 2026-04-05 05:13:34,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:13:34,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4c709e2394c38fe03976 HTTP/1.1" 200 None 2026-04-05 05:13:34,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:13:34,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 05:13:34,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:13:34,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4c709e2394c38fe03976 HTTP/1.1" 200 None 2026-04-05 05:13:34,281 - lava_callback - ERROR - Error processing callback for node 69cf4c709e2394c38fe03976: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41706 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:14:04,933 - lava_callback - INFO - Received callback for node 69cf4c8c9e2394c38fe0399d INFO: 172.21.0.1:43676 - "POST /node/69cf4c8c9e2394c38fe0399d HTTP/1.0" 202 Accepted 2026-04-05 05:14:04,941 - lava_callback - INFO - Starting async job submit for node 69cf4c8c9e2394c38fe0399d 2026-04-05 05:14:04,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:14:04,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4c8c9e2394c38fe0399d HTTP/1.1" 200 None 2026-04-05 05:14:04,981 - lava_callback - DEBUG - Processing node 69cf4c8c9e2394c38fe0399d: baseline-arm-baylibre 2026-04-05 05:14:04,982 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4c8c9e2394c38fe0399d 2026-04-05 05:14:04,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:14:04,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4c8c9e2394c38fe0399d HTTP/1.1" 200 None 2026-04-05 05:14:04,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:14:05,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 05:14:05,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:14:05,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4c8c9e2394c38fe0399d HTTP/1.1" 200 None 2026-04-05 05:14:05,047 - lava_callback - ERROR - Error processing callback for node 69cf4c8c9e2394c38fe0399d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37360 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:15:54,260 - lava_callback - INFO - Received callback for node 69cf4cf79e2394c38fe039ef INFO: 172.21.0.1:52494 - "POST /node/69cf4cf79e2394c38fe039ef HTTP/1.0" 202 Accepted 2026-04-05 05:15:54,270 - lava_callback - INFO - Starting async job submit for node 69cf4cf79e2394c38fe039ef 2026-04-05 05:15:54,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:15:54,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4cf79e2394c38fe039ef HTTP/1.1" 200 None 2026-04-05 05:15:54,287 - lava_callback - DEBUG - Processing node 69cf4cf79e2394c38fe039ef: baseline-arm-clabbe 2026-04-05 05:15:54,287 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4cf79e2394c38fe039ef 2026-04-05 05:15:54,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:15:54,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4cf79e2394c38fe039ef HTTP/1.1" 200 None 2026-04-05 05:15:54,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:15:54,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 05:15:54,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:15:54,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4cf79e2394c38fe039ef HTTP/1.1" 200 None 2026-04-05 05:15:54,347 - lava_callback - ERROR - Error processing callback for node 69cf4cf79e2394c38fe039ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49300 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:16:54,290 - lava_callback - INFO - Received callback for node 69cf4d3a9e2394c38fe03a29 INFO: 172.21.0.1:48960 - "POST /node/69cf4d3a9e2394c38fe03a29 HTTP/1.0" 202 Accepted 2026-04-05 05:16:54,296 - lava_callback - INFO - Starting async job submit for node 69cf4d3a9e2394c38fe03a29 2026-04-05 05:16:54,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:16:54,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4d3a9e2394c38fe03a29 HTTP/1.1" 200 None 2026-04-05 05:16:54,312 - lava_callback - DEBUG - Processing node 69cf4d3a9e2394c38fe03a29: baseline-arm-clabbe 2026-04-05 05:16:54,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4d3a9e2394c38fe03a29 2026-04-05 05:16:54,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:16:54,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4d3a9e2394c38fe03a29 HTTP/1.1" 200 None 2026-04-05 05:16:54,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:16:54,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 05:16:54,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:16:54,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4d3a9e2394c38fe03a29 HTTP/1.1" 200 None 2026-04-05 05:16:54,367 - lava_callback - ERROR - Error processing callback for node 69cf4d3a9e2394c38fe03a29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36238 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:17:45,138 - lava_callback - INFO - Received callback for node 69cf4d659e2394c38fe03a45 INFO: 172.21.0.1:42430 - "POST /node/69cf4d659e2394c38fe03a45 HTTP/1.0" 202 Accepted 2026-04-05 05:17:45,144 - lava_callback - INFO - Starting async job submit for node 69cf4d659e2394c38fe03a45 2026-04-05 05:17:45,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:17:45,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4d659e2394c38fe03a45 HTTP/1.1" 200 None 2026-04-05 05:17:45,174 - lava_callback - DEBUG - Processing node 69cf4d659e2394c38fe03a45: baseline-arm64-baylibre 2026-04-05 05:17:45,174 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4d659e2394c38fe03a45 2026-04-05 05:17:45,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:17:45,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4d659e2394c38fe03a45 HTTP/1.1" 200 None 2026-04-05 05:17:45,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:17:45,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:17:45,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:17:45,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4d659e2394c38fe03a45 HTTP/1.1" 200 None 2026-04-05 05:17:45,244 - lava_callback - ERROR - Error processing callback for node 69cf4d659e2394c38fe03a45: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49968 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:18:45,159 - lava_callback - INFO - Received callback for node 69cf4dab9e2394c38fe03a8a INFO: 172.21.0.1:60396 - "POST /node/69cf4dab9e2394c38fe03a8a HTTP/1.0" 202 Accepted 2026-04-05 05:18:45,165 - lava_callback - INFO - Starting async job submit for node 69cf4dab9e2394c38fe03a8a 2026-04-05 05:18:45,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:18:45,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4dab9e2394c38fe03a8a HTTP/1.1" 200 None 2026-04-05 05:18:45,189 - lava_callback - DEBUG - Processing node 69cf4dab9e2394c38fe03a8a: baseline-arm64-baylibre 2026-04-05 05:18:45,190 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4dab9e2394c38fe03a8a 2026-04-05 05:18:45,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:18:45,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4dab9e2394c38fe03a8a HTTP/1.1" 200 None 2026-04-05 05:18:45,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:18:45,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:18:45,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:18:45,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4dab9e2394c38fe03a8a HTTP/1.1" 200 None 2026-04-05 05:18:45,249 - lava_callback - ERROR - Error processing callback for node 69cf4dab9e2394c38fe03a8a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48436 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:19:54,456 - lava_callback - INFO - Received callback for node 69cf4de99e2394c38fe03ac8 INFO: 172.21.0.1:51580 - "POST /node/69cf4de99e2394c38fe03ac8 HTTP/1.0" 202 Accepted 2026-04-05 05:19:54,462 - lava_callback - INFO - Starting async job submit for node 69cf4de99e2394c38fe03ac8 2026-04-05 05:19:54,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:19:54,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4de99e2394c38fe03ac8 HTTP/1.1" 200 None 2026-04-05 05:19:54,478 - lava_callback - DEBUG - Processing node 69cf4de99e2394c38fe03ac8: baseline-arm-clabbe 2026-04-05 05:19:54,478 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4de99e2394c38fe03ac8 2026-04-05 05:19:54,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:19:54,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4de99e2394c38fe03ac8 HTTP/1.1" 200 None 2026-04-05 05:19:54,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:19:54,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 05:19:54,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:19:54,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4de99e2394c38fe03ac8 HTTP/1.1" 200 None 2026-04-05 05:19:54,548 - lava_callback - ERROR - Error processing callback for node 69cf4de99e2394c38fe03ac8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51794 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:20:34,433 - lava_callback - INFO - Received callback for node 69cf4e0c9e2394c38fe03adf INFO: 172.21.0.1:51804 - "POST /node/69cf4e0c9e2394c38fe03adf HTTP/1.0" 202 Accepted 2026-04-05 05:20:34,439 - lava_callback - INFO - Starting async job submit for node 69cf4e0c9e2394c38fe03adf 2026-04-05 05:20:34,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:20:34,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4e0c9e2394c38fe03adf HTTP/1.1" 200 None 2026-04-05 05:20:34,455 - lava_callback - DEBUG - Processing node 69cf4e0c9e2394c38fe03adf: baseline-arm-clabbe 2026-04-05 05:20:34,455 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4e0c9e2394c38fe03adf 2026-04-05 05:20:34,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:20:34,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4e0c9e2394c38fe03adf HTTP/1.1" 200 None 2026-04-05 05:20:34,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:20:34,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 05:20:34,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:20:34,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4e0c9e2394c38fe03adf HTTP/1.1" 200 None 2026-04-05 05:20:34,527 - lava_callback - ERROR - Error processing callback for node 69cf4e0c9e2394c38fe03adf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33602 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:20:54,490 - lava_callback - INFO - Received callback for node 69cf4e2f9e2394c38fe03af2 INFO: 172.21.0.1:57798 - "POST /node/69cf4e2f9e2394c38fe03af2 HTTP/1.0" 202 Accepted 2026-04-05 05:20:54,496 - lava_callback - INFO - Starting async job submit for node 69cf4e2f9e2394c38fe03af2 2026-04-05 05:20:54,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:20:54,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4e2f9e2394c38fe03af2 HTTP/1.1" 200 None 2026-04-05 05:20:54,512 - lava_callback - DEBUG - Processing node 69cf4e2f9e2394c38fe03af2: baseline-arm-clabbe 2026-04-05 05:20:54,512 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4e2f9e2394c38fe03af2 2026-04-05 05:20:54,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:20:54,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4e2f9e2394c38fe03af2 HTTP/1.1" 200 None 2026-04-05 05:20:54,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:20:54,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 05:20:54,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:20:54,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4e2f9e2394c38fe03af2 HTTP/1.1" 200 None 2026-04-05 05:20:54,572 - lava_callback - ERROR - Error processing callback for node 69cf4e2f9e2394c38fe03af2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56742 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:21:34,443 - lava_callback - INFO - Received callback for node 69cf4e519e2394c38fe03b0e INFO: 172.21.0.1:56754 - "POST /node/69cf4e519e2394c38fe03b0e HTTP/1.0" 202 Accepted 2026-04-05 05:21:34,452 - lava_callback - INFO - Starting async job submit for node 69cf4e519e2394c38fe03b0e 2026-04-05 05:21:34,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:21:34,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4e519e2394c38fe03b0e HTTP/1.1" 200 None 2026-04-05 05:21:34,468 - lava_callback - DEBUG - Processing node 69cf4e519e2394c38fe03b0e: baseline-arm-clabbe 2026-04-05 05:21:34,468 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4e519e2394c38fe03b0e 2026-04-05 05:21:34,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:21:34,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4e519e2394c38fe03b0e HTTP/1.1" 200 None 2026-04-05 05:21:34,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:21:34,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 05:21:34,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:21:34,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4e519e2394c38fe03b0e HTTP/1.1" 200 None 2026-04-05 05:21:34,536 - lava_callback - ERROR - Error processing callback for node 69cf4e519e2394c38fe03b0e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52810 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:22:14,537 - lava_callback - INFO - Received callback for node 69cf4e749e2394c38fe03b2d INFO: 172.21.0.1:40958 - "POST /node/69cf4e749e2394c38fe03b2d HTTP/1.0" 202 Accepted 2026-04-05 05:22:14,543 - lava_callback - INFO - Starting async job submit for node 69cf4e749e2394c38fe03b2d 2026-04-05 05:22:14,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:22:14,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4e749e2394c38fe03b2d HTTP/1.1" 200 None 2026-04-05 05:22:14,559 - lava_callback - DEBUG - Processing node 69cf4e749e2394c38fe03b2d: baseline-arm-clabbe 2026-04-05 05:22:14,560 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4e749e2394c38fe03b2d 2026-04-05 05:22:14,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:22:14,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4e749e2394c38fe03b2d HTTP/1.1" 200 None 2026-04-05 05:22:14,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:22:14,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 05:22:14,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:22:14,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4e749e2394c38fe03b2d HTTP/1.1" 200 None 2026-04-05 05:22:14,614 - lava_callback - ERROR - Error processing callback for node 69cf4e749e2394c38fe03b2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56162 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:22:34,532 - lava_callback - INFO - Received callback for node 69cf4e969e2394c38fe03b4a INFO: 172.21.0.1:56176 - "POST /node/69cf4e969e2394c38fe03b4a HTTP/1.0" 202 Accepted 2026-04-05 05:22:34,538 - lava_callback - INFO - Starting async job submit for node 69cf4e969e2394c38fe03b4a 2026-04-05 05:22:34,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:22:34,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4e969e2394c38fe03b4a HTTP/1.1" 200 None 2026-04-05 05:22:34,554 - lava_callback - DEBUG - Processing node 69cf4e969e2394c38fe03b4a: baseline-arm-clabbe 2026-04-05 05:22:34,554 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4e969e2394c38fe03b4a 2026-04-05 05:22:34,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:22:34,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4e969e2394c38fe03b4a HTTP/1.1" 200 None 2026-04-05 05:22:34,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:22:34,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 05:22:34,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:22:34,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4e969e2394c38fe03b4a HTTP/1.1" 200 None 2026-04-05 05:22:34,613 - lava_callback - ERROR - Error processing callback for node 69cf4e969e2394c38fe03b4a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37594 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:23:34,660 - lava_callback - INFO - Received callback for node 69cf4ecb9e2394c38fe03b81 INFO: 172.21.0.1:37604 - "POST /node/69cf4ecb9e2394c38fe03b81 HTTP/1.0" 202 Accepted 2026-04-05 05:23:34,666 - lava_callback - INFO - Starting async job submit for node 69cf4ecb9e2394c38fe03b81 2026-04-05 05:23:34,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:23:34,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4ecb9e2394c38fe03b81 HTTP/1.1" 200 None 2026-04-05 05:23:34,682 - lava_callback - DEBUG - Processing node 69cf4ecb9e2394c38fe03b81: baseline-arm64-clabbe 2026-04-05 05:23:34,683 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4ecb9e2394c38fe03b81 2026-04-05 05:23:34,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:23:34,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4ecb9e2394c38fe03b81 HTTP/1.1" 200 None 2026-04-05 05:23:34,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:23:34,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:23:34,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:23:34,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4ecb9e2394c38fe03b81 HTTP/1.1" 200 None 2026-04-05 05:23:34,756 - lava_callback - ERROR - Error processing callback for node 69cf4ecb9e2394c38fe03b81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38452 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:24:34,656 - lava_callback - INFO - Received callback for node 69cf4f039e2394c38fe03bc2 INFO: 172.21.0.1:38458 - "POST /node/69cf4f039e2394c38fe03bc2 HTTP/1.0" 202 Accepted 2026-04-05 05:24:34,662 - lava_callback - INFO - Starting async job submit for node 69cf4f039e2394c38fe03bc2 2026-04-05 05:24:34,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:24:34,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4f039e2394c38fe03bc2 HTTP/1.1" 200 None 2026-04-05 05:24:34,678 - lava_callback - DEBUG - Processing node 69cf4f039e2394c38fe03bc2: baseline-arm-clabbe 2026-04-05 05:24:34,678 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4f039e2394c38fe03bc2 2026-04-05 05:24:34,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:24:34,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4f039e2394c38fe03bc2 HTTP/1.1" 200 None 2026-04-05 05:24:34,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:24:34,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 05:24:34,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:24:34,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4f039e2394c38fe03bc2 HTTP/1.1" 200 None 2026-04-05 05:24:34,728 - lava_callback - ERROR - Error processing callback for node 69cf4f039e2394c38fe03bc2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34232 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:25:14,751 - lava_callback - INFO - Received callback for node 69cf4f249e2394c38fe03be2 INFO: 172.21.0.1:48988 - "POST /node/69cf4f249e2394c38fe03be2 HTTP/1.0" 202 Accepted 2026-04-05 05:25:14,756 - lava_callback - INFO - Starting async job submit for node 69cf4f249e2394c38fe03be2 2026-04-05 05:25:14,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:25:14,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4f249e2394c38fe03be2 HTTP/1.1" 200 None 2026-04-05 05:25:14,773 - lava_callback - DEBUG - Processing node 69cf4f249e2394c38fe03be2: baseline-arm-clabbe 2026-04-05 05:25:14,773 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4f249e2394c38fe03be2 2026-04-05 05:25:14,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:25:14,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4f249e2394c38fe03be2 HTTP/1.1" 200 None 2026-04-05 05:25:14,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:25:14,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 05:25:14,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:25:14,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4f249e2394c38fe03be2 HTTP/1.1" 200 None 2026-04-05 05:25:14,828 - lava_callback - ERROR - Error processing callback for node 69cf4f249e2394c38fe03be2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52570 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:25:54,720 - lava_callback - INFO - Received callback for node 69cf4f559e2394c38fe03c13 INFO: 172.21.0.1:60450 - "POST /node/69cf4f559e2394c38fe03c13 HTTP/1.0" 202 Accepted 2026-04-05 05:25:54,727 - lava_callback - INFO - Starting async job submit for node 69cf4f559e2394c38fe03c13 2026-04-05 05:25:54,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:25:54,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4f559e2394c38fe03c13 HTTP/1.1" 200 None 2026-04-05 05:25:54,753 - lava_callback - DEBUG - Processing node 69cf4f559e2394c38fe03c13: baseline-arm64-clabbe 2026-04-05 05:25:54,753 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4f559e2394c38fe03c13 2026-04-05 05:25:54,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:25:54,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4f559e2394c38fe03c13 HTTP/1.1" 200 None 2026-04-05 05:25:54,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:25:54,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:25:54,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:25:54,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4f559e2394c38fe03c13 HTTP/1.1" 200 None 2026-04-05 05:25:54,812 - lava_callback - ERROR - Error processing callback for node 69cf4f559e2394c38fe03c13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54936 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:26:54,739 - lava_callback - INFO - Received callback for node 69cf4f8b9e2394c38fe03c51 INFO: 172.21.0.1:36240 - "POST /node/69cf4f8b9e2394c38fe03c51 HTTP/1.0" 202 Accepted 2026-04-05 05:26:54,745 - lava_callback - INFO - Starting async job submit for node 69cf4f8b9e2394c38fe03c51 2026-04-05 05:26:54,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:26:54,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4f8b9e2394c38fe03c51 HTTP/1.1" 200 None 2026-04-05 05:26:54,761 - lava_callback - DEBUG - Processing node 69cf4f8b9e2394c38fe03c51: baseline-arm-clabbe 2026-04-05 05:26:54,761 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4f8b9e2394c38fe03c51 2026-04-05 05:26:54,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:26:54,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4f8b9e2394c38fe03c51 HTTP/1.1" 200 None 2026-04-05 05:26:54,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:26:54,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4108df9359ff4897d25 HTTP/1.1" 200 None 2026-04-05 05:26:54,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:26:54,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4f8b9e2394c38fe03c51 HTTP/1.1" 200 None 2026-04-05 05:26:54,819 - lava_callback - ERROR - Error processing callback for node 69cf4f8b9e2394c38fe03c51: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53802 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:27:34,762 - lava_callback - INFO - Received callback for node 69cf4fbd9e2394c38fe03c6e INFO: 172.21.0.1:53816 - "POST /node/69cf4fbd9e2394c38fe03c6e HTTP/1.0" 202 Accepted 2026-04-05 05:27:34,768 - lava_callback - INFO - Starting async job submit for node 69cf4fbd9e2394c38fe03c6e 2026-04-05 05:27:34,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:27:34,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4fbd9e2394c38fe03c6e HTTP/1.1" 200 None 2026-04-05 05:27:34,789 - lava_callback - DEBUG - Processing node 69cf4fbd9e2394c38fe03c6e: baseline-arm64-clabbe 2026-04-05 05:27:34,789 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf4fbd9e2394c38fe03c6e 2026-04-05 05:27:34,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:27:34,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf4fbd9e2394c38fe03c6e HTTP/1.1" 200 None 2026-04-05 05:27:34,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:27:34,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:27:34,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:27:34,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf4fbd9e2394c38fe03c6e HTTP/1.1" 200 None 2026-04-05 05:27:34,866 - lava_callback - ERROR - Error processing callback for node 69cf4fbd9e2394c38fe03c6e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49574 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:28:54,945 - lava_callback - INFO - Received callback for node 69cf50079e2394c38fe03ca4 INFO: 172.21.0.1:36588 - "POST /node/69cf50079e2394c38fe03ca4 HTTP/1.0" 202 Accepted 2026-04-05 05:28:54,951 - lava_callback - INFO - Starting async job submit for node 69cf50079e2394c38fe03ca4 2026-04-05 05:28:54,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:28:54,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf50079e2394c38fe03ca4 HTTP/1.1" 200 None 2026-04-05 05:28:54,967 - lava_callback - DEBUG - Processing node 69cf50079e2394c38fe03ca4: baseline-arm64-clabbe 2026-04-05 05:28:54,967 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf50079e2394c38fe03ca4 2026-04-05 05:28:54,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:28:54,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf50079e2394c38fe03ca4 HTTP/1.1" 200 None 2026-04-05 05:28:54,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:28:54,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:28:54,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:28:55,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf50079e2394c38fe03ca4 HTTP/1.1" 200 None 2026-04-05 05:28:55,018 - lava_callback - ERROR - Error processing callback for node 69cf50079e2394c38fe03ca4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49396 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:29:54,970 - lava_callback - INFO - Received callback for node 69cf50509e2394c38fe03cdb INFO: 172.21.0.1:42114 - "POST /node/69cf50509e2394c38fe03cdb HTTP/1.0" 202 Accepted 2026-04-05 05:29:54,975 - lava_callback - INFO - Starting async job submit for node 69cf50509e2394c38fe03cdb 2026-04-05 05:29:54,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:29:54,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf50509e2394c38fe03cdb HTTP/1.1" 200 None 2026-04-05 05:29:54,991 - lava_callback - DEBUG - Processing node 69cf50509e2394c38fe03cdb: baseline-arm64-clabbe 2026-04-05 05:29:54,991 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf50509e2394c38fe03cdb 2026-04-05 05:29:54,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:29:55,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf50509e2394c38fe03cdb HTTP/1.1" 200 None 2026-04-05 05:29:55,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:29:55,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:29:55,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:29:55,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf50509e2394c38fe03cdb HTTP/1.1" 200 None 2026-04-05 05:29:55,051 - lava_callback - ERROR - Error processing callback for node 69cf50509e2394c38fe03cdb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44742 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:31:14,984 - lava_callback - INFO - Received callback for node 69cf509a9e2394c38fe03d12 INFO: 172.21.0.1:40742 - "POST /node/69cf509a9e2394c38fe03d12 HTTP/1.0" 202 Accepted 2026-04-05 05:31:14,989 - lava_callback - INFO - Starting async job submit for node 69cf509a9e2394c38fe03d12 2026-04-05 05:31:14,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:31:15,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf509a9e2394c38fe03d12 HTTP/1.1" 200 None 2026-04-05 05:31:15,006 - lava_callback - DEBUG - Processing node 69cf509a9e2394c38fe03d12: baseline-arm64-clabbe 2026-04-05 05:31:15,006 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf509a9e2394c38fe03d12 2026-04-05 05:31:15,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:31:15,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf509a9e2394c38fe03d12 HTTP/1.1" 200 None 2026-04-05 05:31:15,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:31:15,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:31:15,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:31:15,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf509a9e2394c38fe03d12 HTTP/1.1" 200 None 2026-04-05 05:31:15,057 - lava_callback - ERROR - Error processing callback for node 69cf509a9e2394c38fe03d12: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42200 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:33:26,237 - lava_callback - INFO - Received callback for node 69cf51139e2394c38fe03d4b INFO: 172.21.0.1:49202 - "POST /node/69cf51139e2394c38fe03d4b HTTP/1.0" 202 Accepted 2026-04-05 05:33:26,243 - lava_callback - INFO - Starting async job submit for node 69cf51139e2394c38fe03d4b 2026-04-05 05:33:26,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:33:26,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf51139e2394c38fe03d4b HTTP/1.1" 200 None 2026-04-05 05:33:26,259 - lava_callback - DEBUG - Processing node 69cf51139e2394c38fe03d4b: baseline-arm64-baylibre 2026-04-05 05:33:26,260 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf51139e2394c38fe03d4b 2026-04-05 05:33:26,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:33:26,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf51139e2394c38fe03d4b HTTP/1.1" 200 None 2026-04-05 05:33:26,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:33:26,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:33:26,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:33:26,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf51139e2394c38fe03d4b HTTP/1.1" 200 None 2026-04-05 05:33:26,329 - lava_callback - ERROR - Error processing callback for node 69cf51139e2394c38fe03d4b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45438 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:34:25,983 - lava_callback - INFO - Received callback for node 69cf515c9e2394c38fe03d84 INFO: 172.21.0.1:35522 - "POST /node/69cf515c9e2394c38fe03d84 HTTP/1.0" 202 Accepted 2026-04-05 05:34:25,988 - lava_callback - INFO - Starting async job submit for node 69cf515c9e2394c38fe03d84 2026-04-05 05:34:25,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:34:26,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf515c9e2394c38fe03d84 HTTP/1.1" 200 None 2026-04-05 05:34:26,005 - lava_callback - DEBUG - Processing node 69cf515c9e2394c38fe03d84: baseline-arm64-baylibre 2026-04-05 05:34:26,005 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf515c9e2394c38fe03d84 2026-04-05 05:34:26,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:34:26,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf515c9e2394c38fe03d84 HTTP/1.1" 200 None 2026-04-05 05:34:26,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:34:26,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:34:26,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:34:26,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf515c9e2394c38fe03d84 HTTP/1.1" 200 None 2026-04-05 05:34:26,059 - lava_callback - ERROR - Error processing callback for node 69cf515c9e2394c38fe03d84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60064 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:36:46,143 - lava_callback - INFO - Received callback for node 69cf51d99e2394c38fe03dc3 INFO: 172.21.0.1:55024 - "POST /node/69cf51d99e2394c38fe03dc3 HTTP/1.0" 202 Accepted 2026-04-05 05:36:46,149 - lava_callback - INFO - Starting async job submit for node 69cf51d99e2394c38fe03dc3 2026-04-05 05:36:46,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:36:46,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf51d99e2394c38fe03dc3 HTTP/1.1" 200 None 2026-04-05 05:36:46,173 - lava_callback - DEBUG - Processing node 69cf51d99e2394c38fe03dc3: baseline-arm64-baylibre 2026-04-05 05:36:46,174 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf51d99e2394c38fe03dc3 2026-04-05 05:36:46,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:36:46,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf51d99e2394c38fe03dc3 HTTP/1.1" 200 None 2026-04-05 05:36:46,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:36:46,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:36:46,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:36:46,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf51d99e2394c38fe03dc3 HTTP/1.1" 200 None 2026-04-05 05:36:46,239 - lava_callback - ERROR - Error processing callback for node 69cf51d99e2394c38fe03dc3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47832 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:39:06,314 - lava_callback - INFO - Received callback for node 69cf526a9e2394c38fe03e2f INFO: 172.21.0.1:48312 - "POST /node/69cf526a9e2394c38fe03e2f HTTP/1.0" 202 Accepted 2026-04-05 05:39:06,320 - lava_callback - INFO - Starting async job submit for node 69cf526a9e2394c38fe03e2f 2026-04-05 05:39:06,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:39:06,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf526a9e2394c38fe03e2f HTTP/1.1" 200 None 2026-04-05 05:39:06,337 - lava_callback - DEBUG - Processing node 69cf526a9e2394c38fe03e2f: baseline-arm64-baylibre 2026-04-05 05:39:06,337 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf526a9e2394c38fe03e2f 2026-04-05 05:39:06,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:39:06,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf526a9e2394c38fe03e2f HTTP/1.1" 200 None 2026-04-05 05:39:06,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:39:06,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:39:06,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:39:06,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf526a9e2394c38fe03e2f HTTP/1.1" 200 None 2026-04-05 05:39:06,408 - lava_callback - ERROR - Error processing callback for node 69cf526a9e2394c38fe03e2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49260 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:41:26,488 - lava_callback - INFO - Received callback for node 69cf52f89e2394c38fe03eb2 INFO: 172.21.0.1:60242 - "POST /node/69cf52f89e2394c38fe03eb2 HTTP/1.0" 202 Accepted 2026-04-05 05:41:26,494 - lava_callback - INFO - Starting async job submit for node 69cf52f89e2394c38fe03eb2 2026-04-05 05:41:26,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:60250 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:41:26,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf52f89e2394c38fe03eb2 HTTP/1.1" 200 None 2026-04-05 05:41:26,517 - lava_callback - DEBUG - Processing node 69cf52f89e2394c38fe03eb2: baseline-arm64-baylibre 2026-04-05 05:41:26,518 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf52f89e2394c38fe03eb2 2026-04-05 05:41:26,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:41:26,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf52f89e2394c38fe03eb2 HTTP/1.1" 200 None 2026-04-05 05:41:26,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:41:26,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:41:26,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:41:26,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf52f89e2394c38fe03eb2 HTTP/1.1" 200 None 2026-04-05 05:41:26,601 - lava_callback - ERROR - Error processing callback for node 69cf52f89e2394c38fe03eb2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35414 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:42:26,411 - lava_callback - INFO - Received callback for node 69cf533f9e2394c38fe03ef4 INFO: 172.21.0.1:49060 - "POST /node/69cf533f9e2394c38fe03ef4 HTTP/1.0" 202 Accepted 2026-04-05 05:42:26,417 - lava_callback - INFO - Starting async job submit for node 69cf533f9e2394c38fe03ef4 2026-04-05 05:42:26,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:42:26,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf533f9e2394c38fe03ef4 HTTP/1.1" 200 None 2026-04-05 05:42:26,442 - lava_callback - DEBUG - Processing node 69cf533f9e2394c38fe03ef4: baseline-arm64-baylibre 2026-04-05 05:42:26,442 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf533f9e2394c38fe03ef4 2026-04-05 05:42:26,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:42:26,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf533f9e2394c38fe03ef4 HTTP/1.1" 200 None 2026-04-05 05:42:26,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:42:26,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:42:26,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:49062 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:42:26,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf533f9e2394c38fe03ef4 HTTP/1.1" 200 None 2026-04-05 05:42:26,510 - lava_callback - ERROR - Error processing callback for node 69cf533f9e2394c38fe03ef4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48176 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:44:46,624 - lava_callback - INFO - Received callback for node 69cf53cb9e2394c38fe03f74 INFO: 172.21.0.1:48192 - "POST /node/69cf53cb9e2394c38fe03f74 HTTP/1.0" 202 Accepted 2026-04-05 05:44:46,630 - lava_callback - INFO - Starting async job submit for node 69cf53cb9e2394c38fe03f74 2026-04-05 05:44:46,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:44:46,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf53cb9e2394c38fe03f74 HTTP/1.1" 200 None 2026-04-05 05:44:46,660 - lava_callback - DEBUG - Processing node 69cf53cb9e2394c38fe03f74: baseline-arm64-baylibre 2026-04-05 05:44:46,660 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf53cb9e2394c38fe03f74 2026-04-05 05:44:46,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:44:46,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf53cb9e2394c38fe03f74 HTTP/1.1" 200 None 2026-04-05 05:44:46,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:44:46,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:44:46,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:44:46,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf53cb9e2394c38fe03f74 HTTP/1.1" 200 None 2026-04-05 05:44:46,720 - lava_callback - ERROR - Error processing callback for node 69cf53cb9e2394c38fe03f74: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50256 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:46:35,758 - lava_callback - INFO - Received callback for node 69cf54279e2394c38fe03fac INFO: 172.21.0.1:50270 - "POST /node/69cf54279e2394c38fe03fac HTTP/1.0" 202 Accepted 2026-04-05 05:46:35,763 - lava_callback - INFO - Starting async job submit for node 69cf54279e2394c38fe03fac 2026-04-05 05:46:35,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:46:35,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf54279e2394c38fe03fac HTTP/1.1" 200 None 2026-04-05 05:46:35,780 - lava_callback - DEBUG - Processing node 69cf54279e2394c38fe03fac: baseline-arm64-clabbe 2026-04-05 05:46:35,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf54279e2394c38fe03fac 2026-04-05 05:46:35,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:46:35,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf54279e2394c38fe03fac HTTP/1.1" 200 None 2026-04-05 05:46:35,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:46:35,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:46:35,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:46:35,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf54279e2394c38fe03fac HTTP/1.1" 200 None 2026-04-05 05:46:35,836 - lava_callback - ERROR - Error processing callback for node 69cf54279e2394c38fe03fac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42158 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:47:35,814 - lava_callback - INFO - Received callback for node 69cf546a9e2394c38fe03ff9 INFO: 172.21.0.1:42174 - "POST /node/69cf546a9e2394c38fe03ff9 HTTP/1.0" 202 Accepted 2026-04-05 05:47:35,819 - lava_callback - INFO - Starting async job submit for node 69cf546a9e2394c38fe03ff9 2026-04-05 05:47:35,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:47:35,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf546a9e2394c38fe03ff9 HTTP/1.1" 200 None 2026-04-05 05:47:35,838 - lava_callback - DEBUG - Processing node 69cf546a9e2394c38fe03ff9: baseline-arm64-clabbe 2026-04-05 05:47:35,838 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf546a9e2394c38fe03ff9 2026-04-05 05:47:35,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:47:35,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf546a9e2394c38fe03ff9 HTTP/1.1" 200 None 2026-04-05 05:47:35,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:47:35,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:47:35,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:47:35,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf546a9e2394c38fe03ff9 HTTP/1.1" 200 None 2026-04-05 05:47:35,940 - lava_callback - ERROR - Error processing callback for node 69cf546a9e2394c38fe03ff9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48268 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:48:56,105 - lava_callback - INFO - Received callback for node 69cf54b39e2394c38fe04049 INFO: 172.21.0.1:55022 - "POST /node/69cf54b39e2394c38fe04049 HTTP/1.0" 202 Accepted 2026-04-05 05:48:56,111 - lava_callback - INFO - Starting async job submit for node 69cf54b39e2394c38fe04049 2026-04-05 05:48:56,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:48:56,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf54b39e2394c38fe04049 HTTP/1.1" 200 None 2026-04-05 05:48:56,128 - lava_callback - DEBUG - Processing node 69cf54b39e2394c38fe04049: baseline-arm64-clabbe 2026-04-05 05:48:56,128 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf54b39e2394c38fe04049 2026-04-05 05:48:56,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:48:56,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf54b39e2394c38fe04049 HTTP/1.1" 200 None 2026-04-05 05:48:56,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:48:56,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:48:56,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:48:56,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf54b39e2394c38fe04049 HTTP/1.1" 200 None 2026-04-05 05:48:56,181 - lava_callback - ERROR - Error processing callback for node 69cf54b39e2394c38fe04049: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35762 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 05:50:15,958 - lava_callback - INFO - Received callback for node 69cf55029e2394c38fe04080 INFO: 172.21.0.1:35764 - "POST /node/69cf55029e2394c38fe04080 HTTP/1.0" 202 Accepted 2026-04-05 05:50:15,963 - lava_callback - INFO - Starting async job submit for node 69cf55029e2394c38fe04080 2026-04-05 05:50:15,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:50:15,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf55029e2394c38fe04080 HTTP/1.1" 200 None 2026-04-05 05:50:15,980 - lava_callback - DEBUG - Processing node 69cf55029e2394c38fe04080: baseline-arm64-clabbe 2026-04-05 05:50:15,980 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf55029e2394c38fe04080 2026-04-05 05:50:15,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:50:15,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf55029e2394c38fe04080 HTTP/1.1" 200 None 2026-04-05 05:50:15,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:50:16,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:50:16,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:50:16,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf55029e2394c38fe04080 HTTP/1.1" 200 None 2026-04-05 05:50:16,038 - lava_callback - ERROR - Error processing callback for node 69cf55029e2394c38fe04080: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44662 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 05:51:15,972 - lava_callback - INFO - Received callback for node 69cf554f9e2394c38fe040c5 INFO: 172.21.0.1:44670 - "POST /node/69cf554f9e2394c38fe040c5 HTTP/1.0" 202 Accepted 2026-04-05 05:51:15,978 - lava_callback - INFO - Starting async job submit for node 69cf554f9e2394c38fe040c5 2026-04-05 05:51:15,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:51:15,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf554f9e2394c38fe040c5 HTTP/1.1" 200 None 2026-04-05 05:51:16,000 - lava_callback - DEBUG - Processing node 69cf554f9e2394c38fe040c5: baseline-arm64-clabbe 2026-04-05 05:51:16,000 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf554f9e2394c38fe040c5 2026-04-05 05:51:16,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:51:16,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf554f9e2394c38fe040c5 HTTP/1.1" 200 None 2026-04-05 05:51:16,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:51:16,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:51:16,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:51:16,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf554f9e2394c38fe040c5 HTTP/1.1" 200 None 2026-04-05 05:51:16,056 - lava_callback - ERROR - Error processing callback for node 69cf554f9e2394c38fe040c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44628 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:52:36,049 - lava_callback - INFO - Received callback for node 69cf559c9e2394c38fe04115 INFO: 172.21.0.1:44642 - "POST /node/69cf559c9e2394c38fe04115 HTTP/1.0" 202 Accepted 2026-04-05 05:52:36,055 - lava_callback - INFO - Starting async job submit for node 69cf559c9e2394c38fe04115 2026-04-05 05:52:36,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:52:36,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf559c9e2394c38fe04115 HTTP/1.1" 200 None 2026-04-05 05:52:36,074 - lava_callback - DEBUG - Processing node 69cf559c9e2394c38fe04115: baseline-arm64-clabbe 2026-04-05 05:52:36,074 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf559c9e2394c38fe04115 2026-04-05 05:52:36,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:52:36,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf559c9e2394c38fe04115 HTTP/1.1" 200 None 2026-04-05 05:52:36,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:52:36,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:52:36,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:52:36,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf559c9e2394c38fe04115 HTTP/1.1" 200 None 2026-04-05 05:52:36,152 - lava_callback - ERROR - Error processing callback for node 69cf559c9e2394c38fe04115: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39008 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:53:56,203 - lava_callback - INFO - Received callback for node 69cf55e79e2394c38fe04157 INFO: 172.21.0.1:48496 - "POST /node/69cf55e79e2394c38fe04157 HTTP/1.0" 202 Accepted 2026-04-05 05:53:56,209 - lava_callback - INFO - Starting async job submit for node 69cf55e79e2394c38fe04157 2026-04-05 05:53:56,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:53:56,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf55e79e2394c38fe04157 HTTP/1.1" 200 None 2026-04-05 05:53:56,233 - lava_callback - DEBUG - Processing node 69cf55e79e2394c38fe04157: baseline-arm64-clabbe 2026-04-05 05:53:56,234 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf55e79e2394c38fe04157 2026-04-05 05:53:56,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:53:56,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf55e79e2394c38fe04157 HTTP/1.1" 200 None 2026-04-05 05:53:56,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:53:56,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:53:56,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:53:56,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf55e79e2394c38fe04157 HTTP/1.1" 200 None 2026-04-05 05:53:56,300 - lava_callback - ERROR - Error processing callback for node 69cf55e79e2394c38fe04157: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40726 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-05 05:55:16,346 - lava_callback - INFO - Received callback for node 69cf56329e2394c38fe04191 INFO: 172.21.0.1:40734 - "POST /node/69cf56329e2394c38fe04191 HTTP/1.0" 202 Accepted 2026-04-05 05:55:16,353 - lava_callback - INFO - Starting async job submit for node 69cf56329e2394c38fe04191 2026-04-05 05:55:16,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:55:16,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf56329e2394c38fe04191 HTTP/1.1" 200 None 2026-04-05 05:55:16,373 - lava_callback - DEBUG - Processing node 69cf56329e2394c38fe04191: baseline-arm64-clabbe 2026-04-05 05:55:16,373 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf56329e2394c38fe04191 2026-04-05 05:55:16,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:55:16,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf56329e2394c38fe04191 HTTP/1.1" 200 None 2026-04-05 05:55:16,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:55:16,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:55:16,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:55:16,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf56329e2394c38fe04191 HTTP/1.1" 200 None 2026-04-05 05:55:16,424 - lava_callback - ERROR - Error processing callback for node 69cf56329e2394c38fe04191: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52410 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:56:36,252 - lava_callback - INFO - Received callback for node 69cf56819e2394c38fe041c7 INFO: 172.21.0.1:52412 - "POST /node/69cf56819e2394c38fe041c7 HTTP/1.0" 202 Accepted 2026-04-05 05:56:36,258 - lava_callback - INFO - Starting async job submit for node 69cf56819e2394c38fe041c7 2026-04-05 05:56:36,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:56:36,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf56819e2394c38fe041c7 HTTP/1.1" 200 None 2026-04-05 05:56:36,274 - lava_callback - DEBUG - Processing node 69cf56819e2394c38fe041c7: baseline-arm64-clabbe 2026-04-05 05:56:36,275 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf56819e2394c38fe041c7 2026-04-05 05:56:36,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:56:36,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf56819e2394c38fe041c7 HTTP/1.1" 200 None 2026-04-05 05:56:36,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:56:36,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:56:36,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:56:36,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf56819e2394c38fe041c7 HTTP/1.1" 200 None 2026-04-05 05:56:36,345 - lava_callback - ERROR - Error processing callback for node 69cf56819e2394c38fe041c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51582 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:57:36,310 - lava_callback - INFO - Received callback for node 69cf56ca9e2394c38fe04201 INFO: 172.21.0.1:51594 - "POST /node/69cf56ca9e2394c38fe04201 HTTP/1.0" 202 Accepted 2026-04-05 05:57:36,315 - lava_callback - INFO - Starting async job submit for node 69cf56ca9e2394c38fe04201 2026-04-05 05:57:36,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:57:36,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf56ca9e2394c38fe04201 HTTP/1.1" 200 None 2026-04-05 05:57:36,332 - lava_callback - DEBUG - Processing node 69cf56ca9e2394c38fe04201: baseline-arm64-clabbe 2026-04-05 05:57:36,333 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf56ca9e2394c38fe04201 2026-04-05 05:57:36,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:57:36,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf56ca9e2394c38fe04201 HTTP/1.1" 200 None 2026-04-05 05:57:36,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:57:36,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:57:36,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:57:36,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf56ca9e2394c38fe04201 HTTP/1.1" 200 None 2026-04-05 05:57:36,390 - lava_callback - ERROR - Error processing callback for node 69cf56ca9e2394c38fe04201: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56050 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:58:56,452 - lava_callback - INFO - Received callback for node 69cf57149e2394c38fe04237 INFO: 172.21.0.1:37162 - "POST /node/69cf57149e2394c38fe04237 HTTP/1.0" 202 Accepted 2026-04-05 05:58:56,457 - lava_callback - INFO - Starting async job submit for node 69cf57149e2394c38fe04237 2026-04-05 05:58:56,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:58:56,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf57149e2394c38fe04237 HTTP/1.1" 200 None 2026-04-05 05:58:56,473 - lava_callback - DEBUG - Processing node 69cf57149e2394c38fe04237: baseline-arm64-clabbe 2026-04-05 05:58:56,473 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf57149e2394c38fe04237 2026-04-05 05:58:56,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:58:56,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf57149e2394c38fe04237 HTTP/1.1" 200 None 2026-04-05 05:58:56,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 05:58:56,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 05:58:56,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:37168 - "GET / HTTP/1.0" 200 OK 2026-04-05 05:58:56,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf57149e2394c38fe04237 HTTP/1.1" 200 None 2026-04-05 05:58:56,534 - lava_callback - ERROR - Error processing callback for node 69cf57149e2394c38fe04237: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60684 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:00:16,616 - lava_callback - INFO - Received callback for node 69cf575e9e2394c38fe04269 INFO: 172.21.0.1:60686 - "POST /node/69cf575e9e2394c38fe04269 HTTP/1.0" 202 Accepted 2026-04-05 06:00:16,621 - lava_callback - INFO - Starting async job submit for node 69cf575e9e2394c38fe04269 2026-04-05 06:00:16,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:00:16,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf575e9e2394c38fe04269 HTTP/1.1" 200 None 2026-04-05 06:00:16,638 - lava_callback - DEBUG - Processing node 69cf575e9e2394c38fe04269: baseline-arm64-clabbe 2026-04-05 06:00:16,638 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf575e9e2394c38fe04269 2026-04-05 06:00:16,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:00:16,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf575e9e2394c38fe04269 HTTP/1.1" 200 None 2026-04-05 06:00:16,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:00:16,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-05 06:00:16,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:00:16,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf575e9e2394c38fe04269 HTTP/1.1" 200 None 2026-04-05 06:00:16,704 - lava_callback - ERROR - Error processing callback for node 69cf575e9e2394c38fe04269: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43260 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:37:09,457 - lava_callback - INFO - Received callback for node 69cf60109e2394c38fe042ce INFO: 172.21.0.1:43266 - "POST /node/69cf60109e2394c38fe042ce HTTP/1.0" 202 Accepted 2026-04-05 06:37:09,463 - lava_callback - INFO - Starting async job submit for node 69cf60109e2394c38fe042ce 2026-04-05 06:37:09,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:37:09,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf60109e2394c38fe042ce HTTP/1.1" 200 None 2026-04-05 06:37:09,492 - lava_callback - DEBUG - Processing node 69cf60109e2394c38fe042ce: baseline-arm-baylibre 2026-04-05 06:37:09,492 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf60109e2394c38fe042ce 2026-04-05 06:37:09,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:37:09,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf60109e2394c38fe042ce HTTP/1.1" 200 None 2026-04-05 06:37:09,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:37:09,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 06:37:09,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:37:09,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf60109e2394c38fe042ce HTTP/1.1" 200 None 2026-04-05 06:37:09,558 - lava_callback - ERROR - Error processing callback for node 69cf60109e2394c38fe042ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51778 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:39:09,501 - lava_callback - INFO - Received callback for node 69cf60799e2394c38fe04302 INFO: 172.21.0.1:51792 - "POST /node/69cf60799e2394c38fe04302 HTTP/1.0" 202 Accepted 2026-04-05 06:39:09,507 - lava_callback - INFO - Starting async job submit for node 69cf60799e2394c38fe04302 2026-04-05 06:39:09,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:39:09,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf60799e2394c38fe04302 HTTP/1.1" 200 None 2026-04-05 06:39:09,523 - lava_callback - DEBUG - Processing node 69cf60799e2394c38fe04302: baseline-arm-baylibre 2026-04-05 06:39:09,524 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf60799e2394c38fe04302 2026-04-05 06:39:09,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:39:09,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf60799e2394c38fe04302 HTTP/1.1" 200 None 2026-04-05 06:39:09,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:39:09,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 06:39:09,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:39:09,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf60799e2394c38fe04302 HTTP/1.1" 200 None 2026-04-05 06:39:09,613 - lava_callback - ERROR - Error processing callback for node 69cf60799e2394c38fe04302: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59184 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:39:29,481 - lava_callback - INFO - Received callback for node 69cf609d9e2394c38fe04316 INFO: 172.21.0.1:59192 - "POST /node/69cf609d9e2394c38fe04316 HTTP/1.0" 202 Accepted 2026-04-05 06:39:29,489 - lava_callback - INFO - Starting async job submit for node 69cf609d9e2394c38fe04316 2026-04-05 06:39:29,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:39:29,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf609d9e2394c38fe04316 HTTP/1.1" 200 None 2026-04-05 06:39:29,505 - lava_callback - DEBUG - Processing node 69cf609d9e2394c38fe04316: baseline-arm-baylibre 2026-04-05 06:39:29,505 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf609d9e2394c38fe04316 2026-04-05 06:39:29,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:39:29,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf609d9e2394c38fe04316 HTTP/1.1" 200 None 2026-04-05 06:39:29,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:39:29,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 06:39:29,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:39:29,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf609d9e2394c38fe04316 HTTP/1.1" 200 None 2026-04-05 06:39:29,559 - lava_callback - ERROR - Error processing callback for node 69cf609d9e2394c38fe04316: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51906 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:40:18,740 - lava_callback - INFO - Received callback for node 69cf60c19e2394c38fe0432c INFO: 172.21.0.1:51918 - "POST /node/69cf60c19e2394c38fe0432c HTTP/1.0" 202 Accepted 2026-04-05 06:40:18,745 - lava_callback - INFO - Starting async job submit for node 69cf60c19e2394c38fe0432c 2026-04-05 06:40:18,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:40:18,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf60c19e2394c38fe0432c HTTP/1.1" 200 None 2026-04-05 06:40:18,761 - lava_callback - DEBUG - Processing node 69cf60c19e2394c38fe0432c: baseline-arm-clabbe 2026-04-05 06:40:18,761 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf60c19e2394c38fe0432c 2026-04-05 06:40:18,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:40:18,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf60c19e2394c38fe0432c HTTP/1.1" 200 None 2026-04-05 06:40:18,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:40:18,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 06:40:18,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:40:18,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf60c19e2394c38fe0432c HTTP/1.1" 200 None 2026-04-05 06:40:18,824 - lava_callback - ERROR - Error processing callback for node 69cf60c19e2394c38fe0432c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49250 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:40:49,571 - lava_callback - INFO - Received callback for node 69cf60e29e2394c38fe04348 INFO: 172.21.0.1:49264 - "POST /node/69cf60e29e2394c38fe04348 HTTP/1.0" 202 Accepted 2026-04-05 06:40:49,576 - lava_callback - INFO - Starting async job submit for node 69cf60e29e2394c38fe04348 2026-04-05 06:40:49,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:40:49,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf60e29e2394c38fe04348 HTTP/1.1" 200 None 2026-04-05 06:40:49,593 - lava_callback - DEBUG - Processing node 69cf60e29e2394c38fe04348: baseline-arm-baylibre 2026-04-05 06:40:49,593 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf60e29e2394c38fe04348 2026-04-05 06:40:49,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:40:49,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf60e29e2394c38fe04348 HTTP/1.1" 200 None 2026-04-05 06:40:49,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:40:49,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 06:40:49,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:40:49,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf60e29e2394c38fe04348 HTTP/1.1" 200 None 2026-04-05 06:40:49,653 - lava_callback - ERROR - Error processing callback for node 69cf60e29e2394c38fe04348: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55906 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:41:18,465 - lava_callback - INFO - Received callback for node 69cf61049e2394c38fe04388 INFO: 172.21.0.1:55910 - "POST /node/69cf61049e2394c38fe04388 HTTP/1.0" 202 Accepted 2026-04-05 06:41:18,471 - lava_callback - INFO - Starting async job submit for node 69cf61049e2394c38fe04388 2026-04-05 06:41:18,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:41:18,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf61049e2394c38fe04388 HTTP/1.1" 200 None 2026-04-05 06:41:18,487 - lava_callback - DEBUG - Processing node 69cf61049e2394c38fe04388: baseline-arm-clabbe 2026-04-05 06:41:18,487 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf61049e2394c38fe04388 2026-04-05 06:41:18,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:41:18,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf61049e2394c38fe04388 HTTP/1.1" 200 None 2026-04-05 06:41:18,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:41:18,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 06:41:18,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:41:18,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf61049e2394c38fe04388 HTTP/1.1" 200 None 2026-04-05 06:41:18,544 - lava_callback - ERROR - Error processing callback for node 69cf61049e2394c38fe04388: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56798 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:41:58,528 - lava_callback - INFO - Received callback for node 69cf61259e2394c38fe043b6 INFO: 172.21.0.1:56814 - "POST /node/69cf61259e2394c38fe043b6 HTTP/1.0" 202 Accepted 2026-04-05 06:41:58,534 - lava_callback - INFO - Starting async job submit for node 69cf61259e2394c38fe043b6 2026-04-05 06:41:58,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:41:58,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf61259e2394c38fe043b6 HTTP/1.1" 200 None 2026-04-05 06:41:58,554 - lava_callback - DEBUG - Processing node 69cf61259e2394c38fe043b6: baseline-arm-clabbe 2026-04-05 06:41:58,554 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf61259e2394c38fe043b6 2026-04-05 06:41:58,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:41:58,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf61259e2394c38fe043b6 HTTP/1.1" 200 None 2026-04-05 06:41:58,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:41:58,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 06:41:58,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:41:58,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf61259e2394c38fe043b6 HTTP/1.1" 200 None 2026-04-05 06:41:58,620 - lava_callback - ERROR - Error processing callback for node 69cf61259e2394c38fe043b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55982 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:42:58,613 - lava_callback - INFO - Received callback for node 69cf61699e2394c38fe043e8 INFO: 172.21.0.1:55984 - "POST /node/69cf61699e2394c38fe043e8 HTTP/1.0" 202 Accepted 2026-04-05 06:42:58,618 - lava_callback - INFO - Starting async job submit for node 69cf61699e2394c38fe043e8 2026-04-05 06:42:58,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:42:58,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf61699e2394c38fe043e8 HTTP/1.1" 200 None 2026-04-05 06:42:58,636 - lava_callback - DEBUG - Processing node 69cf61699e2394c38fe043e8: baseline-arm-clabbe 2026-04-05 06:42:58,637 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf61699e2394c38fe043e8 2026-04-05 06:42:58,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:42:58,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf61699e2394c38fe043e8 HTTP/1.1" 200 None 2026-04-05 06:42:58,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:42:58,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 06:42:58,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:42:58,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf61699e2394c38fe043e8 HTTP/1.1" 200 None 2026-04-05 06:42:58,689 - lava_callback - ERROR - Error processing callback for node 69cf61699e2394c38fe043e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43760 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:43:38,680 - lava_callback - INFO - Received callback for node 69cf618b9e2394c38fe04407 INFO: 172.21.0.1:43774 - "POST /node/69cf618b9e2394c38fe04407 HTTP/1.0" 202 Accepted 2026-04-05 06:43:38,686 - lava_callback - INFO - Starting async job submit for node 69cf618b9e2394c38fe04407 2026-04-05 06:43:38,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:43:38,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf618b9e2394c38fe04407 HTTP/1.1" 200 None 2026-04-05 06:43:38,708 - lava_callback - DEBUG - Processing node 69cf618b9e2394c38fe04407: baseline-arm-clabbe 2026-04-05 06:43:38,708 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf618b9e2394c38fe04407 2026-04-05 06:43:38,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:43:38,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf618b9e2394c38fe04407 HTTP/1.1" 200 None 2026-04-05 06:43:38,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:43:38,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 06:43:38,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:43:38,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf618b9e2394c38fe04407 HTTP/1.1" 200 None 2026-04-05 06:43:38,775 - lava_callback - ERROR - Error processing callback for node 69cf618b9e2394c38fe04407: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43090 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:43:58,707 - lava_callback - INFO - Received callback for node 69cf61ab9e2394c38fe04429 INFO: 172.21.0.1:43106 - "POST /node/69cf61ab9e2394c38fe04429 HTTP/1.0" 202 Accepted 2026-04-05 06:43:58,713 - lava_callback - INFO - Starting async job submit for node 69cf61ab9e2394c38fe04429 2026-04-05 06:43:58,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:43:58,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf61ab9e2394c38fe04429 HTTP/1.1" 200 None 2026-04-05 06:43:58,728 - lava_callback - DEBUG - Processing node 69cf61ab9e2394c38fe04429: baseline-arm-clabbe 2026-04-05 06:43:58,729 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf61ab9e2394c38fe04429 2026-04-05 06:43:58,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:43:58,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf61ab9e2394c38fe04429 HTTP/1.1" 200 None 2026-04-05 06:43:58,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:43:58,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 06:43:58,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:43:58,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf61ab9e2394c38fe04429 HTTP/1.1" 200 None 2026-04-05 06:43:58,781 - lava_callback - ERROR - Error processing callback for node 69cf61ab9e2394c38fe04429: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49634 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:44:38,699 - lava_callback - INFO - Received callback for node 69cf61ce9e2394c38fe0444d INFO: 172.21.0.1:49650 - "POST /node/69cf61ce9e2394c38fe0444d HTTP/1.0" 202 Accepted 2026-04-05 06:44:38,705 - lava_callback - INFO - Starting async job submit for node 69cf61ce9e2394c38fe0444d 2026-04-05 06:44:38,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:44:38,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf61ce9e2394c38fe0444d HTTP/1.1" 200 None 2026-04-05 06:44:38,721 - lava_callback - DEBUG - Processing node 69cf61ce9e2394c38fe0444d: baseline-arm-clabbe 2026-04-05 06:44:38,721 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf61ce9e2394c38fe0444d 2026-04-05 06:44:38,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:44:38,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf61ce9e2394c38fe0444d HTTP/1.1" 200 None 2026-04-05 06:44:38,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:44:38,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 06:44:38,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:44:38,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf61ce9e2394c38fe0444d HTTP/1.1" 200 None 2026-04-05 06:44:38,784 - lava_callback - ERROR - Error processing callback for node 69cf61ce9e2394c38fe0444d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43610 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:45:18,817 - lava_callback - INFO - Received callback for node 69cf61f19e2394c38fe04464 INFO: 172.21.0.1:43620 - "POST /node/69cf61f19e2394c38fe04464 HTTP/1.0" 202 Accepted 2026-04-05 06:45:18,823 - lava_callback - INFO - Starting async job submit for node 69cf61f19e2394c38fe04464 2026-04-05 06:45:18,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:45:18,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf61f19e2394c38fe04464 HTTP/1.1" 200 None 2026-04-05 06:45:18,838 - lava_callback - DEBUG - Processing node 69cf61f19e2394c38fe04464: baseline-arm-clabbe 2026-04-05 06:45:18,839 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf61f19e2394c38fe04464 2026-04-05 06:45:18,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:45:18,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf61f19e2394c38fe04464 HTTP/1.1" 200 None 2026-04-05 06:45:18,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:45:18,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 06:45:18,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:45:18,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf61f19e2394c38fe04464 HTTP/1.1" 200 None 2026-04-05 06:45:18,891 - lava_callback - ERROR - Error processing callback for node 69cf61f19e2394c38fe04464: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47236 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:45:58,668 - lava_callback - INFO - Received callback for node 69cf62139e2394c38fe04499 INFO: 172.21.0.1:47240 - "POST /node/69cf62139e2394c38fe04499 HTTP/1.0" 202 Accepted 2026-04-05 06:45:58,673 - lava_callback - INFO - Starting async job submit for node 69cf62139e2394c38fe04499 2026-04-05 06:45:58,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:45:58,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf62139e2394c38fe04499 HTTP/1.1" 200 None 2026-04-05 06:45:58,689 - lava_callback - DEBUG - Processing node 69cf62139e2394c38fe04499: baseline-arm-clabbe 2026-04-05 06:45:58,690 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf62139e2394c38fe04499 2026-04-05 06:45:58,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:45:58,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf62139e2394c38fe04499 HTTP/1.1" 200 None 2026-04-05 06:45:58,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:45:58,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 06:45:58,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:45:58,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf62139e2394c38fe04499 HTTP/1.1" 200 None 2026-04-05 06:45:58,749 - lava_callback - ERROR - Error processing callback for node 69cf62139e2394c38fe04499: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50964 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:46:18,747 - lava_callback - INFO - Received callback for node 69cf62349e2394c38fe044b6 INFO: 172.21.0.1:50978 - "POST /node/69cf62349e2394c38fe044b6 HTTP/1.0" 202 Accepted 2026-04-05 06:46:18,753 - lava_callback - INFO - Starting async job submit for node 69cf62349e2394c38fe044b6 2026-04-05 06:46:18,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:46:18,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf62349e2394c38fe044b6 HTTP/1.1" 200 None 2026-04-05 06:46:18,769 - lava_callback - DEBUG - Processing node 69cf62349e2394c38fe044b6: baseline-arm-clabbe 2026-04-05 06:46:18,769 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf62349e2394c38fe044b6 2026-04-05 06:46:18,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:46:18,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf62349e2394c38fe044b6 HTTP/1.1" 200 None 2026-04-05 06:46:18,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:46:18,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 06:46:18,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:46:18,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf62349e2394c38fe044b6 HTTP/1.1" 200 None 2026-04-05 06:46:18,835 - lava_callback - ERROR - Error processing callback for node 69cf62349e2394c38fe044b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56054 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:46:58,779 - lava_callback - INFO - Received callback for node 69cf62559e2394c38fe044d3 INFO: 172.21.0.1:56068 - "POST /node/69cf62559e2394c38fe044d3 HTTP/1.0" 202 Accepted 2026-04-05 06:46:58,786 - lava_callback - INFO - Starting async job submit for node 69cf62559e2394c38fe044d3 2026-04-05 06:46:58,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:46:58,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf62559e2394c38fe044d3 HTTP/1.1" 200 None 2026-04-05 06:46:58,806 - lava_callback - DEBUG - Processing node 69cf62559e2394c38fe044d3: baseline-arm-clabbe 2026-04-05 06:46:58,806 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf62559e2394c38fe044d3 2026-04-05 06:46:58,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:46:58,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf62559e2394c38fe044d3 HTTP/1.1" 200 None 2026-04-05 06:46:58,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:46:59,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 06:46:59,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:46:59,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf62559e2394c38fe044d3 HTTP/1.1" 200 None 2026-04-05 06:46:59,045 - lava_callback - ERROR - Error processing callback for node 69cf62559e2394c38fe044d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47108 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:47:38,841 - lava_callback - INFO - Received callback for node 69cf62769e2394c38fe044f7 INFO: 172.21.0.1:47122 - "POST /node/69cf62769e2394c38fe044f7 HTTP/1.0" 202 Accepted 2026-04-05 06:47:38,847 - lava_callback - INFO - Starting async job submit for node 69cf62769e2394c38fe044f7 2026-04-05 06:47:38,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:47:38,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf62769e2394c38fe044f7 HTTP/1.1" 200 None 2026-04-05 06:47:38,863 - lava_callback - DEBUG - Processing node 69cf62769e2394c38fe044f7: baseline-arm-clabbe 2026-04-05 06:47:38,863 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf62769e2394c38fe044f7 2026-04-05 06:47:38,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:47:38,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf62769e2394c38fe044f7 HTTP/1.1" 200 None 2026-04-05 06:47:38,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:47:38,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc647b8cd9cbcdc9459647 HTTP/1.1" 200 None 2026-04-05 06:47:38,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:47:38,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf62769e2394c38fe044f7 HTTP/1.1" 200 None 2026-04-05 06:47:38,928 - lava_callback - ERROR - Error processing callback for node 69cf62769e2394c38fe044f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39728 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:47:50,014 - lava_callback - INFO - Received callback for node 69cf62939e2394c38fe04520 INFO: 172.21.0.1:44188 - "POST /node/69cf62939e2394c38fe04520 HTTP/1.0" 202 Accepted 2026-04-05 06:47:50,020 - lava_callback - INFO - Starting async job submit for node 69cf62939e2394c38fe04520 2026-04-05 06:47:50,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:47:50,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf62939e2394c38fe04520 HTTP/1.1" 200 None 2026-04-05 06:47:50,035 - lava_callback - DEBUG - Processing node 69cf62939e2394c38fe04520: baseline-arm-baylibre 2026-04-05 06:47:50,036 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf62939e2394c38fe04520 2026-04-05 06:47:50,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:47:50,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf62939e2394c38fe04520 HTTP/1.1" 200 None 2026-04-05 06:47:50,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:47:50,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 06:47:50,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:47:50,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf62939e2394c38fe04520 HTTP/1.1" 200 None 2026-04-05 06:47:50,093 - lava_callback - ERROR - Error processing callback for node 69cf62939e2394c38fe04520: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60938 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:48:29,991 - lava_callback - INFO - Received callback for node 69cf62b49e2394c38fe04538 INFO: 172.21.0.1:58330 - "POST /node/69cf62b49e2394c38fe04538 HTTP/1.0" 202 Accepted 2026-04-05 06:48:29,996 - lava_callback - INFO - Starting async job submit for node 69cf62b49e2394c38fe04538 2026-04-05 06:48:29,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:48:30,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf62b49e2394c38fe04538 HTTP/1.1" 200 None 2026-04-05 06:48:30,016 - lava_callback - DEBUG - Processing node 69cf62b49e2394c38fe04538: baseline-arm-baylibre 2026-04-05 06:48:30,016 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf62b49e2394c38fe04538 2026-04-05 06:48:30,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:48:30,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf62b49e2394c38fe04538 HTTP/1.1" 200 None 2026-04-05 06:48:30,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:48:30,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 06:48:30,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:48:30,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf62b49e2394c38fe04538 HTTP/1.1" 200 None 2026-04-05 06:48:30,079 - lava_callback - ERROR - Error processing callback for node 69cf62b49e2394c38fe04538: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51216 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:49:10,047 - lava_callback - INFO - Received callback for node 69cf62d49e2394c38fe04558 INFO: 172.21.0.1:46110 - "POST /node/69cf62d49e2394c38fe04558 HTTP/1.0" 202 Accepted 2026-04-05 06:49:10,053 - lava_callback - INFO - Starting async job submit for node 69cf62d49e2394c38fe04558 2026-04-05 06:49:10,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:49:10,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf62d49e2394c38fe04558 HTTP/1.1" 200 None 2026-04-05 06:49:10,077 - lava_callback - DEBUG - Processing node 69cf62d49e2394c38fe04558: baseline-arm-baylibre 2026-04-05 06:49:10,077 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf62d49e2394c38fe04558 2026-04-05 06:49:10,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:49:10,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf62d49e2394c38fe04558 HTTP/1.1" 200 None 2026-04-05 06:49:10,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:49:10,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 06:49:10,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:49:10,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf62d49e2394c38fe04558 HTTP/1.1" 200 None 2026-04-05 06:49:10,142 - lava_callback - ERROR - Error processing callback for node 69cf62d49e2394c38fe04558: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60526 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:49:30,058 - lava_callback - INFO - Received callback for node 69cf62f79e2394c38fe04585 INFO: 172.21.0.1:43508 - "POST /node/69cf62f79e2394c38fe04585 HTTP/1.0" 202 Accepted 2026-04-05 06:49:30,067 - lava_callback - INFO - Starting async job submit for node 69cf62f79e2394c38fe04585 2026-04-05 06:49:30,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:49:30,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf62f79e2394c38fe04585 HTTP/1.1" 200 None 2026-04-05 06:49:30,089 - lava_callback - DEBUG - Processing node 69cf62f79e2394c38fe04585: baseline-arm-baylibre 2026-04-05 06:49:30,089 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf62f79e2394c38fe04585 2026-04-05 06:49:30,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:49:30,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf62f79e2394c38fe04585 HTTP/1.1" 200 None 2026-04-05 06:49:30,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:49:30,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 06:49:30,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:49:30,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf62f79e2394c38fe04585 HTTP/1.1" 200 None 2026-04-05 06:49:30,159 - lava_callback - ERROR - Error processing callback for node 69cf62f79e2394c38fe04585: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38154 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:50:10,083 - lava_callback - INFO - Received callback for node 69cf63199e2394c38fe045bf INFO: 172.21.0.1:35574 - "POST /node/69cf63199e2394c38fe045bf HTTP/1.0" 202 Accepted 2026-04-05 06:50:10,089 - lava_callback - INFO - Starting async job submit for node 69cf63199e2394c38fe045bf 2026-04-05 06:50:10,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:50:10,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf63199e2394c38fe045bf HTTP/1.1" 200 None 2026-04-05 06:50:10,111 - lava_callback - DEBUG - Processing node 69cf63199e2394c38fe045bf: baseline-arm-baylibre 2026-04-05 06:50:10,112 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf63199e2394c38fe045bf 2026-04-05 06:50:10,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:50:10,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf63199e2394c38fe045bf HTTP/1.1" 200 None 2026-04-05 06:50:10,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:50:10,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 06:50:10,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:50:10,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf63199e2394c38fe045bf HTTP/1.1" 200 None 2026-04-05 06:50:10,179 - lava_callback - ERROR - Error processing callback for node 69cf63199e2394c38fe045bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34630 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:50:50,157 - lava_callback - INFO - Received callback for node 69cf63389e2394c38fe045e6 INFO: 172.21.0.1:58740 - "POST /node/69cf63389e2394c38fe045e6 HTTP/1.0" 202 Accepted 2026-04-05 06:50:50,163 - lava_callback - INFO - Starting async job submit for node 69cf63389e2394c38fe045e6 2026-04-05 06:50:50,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:50:50,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf63389e2394c38fe045e6 HTTP/1.1" 200 None 2026-04-05 06:50:50,183 - lava_callback - DEBUG - Processing node 69cf63389e2394c38fe045e6: baseline-arm-baylibre 2026-04-05 06:50:50,183 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf63389e2394c38fe045e6 2026-04-05 06:50:50,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:50:50,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf63389e2394c38fe045e6 HTTP/1.1" 200 None 2026-04-05 06:50:50,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:50:50,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 06:50:50,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:50:50,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf63389e2394c38fe045e6 HTTP/1.1" 200 None 2026-04-05 06:50:50,242 - lava_callback - ERROR - Error processing callback for node 69cf63389e2394c38fe045e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42126 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:51:10,118 - lava_callback - INFO - Received callback for node 69cf635b9e2394c38fe04620 INFO: 172.21.0.1:43914 - "POST /node/69cf635b9e2394c38fe04620 HTTP/1.0" 202 Accepted 2026-04-05 06:51:10,124 - lava_callback - INFO - Starting async job submit for node 69cf635b9e2394c38fe04620 2026-04-05 06:51:10,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:51:10,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf635b9e2394c38fe04620 HTTP/1.1" 200 None 2026-04-05 06:51:10,144 - lava_callback - DEBUG - Processing node 69cf635b9e2394c38fe04620: baseline-arm-baylibre 2026-04-05 06:51:10,145 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf635b9e2394c38fe04620 2026-04-05 06:51:10,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:51:10,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf635b9e2394c38fe04620 HTTP/1.1" 200 None 2026-04-05 06:51:10,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:51:10,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 06:51:10,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:51:10,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf635b9e2394c38fe04620 HTTP/1.1" 200 None 2026-04-05 06:51:10,204 - lava_callback - ERROR - Error processing callback for node 69cf635b9e2394c38fe04620: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37216 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:51:50,153 - lava_callback - INFO - Received callback for node 69cf63799e2394c38fe0464e INFO: 172.21.0.1:37944 - "POST /node/69cf63799e2394c38fe0464e HTTP/1.0" 202 Accepted 2026-04-05 06:51:50,159 - lava_callback - INFO - Starting async job submit for node 69cf63799e2394c38fe0464e 2026-04-05 06:51:50,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:51:50,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf63799e2394c38fe0464e HTTP/1.1" 200 None 2026-04-05 06:51:50,176 - lava_callback - DEBUG - Processing node 69cf63799e2394c38fe0464e: baseline-arm-baylibre 2026-04-05 06:51:50,177 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf63799e2394c38fe0464e 2026-04-05 06:51:50,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:51:50,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf63799e2394c38fe0464e HTTP/1.1" 200 None 2026-04-05 06:51:50,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:51:50,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 06:51:50,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:51:50,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf63799e2394c38fe0464e HTTP/1.1" 200 None 2026-04-05 06:51:50,244 - lava_callback - ERROR - Error processing callback for node 69cf63799e2394c38fe0464e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38818 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:53:30,368 - lava_callback - INFO - Received callback for node 69cf63d89e2394c38fe046be INFO: 172.21.0.1:35564 - "POST /node/69cf63d89e2394c38fe046be HTTP/1.0" 202 Accepted 2026-04-05 06:53:30,375 - lava_callback - INFO - Starting async job submit for node 69cf63d89e2394c38fe046be 2026-04-05 06:53:30,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:53:30,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf63d89e2394c38fe046be HTTP/1.1" 200 None 2026-04-05 06:53:30,390 - lava_callback - DEBUG - Processing node 69cf63d89e2394c38fe046be: baseline-arm-baylibre 2026-04-05 06:53:30,390 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf63d89e2394c38fe046be 2026-04-05 06:53:30,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:53:30,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf63d89e2394c38fe046be HTTP/1.1" 200 None 2026-04-05 06:53:30,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:53:30,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 06:53:30,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:53:30,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf63d89e2394c38fe046be HTTP/1.1" 200 None 2026-04-05 06:53:30,505 - lava_callback - ERROR - Error processing callback for node 69cf63d89e2394c38fe046be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43578 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:53:50,280 - lava_callback - INFO - Received callback for node 69cf63fa9e2394c38fe046d3 INFO: 172.21.0.1:34976 - "POST /node/69cf63fa9e2394c38fe046d3 HTTP/1.0" 202 Accepted 2026-04-05 06:53:50,286 - lava_callback - INFO - Starting async job submit for node 69cf63fa9e2394c38fe046d3 2026-04-05 06:53:50,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:53:50,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf63fa9e2394c38fe046d3 HTTP/1.1" 200 None 2026-04-05 06:53:50,311 - lava_callback - DEBUG - Processing node 69cf63fa9e2394c38fe046d3: baseline-arm-baylibre 2026-04-05 06:53:50,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf63fa9e2394c38fe046d3 2026-04-05 06:53:50,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:53:50,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf63fa9e2394c38fe046d3 HTTP/1.1" 200 None 2026-04-05 06:53:50,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:53:50,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 06:53:50,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:53:50,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf63fa9e2394c38fe046d3 HTTP/1.1" 200 None 2026-04-05 06:53:50,379 - lava_callback - ERROR - Error processing callback for node 69cf63fa9e2394c38fe046d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39214 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:54:30,300 - lava_callback - INFO - Received callback for node 69cf641d9e2394c38fe046f4 INFO: 172.21.0.1:42096 - "POST /node/69cf641d9e2394c38fe046f4 HTTP/1.0" 202 Accepted 2026-04-05 06:54:30,305 - lava_callback - INFO - Starting async job submit for node 69cf641d9e2394c38fe046f4 2026-04-05 06:54:30,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:54:30,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf641d9e2394c38fe046f4 HTTP/1.1" 200 None 2026-04-05 06:54:30,327 - lava_callback - DEBUG - Processing node 69cf641d9e2394c38fe046f4: baseline-arm-baylibre 2026-04-05 06:54:30,328 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf641d9e2394c38fe046f4 2026-04-05 06:54:30,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:54:30,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf641d9e2394c38fe046f4 HTTP/1.1" 200 None 2026-04-05 06:54:30,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:54:30,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 06:54:30,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:54:30,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf641d9e2394c38fe046f4 HTTP/1.1" 200 None 2026-04-05 06:54:30,380 - lava_callback - ERROR - Error processing callback for node 69cf641d9e2394c38fe046f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33016 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:55:10,344 - lava_callback - INFO - Received callback for node 69cf64419e2394c38fe04717 INFO: 172.21.0.1:45160 - "POST /node/69cf64419e2394c38fe04717 HTTP/1.0" 202 Accepted 2026-04-05 06:55:10,352 - lava_callback - INFO - Starting async job submit for node 69cf64419e2394c38fe04717 2026-04-05 06:55:10,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:55:10,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf64419e2394c38fe04717 HTTP/1.1" 200 None 2026-04-05 06:55:10,369 - lava_callback - DEBUG - Processing node 69cf64419e2394c38fe04717: baseline-arm-baylibre 2026-04-05 06:55:10,369 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf64419e2394c38fe04717 2026-04-05 06:55:10,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:55:10,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf64419e2394c38fe04717 HTTP/1.1" 200 None 2026-04-05 06:55:10,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:55:10,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 06:55:10,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:55:10,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf64419e2394c38fe04717 HTTP/1.1" 200 None 2026-04-05 06:55:10,437 - lava_callback - ERROR - Error processing callback for node 69cf64419e2394c38fe04717: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35366 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:55:39,203 - lava_callback - INFO - Received callback for node 69cf64669e2394c38fe04752 INFO: 172.21.0.1:35370 - "POST /node/69cf64669e2394c38fe04752 HTTP/1.0" 202 Accepted 2026-04-05 06:55:39,209 - lava_callback - INFO - Starting async job submit for node 69cf64669e2394c38fe04752 2026-04-05 06:55:39,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:55:39,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf64669e2394c38fe04752 HTTP/1.1" 200 None 2026-04-05 06:55:39,225 - lava_callback - DEBUG - Processing node 69cf64669e2394c38fe04752: baseline-arm-clabbe 2026-04-05 06:55:39,225 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf64669e2394c38fe04752 2026-04-05 06:55:39,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:55:39,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf64669e2394c38fe04752 HTTP/1.1" 200 None 2026-04-05 06:55:39,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:55:39,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 06:55:39,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:55:39,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf64669e2394c38fe04752 HTTP/1.1" 200 None 2026-04-05 06:55:39,277 - lava_callback - ERROR - Error processing callback for node 69cf64669e2394c38fe04752: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52516 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:56:19,216 - lava_callback - INFO - Received callback for node 69cf64879e2394c38fe04794 INFO: 172.21.0.1:52522 - "POST /node/69cf64879e2394c38fe04794 HTTP/1.0" 202 Accepted 2026-04-05 06:56:19,222 - lava_callback - INFO - Starting async job submit for node 69cf64879e2394c38fe04794 2026-04-05 06:56:19,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:56:19,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf64879e2394c38fe04794 HTTP/1.1" 200 None 2026-04-05 06:56:19,245 - lava_callback - DEBUG - Processing node 69cf64879e2394c38fe04794: baseline-arm-clabbe 2026-04-05 06:56:19,245 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf64879e2394c38fe04794 2026-04-05 06:56:19,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:56:19,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf64879e2394c38fe04794 HTTP/1.1" 200 None 2026-04-05 06:56:19,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:56:19,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 06:56:19,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:56:19,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf64879e2394c38fe04794 HTTP/1.1" 200 None 2026-04-05 06:56:19,310 - lava_callback - ERROR - Error processing callback for node 69cf64879e2394c38fe04794: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49326 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:56:50,420 - lava_callback - INFO - Received callback for node 69cf64a59e2394c38fe047b6 INFO: 172.21.0.1:48114 - "POST /node/69cf64a59e2394c38fe047b6 HTTP/1.0" 202 Accepted 2026-04-05 06:56:50,425 - lava_callback - INFO - Starting async job submit for node 69cf64a59e2394c38fe047b6 2026-04-05 06:56:50,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:56:50,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf64a59e2394c38fe047b6 HTTP/1.1" 200 None 2026-04-05 06:56:50,442 - lava_callback - DEBUG - Processing node 69cf64a59e2394c38fe047b6: baseline-arm-baylibre 2026-04-05 06:56:50,442 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf64a59e2394c38fe047b6 2026-04-05 06:56:50,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:56:50,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf64a59e2394c38fe047b6 HTTP/1.1" 200 None 2026-04-05 06:56:50,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:56:50,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 06:56:50,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:56:50,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf64a59e2394c38fe047b6 HTTP/1.1" 200 None 2026-04-05 06:56:50,501 - lava_callback - ERROR - Error processing callback for node 69cf64a59e2394c38fe047b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52858 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:57:30,447 - lava_callback - INFO - Received callback for node 69cf64c79e2394c38fe047d8 INFO: 172.21.0.1:48022 - "POST /node/69cf64c79e2394c38fe047d8 HTTP/1.0" 202 Accepted 2026-04-05 06:57:30,453 - lava_callback - INFO - Starting async job submit for node 69cf64c79e2394c38fe047d8 2026-04-05 06:57:30,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:57:30,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf64c79e2394c38fe047d8 HTTP/1.1" 200 None 2026-04-05 06:57:30,471 - lava_callback - DEBUG - Processing node 69cf64c79e2394c38fe047d8: baseline-arm-baylibre 2026-04-05 06:57:30,471 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf64c79e2394c38fe047d8 2026-04-05 06:57:30,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:57:30,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf64c79e2394c38fe047d8 HTTP/1.1" 200 None 2026-04-05 06:57:30,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:57:30,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 06:57:30,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:57:30,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf64c79e2394c38fe047d8 HTTP/1.1" 200 None 2026-04-05 06:57:30,523 - lava_callback - ERROR - Error processing callback for node 69cf64c79e2394c38fe047d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46388 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:59:39,481 - lava_callback - INFO - Received callback for node 69cf65499e2394c38fe04860 INFO: 172.21.0.1:46404 - "POST /node/69cf65499e2394c38fe04860 HTTP/1.0" 202 Accepted 2026-04-05 06:59:39,487 - lava_callback - INFO - Starting async job submit for node 69cf65499e2394c38fe04860 2026-04-05 06:59:39,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:59:39,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf65499e2394c38fe04860 HTTP/1.1" 200 None 2026-04-05 06:59:39,504 - lava_callback - DEBUG - Processing node 69cf65499e2394c38fe04860: baseline-arm-clabbe 2026-04-05 06:59:39,504 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf65499e2394c38fe04860 2026-04-05 06:59:39,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:59:39,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf65499e2394c38fe04860 HTTP/1.1" 200 None 2026-04-05 06:59:39,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:59:39,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 06:59:39,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:59:39,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf65499e2394c38fe04860 HTTP/1.1" 200 None 2026-04-05 06:59:39,574 - lava_callback - ERROR - Error processing callback for node 69cf65499e2394c38fe04860: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58224 - "GET / HTTP/1.0" 200 OK 2026-04-05 06:59:59,470 - lava_callback - INFO - Received callback for node 69cf65699e2394c38fe0487e INFO: 172.21.0.1:58228 - "POST /node/69cf65699e2394c38fe0487e HTTP/1.0" 202 Accepted 2026-04-05 06:59:59,476 - lava_callback - INFO - Starting async job submit for node 69cf65699e2394c38fe0487e 2026-04-05 06:59:59,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:59:59,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf65699e2394c38fe0487e HTTP/1.1" 200 None 2026-04-05 06:59:59,495 - lava_callback - DEBUG - Processing node 69cf65699e2394c38fe0487e: baseline-arm-clabbe 2026-04-05 06:59:59,495 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf65699e2394c38fe0487e 2026-04-05 06:59:59,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:59:59,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf65699e2394c38fe0487e HTTP/1.1" 200 None 2026-04-05 06:59:59,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:59:59,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 06:59:59,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 06:59:59,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf65699e2394c38fe0487e HTTP/1.1" 200 None 2026-04-05 06:59:59,549 - lava_callback - ERROR - Error processing callback for node 69cf65699e2394c38fe0487e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50668 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:00:39,485 - lava_callback - INFO - Received callback for node 69cf658b9e2394c38fe04899 INFO: 172.21.0.1:50682 - "POST /node/69cf658b9e2394c38fe04899 HTTP/1.0" 202 Accepted 2026-04-05 07:00:39,491 - lava_callback - INFO - Starting async job submit for node 69cf658b9e2394c38fe04899 2026-04-05 07:00:39,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:00:39,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf658b9e2394c38fe04899 HTTP/1.1" 200 None 2026-04-05 07:00:39,507 - lava_callback - DEBUG - Processing node 69cf658b9e2394c38fe04899: baseline-arm-clabbe 2026-04-05 07:00:39,508 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf658b9e2394c38fe04899 2026-04-05 07:00:39,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:00:39,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf658b9e2394c38fe04899 HTTP/1.1" 200 None 2026-04-05 07:00:39,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:00:39,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 07:00:39,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:00:39,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf658b9e2394c38fe04899 HTTP/1.1" 200 None 2026-04-05 07:00:39,562 - lava_callback - ERROR - Error processing callback for node 69cf658b9e2394c38fe04899: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34762 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:01:19,492 - lava_callback - INFO - Received callback for node 69cf65ab9e2394c38fe048b7 INFO: 172.21.0.1:34768 - "POST /node/69cf65ab9e2394c38fe048b7 HTTP/1.0" 202 Accepted 2026-04-05 07:01:19,498 - lava_callback - INFO - Starting async job submit for node 69cf65ab9e2394c38fe048b7 2026-04-05 07:01:19,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:01:19,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf65ab9e2394c38fe048b7 HTTP/1.1" 200 None 2026-04-05 07:01:19,515 - lava_callback - DEBUG - Processing node 69cf65ab9e2394c38fe048b7: baseline-arm-clabbe 2026-04-05 07:01:19,515 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf65ab9e2394c38fe048b7 2026-04-05 07:01:19,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:01:19,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf65ab9e2394c38fe048b7 HTTP/1.1" 200 None 2026-04-05 07:01:19,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:01:19,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 07:01:19,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:01:19,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf65ab9e2394c38fe048b7 HTTP/1.1" 200 None 2026-04-05 07:01:19,571 - lava_callback - ERROR - Error processing callback for node 69cf65ab9e2394c38fe048b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60710 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:01:39,524 - lava_callback - INFO - Received callback for node 69cf65ce9e2394c38fe048e1 INFO: 172.21.0.1:60726 - "POST /node/69cf65ce9e2394c38fe048e1 HTTP/1.0" 202 Accepted 2026-04-05 07:01:39,533 - lava_callback - INFO - Starting async job submit for node 69cf65ce9e2394c38fe048e1 2026-04-05 07:01:39,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:01:39,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf65ce9e2394c38fe048e1 HTTP/1.1" 200 None 2026-04-05 07:01:39,554 - lava_callback - DEBUG - Processing node 69cf65ce9e2394c38fe048e1: baseline-arm-clabbe 2026-04-05 07:01:39,554 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf65ce9e2394c38fe048e1 2026-04-05 07:01:39,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:01:39,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf65ce9e2394c38fe048e1 HTTP/1.1" 200 None 2026-04-05 07:01:39,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:01:39,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 07:01:39,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:01:39,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf65ce9e2394c38fe048e1 HTTP/1.1" 200 None 2026-04-05 07:01:39,613 - lava_callback - ERROR - Error processing callback for node 69cf65ce9e2394c38fe048e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53864 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:03:19,714 - lava_callback - INFO - Received callback for node 69cf66329e2394c38fe04960 INFO: 172.21.0.1:57634 - "POST /node/69cf66329e2394c38fe04960 HTTP/1.0" 202 Accepted 2026-04-05 07:03:19,720 - lava_callback - INFO - Starting async job submit for node 69cf66329e2394c38fe04960 2026-04-05 07:03:19,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:03:19,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf66329e2394c38fe04960 HTTP/1.1" 200 None 2026-04-05 07:03:19,736 - lava_callback - DEBUG - Processing node 69cf66329e2394c38fe04960: baseline-arm-clabbe 2026-04-05 07:03:19,736 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf66329e2394c38fe04960 2026-04-05 07:03:19,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:03:19,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf66329e2394c38fe04960 HTTP/1.1" 200 None 2026-04-05 07:03:19,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:03:19,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 07:03:19,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:03:19,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf66329e2394c38fe04960 HTTP/1.1" 200 None 2026-04-05 07:03:19,794 - lava_callback - ERROR - Error processing callback for node 69cf66329e2394c38fe04960: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51198 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:03:59,600 - lava_callback - INFO - Received callback for node 69cf66549e2394c38fe04982 INFO: 172.21.0.1:51206 - "POST /node/69cf66549e2394c38fe04982 HTTP/1.0" 202 Accepted 2026-04-05 07:03:59,605 - lava_callback - INFO - Starting async job submit for node 69cf66549e2394c38fe04982 2026-04-05 07:03:59,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:03:59,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf66549e2394c38fe04982 HTTP/1.1" 200 None 2026-04-05 07:03:59,621 - lava_callback - DEBUG - Processing node 69cf66549e2394c38fe04982: baseline-arm-clabbe 2026-04-05 07:03:59,622 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf66549e2394c38fe04982 2026-04-05 07:03:59,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:03:59,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf66549e2394c38fe04982 HTTP/1.1" 200 None 2026-04-05 07:03:59,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:03:59,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 07:03:59,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:03:59,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf66549e2394c38fe04982 HTTP/1.1" 200 None 2026-04-05 07:03:59,684 - lava_callback - ERROR - Error processing callback for node 69cf66549e2394c38fe04982: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41980 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:04:39,708 - lava_callback - INFO - Received callback for node 69cf66769e2394c38fe049a3 INFO: 172.21.0.1:35364 - "POST /node/69cf66769e2394c38fe049a3 HTTP/1.0" 202 Accepted 2026-04-05 07:04:39,715 - lava_callback - INFO - Starting async job submit for node 69cf66769e2394c38fe049a3 2026-04-05 07:04:39,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:04:39,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf66769e2394c38fe049a3 HTTP/1.1" 200 None 2026-04-05 07:04:39,737 - lava_callback - DEBUG - Processing node 69cf66769e2394c38fe049a3: baseline-arm-clabbe 2026-04-05 07:04:39,737 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf66769e2394c38fe049a3 2026-04-05 07:04:39,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:04:39,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf66769e2394c38fe049a3 HTTP/1.1" 200 None 2026-04-05 07:04:39,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:04:39,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 07:04:39,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:04:39,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf66769e2394c38fe049a3 HTTP/1.1" 200 None 2026-04-05 07:04:39,821 - lava_callback - ERROR - Error processing callback for node 69cf66769e2394c38fe049a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54172 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:09:51,173 - lava_callback - INFO - Received callback for node 69cf67af9e2394c38fe04a9b INFO: 172.21.0.1:38248 - "POST /node/69cf67af9e2394c38fe04a9b HTTP/1.0" 202 Accepted 2026-04-05 07:09:51,178 - lava_callback - INFO - Starting async job submit for node 69cf67af9e2394c38fe04a9b 2026-04-05 07:09:51,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:09:51,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf67af9e2394c38fe04a9b HTTP/1.1" 200 None 2026-04-05 07:09:51,196 - lava_callback - DEBUG - Processing node 69cf67af9e2394c38fe04a9b: baseline-arm-baylibre 2026-04-05 07:09:51,196 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf67af9e2394c38fe04a9b 2026-04-05 07:09:51,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:09:51,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf67af9e2394c38fe04a9b HTTP/1.1" 200 None 2026-04-05 07:09:51,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:09:51,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 07:09:51,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:09:51,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf67af9e2394c38fe04a9b HTTP/1.1" 200 None 2026-04-05 07:09:51,251 - lava_callback - ERROR - Error processing callback for node 69cf67af9e2394c38fe04a9b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36960 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:10:20,003 - lava_callback - INFO - Received callback for node 69cf67d49e2394c38fe04acf INFO: 172.21.0.1:35160 - "POST /node/69cf67d49e2394c38fe04acf HTTP/1.0" 202 Accepted 2026-04-05 07:10:20,011 - lava_callback - INFO - Starting async job submit for node 69cf67d49e2394c38fe04acf 2026-04-05 07:10:20,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:10:20,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf67d49e2394c38fe04acf HTTP/1.1" 200 None 2026-04-05 07:10:20,028 - lava_callback - DEBUG - Processing node 69cf67d49e2394c38fe04acf: baseline-arm-clabbe 2026-04-05 07:10:20,029 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf67d49e2394c38fe04acf 2026-04-05 07:10:20,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:10:20,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf67d49e2394c38fe04acf HTTP/1.1" 200 None 2026-04-05 07:10:20,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:10:20,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 07:10:20,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:10:20,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf67d49e2394c38fe04acf HTTP/1.1" 200 None 2026-04-05 07:10:20,101 - lava_callback - ERROR - Error processing callback for node 69cf67d49e2394c38fe04acf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36510 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:12:11,268 - lava_callback - INFO - Received callback for node 69cf68419e2394c38fe04b1a INFO: 172.21.0.1:32826 - "POST /node/69cf68419e2394c38fe04b1a HTTP/1.0" 202 Accepted 2026-04-05 07:12:11,274 - lava_callback - INFO - Starting async job submit for node 69cf68419e2394c38fe04b1a 2026-04-05 07:12:11,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:12:11,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf68419e2394c38fe04b1a HTTP/1.1" 200 None 2026-04-05 07:12:11,289 - lava_callback - DEBUG - Processing node 69cf68419e2394c38fe04b1a: baseline-arm64-baylibre 2026-04-05 07:12:11,290 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf68419e2394c38fe04b1a 2026-04-05 07:12:11,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:12:11,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf68419e2394c38fe04b1a HTTP/1.1" 200 None 2026-04-05 07:12:11,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:12:11,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-05 07:12:11,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:12:11,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf68419e2394c38fe04b1a HTTP/1.1" 200 None 2026-04-05 07:12:11,347 - lava_callback - ERROR - Error processing callback for node 69cf68419e2394c38fe04b1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49596 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:13:20,179 - lava_callback - INFO - Received callback for node 69cf688c9e2394c38fe04b4f INFO: 172.21.0.1:60268 - "POST /node/69cf688c9e2394c38fe04b4f HTTP/1.0" 202 Accepted 2026-04-05 07:13:20,185 - lava_callback - INFO - Starting async job submit for node 69cf688c9e2394c38fe04b4f 2026-04-05 07:13:20,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:13:20,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf688c9e2394c38fe04b4f HTTP/1.1" 200 None 2026-04-05 07:13:20,204 - lava_callback - DEBUG - Processing node 69cf688c9e2394c38fe04b4f: baseline-arm64-clabbe 2026-04-05 07:13:20,204 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf688c9e2394c38fe04b4f 2026-04-05 07:13:20,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:13:20,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf688c9e2394c38fe04b4f HTTP/1.1" 200 None 2026-04-05 07:13:20,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:13:20,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-05 07:13:20,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:13:20,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf688c9e2394c38fe04b4f HTTP/1.1" 200 None 2026-04-05 07:13:20,262 - lava_callback - ERROR - Error processing callback for node 69cf688c9e2394c38fe04b4f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59950 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:14:40,248 - lava_callback - INFO - Received callback for node 69cf68d49e2394c38fe04b7b INFO: 172.21.0.1:40410 - "POST /node/69cf68d49e2394c38fe04b7b HTTP/1.0" 202 Accepted 2026-04-05 07:14:40,254 - lava_callback - INFO - Starting async job submit for node 69cf68d49e2394c38fe04b7b 2026-04-05 07:14:40,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:14:40,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf68d49e2394c38fe04b7b HTTP/1.1" 200 None 2026-04-05 07:14:40,270 - lava_callback - DEBUG - Processing node 69cf68d49e2394c38fe04b7b: baseline-arm64-clabbe 2026-04-05 07:14:40,270 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf68d49e2394c38fe04b7b 2026-04-05 07:14:40,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:14:40,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf68d49e2394c38fe04b7b HTTP/1.1" 200 None 2026-04-05 07:14:40,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:14:40,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-05 07:14:40,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:14:40,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf68d49e2394c38fe04b7b HTTP/1.1" 200 None 2026-04-05 07:14:40,324 - lava_callback - ERROR - Error processing callback for node 69cf68d49e2394c38fe04b7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33828 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:16:00,260 - lava_callback - INFO - Received callback for node 69cf691d9e2394c38fe04bc0 INFO: 172.21.0.1:49556 - "POST /node/69cf691d9e2394c38fe04bc0 HTTP/1.0" 202 Accepted 2026-04-05 07:16:00,266 - lava_callback - INFO - Starting async job submit for node 69cf691d9e2394c38fe04bc0 2026-04-05 07:16:00,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:16:00,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf691d9e2394c38fe04bc0 HTTP/1.1" 200 None 2026-04-05 07:16:00,281 - lava_callback - DEBUG - Processing node 69cf691d9e2394c38fe04bc0: baseline-arm64-clabbe 2026-04-05 07:16:00,281 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf691d9e2394c38fe04bc0 2026-04-05 07:16:00,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:16:00,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf691d9e2394c38fe04bc0 HTTP/1.1" 200 None 2026-04-05 07:16:00,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:16:00,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-05 07:16:00,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:16:00,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf691d9e2394c38fe04bc0 HTTP/1.1" 200 None 2026-04-05 07:16:00,339 - lava_callback - ERROR - Error processing callback for node 69cf691d9e2394c38fe04bc0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43306 - "GET /node/694732c13daac4806359841a%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37514 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:17:00,434 - lava_callback - INFO - Received callback for node 69cf69639e2394c38fe04bf9 INFO: 172.21.0.1:54738 - "POST /node/69cf69639e2394c38fe04bf9 HTTP/1.0" 202 Accepted 2026-04-05 07:17:00,441 - lava_callback - INFO - Starting async job submit for node 69cf69639e2394c38fe04bf9 2026-04-05 07:17:00,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:17:00,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf69639e2394c38fe04bf9 HTTP/1.1" 200 None 2026-04-05 07:17:00,486 - lava_callback - DEBUG - Processing node 69cf69639e2394c38fe04bf9: baseline-arm64-clabbe 2026-04-05 07:17:00,486 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf69639e2394c38fe04bf9 2026-04-05 07:17:00,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:17:00,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf69639e2394c38fe04bf9 HTTP/1.1" 200 None 2026-04-05 07:17:00,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:17:00,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-05 07:17:00,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:17:00,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf69639e2394c38fe04bf9 HTTP/1.1" 200 None 2026-04-05 07:17:00,548 - lava_callback - ERROR - Error processing callback for node 69cf69639e2394c38fe04bf9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54348 - "GET /node/69876c16e31b58f834f1990e%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:54354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38364 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:18:20,507 - lava_callback - INFO - Received callback for node 69cf69a99e2394c38fe04c30 INFO: 172.21.0.1:52378 - "POST /node/69cf69a99e2394c38fe04c30 HTTP/1.0" 202 Accepted 2026-04-05 07:18:20,513 - lava_callback - INFO - Starting async job submit for node 69cf69a99e2394c38fe04c30 2026-04-05 07:18:20,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:18:20,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf69a99e2394c38fe04c30 HTTP/1.1" 200 None 2026-04-05 07:18:20,529 - lava_callback - DEBUG - Processing node 69cf69a99e2394c38fe04c30: baseline-arm64-clabbe 2026-04-05 07:18:20,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf69a99e2394c38fe04c30 2026-04-05 07:18:20,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:18:20,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf69a99e2394c38fe04c30 HTTP/1.1" 200 None 2026-04-05 07:18:20,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:18:20,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-05 07:18:20,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:18:20,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf69a99e2394c38fe04c30 HTTP/1.1" 200 None 2026-04-05 07:18:20,588 - lava_callback - ERROR - Error processing callback for node 69cf69a99e2394c38fe04c30: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42224 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:19:20,527 - lava_callback - INFO - Received callback for node 69cf69f09e2394c38fe04c66 INFO: 172.21.0.1:58400 - "POST /node/69cf69f09e2394c38fe04c66 HTTP/1.0" 202 Accepted 2026-04-05 07:19:20,532 - lava_callback - INFO - Starting async job submit for node 69cf69f09e2394c38fe04c66 2026-04-05 07:19:20,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:19:20,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf69f09e2394c38fe04c66 HTTP/1.1" 200 None 2026-04-05 07:19:20,550 - lava_callback - DEBUG - Processing node 69cf69f09e2394c38fe04c66: baseline-arm64-clabbe 2026-04-05 07:19:20,550 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf69f09e2394c38fe04c66 2026-04-05 07:19:20,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:19:20,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf69f09e2394c38fe04c66 HTTP/1.1" 200 None 2026-04-05 07:19:20,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:19:20,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf070a9e2394c38fe00f4e HTTP/1.1" 200 None 2026-04-05 07:19:20,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:19:20,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf69f09e2394c38fe04c66 HTTP/1.1" 200 None 2026-04-05 07:19:20,607 - lava_callback - ERROR - Error processing callback for node 69cf69f09e2394c38fe04c66: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55478 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:20:20,476 - lava_callback - INFO - Received callback for node 69cf6a2b9e2394c38fe04c98 INFO: 172.21.0.1:48948 - "POST /node/69cf6a2b9e2394c38fe04c98 HTTP/1.0" 202 Accepted 2026-04-05 07:20:20,482 - lava_callback - INFO - Starting async job submit for node 69cf6a2b9e2394c38fe04c98 2026-04-05 07:20:20,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:20:20,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6a2b9e2394c38fe04c98 HTTP/1.1" 200 None 2026-04-05 07:20:20,506 - lava_callback - DEBUG - Processing node 69cf6a2b9e2394c38fe04c98: baseline-arm-clabbe 2026-04-05 07:20:20,506 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6a2b9e2394c38fe04c98 2026-04-05 07:20:20,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:20:20,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6a2b9e2394c38fe04c98 HTTP/1.1" 200 None 2026-04-05 07:20:20,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:20:20,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 07:20:20,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:20:20,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6a2b9e2394c38fe04c98 HTTP/1.1" 200 None 2026-04-05 07:20:20,570 - lava_callback - ERROR - Error processing callback for node 69cf6a2b9e2394c38fe04c98: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41434 - "GET /node/6949e3862060d3d84791cf1f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41444 - "GET /node/69523e065318368af0c49cfe%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35848 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:21:00,490 - lava_callback - INFO - Received callback for node 69cf6a4c9e2394c38fe04cbc INFO: 172.21.0.1:59306 - "POST /node/69cf6a4c9e2394c38fe04cbc HTTP/1.0" 202 Accepted 2026-04-05 07:21:00,499 - lava_callback - INFO - Starting async job submit for node 69cf6a4c9e2394c38fe04cbc 2026-04-05 07:21:00,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:21:00,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6a4c9e2394c38fe04cbc HTTP/1.1" 200 None 2026-04-05 07:21:00,520 - lava_callback - DEBUG - Processing node 69cf6a4c9e2394c38fe04cbc: baseline-arm-clabbe 2026-04-05 07:21:00,520 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6a4c9e2394c38fe04cbc 2026-04-05 07:21:00,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:21:00,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6a4c9e2394c38fe04cbc HTTP/1.1" 200 None 2026-04-05 07:21:00,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:21:00,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 07:21:00,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:21:00,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6a4c9e2394c38fe04cbc HTTP/1.1" 200 None 2026-04-05 07:21:00,588 - lava_callback - ERROR - Error processing callback for node 69cf6a4c9e2394c38fe04cbc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33470 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:21:20,569 - lava_callback - INFO - Received callback for node 69cf6a6c9e2394c38fe04ce6 INFO: 172.21.0.1:41202 - "POST /node/69cf6a6c9e2394c38fe04ce6 HTTP/1.0" 202 Accepted 2026-04-05 07:21:20,575 - lava_callback - INFO - Starting async job submit for node 69cf6a6c9e2394c38fe04ce6 2026-04-05 07:21:20,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:21:20,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6a6c9e2394c38fe04ce6 HTTP/1.1" 200 None 2026-04-05 07:21:20,597 - lava_callback - DEBUG - Processing node 69cf6a6c9e2394c38fe04ce6: baseline-arm-clabbe 2026-04-05 07:21:20,597 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6a6c9e2394c38fe04ce6 2026-04-05 07:21:20,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:21:20,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6a6c9e2394c38fe04ce6 HTTP/1.1" 200 None 2026-04-05 07:21:20,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:21:20,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 07:21:20,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:21:20,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6a6c9e2394c38fe04ce6 HTTP/1.1" 200 None 2026-04-05 07:21:20,672 - lava_callback - ERROR - Error processing callback for node 69cf6a6c9e2394c38fe04ce6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35054 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:22:00,540 - lava_callback - INFO - Received callback for node 69cf6a8e9e2394c38fe04cfd INFO: 172.21.0.1:42154 - "POST /node/69cf6a8e9e2394c38fe04cfd HTTP/1.0" 202 Accepted 2026-04-05 07:22:00,550 - lava_callback - INFO - Starting async job submit for node 69cf6a8e9e2394c38fe04cfd 2026-04-05 07:22:00,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:22:00,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6a8e9e2394c38fe04cfd HTTP/1.1" 200 None 2026-04-05 07:22:00,573 - lava_callback - DEBUG - Processing node 69cf6a8e9e2394c38fe04cfd: baseline-arm-clabbe 2026-04-05 07:22:00,574 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6a8e9e2394c38fe04cfd 2026-04-05 07:22:00,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:22:00,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6a8e9e2394c38fe04cfd HTTP/1.1" 200 None 2026-04-05 07:22:00,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:22:00,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 07:22:00,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:22:00,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6a8e9e2394c38fe04cfd HTTP/1.1" 200 None 2026-04-05 07:22:00,650 - lava_callback - ERROR - Error processing callback for node 69cf6a8e9e2394c38fe04cfd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52994 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:22:31,888 - lava_callback - INFO - Received callback for node 69cf6aad9e2394c38fe04d1c INFO: 172.21.0.1:53600 - "POST /node/69cf6aad9e2394c38fe04d1c HTTP/1.0" 202 Accepted 2026-04-05 07:22:31,894 - lava_callback - INFO - Starting async job submit for node 69cf6aad9e2394c38fe04d1c 2026-04-05 07:22:31,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:22:31,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6aad9e2394c38fe04d1c HTTP/1.1" 200 None 2026-04-05 07:22:31,911 - lava_callback - DEBUG - Processing node 69cf6aad9e2394c38fe04d1c: baseline-arm-baylibre 2026-04-05 07:22:31,911 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6aad9e2394c38fe04d1c 2026-04-05 07:22:31,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:22:31,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6aad9e2394c38fe04d1c HTTP/1.1" 200 None 2026-04-05 07:22:31,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:22:31,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 07:22:31,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:22:31,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6aad9e2394c38fe04d1c HTTP/1.1" 200 None 2026-04-05 07:22:31,966 - lava_callback - ERROR - Error processing callback for node 69cf6aad9e2394c38fe04d1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42682 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:23:00,641 - lava_callback - INFO - Received callback for node 69cf6ad09e2394c38fe04d3e INFO: 172.21.0.1:41782 - "POST /node/69cf6ad09e2394c38fe04d3e HTTP/1.0" 202 Accepted 2026-04-05 07:23:00,650 - lava_callback - INFO - Starting async job submit for node 69cf6ad09e2394c38fe04d3e 2026-04-05 07:23:00,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:23:00,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6ad09e2394c38fe04d3e HTTP/1.1" 200 None 2026-04-05 07:23:00,668 - lava_callback - DEBUG - Processing node 69cf6ad09e2394c38fe04d3e: baseline-arm-clabbe 2026-04-05 07:23:00,668 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6ad09e2394c38fe04d3e 2026-04-05 07:23:00,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:23:00,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6ad09e2394c38fe04d3e HTTP/1.1" 200 None 2026-04-05 07:23:00,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:23:00,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 07:23:00,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:23:00,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6ad09e2394c38fe04d3e HTTP/1.1" 200 None 2026-04-05 07:23:00,730 - lava_callback - ERROR - Error processing callback for node 69cf6ad09e2394c38fe04d3e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41784 - "GET /node/698b674a0a16aea5a0dc758d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55430 - "GET /node/69862ad1177ca0f097bd21c2%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-05 07:23:40,717 - lava_callback - INFO - Received callback for node 69cf6af19e2394c38fe04d60 INFO: 172.21.0.1:39986 - "POST /node/69cf6af19e2394c38fe04d60 HTTP/1.0" 202 Accepted 2026-04-05 07:23:40,723 - lava_callback - INFO - Starting async job submit for node 69cf6af19e2394c38fe04d60 2026-04-05 07:23:40,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:23:40,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6af19e2394c38fe04d60 HTTP/1.1" 200 None 2026-04-05 07:23:40,740 - lava_callback - DEBUG - Processing node 69cf6af19e2394c38fe04d60: baseline-arm-clabbe 2026-04-05 07:23:40,740 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6af19e2394c38fe04d60 2026-04-05 07:23:40,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:23:40,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6af19e2394c38fe04d60 HTTP/1.1" 200 None 2026-04-05 07:23:40,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:23:40,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 07:23:40,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:23:40,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6af19e2394c38fe04d60 HTTP/1.1" 200 None 2026-04-05 07:23:40,800 - lava_callback - ERROR - Error processing callback for node 69cf6af19e2394c38fe04d60: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49906 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:24:20,781 - lava_callback - INFO - Received callback for node 69cf6b139e2394c38fe04d7c INFO: 172.21.0.1:39284 - "POST /node/69cf6b139e2394c38fe04d7c HTTP/1.0" 202 Accepted 2026-04-05 07:24:20,787 - lava_callback - INFO - Starting async job submit for node 69cf6b139e2394c38fe04d7c 2026-04-05 07:24:20,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:24:20,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6b139e2394c38fe04d7c HTTP/1.1" 200 None 2026-04-05 07:24:20,805 - lava_callback - DEBUG - Processing node 69cf6b139e2394c38fe04d7c: baseline-arm-clabbe 2026-04-05 07:24:20,805 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6b139e2394c38fe04d7c 2026-04-05 07:24:20,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:24:20,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6b139e2394c38fe04d7c HTTP/1.1" 200 None 2026-04-05 07:24:20,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:24:20,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf06fe9e2394c38fe00f3f HTTP/1.1" 200 None 2026-04-05 07:24:20,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:24:20,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6b139e2394c38fe04d7c HTTP/1.1" 200 None 2026-04-05 07:24:20,877 - lava_callback - ERROR - Error processing callback for node 69cf6b139e2394c38fe04d7c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39178 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:24:40,762 - lava_callback - INFO - Received callback for node 69cf6b359e2394c38fe04d96 INFO: 172.21.0.1:55092 - "POST /node/69cf6b359e2394c38fe04d96 HTTP/1.0" 202 Accepted 2026-04-05 07:24:40,768 - lava_callback - INFO - Starting async job submit for node 69cf6b359e2394c38fe04d96 2026-04-05 07:24:40,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:24:40,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6b359e2394c38fe04d96 HTTP/1.1" 200 None 2026-04-05 07:24:40,783 - lava_callback - DEBUG - Processing node 69cf6b359e2394c38fe04d96: baseline-arm-clabbe 2026-04-05 07:24:40,784 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6b359e2394c38fe04d96 2026-04-05 07:24:40,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:24:40,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6b359e2394c38fe04d96 HTTP/1.1" 200 None 2026-04-05 07:24:40,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:24:40,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 07:24:40,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:24:40,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6b359e2394c38fe04d96 HTTP/1.1" 200 None 2026-04-05 07:24:40,871 - lava_callback - ERROR - Error processing callback for node 69cf6b359e2394c38fe04d96: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55130 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:25:20,762 - lava_callback - INFO - Received callback for node 69cf6b589e2394c38fe04dd6 INFO: 172.21.0.1:59960 - "POST /node/69cf6b589e2394c38fe04dd6 HTTP/1.0" 202 Accepted 2026-04-05 07:25:20,769 - lava_callback - INFO - Starting async job submit for node 69cf6b589e2394c38fe04dd6 2026-04-05 07:25:20,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:25:20,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6b589e2394c38fe04dd6 HTTP/1.1" 200 None 2026-04-05 07:25:20,785 - lava_callback - DEBUG - Processing node 69cf6b589e2394c38fe04dd6: baseline-arm-clabbe 2026-04-05 07:25:20,786 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6b589e2394c38fe04dd6 2026-04-05 07:25:20,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:25:20,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6b589e2394c38fe04dd6 HTTP/1.1" 200 None 2026-04-05 07:25:20,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:25:20,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 07:25:20,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:25:20,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6b589e2394c38fe04dd6 HTTP/1.1" 200 None 2026-04-05 07:25:20,847 - lava_callback - ERROR - Error processing callback for node 69cf6b589e2394c38fe04dd6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41188 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:26:00,770 - lava_callback - INFO - Received callback for node 69cf6b7a9e2394c38fe04df8 INFO: 172.21.0.1:54288 - "POST /node/69cf6b7a9e2394c38fe04df8 HTTP/1.0" 202 Accepted 2026-04-05 07:26:00,776 - lava_callback - INFO - Starting async job submit for node 69cf6b7a9e2394c38fe04df8 2026-04-05 07:26:00,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:26:00,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6b7a9e2394c38fe04df8 HTTP/1.1" 200 None 2026-04-05 07:26:00,793 - lava_callback - DEBUG - Processing node 69cf6b7a9e2394c38fe04df8: baseline-arm-clabbe 2026-04-05 07:26:00,794 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6b7a9e2394c38fe04df8 2026-04-05 07:26:00,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:26:00,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6b7a9e2394c38fe04df8 HTTP/1.1" 200 None 2026-04-05 07:26:00,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:26:00,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-05 07:26:00,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:26:00,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6b7a9e2394c38fe04df8 HTTP/1.1" 200 None 2026-04-05 07:26:00,868 - lava_callback - ERROR - Error processing callback for node 69cf6b7a9e2394c38fe04df8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET /node/693b871241fb4c95097668e3%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37422 - "GET /node/693af06efee8383e92b691f2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:37438 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:26:32,070 - lava_callback - INFO - Received callback for node 69cf6b9f9e2394c38fe04e1e INFO: 172.21.0.1:35736 - "POST /node/69cf6b9f9e2394c38fe04e1e HTTP/1.0" 202 Accepted 2026-04-05 07:26:32,079 - lava_callback - INFO - Starting async job submit for node 69cf6b9f9e2394c38fe04e1e 2026-04-05 07:26:32,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:26:32,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6b9f9e2394c38fe04e1e HTTP/1.1" 200 None 2026-04-05 07:26:32,096 - lava_callback - DEBUG - Processing node 69cf6b9f9e2394c38fe04e1e: baseline-arm64-baylibre 2026-04-05 07:26:32,097 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6b9f9e2394c38fe04e1e 2026-04-05 07:26:32,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:26:32,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6b9f9e2394c38fe04e1e HTTP/1.1" 200 None 2026-04-05 07:26:32,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:26:32,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 07:26:32,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:26:32,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6b9f9e2394c38fe04e1e HTTP/1.1" 200 None 2026-04-05 07:26:32,185 - lava_callback - ERROR - Error processing callback for node 69cf6b9f9e2394c38fe04e1e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47438 - "GET /node/698a0f0822b4cc0f227ad8d1%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:58336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54750 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:27:52,323 - lava_callback - INFO - Received callback for node 69cf6be29e2394c38fe04e5e INFO: 172.21.0.1:57296 - "POST /node/69cf6be29e2394c38fe04e5e HTTP/1.0" 202 Accepted 2026-04-05 07:27:52,329 - lava_callback - INFO - Starting async job submit for node 69cf6be29e2394c38fe04e5e 2026-04-05 07:27:52,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:27:52,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6be29e2394c38fe04e5e HTTP/1.1" 200 None 2026-04-05 07:27:52,352 - lava_callback - DEBUG - Processing node 69cf6be29e2394c38fe04e5e: baseline-arm64-baylibre 2026-04-05 07:27:52,352 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6be29e2394c38fe04e5e 2026-04-05 07:27:52,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:27:52,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6be29e2394c38fe04e5e HTTP/1.1" 200 None 2026-04-05 07:27:52,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:27:52,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 07:27:52,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:27:52,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6be29e2394c38fe04e5e HTTP/1.1" 200 None 2026-04-05 07:27:52,420 - lava_callback - ERROR - Error processing callback for node 69cf6be29e2394c38fe04e5e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57680 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:28:52,171 - lava_callback - INFO - Received callback for node 69cf6c279e2394c38fe04e8d INFO: 172.21.0.1:39718 - "POST /node/69cf6c279e2394c38fe04e8d HTTP/1.0" 202 Accepted 2026-04-05 07:28:52,178 - lava_callback - INFO - Starting async job submit for node 69cf6c279e2394c38fe04e8d 2026-04-05 07:28:52,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:28:52,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6c279e2394c38fe04e8d HTTP/1.1" 200 None 2026-04-05 07:28:52,200 - lava_callback - DEBUG - Processing node 69cf6c279e2394c38fe04e8d: baseline-arm64-baylibre 2026-04-05 07:28:52,200 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6c279e2394c38fe04e8d 2026-04-05 07:28:52,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:28:52,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6c279e2394c38fe04e8d HTTP/1.1" 200 None 2026-04-05 07:28:52,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:28:52,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 07:28:52,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:28:52,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6c279e2394c38fe04e8d HTTP/1.1" 200 None 2026-04-05 07:28:52,277 - lava_callback - ERROR - Error processing callback for node 69cf6c279e2394c38fe04e8d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54082 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:29:52,264 - lava_callback - INFO - Received callback for node 69cf6c6c9e2394c38fe04eb5 INFO: 172.21.0.1:51112 - "POST /node/69cf6c6c9e2394c38fe04eb5 HTTP/1.0" 202 Accepted 2026-04-05 07:29:52,270 - lava_callback - INFO - Starting async job submit for node 69cf6c6c9e2394c38fe04eb5 2026-04-05 07:29:52,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:29:52,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6c6c9e2394c38fe04eb5 HTTP/1.1" 200 None 2026-04-05 07:29:52,293 - lava_callback - DEBUG - Processing node 69cf6c6c9e2394c38fe04eb5: baseline-arm64-baylibre 2026-04-05 07:29:52,293 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6c6c9e2394c38fe04eb5 2026-04-05 07:29:52,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:29:52,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6c6c9e2394c38fe04eb5 HTTP/1.1" 200 None 2026-04-05 07:29:52,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:29:52,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 07:29:52,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:29:52,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6c6c9e2394c38fe04eb5 HTTP/1.1" 200 None 2026-04-05 07:29:52,371 - lava_callback - ERROR - Error processing callback for node 69cf6c6c9e2394c38fe04eb5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47708 - "GET /node/698b071f3b3beb19e7617fbf%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47716 - "GET /node/694a550783c67c43d1ed96b2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53074 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:31:12,322 - lava_callback - INFO - Received callback for node 69cf6cb09e2394c38fe04ee9 INFO: 172.21.0.1:51638 - "POST /node/69cf6cb09e2394c38fe04ee9 HTTP/1.0" 202 Accepted 2026-04-05 07:31:12,328 - lava_callback - INFO - Starting async job submit for node 69cf6cb09e2394c38fe04ee9 2026-04-05 07:31:12,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:31:12,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6cb09e2394c38fe04ee9 HTTP/1.1" 200 None 2026-04-05 07:31:12,353 - lava_callback - DEBUG - Processing node 69cf6cb09e2394c38fe04ee9: baseline-arm64-baylibre 2026-04-05 07:31:12,354 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6cb09e2394c38fe04ee9 2026-04-05 07:31:12,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:31:12,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6cb09e2394c38fe04ee9 HTTP/1.1" 200 None 2026-04-05 07:31:12,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:31:12,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 07:31:12,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:31:12,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6cb09e2394c38fe04ee9 HTTP/1.1" 200 None 2026-04-05 07:31:12,412 - lava_callback - ERROR - Error processing callback for node 69cf6cb09e2394c38fe04ee9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36320 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:32:21,197 - lava_callback - INFO - Received callback for node 69cf6cfb9e2394c38fe04f18 INFO: 172.21.0.1:36332 - "POST /node/69cf6cfb9e2394c38fe04f18 HTTP/1.0" 202 Accepted 2026-04-05 07:32:21,203 - lava_callback - INFO - Starting async job submit for node 69cf6cfb9e2394c38fe04f18 2026-04-05 07:32:21,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:32:21,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6cfb9e2394c38fe04f18 HTTP/1.1" 200 None 2026-04-05 07:32:21,219 - lava_callback - DEBUG - Processing node 69cf6cfb9e2394c38fe04f18: baseline-arm64-clabbe 2026-04-05 07:32:21,219 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6cfb9e2394c38fe04f18 2026-04-05 07:32:21,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:32:21,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6cfb9e2394c38fe04f18 HTTP/1.1" 200 None 2026-04-05 07:32:21,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:32:21,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 07:32:21,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:32:21,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6cfb9e2394c38fe04f18 HTTP/1.1" 200 None 2026-04-05 07:32:21,271 - lava_callback - ERROR - Error processing callback for node 69cf6cfb9e2394c38fe04f18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36334 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:36350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37112 - "GET /security.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:37124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38744 - "GET /node/6986fc1d6e077e4126a7d4fa%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:38746 - "GET /node/69b38c03974c91e64560f949%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37176 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:33:41,259 - lava_callback - INFO - Received callback for node 69cf6d429e2394c38fe04f46 INFO: 172.21.0.1:41890 - "POST /node/69cf6d429e2394c38fe04f46 HTTP/1.0" 202 Accepted 2026-04-05 07:33:41,265 - lava_callback - INFO - Starting async job submit for node 69cf6d429e2394c38fe04f46 2026-04-05 07:33:41,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:33:41,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6d429e2394c38fe04f46 HTTP/1.1" 200 None 2026-04-05 07:33:41,281 - lava_callback - DEBUG - Processing node 69cf6d429e2394c38fe04f46: baseline-arm64-clabbe 2026-04-05 07:33:41,281 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6d429e2394c38fe04f46 2026-04-05 07:33:41,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:33:41,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6d429e2394c38fe04f46 HTTP/1.1" 200 None 2026-04-05 07:33:41,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:33:41,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 07:33:41,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:33:41,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6d429e2394c38fe04f46 HTTP/1.1" 200 None 2026-04-05 07:33:41,336 - lava_callback - ERROR - Error processing callback for node 69cf6d429e2394c38fe04f46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59114 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:34:41,320 - lava_callback - INFO - Received callback for node 69cf6d8a9e2394c38fe04f6c INFO: 172.21.0.1:41976 - "POST /node/69cf6d8a9e2394c38fe04f6c HTTP/1.0" 202 Accepted 2026-04-05 07:34:41,326 - lava_callback - INFO - Starting async job submit for node 69cf6d8a9e2394c38fe04f6c 2026-04-05 07:34:41,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:34:41,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6d8a9e2394c38fe04f6c HTTP/1.1" 200 None 2026-04-05 07:34:41,341 - lava_callback - DEBUG - Processing node 69cf6d8a9e2394c38fe04f6c: baseline-arm64-clabbe 2026-04-05 07:34:41,341 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6d8a9e2394c38fe04f6c 2026-04-05 07:34:41,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:34:41,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6d8a9e2394c38fe04f6c HTTP/1.1" 200 None 2026-04-05 07:34:41,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:34:41,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 07:34:41,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:34:41,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6d8a9e2394c38fe04f6c HTTP/1.1" 200 None 2026-04-05 07:34:41,393 - lava_callback - ERROR - Error processing callback for node 69cf6d8a9e2394c38fe04f6c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45932 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:36:01,387 - lava_callback - INFO - Received callback for node 69cf6dd39e2394c38fe04fa6 INFO: 172.21.0.1:53678 - "POST /node/69cf6dd39e2394c38fe04fa6 HTTP/1.0" 202 Accepted 2026-04-05 07:36:01,393 - lava_callback - INFO - Starting async job submit for node 69cf6dd39e2394c38fe04fa6 2026-04-05 07:36:01,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:36:01,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6dd39e2394c38fe04fa6 HTTP/1.1" 200 None 2026-04-05 07:36:01,432 - lava_callback - DEBUG - Processing node 69cf6dd39e2394c38fe04fa6: baseline-arm64-clabbe 2026-04-05 07:36:01,432 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6dd39e2394c38fe04fa6 2026-04-05 07:36:01,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:36:01,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6dd39e2394c38fe04fa6 HTTP/1.1" 200 None 2026-04-05 07:36:01,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:36:01,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 07:36:01,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:36:01,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6dd39e2394c38fe04fa6 HTTP/1.1" 200 None 2026-04-05 07:36:01,491 - lava_callback - ERROR - Error processing callback for node 69cf6dd39e2394c38fe04fa6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39348 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:37:01,441 - lava_callback - INFO - Received callback for node 69cf6e189e2394c38fe04fe9 INFO: 172.21.0.1:35540 - "POST /node/69cf6e189e2394c38fe04fe9 HTTP/1.0" 202 Accepted 2026-04-05 07:37:01,448 - lava_callback - INFO - Starting async job submit for node 69cf6e189e2394c38fe04fe9 2026-04-05 07:37:01,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:37:01,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6e189e2394c38fe04fe9 HTTP/1.1" 200 None 2026-04-05 07:37:01,465 - lava_callback - DEBUG - Processing node 69cf6e189e2394c38fe04fe9: baseline-arm64-clabbe 2026-04-05 07:37:01,465 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6e189e2394c38fe04fe9 2026-04-05 07:37:01,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:37:01,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6e189e2394c38fe04fe9 HTTP/1.1" 200 None 2026-04-05 07:37:01,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:37:01,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 07:37:01,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:37:01,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6e189e2394c38fe04fe9 HTTP/1.1" 200 None 2026-04-05 07:37:01,524 - lava_callback - ERROR - Error processing callback for node 69cf6e189e2394c38fe04fe9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51718 - "GET /node/69b13cb3a870a1dc3343c6b8%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51730 - "GET /node/6985c42971989fb141498070%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:51742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45186 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:38:21,770 - lava_callback - INFO - Received callback for node 69cf6e629e2394c38fe05016 INFO: 172.21.0.1:43532 - "POST /node/69cf6e629e2394c38fe05016 HTTP/1.0" 202 Accepted 2026-04-05 07:38:21,776 - lava_callback - INFO - Starting async job submit for node 69cf6e629e2394c38fe05016 2026-04-05 07:38:21,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:38:21,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6e629e2394c38fe05016 HTTP/1.1" 200 None 2026-04-05 07:38:21,792 - lava_callback - DEBUG - Processing node 69cf6e629e2394c38fe05016: baseline-arm64-clabbe 2026-04-05 07:38:21,792 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6e629e2394c38fe05016 2026-04-05 07:38:21,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:38:21,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6e629e2394c38fe05016 HTTP/1.1" 200 None 2026-04-05 07:38:21,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:38:21,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 07:38:21,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:38:21,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6e629e2394c38fe05016 HTTP/1.1" 200 None 2026-04-05 07:38:21,845 - lava_callback - ERROR - Error processing callback for node 69cf6e629e2394c38fe05016: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49964 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:39:32,829 - lava_callback - INFO - Received callback for node 69cf6e9f9e2394c38fe05047 INFO: 172.21.0.1:36264 - "POST /node/69cf6e9f9e2394c38fe05047 HTTP/1.0" 202 Accepted 2026-04-05 07:39:32,834 - lava_callback - INFO - Starting async job submit for node 69cf6e9f9e2394c38fe05047 2026-04-05 07:39:32,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:39:32,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6e9f9e2394c38fe05047 HTTP/1.1" 200 None 2026-04-05 07:39:32,852 - lava_callback - DEBUG - Processing node 69cf6e9f9e2394c38fe05047: baseline-arm64-baylibre 2026-04-05 07:39:32,852 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6e9f9e2394c38fe05047 2026-04-05 07:39:32,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:39:32,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6e9f9e2394c38fe05047 HTTP/1.1" 200 None 2026-04-05 07:39:32,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:39:32,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 07:39:32,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:39:32,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6e9f9e2394c38fe05047 HTTP/1.1" 200 None 2026-04-05 07:39:32,922 - lava_callback - ERROR - Error processing callback for node 69cf6e9f9e2394c38fe05047: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50086 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:40:32,759 - lava_callback - INFO - Received callback for node 69cf6eeb9e2394c38fe0505b INFO: 172.21.0.1:51642 - "POST /node/69cf6eeb9e2394c38fe0505b HTTP/1.0" 202 Accepted 2026-04-05 07:40:32,764 - lava_callback - INFO - Starting async job submit for node 69cf6eeb9e2394c38fe0505b 2026-04-05 07:40:32,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:40:32,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6eeb9e2394c38fe0505b HTTP/1.1" 200 None 2026-04-05 07:40:32,781 - lava_callback - DEBUG - Processing node 69cf6eeb9e2394c38fe0505b: baseline-arm64-baylibre 2026-04-05 07:40:32,781 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6eeb9e2394c38fe0505b 2026-04-05 07:40:32,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:40:32,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6eeb9e2394c38fe0505b HTTP/1.1" 200 None 2026-04-05 07:40:32,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:40:32,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 07:40:32,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:40:32,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6eeb9e2394c38fe0505b HTTP/1.1" 200 None 2026-04-05 07:40:32,848 - lava_callback - ERROR - Error processing callback for node 69cf6eeb9e2394c38fe0505b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34340 - "GET /node/69aefc65ce46d8ec186ac289%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57248 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:41:52,876 - lava_callback - INFO - Received callback for node 69cf6f2f9e2394c38fe05083 INFO: 172.21.0.1:51284 - "POST /node/69cf6f2f9e2394c38fe05083 HTTP/1.0" 202 Accepted 2026-04-05 07:41:52,883 - lava_callback - INFO - Starting async job submit for node 69cf6f2f9e2394c38fe05083 2026-04-05 07:41:52,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:41:52,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6f2f9e2394c38fe05083 HTTP/1.1" 200 None 2026-04-05 07:41:52,899 - lava_callback - DEBUG - Processing node 69cf6f2f9e2394c38fe05083: baseline-arm64-baylibre 2026-04-05 07:41:52,899 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6f2f9e2394c38fe05083 2026-04-05 07:41:52,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:41:52,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6f2f9e2394c38fe05083 HTTP/1.1" 200 None 2026-04-05 07:41:52,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:41:52,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 07:41:52,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:41:52,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6f2f9e2394c38fe05083 HTTP/1.1" 200 None 2026-04-05 07:41:52,959 - lava_callback - ERROR - Error processing callback for node 69cf6f2f9e2394c38fe05083: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51956 - "GET /node/694afcfa6c96ed51d3172b7d%5Cn HTTP/1.0" 405 Method Not Allowed 2026-04-05 07:42:52,931 - lava_callback - INFO - Received callback for node 69cf6f749e2394c38fe050c9 INFO: 172.21.0.1:51960 - "POST /node/69cf6f749e2394c38fe050c9 HTTP/1.0" 202 Accepted 2026-04-05 07:42:52,937 - lava_callback - INFO - Starting async job submit for node 69cf6f749e2394c38fe050c9 2026-04-05 07:42:52,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:42:52,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6f749e2394c38fe050c9 HTTP/1.1" 200 None 2026-04-05 07:42:52,958 - lava_callback - DEBUG - Processing node 69cf6f749e2394c38fe050c9: baseline-arm64-baylibre 2026-04-05 07:42:52,958 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6f749e2394c38fe050c9 2026-04-05 07:42:52,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:42:52,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6f749e2394c38fe050c9 HTTP/1.1" 200 None 2026-04-05 07:42:52,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:42:52,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 07:42:52,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:42:53,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6f749e2394c38fe050c9 HTTP/1.1" 200 None 2026-04-05 07:42:53,029 - lava_callback - ERROR - Error processing callback for node 69cf6f749e2394c38fe050c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47136 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:44:13,055 - lava_callback - INFO - Received callback for node 69cf6fbd9e2394c38fe050f6 INFO: 172.21.0.1:42056 - "POST /node/69cf6fbd9e2394c38fe050f6 HTTP/1.0" 202 Accepted 2026-04-05 07:44:13,061 - lava_callback - INFO - Starting async job submit for node 69cf6fbd9e2394c38fe050f6 2026-04-05 07:44:13,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:44:13,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6fbd9e2394c38fe050f6 HTTP/1.1" 200 None 2026-04-05 07:44:13,080 - lava_callback - DEBUG - Processing node 69cf6fbd9e2394c38fe050f6: baseline-arm64-baylibre 2026-04-05 07:44:13,081 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf6fbd9e2394c38fe050f6 2026-04-05 07:44:13,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:44:13,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf6fbd9e2394c38fe050f6 HTTP/1.1" 200 None 2026-04-05 07:44:13,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:44:13,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 07:44:13,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:44:13,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf6fbd9e2394c38fe050f6 HTTP/1.1" 200 None 2026-04-05 07:44:13,149 - lava_callback - ERROR - Error processing callback for node 69cf6fbd9e2394c38fe050f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36384 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:45:33,109 - lava_callback - INFO - Received callback for node 69cf70099e2394c38fe0513f INFO: 172.21.0.1:57356 - "POST /node/69cf70099e2394c38fe0513f HTTP/1.0" 202 Accepted 2026-04-05 07:45:33,114 - lava_callback - INFO - Starting async job submit for node 69cf70099e2394c38fe0513f 2026-04-05 07:45:33,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:45:33,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf70099e2394c38fe0513f HTTP/1.1" 200 None 2026-04-05 07:45:33,130 - lava_callback - DEBUG - Processing node 69cf70099e2394c38fe0513f: baseline-arm64-baylibre 2026-04-05 07:45:33,130 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf70099e2394c38fe0513f 2026-04-05 07:45:33,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:45:33,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf70099e2394c38fe0513f HTTP/1.1" 200 None 2026-04-05 07:45:33,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:45:33,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 07:45:33,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:45:33,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf70099e2394c38fe0513f HTTP/1.1" 200 None 2026-04-05 07:45:33,222 - lava_callback - ERROR - Error processing callback for node 69cf70099e2394c38fe0513f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36850 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:46:33,076 - lava_callback - INFO - Received callback for node 69cf70559e2394c38fe05178 INFO: 172.21.0.1:40130 - "POST /node/69cf70559e2394c38fe05178 HTTP/1.0" 202 Accepted 2026-04-05 07:46:33,082 - lava_callback - INFO - Starting async job submit for node 69cf70559e2394c38fe05178 2026-04-05 07:46:33,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:46:33,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf70559e2394c38fe05178 HTTP/1.1" 200 None 2026-04-05 07:46:33,099 - lava_callback - DEBUG - Processing node 69cf70559e2394c38fe05178: baseline-arm64-baylibre 2026-04-05 07:46:33,100 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf70559e2394c38fe05178 2026-04-05 07:46:33,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:46:33,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf70559e2394c38fe05178 HTTP/1.1" 200 None 2026-04-05 07:46:33,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:46:33,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 07:46:33,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:46:33,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf70559e2394c38fe05178 HTTP/1.1" 200 None 2026-04-05 07:46:33,175 - lava_callback - ERROR - Error processing callback for node 69cf70559e2394c38fe05178: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46722 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:48:22,090 - lava_callback - INFO - Received callback for node 69cf70b99e2394c38fe051af INFO: 172.21.0.1:41978 - "POST /node/69cf70b99e2394c38fe051af HTTP/1.0" 202 Accepted 2026-04-05 07:48:22,095 - lava_callback - INFO - Starting async job submit for node 69cf70b99e2394c38fe051af 2026-04-05 07:48:22,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:48:22,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf70b99e2394c38fe051af HTTP/1.1" 200 None 2026-04-05 07:48:22,114 - lava_callback - DEBUG - Processing node 69cf70b99e2394c38fe051af: baseline-arm64-clabbe 2026-04-05 07:48:22,114 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf70b99e2394c38fe051af 2026-04-05 07:48:22,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:48:22,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf70b99e2394c38fe051af HTTP/1.1" 200 None 2026-04-05 07:48:22,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:48:22,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 07:48:22,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:48:22,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf70b99e2394c38fe051af HTTP/1.1" 200 None 2026-04-05 07:48:22,169 - lava_callback - ERROR - Error processing callback for node 69cf70b99e2394c38fe051af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47744 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:49:13,276 - lava_callback - INFO - Received callback for node 69cf70f39e2394c38fe051ed INFO: 172.21.0.1:40064 - "POST /node/69cf70f39e2394c38fe051ed HTTP/1.0" 202 Accepted 2026-04-05 07:49:13,282 - lava_callback - INFO - Starting async job submit for node 69cf70f39e2394c38fe051ed 2026-04-05 07:49:13,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:49:13,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf70f39e2394c38fe051ed HTTP/1.1" 200 None 2026-04-05 07:49:13,297 - lava_callback - DEBUG - Processing node 69cf70f39e2394c38fe051ed: baseline-arm64-baylibre 2026-04-05 07:49:13,298 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf70f39e2394c38fe051ed 2026-04-05 07:49:13,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:49:13,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf70f39e2394c38fe051ed HTTP/1.1" 200 None 2026-04-05 07:49:13,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:49:13,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 07:49:13,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:49:13,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf70f39e2394c38fe051ed HTTP/1.1" 200 None 2026-04-05 07:49:13,353 - lava_callback - ERROR - Error processing callback for node 69cf70f39e2394c38fe051ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36924 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:51:42,160 - lava_callback - INFO - Received callback for node 69cf71859e2394c38fe05256 INFO: 172.21.0.1:34614 - "POST /node/69cf71859e2394c38fe05256 HTTP/1.0" 202 Accepted 2026-04-05 07:51:42,169 - lava_callback - INFO - Starting async job submit for node 69cf71859e2394c38fe05256 2026-04-05 07:51:42,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:51:42,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf71859e2394c38fe05256 HTTP/1.1" 200 None 2026-04-05 07:51:42,192 - lava_callback - DEBUG - Processing node 69cf71859e2394c38fe05256: baseline-arm64-clabbe 2026-04-05 07:51:42,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf71859e2394c38fe05256 2026-04-05 07:51:42,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:51:42,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf71859e2394c38fe05256 HTTP/1.1" 200 None 2026-04-05 07:51:42,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:51:42,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 07:51:42,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:51:42,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf71859e2394c38fe05256 HTTP/1.1" 200 None 2026-04-05 07:51:42,251 - lava_callback - ERROR - Error processing callback for node 69cf71859e2394c38fe05256: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53874 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:52:53,521 - lava_callback - INFO - Received callback for node 69cf71c49e2394c38fe0527b INFO: 172.21.0.1:45508 - "POST /node/69cf71c49e2394c38fe0527b HTTP/1.0" 202 Accepted 2026-04-05 07:52:53,527 - lava_callback - INFO - Starting async job submit for node 69cf71c49e2394c38fe0527b 2026-04-05 07:52:53,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:52:53,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf71c49e2394c38fe0527b HTTP/1.1" 200 None 2026-04-05 07:52:53,551 - lava_callback - DEBUG - Processing node 69cf71c49e2394c38fe0527b: baseline-arm64-baylibre 2026-04-05 07:52:53,551 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf71c49e2394c38fe0527b 2026-04-05 07:52:53,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:52:53,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf71c49e2394c38fe0527b HTTP/1.1" 200 None 2026-04-05 07:52:53,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:52:53,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 07:52:53,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:52:53,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf71c49e2394c38fe0527b HTTP/1.1" 200 None 2026-04-05 07:52:53,623 - lava_callback - ERROR - Error processing callback for node 69cf71c49e2394c38fe0527b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45518 - "GET /node/693b810441fb4c9509764c63%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45528 - "GET /node/692954ebf7abe3da4c22a3e7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:45536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43572 - "GET /node/6986fb816e077e4126a7d449%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:43580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49780 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:55:13,623 - lava_callback - INFO - Received callback for node 69cf72509e2394c38fe052ea INFO: 172.21.0.1:41804 - "POST /node/69cf72509e2394c38fe052ea HTTP/1.0" 202 Accepted 2026-04-05 07:55:13,629 - lava_callback - INFO - Starting async job submit for node 69cf72509e2394c38fe052ea 2026-04-05 07:55:13,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:55:13,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf72509e2394c38fe052ea HTTP/1.1" 200 None 2026-04-05 07:55:13,646 - lava_callback - DEBUG - Processing node 69cf72509e2394c38fe052ea: baseline-arm64-baylibre 2026-04-05 07:55:13,646 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf72509e2394c38fe052ea 2026-04-05 07:55:13,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:55:13,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf72509e2394c38fe052ea HTTP/1.1" 200 None 2026-04-05 07:55:13,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:55:13,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 07:55:13,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:55:13,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf72509e2394c38fe052ea HTTP/1.1" 200 None 2026-04-05 07:55:13,712 - lava_callback - ERROR - Error processing callback for node 69cf72509e2394c38fe052ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35486 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:56:42,448 - lava_callback - INFO - Received callback for node 69cf72ad9e2394c38fe0531e INFO: 172.21.0.1:49102 - "POST /node/69cf72ad9e2394c38fe0531e HTTP/1.0" 202 Accepted 2026-04-05 07:56:42,454 - lava_callback - INFO - Starting async job submit for node 69cf72ad9e2394c38fe0531e 2026-04-05 07:56:42,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:56:42,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf72ad9e2394c38fe0531e HTTP/1.1" 200 None 2026-04-05 07:56:42,473 - lava_callback - DEBUG - Processing node 69cf72ad9e2394c38fe0531e: baseline-arm64-clabbe 2026-04-05 07:56:42,473 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf72ad9e2394c38fe0531e 2026-04-05 07:56:42,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:56:42,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf72ad9e2394c38fe0531e HTTP/1.1" 200 None 2026-04-05 07:56:42,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:56:42,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 07:56:42,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:56:42,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf72ad9e2394c38fe0531e HTTP/1.1" 200 None 2026-04-05 07:56:42,551 - lava_callback - ERROR - Error processing callback for node 69cf72ad9e2394c38fe0531e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33248 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:57:53,692 - lava_callback - INFO - Received callback for node 69cf72ee9e2394c38fe0535b INFO: 172.21.0.1:45294 - "POST /node/69cf72ee9e2394c38fe0535b HTTP/1.0" 202 Accepted 2026-04-05 07:57:53,698 - lava_callback - INFO - Starting async job submit for node 69cf72ee9e2394c38fe0535b 2026-04-05 07:57:53,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:57:53,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf72ee9e2394c38fe0535b HTTP/1.1" 200 None 2026-04-05 07:57:53,714 - lava_callback - DEBUG - Processing node 69cf72ee9e2394c38fe0535b: baseline-arm64-baylibre 2026-04-05 07:57:53,714 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf72ee9e2394c38fe0535b 2026-04-05 07:57:53,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:57:53,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf72ee9e2394c38fe0535b HTTP/1.1" 200 None 2026-04-05 07:57:53,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:57:53,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 07:57:53,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:57:53,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf72ee9e2394c38fe0535b HTTP/1.1" 200 None 2026-04-05 07:57:53,784 - lava_callback - ERROR - Error processing callback for node 69cf72ee9e2394c38fe0535b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57208 - "GET / HTTP/1.0" 200 OK 2026-04-05 07:58:53,718 - lava_callback - INFO - Received callback for node 69cf73319e2394c38fe05389 INFO: 172.21.0.1:40968 - "POST /node/69cf73319e2394c38fe05389 HTTP/1.0" 202 Accepted 2026-04-05 07:58:53,725 - lava_callback - INFO - Starting async job submit for node 69cf73319e2394c38fe05389 2026-04-05 07:58:53,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:58:53,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf73319e2394c38fe05389 HTTP/1.1" 200 None 2026-04-05 07:58:53,744 - lava_callback - DEBUG - Processing node 69cf73319e2394c38fe05389: baseline-arm64-baylibre 2026-04-05 07:58:53,744 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf73319e2394c38fe05389 2026-04-05 07:58:53,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:58:53,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf73319e2394c38fe05389 HTTP/1.1" 200 None 2026-04-05 07:58:53,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:58:53,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 07:58:53,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 07:58:53,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf73319e2394c38fe05389 HTTP/1.1" 200 None 2026-04-05 07:58:53,810 - lava_callback - ERROR - Error processing callback for node 69cf73319e2394c38fe05389: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58608 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:00:22,808 - lava_callback - INFO - Received callback for node 69cf73839e2394c38fe053be INFO: 172.21.0.1:60396 - "POST /node/69cf73839e2394c38fe053be HTTP/1.0" 202 Accepted 2026-04-05 08:00:22,814 - lava_callback - INFO - Starting async job submit for node 69cf73839e2394c38fe053be 2026-04-05 08:00:22,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:00:22,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf73839e2394c38fe053be HTTP/1.1" 200 None 2026-04-05 08:00:22,830 - lava_callback - DEBUG - Processing node 69cf73839e2394c38fe053be: baseline-arm64-clabbe 2026-04-05 08:00:22,830 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf73839e2394c38fe053be 2026-04-05 08:00:22,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:00:22,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf73839e2394c38fe053be HTTP/1.1" 200 None 2026-04-05 08:00:22,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:00:22,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 08:00:22,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:00:22,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf73839e2394c38fe053be HTTP/1.1" 200 None 2026-04-05 08:00:22,893 - lava_callback - ERROR - Error processing callback for node 69cf73839e2394c38fe053be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42700 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:01:22,668 - lava_callback - INFO - Received callback for node 69cf73ca9e2394c38fe05413 INFO: 172.21.0.1:46798 - "POST /node/69cf73ca9e2394c38fe05413 HTTP/1.0" 202 Accepted 2026-04-05 08:01:22,674 - lava_callback - INFO - Starting async job submit for node 69cf73ca9e2394c38fe05413 2026-04-05 08:01:22,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:01:22,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf73ca9e2394c38fe05413 HTTP/1.1" 200 None 2026-04-05 08:01:22,692 - lava_callback - DEBUG - Processing node 69cf73ca9e2394c38fe05413: baseline-arm64-clabbe 2026-04-05 08:01:22,693 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf73ca9e2394c38fe05413 2026-04-05 08:01:22,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:01:22,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf73ca9e2394c38fe05413 HTTP/1.1" 200 None 2026-04-05 08:01:22,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:01:22,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 08:01:22,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:01:22,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf73ca9e2394c38fe05413 HTTP/1.1" 200 None 2026-04-05 08:01:22,773 - lava_callback - ERROR - Error processing callback for node 69cf73ca9e2394c38fe05413: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58872 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:02:42,748 - lava_callback - INFO - Received callback for node 69cf74129e2394c38fe0543e INFO: 172.21.0.1:50618 - "POST /node/69cf74129e2394c38fe0543e HTTP/1.0" 202 Accepted 2026-04-05 08:02:42,754 - lava_callback - INFO - Starting async job submit for node 69cf74129e2394c38fe0543e 2026-04-05 08:02:42,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:02:42,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf74129e2394c38fe0543e HTTP/1.1" 200 None 2026-04-05 08:02:42,770 - lava_callback - DEBUG - Processing node 69cf74129e2394c38fe0543e: baseline-arm64-clabbe 2026-04-05 08:02:42,770 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf74129e2394c38fe0543e 2026-04-05 08:02:42,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:02:42,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf74129e2394c38fe0543e HTTP/1.1" 200 None 2026-04-05 08:02:42,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:02:42,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 08:02:42,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:02:42,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf74129e2394c38fe0543e HTTP/1.1" 200 None 2026-04-05 08:02:42,828 - lava_callback - ERROR - Error processing callback for node 69cf74129e2394c38fe0543e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55774 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:03:34,030 - lava_callback - INFO - Received callback for node 69cf74539e2394c38fe05474 INFO: 172.21.0.1:39476 - "POST /node/69cf74539e2394c38fe05474 HTTP/1.0" 202 Accepted 2026-04-05 08:03:34,036 - lava_callback - INFO - Starting async job submit for node 69cf74539e2394c38fe05474 2026-04-05 08:03:34,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:03:34,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf74539e2394c38fe05474 HTTP/1.1" 200 None 2026-04-05 08:03:34,053 - lava_callback - DEBUG - Processing node 69cf74539e2394c38fe05474: baseline-arm64-baylibre 2026-04-05 08:03:34,053 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf74539e2394c38fe05474 2026-04-05 08:03:34,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:03:34,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf74539e2394c38fe05474 HTTP/1.1" 200 None 2026-04-05 08:03:34,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:03:34,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 08:03:34,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:39488 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:03:34,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf74539e2394c38fe05474 HTTP/1.1" 200 None 2026-04-05 08:03:34,108 - lava_callback - ERROR - Error processing callback for node 69cf74539e2394c38fe05474: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53392 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:05:02,865 - lava_callback - INFO - Received callback for node 69cf74a29e2394c38fe054b7 INFO: 172.21.0.1:54874 - "POST /node/69cf74a29e2394c38fe054b7 HTTP/1.0" 202 Accepted 2026-04-05 08:05:02,871 - lava_callback - INFO - Starting async job submit for node 69cf74a29e2394c38fe054b7 2026-04-05 08:05:02,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:05:02,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf74a29e2394c38fe054b7 HTTP/1.1" 200 None 2026-04-05 08:05:02,887 - lava_callback - DEBUG - Processing node 69cf74a29e2394c38fe054b7: baseline-arm64-clabbe 2026-04-05 08:05:02,887 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf74a29e2394c38fe054b7 2026-04-05 08:05:02,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:05:02,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf74a29e2394c38fe054b7 HTTP/1.1" 200 None 2026-04-05 08:05:02,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:05:02,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 08:05:02,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:05:02,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf74a29e2394c38fe054b7 HTTP/1.1" 200 None 2026-04-05 08:05:02,956 - lava_callback - ERROR - Error processing callback for node 69cf74a29e2394c38fe054b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59530 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:06:02,960 - lava_callback - INFO - Received callback for node 69cf74e69e2394c38fe054f0 INFO: 172.21.0.1:50198 - "POST /node/69cf74e69e2394c38fe054f0 HTTP/1.0" 202 Accepted 2026-04-05 08:06:02,965 - lava_callback - INFO - Starting async job submit for node 69cf74e69e2394c38fe054f0 2026-04-05 08:06:02,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:06:02,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf74e69e2394c38fe054f0 HTTP/1.1" 200 None 2026-04-05 08:06:02,982 - lava_callback - DEBUG - Processing node 69cf74e69e2394c38fe054f0: baseline-arm64-clabbe 2026-04-05 08:06:02,983 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf74e69e2394c38fe054f0 2026-04-05 08:06:02,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:06:03,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf74e69e2394c38fe054f0 HTTP/1.1" 200 None 2026-04-05 08:06:03,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:06:03,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 08:06:03,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:06:03,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf74e69e2394c38fe054f0 HTTP/1.1" 200 None 2026-04-05 08:06:03,045 - lava_callback - ERROR - Error processing callback for node 69cf74e69e2394c38fe054f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50066 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:07:22,990 - lava_callback - INFO - Received callback for node 69cf75329e2394c38fe05528 INFO: 172.21.0.1:51922 - "POST /node/69cf75329e2394c38fe05528 HTTP/1.0" 202 Accepted 2026-04-05 08:07:22,998 - lava_callback - INFO - Starting async job submit for node 69cf75329e2394c38fe05528 2026-04-05 08:07:23,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:07:23,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf75329e2394c38fe05528 HTTP/1.1" 200 None 2026-04-05 08:07:23,019 - lava_callback - DEBUG - Processing node 69cf75329e2394c38fe05528: baseline-arm64-clabbe 2026-04-05 08:07:23,019 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf75329e2394c38fe05528 2026-04-05 08:07:23,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:07:23,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf75329e2394c38fe05528 HTTP/1.1" 200 None 2026-04-05 08:07:23,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:07:23,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 08:07:23,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:07:23,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf75329e2394c38fe05528 HTTP/1.1" 200 None 2026-04-05 08:07:23,082 - lava_callback - ERROR - Error processing callback for node 69cf75329e2394c38fe05528: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60674 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:08:43,126 - lava_callback - INFO - Received callback for node 69cf757e9e2394c38fe0554c INFO: 172.21.0.1:49478 - "POST /node/69cf757e9e2394c38fe0554c HTTP/1.0" 202 Accepted 2026-04-05 08:08:43,132 - lava_callback - INFO - Starting async job submit for node 69cf757e9e2394c38fe0554c 2026-04-05 08:08:43,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:08:43,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf757e9e2394c38fe0554c HTTP/1.1" 200 None 2026-04-05 08:08:43,149 - lava_callback - DEBUG - Processing node 69cf757e9e2394c38fe0554c: baseline-arm64-clabbe 2026-04-05 08:08:43,149 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf757e9e2394c38fe0554c 2026-04-05 08:08:43,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:08:43,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf757e9e2394c38fe0554c HTTP/1.1" 200 None 2026-04-05 08:08:43,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:08:43,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 08:08:43,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:08:43,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf757e9e2394c38fe0554c HTTP/1.1" 200 None 2026-04-05 08:08:43,209 - lava_callback - ERROR - Error processing callback for node 69cf757e9e2394c38fe0554c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60936 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:09:54,472 - lava_callback - INFO - Received callback for node 69cf75c19e2394c38fe05578 INFO: 172.21.0.1:41454 - "POST /node/69cf75c19e2394c38fe05578 HTTP/1.0" 202 Accepted 2026-04-05 08:09:54,477 - lava_callback - INFO - Starting async job submit for node 69cf75c19e2394c38fe05578 2026-04-05 08:09:54,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:09:54,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf75c19e2394c38fe05578 HTTP/1.1" 200 None 2026-04-05 08:09:54,493 - lava_callback - DEBUG - Processing node 69cf75c19e2394c38fe05578: baseline-arm64-baylibre 2026-04-05 08:09:54,493 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf75c19e2394c38fe05578 2026-04-05 08:09:54,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:09:54,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf75c19e2394c38fe05578 HTTP/1.1" 200 None 2026-04-05 08:09:54,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:09:54,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 08:09:54,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:09:54,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf75c19e2394c38fe05578 HTTP/1.1" 200 None 2026-04-05 08:09:54,550 - lava_callback - ERROR - Error processing callback for node 69cf75c19e2394c38fe05578: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50172 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:11:03,213 - lava_callback - INFO - Received callback for node 69cf760b9e2394c38fe055c7 INFO: 172.21.0.1:42064 - "POST /node/69cf760b9e2394c38fe055c7 HTTP/1.0" 202 Accepted 2026-04-05 08:11:03,219 - lava_callback - INFO - Starting async job submit for node 69cf760b9e2394c38fe055c7 2026-04-05 08:11:03,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:11:03,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf760b9e2394c38fe055c7 HTTP/1.1" 200 None 2026-04-05 08:11:03,235 - lava_callback - DEBUG - Processing node 69cf760b9e2394c38fe055c7: baseline-arm64-clabbe 2026-04-05 08:11:03,235 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf760b9e2394c38fe055c7 2026-04-05 08:11:03,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:11:03,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf760b9e2394c38fe055c7 HTTP/1.1" 200 None 2026-04-05 08:11:03,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:11:03,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc648c8cd9cbcdc9459656 HTTP/1.1" 200 None 2026-04-05 08:11:03,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:11:03,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf760b9e2394c38fe055c7 HTTP/1.1" 200 None 2026-04-05 08:11:03,295 - lava_callback - ERROR - Error processing callback for node 69cf760b9e2394c38fe055c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39500 - "GET / HTTP/1.0" 200 OK 2026-04-05 08:12:23,238 - lava_callback - INFO - Received callback for node 69cf76519e2394c38fe05601 INFO: 172.21.0.1:51910 - "POST /node/69cf76519e2394c38fe05601 HTTP/1.0" 202 Accepted 2026-04-05 08:12:23,247 - lava_callback - INFO - Starting async job submit for node 69cf76519e2394c38fe05601 2026-04-05 08:12:23,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:12:23,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf76519e2394c38fe05601 HTTP/1.1" 200 None 2026-04-05 08:12:23,264 - lava_callback - DEBUG - Processing node 69cf76519e2394c38fe05601: baseline-arm64-clabbe 2026-04-05 08:12:23,264 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cf76519e2394c38fe05601 2026-04-05 08:12:23,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:12:23,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cf76519e2394c38fe05601 HTTP/1.1" 200 None 2026-04-05 08:12:23,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:12:23,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-05 08:12:23,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-05 08:12:23,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cf76519e2394c38fe05601 HTTP/1.1" 200 None 2026-04-05 08:12:23,349 - lava_callback - ERROR - Error processing callback for node 69cf76519e2394c38fe05601: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44784 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]