Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kvm-unit-tests/20250624.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-rt/20240806.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bullseye/20240129.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-gst-h26forge/20250117.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-wifi/20250925.0/{debarch}/': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'http://storage.kernelci.org/images/rootfs/debian/bookworm/20240313.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-fault-injection/20250520.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromiumos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromeos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromeos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromeos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromeos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromeos-{flavour}.flavour.config': 'krev' INFO: Started server process [1] INFO: Waiting for application startup. Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromeos-{flavour}.flavour.config': 'krev' Format string error in param 'cros://chromeos-{krev}/{crosarch}/chromeos-{flavour}.flavour.config': 'krev' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-kselftest/20250724.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-ltp/20250818.0/{debarch}': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-gst-fluster/20240926.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-gst-fluster/20240926.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-gst-fluster/20240926.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-gst-fluster/20240926.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-gst-fluster/20240926.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-gst-fluster/20240926.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-gst-fluster/20240926.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-wifi/20250925.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-wifi/20250925.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-wifi/20250925.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-wifi/20250925.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-wifi/20250925.0/{debarch}/': 'debarch' Format string error in param 'https://storage.kernelci.org/images/rootfs/debian/bookworm-wifi/20250925.0/{debarch}/': 'debarch' 2025-09-26 09:23:58,344 - lava_callback - INFO - FastAPI application started - LAVA callback server is ready INFO: Application startup complete. 2025-09-26 09:23:58,344 - lava_callback - DEBUG - Debug logging is enabled INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.20.0.1:59232 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:24:11,341 - lava_callback - INFO - Received callback for node 68d3b8a65180aefab120b2c2 2025-09-26 09:24:11,349 - lava_callback - INFO - Starting async job submit for node 68d3b8a65180aefab120b2c2 INFO: 172.20.0.1:50626 - "POST /node/68d3b8a65180aefab120b2c2 HTTP/1.0" 202 Accepted 2025-09-26 09:24:11,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:24:11,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3b8a65180aefab120b2c2 HTTP/1.1" 200 None 2025-09-26 09:24:11,373 - lava_callback - DEBUG - Processing node 68d3b8a65180aefab120b2c2: baseline-arm 2025-09-26 09:24:11,373 - lava_callback - ERROR - Error processing callback for node 68d3b8a65180aefab120b2c2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:24:12,061 - lava_callback - INFO - Received callback for node 68d3b8b55180aefab120b2f8 INFO: 172.20.0.1:50634 - "POST /node/68d3b8b55180aefab120b2f8 HTTP/1.0" 202 Accepted 2025-09-26 09:24:12,067 - lava_callback - INFO - Starting async job submit for node 68d3b8b55180aefab120b2f8 2025-09-26 09:24:12,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:24:12,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3b8b55180aefab120b2f8 HTTP/1.1" 200 None 2025-09-26 09:24:12,082 - lava_callback - DEBUG - Processing node 68d3b8b55180aefab120b2f8: baseline-arm 2025-09-26 09:24:12,082 - lava_callback - ERROR - Error processing callback for node 68d3b8b55180aefab120b2f8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:50650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60014 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:24:31,293 - lava_callback - INFO - Received callback for node 68d3b8ba5180aefab120b312 INFO: 172.20.0.1:51598 - "POST /node/68d3b8ba5180aefab120b312 HTTP/1.0" 202 Accepted 2025-09-26 09:24:31,299 - lava_callback - INFO - Starting async job submit for node 68d3b8ba5180aefab120b312 2025-09-26 09:24:31,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:24:31,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3b8ba5180aefab120b312 HTTP/1.1" 200 None 2025-09-26 09:24:31,313 - lava_callback - DEBUG - Processing node 68d3b8ba5180aefab120b312: baseline-arm 2025-09-26 09:24:31,313 - lava_callback - ERROR - Error processing callback for node 68d3b8ba5180aefab120b312: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:24:32,543 - lava_callback - INFO - Received callback for node 68d3b8c35180aefab120b31b INFO: 172.20.0.1:51606 - "POST /node/68d3b8c35180aefab120b31b HTTP/1.0" 202 Accepted 2025-09-26 09:24:32,549 - lava_callback - INFO - Starting async job submit for node 68d3b8c35180aefab120b31b 2025-09-26 09:24:32,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:24:32,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3b8c35180aefab120b31b HTTP/1.1" 200 None 2025-09-26 09:24:32,568 - lava_callback - DEBUG - Processing node 68d3b8c35180aefab120b31b: baseline-arm 2025-09-26 09:24:32,568 - lava_callback - ERROR - Error processing callback for node 68d3b8c35180aefab120b31b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:24:33,223 - lava_callback - INFO - Received callback for node 68d3b8c85180aefab120b322 INFO: 172.20.0.1:51616 - "POST /node/68d3b8c85180aefab120b322 HTTP/1.0" 202 Accepted 2025-09-26 09:24:33,229 - lava_callback - INFO - Starting async job submit for node 68d3b8c85180aefab120b322 2025-09-26 09:24:33,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:24:33,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3b8c85180aefab120b322 HTTP/1.1" 200 None 2025-09-26 09:24:33,245 - lava_callback - DEBUG - Processing node 68d3b8c85180aefab120b322: baseline-arm 2025-09-26 09:24:33,245 - lava_callback - ERROR - Error processing callback for node 68d3b8c85180aefab120b322: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:51626 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:24:45,950 - lava_callback - INFO - Received callback for node 68d3bd1d5180aefab120bb7c INFO: 172.20.0.1:34954 - "POST /node/68d3bd1d5180aefab120bb7c HTTP/1.0" 202 Accepted 2025-09-26 09:24:45,959 - lava_callback - INFO - Starting async job submit for node 68d3bd1d5180aefab120bb7c 2025-09-26 09:24:46,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:24:46,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bd1d5180aefab120bb7c HTTP/1.1" 200 None 2025-09-26 09:24:46,052 - lava_callback - DEBUG - Processing node 68d3bd1d5180aefab120bb7c: baseline-arm64 INFO: 172.20.0.1:34962 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:24:47,125 - lava_callback - ERROR - Error processing callback for node 68d3bd1d5180aefab120bb7c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 09:24:51,326 - lava_callback - INFO - Received callback for node 68d3b8cc5180aefab120b325 INFO: 172.20.0.1:55986 - "POST /node/68d3b8cc5180aefab120b325 HTTP/1.0" 202 Accepted 2025-09-26 09:24:51,335 - lava_callback - INFO - Starting async job submit for node 68d3b8cc5180aefab120b325 2025-09-26 09:24:51,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:24:51,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3b8cc5180aefab120b325 HTTP/1.1" 200 None 2025-09-26 09:24:51,355 - lava_callback - DEBUG - Processing node 68d3b8cc5180aefab120b325: baseline-arm 2025-09-26 09:24:51,355 - lava_callback - ERROR - Error processing callback for node 68d3b8cc5180aefab120b325: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:24:52,034 - lava_callback - INFO - Received callback for node 68d3b8d25180aefab120b32b INFO: 172.20.0.1:55994 - "POST /node/68d3b8d25180aefab120b32b HTTP/1.0" 202 Accepted 2025-09-26 09:24:52,040 - lava_callback - INFO - Starting async job submit for node 68d3b8d25180aefab120b32b 2025-09-26 09:24:52,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:24:52,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3b8d25180aefab120b32b HTTP/1.1" 200 None 2025-09-26 09:24:52,054 - lava_callback - DEBUG - Processing node 68d3b8d25180aefab120b32b: baseline-arm 2025-09-26 09:24:52,054 - lava_callback - ERROR - Error processing callback for node 68d3b8d25180aefab120b32b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:55996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49536 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:25:11,336 - lava_callback - INFO - Received callback for node 68d3b8de5180aefab120b339 INFO: 172.20.0.1:46196 - "POST /node/68d3b8de5180aefab120b339 HTTP/1.0" 202 Accepted 2025-09-26 09:25:11,345 - lava_callback - INFO - Starting async job submit for node 68d3b8de5180aefab120b339 2025-09-26 09:25:11,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:25:11,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3b8de5180aefab120b339 HTTP/1.1" 200 None 2025-09-26 09:25:11,365 - lava_callback - DEBUG - Processing node 68d3b8de5180aefab120b339: baseline-arm 2025-09-26 09:25:11,365 - lava_callback - ERROR - Error processing callback for node 68d3b8de5180aefab120b339: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:25:12,094 - lava_callback - INFO - Received callback for node 68d3b8e05180aefab120b33f INFO: 172.20.0.1:46200 - "POST /node/68d3b8e05180aefab120b33f HTTP/1.0" 202 Accepted 2025-09-26 09:25:12,103 - lava_callback - INFO - Starting async job submit for node 68d3b8e05180aefab120b33f 2025-09-26 09:25:12,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:25:12,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3b8e05180aefab120b33f HTTP/1.1" 200 None 2025-09-26 09:25:12,119 - lava_callback - DEBUG - Processing node 68d3b8e05180aefab120b33f: baseline-arm 2025-09-26 09:25:12,119 - lava_callback - ERROR - Error processing callback for node 68d3b8e05180aefab120b33f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:25:12,827 - lava_callback - INFO - Received callback for node 68d3b8e45180aefab120b343 INFO: 172.20.0.1:46204 - "POST /node/68d3b8e45180aefab120b343 HTTP/1.0" 202 Accepted 2025-09-26 09:25:12,835 - lava_callback - INFO - Starting async job submit for node 68d3b8e45180aefab120b343 2025-09-26 09:25:12,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:25:12,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3b8e45180aefab120b343 HTTP/1.1" 200 None 2025-09-26 09:25:12,869 - lava_callback - DEBUG - Processing node 68d3b8e45180aefab120b343: baseline-arm 2025-09-26 09:25:12,869 - lava_callback - ERROR - Error processing callback for node 68d3b8e45180aefab120b343: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:25:13,547 - lava_callback - INFO - Received callback for node 68d3b8e85180aefab120b34a INFO: 172.20.0.1:46216 - "POST /node/68d3b8e85180aefab120b34a HTTP/1.0" 202 Accepted 2025-09-26 09:25:13,556 - lava_callback - INFO - Starting async job submit for node 68d3b8e85180aefab120b34a 2025-09-26 09:25:13,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:25:13,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3b8e85180aefab120b34a HTTP/1.1" 200 None 2025-09-26 09:25:13,595 - lava_callback - DEBUG - Processing node 68d3b8e85180aefab120b34a: baseline-arm 2025-09-26 09:25:13,595 - lava_callback - ERROR - Error processing callback for node 68d3b8e85180aefab120b34a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:46226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46246 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:25:18,772 - lava_callback - INFO - Received callback for node 68d4087ecd36afa834e16c6d INFO: 172.20.0.1:46256 - "POST /node/68d4087ecd36afa834e16c6d HTTP/1.0" 202 Accepted 2025-09-26 09:25:18,779 - lava_callback - INFO - Starting async job submit for node 68d4087ecd36afa834e16c6d 2025-09-26 09:25:18,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:25:18,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4087ecd36afa834e16c6d HTTP/1.1" 200 None 2025-09-26 09:25:18,817 - lava_callback - DEBUG - Processing node 68d4087ecd36afa834e16c6d: baseline-arm 2025-09-26 09:25:19,097 - lava_callback - ERROR - Error processing callback for node 68d4087ecd36afa834e16c6d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 09:25:20,077 - lava_callback - INFO - Received callback for node 68d3bd245180aefab120bb88 INFO: 172.20.0.1:33166 - "POST /node/68d3bd245180aefab120bb88 HTTP/1.0" 202 Accepted 2025-09-26 09:25:20,089 - lava_callback - INFO - Starting async job submit for node 68d3bd245180aefab120bb88 2025-09-26 09:25:20,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:25:20,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bd245180aefab120bb88 HTTP/1.1" 200 None 2025-09-26 09:25:20,144 - lava_callback - DEBUG - Processing node 68d3bd245180aefab120bb88: baseline-arm64 2025-09-26 09:25:21,109 - lava_callback - ERROR - Error processing callback for node 68d3bd245180aefab120bb88: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:33174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40742 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:25:40,167 - lava_callback - INFO - Received callback for node 68d3bd2b5180aefab120bb94 INFO: 172.20.0.1:60750 - "POST /node/68d3bd2b5180aefab120bb94 HTTP/1.0" 202 Accepted 2025-09-26 09:25:40,174 - lava_callback - INFO - Starting async job submit for node 68d3bd2b5180aefab120bb94 2025-09-26 09:25:40,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:25:40,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bd2b5180aefab120bb94 HTTP/1.1" 200 None 2025-09-26 09:25:40,236 - lava_callback - DEBUG - Processing node 68d3bd2b5180aefab120bb94: baseline-arm64 2025-09-26 09:25:41,141 - lava_callback - ERROR - Error processing callback for node 68d3bd2b5180aefab120bb94: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:60756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42654 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:26:05,235 - lava_callback - INFO - Received callback for node 68d3b9275180aefab120b39b INFO: 172.20.0.1:42912 - "POST /node/68d3b9275180aefab120b39b HTTP/1.0" 202 Accepted 2025-09-26 09:26:05,241 - lava_callback - INFO - Starting async job submit for node 68d3b9275180aefab120b39b 2025-09-26 09:26:05,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:26:05,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3b9275180aefab120b39b HTTP/1.1" 200 None 2025-09-26 09:26:05,261 - lava_callback - DEBUG - Processing node 68d3b9275180aefab120b39b: ltp-cap-bounds 2025-09-26 09:26:05,262 - lava_callback - ERROR - Error processing callback for node 68d3b9275180aefab120b39b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:42928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59112 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:26:58,737 - lava_callback - INFO - Received callback for node 68d3bd365180aefab120bbb5 INFO: 172.20.0.1:59126 - "POST /node/68d3bd365180aefab120bbb5 HTTP/1.0" 202 Accepted 2025-09-26 09:26:58,748 - lava_callback - INFO - Starting async job submit for node 68d3bd365180aefab120bbb5 2025-09-26 09:26:58,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:26:58,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bd365180aefab120bbb5 HTTP/1.1" 200 None 2025-09-26 09:26:58,827 - lava_callback - DEBUG - Processing node 68d3bd365180aefab120bbb5: baseline-arm64 2025-09-26 09:27:00,114 - lava_callback - ERROR - Error processing callback for node 68d3bd365180aefab120bbb5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:55756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49602 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:27:25,237 - lava_callback - INFO - Received callback for node 68d3b9685180aefab120b41a INFO: 172.20.0.1:48572 - "POST /node/68d3b9685180aefab120b41a HTTP/1.0" 202 Accepted 2025-09-26 09:27:25,246 - lava_callback - INFO - Starting async job submit for node 68d3b9685180aefab120b41a 2025-09-26 09:27:25,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:27:25,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3b9685180aefab120b41a HTTP/1.1" 200 None 2025-09-26 09:27:25,287 - lava_callback - DEBUG - Processing node 68d3b9685180aefab120b41a: ltp-cap-bounds 2025-09-26 09:27:25,287 - lava_callback - ERROR - Error processing callback for node 68d3b9685180aefab120b41a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:27:26,065 - lava_callback - INFO - Received callback for node 68d3b9715180aefab120b428 INFO: 172.20.0.1:48584 - "POST /node/68d3b9715180aefab120b428 HTTP/1.0" 202 Accepted 2025-09-26 09:27:26,076 - lava_callback - INFO - Starting async job submit for node 68d3b9715180aefab120b428 2025-09-26 09:27:26,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:27:26,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3b9715180aefab120b428 HTTP/1.1" 200 None 2025-09-26 09:27:26,103 - lava_callback - DEBUG - Processing node 68d3b9715180aefab120b428: ltp-cap-bounds 2025-09-26 09:27:26,103 - lava_callback - ERROR - Error processing callback for node 68d3b9715180aefab120b428: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:48592 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:27:34,874 - lava_callback - INFO - Received callback for node 68d4087fcd36afa834e16c70 INFO: 172.20.0.1:47736 - "POST /node/68d4087fcd36afa834e16c70 HTTP/1.0" 202 Accepted 2025-09-26 09:27:34,886 - lava_callback - INFO - Starting async job submit for node 68d4087fcd36afa834e16c70 2025-09-26 09:27:34,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:27:34,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4087fcd36afa834e16c70 HTTP/1.1" 200 None 2025-09-26 09:27:34,958 - lava_callback - DEBUG - Processing node 68d4087fcd36afa834e16c70: baseline-arm 2025-09-26 09:27:35,529 - lava_callback - ERROR - Error processing callback for node 68d4087fcd36afa834e16c70: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:47740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58218 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:28:17,265 - lava_callback - INFO - Received callback for node 68d3b8a15180aefab120b2b6 2025-09-26 09:28:17,290 - lava_callback - INFO - Starting async job submit for node 68d3b8a15180aefab120b2b6 INFO: 172.20.0.1:58230 - "POST /node/68d3b8a15180aefab120b2b6 HTTP/1.0" 202 Accepted 2025-09-26 09:28:17,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:17,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3b8a15180aefab120b2b6 HTTP/1.1" 200 None 2025-09-26 09:28:17,412 - lava_callback - DEBUG - Processing node 68d3b8a15180aefab120b2b6: baseline-arm 2025-09-26 09:28:17,953 - lava_callback - ERROR - Error processing callback for node 68d3b8a15180aefab120b2b6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:58236 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:28:25,182 - lava_callback - INFO - Received callback for node 68d65c682f83206171a8fda7 INFO: 172.20.0.1:37256 - "POST /node/68d65c682f83206171a8fda7 HTTP/1.0" 202 Accepted 2025-09-26 09:28:25,195 - lava_callback - INFO - Starting async job submit for node 68d65c682f83206171a8fda7 2025-09-26 09:28:25,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:25,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c682f83206171a8fda7 HTTP/1.1" 200 None 2025-09-26 09:28:25,250 - lava_callback - DEBUG - Processing node 68d65c682f83206171a8fda7: baseline-arm 2025-09-26 09:28:25,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:28:26,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:28:26,059 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d65c682f83206171a8fda7/log.txt.gz 2025-09-26 09:28:26,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:28:26,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:28:26,276 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d65c682f83206171a8fda7/lava_callback.json.gz 2025-09-26 09:28:26,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:26,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c682f83206171a8fda7 HTTP/1.1" 200 None 2025-09-26 09:28:26,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:26,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-26 09:28:26,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:26,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d65c682f83206171a8fda7 HTTP/1.1" 200 None 2025-09-26 09:28:26,406 - lava_callback - INFO - Completed processing callback for node 68d65c682f83206171a8fda7 INFO: 172.20.0.1:37270 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:28:28,896 - lava_callback - INFO - Received callback for node 68d65c6e2f83206171a8fdb3 INFO: 172.20.0.1:37286 - "POST /node/68d65c6e2f83206171a8fdb3 HTTP/1.0" 202 Accepted 2025-09-26 09:28:28,906 - lava_callback - INFO - Starting async job submit for node 68d65c6e2f83206171a8fdb3 2025-09-26 09:28:28,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:28,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c6e2f83206171a8fdb3 HTTP/1.1" 200 None 2025-09-26 09:28:28,960 - lava_callback - DEBUG - Processing node 68d65c6e2f83206171a8fdb3: baseline-arm 2025-09-26 09:28:29,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:28:29,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:28:29,784 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d65c6e2f83206171a8fdb3/log.txt.gz 2025-09-26 09:28:29,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:28:30,007 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:28:30,008 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d65c6e2f83206171a8fdb3/lava_callback.json.gz 2025-09-26 09:28:30,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:30,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c6e2f83206171a8fdb3 HTTP/1.1" 200 None 2025-09-26 09:28:30,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:30,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-26 09:28:30,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:30,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d65c6e2f83206171a8fdb3 HTTP/1.1" 200 None 2025-09-26 09:28:30,137 - lava_callback - INFO - Completed processing callback for node 68d65c6e2f83206171a8fdb3 INFO: 172.20.0.1:42592 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:28:45,736 - lava_callback - INFO - Received callback for node 68d65c652f83206171a8fd9e INFO: 172.20.0.1:60976 - "POST /node/68d65c652f83206171a8fd9e HTTP/1.0" 202 Accepted 2025-09-26 09:28:45,742 - lava_callback - INFO - Starting async job submit for node 68d65c652f83206171a8fd9e 2025-09-26 09:28:45,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:45,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c652f83206171a8fd9e HTTP/1.1" 200 None 2025-09-26 09:28:45,789 - lava_callback - DEBUG - Processing node 68d65c652f83206171a8fd9e: baseline-arm 2025-09-26 09:28:46,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:60982 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:28:46,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:28:46,844 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d65c652f83206171a8fd9e/log.txt.gz 2025-09-26 09:28:46,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:28:49,222 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:28:49,223 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d65c652f83206171a8fd9e/lava_callback.json.gz 2025-09-26 09:28:49,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:49,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c652f83206171a8fd9e HTTP/1.1" 200 None 2025-09-26 09:28:49,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:49,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-26 09:28:49,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:49,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d65c652f83206171a8fd9e HTTP/1.1" 200 None 2025-09-26 09:28:49,339 - lava_callback - INFO - Completed processing callback for node 68d65c652f83206171a8fd9e 2025-09-26 09:28:50,078 - lava_callback - INFO - Received callback for node 68d65c7a2f83206171a8fdda INFO: 172.20.0.1:52786 - "POST /node/68d65c7a2f83206171a8fdda HTTP/1.0" 202 Accepted 2025-09-26 09:28:50,089 - lava_callback - INFO - Starting async job submit for node 68d65c7a2f83206171a8fdda 2025-09-26 09:28:50,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:50,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c7a2f83206171a8fdda HTTP/1.1" 200 None 2025-09-26 09:28:50,153 - lava_callback - DEBUG - Processing node 68d65c7a2f83206171a8fdda: baseline-arm-broonie 2025-09-26 09:28:50,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:28:50,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:28:50,753 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d65c7a2f83206171a8fdda/log.txt.gz 2025-09-26 09:28:50,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:28:50,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:28:50,941 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d65c7a2f83206171a8fdda/lava_callback.json.gz 2025-09-26 09:28:50,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:50,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c7a2f83206171a8fdda HTTP/1.1" 200 None 2025-09-26 09:28:51,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:51,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-26 09:28:51,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:51,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d65c7a2f83206171a8fdda HTTP/1.1" 200 None 2025-09-26 09:28:51,043 - lava_callback - INFO - Completed processing callback for node 68d65c7a2f83206171a8fdda 2025-09-26 09:28:51,212 - lava_callback - INFO - Received callback for node 68d65c692f83206171a8fdaa INFO: 172.20.0.1:52794 - "POST /node/68d65c692f83206171a8fdaa HTTP/1.0" 202 Accepted 2025-09-26 09:28:51,221 - lava_callback - INFO - Starting async job submit for node 68d65c692f83206171a8fdaa 2025-09-26 09:28:51,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:51,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c692f83206171a8fdaa HTTP/1.1" 200 None 2025-09-26 09:28:51,280 - lava_callback - DEBUG - Processing node 68d65c692f83206171a8fdaa: baseline-arm 2025-09-26 09:28:51,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:28:51,642 - lava_callback - INFO - Received callback for node 68d3b9b75180aefab120b4ba 2025-09-26 09:28:51,648 - lava_callback - INFO - Starting async job submit for node 68d3b9b75180aefab120b4ba INFO: 172.20.0.1:52800 - "POST /node/68d3b9b75180aefab120b4ba HTTP/1.0" 202 Accepted 2025-09-26 09:28:51,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:51,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3b9b75180aefab120b4ba HTTP/1.1" 200 None 2025-09-26 09:28:51,664 - lava_callback - DEBUG - Processing node 68d3b9b75180aefab120b4ba: baseline-arm 2025-09-26 09:28:51,664 - lava_callback - ERROR - Error processing callback for node 68d3b9b75180aefab120b4ba: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:28:51,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:28:51,667 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d65c692f83206171a8fdaa/log.txt.gz 2025-09-26 09:28:51,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:28:51,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:28:51,833 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d65c692f83206171a8fdaa/lava_callback.json.gz 2025-09-26 09:28:51,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:51,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c692f83206171a8fdaa HTTP/1.1" 200 None 2025-09-26 09:28:51,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:51,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-26 09:28:51,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:51,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d65c692f83206171a8fdaa HTTP/1.1" 200 None 2025-09-26 09:28:51,919 - lava_callback - INFO - Completed processing callback for node 68d65c692f83206171a8fdaa 2025-09-26 09:28:52,135 - lava_callback - INFO - Received callback for node 68d65c7b2f83206171a8fddd INFO: 172.20.0.1:52810 - "POST /node/68d65c7b2f83206171a8fddd HTTP/1.0" 202 Accepted 2025-09-26 09:28:52,141 - lava_callback - INFO - Starting async job submit for node 68d65c7b2f83206171a8fddd 2025-09-26 09:28:52,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:52,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c7b2f83206171a8fddd HTTP/1.1" 200 None 2025-09-26 09:28:52,188 - lava_callback - DEBUG - Processing node 68d65c7b2f83206171a8fddd: baseline-arm-broonie 2025-09-26 09:28:52,338 - lava_callback - INFO - Received callback for node 68d3b9c55180aefab120b4c3 INFO: 172.20.0.1:52824 - "POST /node/68d3b9c55180aefab120b4c3 HTTP/1.0" 202 Accepted 2025-09-26 09:28:52,354 - lava_callback - INFO - Starting async job submit for node 68d3b9c55180aefab120b4c3 2025-09-26 09:28:52,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:52,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:28:52,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3b9c55180aefab120b4c3 HTTP/1.1" 200 None 2025-09-26 09:28:52,419 - lava_callback - DEBUG - Processing node 68d3b9c55180aefab120b4c3: baseline-arm 2025-09-26 09:28:52,419 - lava_callback - ERROR - Error processing callback for node 68d3b9c55180aefab120b4c3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:28:54,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:28:54,607 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d65c7b2f83206171a8fddd/log.txt.gz 2025-09-26 09:28:54,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:28:54,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:28:54,744 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d65c7b2f83206171a8fddd/lava_callback.json.gz 2025-09-26 09:28:54,764 - lava_callback - INFO - Received callback for node 68d65c8d2f83206171a8fe3d 2025-09-26 09:28:54,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:52834 - "POST /node/68d65c8d2f83206171a8fe3d HTTP/1.0" 202 Accepted 2025-09-26 09:28:54,799 - lava_callback - INFO - Starting async job submit for node 68d65c8d2f83206171a8fe3d 2025-09-26 09:28:54,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c7b2f83206171a8fddd HTTP/1.1" 200 None 2025-09-26 09:28:54,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:54,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:54,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe3d HTTP/1.1" 200 None 2025-09-26 09:28:54,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-26 09:28:54,845 - lava_callback - DEBUG - Processing node 68d65c8d2f83206171a8fe3d: baseline-arm-pengutronix 2025-09-26 09:28:54,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:54,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d65c7b2f83206171a8fddd HTTP/1.1" 200 None 2025-09-26 09:28:54,971 - lava_callback - INFO - Completed processing callback for node 68d65c7b2f83206171a8fddd 2025-09-26 09:28:55,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:28:55,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:28:55,188 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d65c8d2f83206171a8fe3d/log.txt.gz 2025-09-26 09:28:55,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:28:55,311 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:28:55,312 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d65c8d2f83206171a8fe3d/lava_callback.json.gz 2025-09-26 09:28:55,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:55,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe3d HTTP/1.1" 200 None 2025-09-26 09:28:55,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:55,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-26 09:28:55,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:55,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d65c8d2f83206171a8fe3d HTTP/1.1" 200 None 2025-09-26 09:28:55,398 - lava_callback - INFO - Completed processing callback for node 68d65c8d2f83206171a8fe3d 2025-09-26 09:28:56,063 - lava_callback - INFO - Received callback for node 68d65c8c2f83206171a8fe31 INFO: 172.20.0.1:52844 - "POST /node/68d65c8c2f83206171a8fe31 HTTP/1.0" 202 Accepted 2025-09-26 09:28:56,069 - lava_callback - INFO - Starting async job submit for node 68d65c8c2f83206171a8fe31 2025-09-26 09:28:56,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:56,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8c2f83206171a8fe31 HTTP/1.1" 200 None 2025-09-26 09:28:56,102 - lava_callback - DEBUG - Processing node 68d65c8c2f83206171a8fe31: baseline-arm-pengutronix 2025-09-26 09:28:56,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:28:56,412 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:28:56,412 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d65c8c2f83206171a8fe31/log.txt.gz 2025-09-26 09:28:56,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:52852 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:28:56,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:28:56,537 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d65c8c2f83206171a8fe31/lava_callback.json.gz 2025-09-26 09:28:56,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:56,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8c2f83206171a8fe31 HTTP/1.1" 200 None 2025-09-26 09:28:56,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:56,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-26 09:28:56,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:56,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d65c8c2f83206171a8fe31 HTTP/1.1" 200 None 2025-09-26 09:28:56,617 - lava_callback - INFO - Completed processing callback for node 68d65c8c2f83206171a8fe31 INFO: 172.20.0.1:52854 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:28:57,573 - lava_callback - INFO - Received callback for node 68d65c8d2f83206171a8fe3a INFO: 172.20.0.1:52864 - "POST /node/68d65c8d2f83206171a8fe3a HTTP/1.0" 202 Accepted 2025-09-26 09:28:57,582 - lava_callback - INFO - Starting async job submit for node 68d65c8d2f83206171a8fe3a 2025-09-26 09:28:57,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:28:57,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe3a HTTP/1.1" 200 None 2025-09-26 09:28:57,613 - lava_callback - DEBUG - Processing node 68d65c8d2f83206171a8fe3a: baseline-arm-pengutronix 2025-09-26 09:28:57,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:28:59,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:28:59,522 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d65c8d2f83206171a8fe3a/log.txt.gz 2025-09-26 09:28:59,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:29:01,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:29:01,898 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d65c8d2f83206171a8fe3a/lava_callback.json.gz 2025-09-26 09:29:01,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:01,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe3a HTTP/1.1" 200 None 2025-09-26 09:29:01,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:01,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-26 09:29:01,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:01,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d65c8d2f83206171a8fe3a HTTP/1.1" 200 None 2025-09-26 09:29:01,996 - lava_callback - INFO - Completed processing callback for node 68d65c8d2f83206171a8fe3a 2025-09-26 09:29:03,287 - lava_callback - INFO - Received callback for node 68d6594e5d85f2a87334b22d INFO: 172.20.0.1:43858 - "POST /node/68d6594e5d85f2a87334b22d HTTP/1.0" 202 Accepted 2025-09-26 09:29:03,297 - lava_callback - INFO - Starting async job submit for node 68d6594e5d85f2a87334b22d 2025-09-26 09:29:03,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:03,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6594e5d85f2a87334b22d HTTP/1.1" 200 None 2025-09-26 09:29:03,377 - lava_callback - DEBUG - Processing node 68d6594e5d85f2a87334b22d: baseline-arm64 2025-09-26 09:29:04,496 - lava_callback - ERROR - Error processing callback for node 68d6594e5d85f2a87334b22d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 09:29:05,346 - lava_callback - INFO - Received callback for node 68d659495d85f2a87334b212 INFO: 172.20.0.1:43864 - "POST /node/68d659495d85f2a87334b212 HTTP/1.0" 202 Accepted 2025-09-26 09:29:05,357 - lava_callback - INFO - Starting async job submit for node 68d659495d85f2a87334b212 2025-09-26 09:29:05,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:05,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d659495d85f2a87334b212 HTTP/1.1" 200 None 2025-09-26 09:29:05,421 - lava_callback - DEBUG - Processing node 68d659495d85f2a87334b212: baseline-arm64 2025-09-26 09:29:06,401 - lava_callback - ERROR - Error processing callback for node 68d659495d85f2a87334b212: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:43870 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:29:11,869 - lava_callback - INFO - Received callback for node 68d3b9d05180aefab120b4ce INFO: 172.20.0.1:39196 - "POST /node/68d3b9d05180aefab120b4ce HTTP/1.0" 202 Accepted 2025-09-26 09:29:11,875 - lava_callback - INFO - Starting async job submit for node 68d3b9d05180aefab120b4ce 2025-09-26 09:29:11,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:11,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3b9d05180aefab120b4ce HTTP/1.1" 200 None 2025-09-26 09:29:11,890 - lava_callback - DEBUG - Processing node 68d3b9d05180aefab120b4ce: baseline-arm 2025-09-26 09:29:11,890 - lava_callback - ERROR - Error processing callback for node 68d3b9d05180aefab120b4ce: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:39202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39228 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:29:22,535 - lava_callback - INFO - Received callback for node 68d65c832f83206171a8fe05 INFO: 172.20.0.1:59268 - "POST /node/68d65c832f83206171a8fe05 HTTP/1.0" 202 Accepted 2025-09-26 09:29:22,541 - lava_callback - INFO - Starting async job submit for node 68d65c832f83206171a8fe05 2025-09-26 09:29:22,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:22,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c832f83206171a8fe05 HTTP/1.1" 200 None 2025-09-26 09:29:22,581 - lava_callback - DEBUG - Processing node 68d65c832f83206171a8fe05: baseline-arm-clabbe 2025-09-26 09:29:22,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:29:23,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:29:23,493 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d65c832f83206171a8fe05/log.txt.gz 2025-09-26 09:29:23,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:29:25,836 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:29:25,836 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d65c832f83206171a8fe05/lava_callback.json.gz 2025-09-26 09:29:25,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:25,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c832f83206171a8fe05 HTTP/1.1" 200 None 2025-09-26 09:29:25,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:25,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-26 09:29:25,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:25,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d65c832f83206171a8fe05 HTTP/1.1" 200 None 2025-09-26 09:29:25,958 - lava_callback - INFO - Completed processing callback for node 68d65c832f83206171a8fe05 INFO: 172.20.0.1:59284 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:29:33,699 - lava_callback - INFO - Received callback for node 68d65c722f83206171a8fdb9 INFO: 172.20.0.1:48128 - "POST /node/68d65c722f83206171a8fdb9 HTTP/1.0" 202 Accepted 2025-09-26 09:29:33,705 - lava_callback - INFO - Starting async job submit for node 68d65c722f83206171a8fdb9 2025-09-26 09:29:33,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:33,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c722f83206171a8fdb9 HTTP/1.1" 200 None 2025-09-26 09:29:33,738 - lava_callback - DEBUG - Processing node 68d65c722f83206171a8fdb9: baseline-arm-baylibre 2025-09-26 09:29:33,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:29:35,168 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:29:35,169 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d65c722f83206171a8fdb9/log.txt.gz 2025-09-26 09:29:35,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:29:35,735 - lava_callback - INFO - Received callback for node 68d65c762f83206171a8fdcb INFO: 172.20.0.1:48136 - "POST /node/68d65c762f83206171a8fdcb HTTP/1.0" 202 Accepted 2025-09-26 09:29:35,742 - lava_callback - INFO - Starting async job submit for node 68d65c762f83206171a8fdcb 2025-09-26 09:29:35,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:35,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c762f83206171a8fdcb HTTP/1.1" 200 None 2025-09-26 09:29:35,806 - lava_callback - DEBUG - Processing node 68d65c762f83206171a8fdcb: baseline-arm-baylibre 2025-09-26 09:29:36,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:48138 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:29:37,504 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:29:37,505 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d65c762f83206171a8fdcb/log.txt.gz 2025-09-26 09:29:37,509 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:29:37,510 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d65c722f83206171a8fdb9/lava_callback.json.gz 2025-09-26 09:29:37,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:37,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:29:37,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c722f83206171a8fdb9 HTTP/1.1" 200 None 2025-09-26 09:29:37,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:37,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-26 09:29:37,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:37,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d65c722f83206171a8fdb9 HTTP/1.1" 200 None 2025-09-26 09:29:37,610 - lava_callback - INFO - Completed processing callback for node 68d65c722f83206171a8fdb9 2025-09-26 09:29:39,613 - lava_callback - INFO - Received callback for node 68d65c882f83206171a8fe25 INFO: 172.20.0.1:49848 - "POST /node/68d65c882f83206171a8fe25 HTTP/1.0" 202 Accepted 2025-09-26 09:29:39,622 - lava_callback - INFO - Starting async job submit for node 68d65c882f83206171a8fe25 2025-09-26 09:29:39,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:39,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c882f83206171a8fe25 HTTP/1.1" 200 None 2025-09-26 09:29:39,658 - lava_callback - DEBUG - Processing node 68d65c882f83206171a8fe25: baseline-arm-kontron 2025-09-26 09:29:39,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:29:39,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:29:39,971 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d65c762f83206171a8fdcb/lava_callback.json.gz 2025-09-26 09:29:40,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:40,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c762f83206171a8fdcb HTTP/1.1" 200 None 2025-09-26 09:29:40,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:40,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-26 09:29:40,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:40,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d65c762f83206171a8fdcb HTTP/1.1" 200 None 2025-09-26 09:29:40,125 - lava_callback - INFO - Completed processing callback for node 68d65c762f83206171a8fdcb 2025-09-26 09:29:40,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:29:40,209 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-68d65c882f83206171a8fe25/log.txt.gz 2025-09-26 09:29:40,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:29:40,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:29:40,414 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-68d65c882f83206171a8fe25/lava_callback.json.gz 2025-09-26 09:29:40,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:40,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c882f83206171a8fe25 HTTP/1.1" 200 None 2025-09-26 09:29:40,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:40,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-26 09:29:40,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:40,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d65c882f83206171a8fe25 HTTP/1.1" 200 None 2025-09-26 09:29:40,530 - lava_callback - INFO - Completed processing callback for node 68d65c882f83206171a8fe25 2025-09-26 09:29:40,855 - lava_callback - INFO - Received callback for node 68d65c8b2f83206171a8fe2e INFO: 172.20.0.1:49850 - "POST /node/68d65c8b2f83206171a8fe2e HTTP/1.0" 202 Accepted 2025-09-26 09:29:40,865 - lava_callback - INFO - Starting async job submit for node 68d65c8b2f83206171a8fe2e 2025-09-26 09:29:40,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:40,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8b2f83206171a8fe2e HTTP/1.1" 200 None 2025-09-26 09:29:40,925 - lava_callback - DEBUG - Processing node 68d65c8b2f83206171a8fe2e: baseline-arm-kontron 2025-09-26 09:29:41,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:29:41,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:29:41,538 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-68d65c8b2f83206171a8fe2e/log.txt.gz 2025-09-26 09:29:41,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:29:41,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:29:41,707 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-68d65c8b2f83206171a8fe2e/lava_callback.json.gz 2025-09-26 09:29:41,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:41,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8b2f83206171a8fe2e HTTP/1.1" 200 None 2025-09-26 09:29:41,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:41,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-26 09:29:41,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:41,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d65c8b2f83206171a8fe2e HTTP/1.1" 200 None 2025-09-26 09:29:41,874 - lava_callback - INFO - Completed processing callback for node 68d65c8b2f83206171a8fe2e INFO: 172.20.0.1:49866 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:29:51,625 - lava_callback - INFO - Received callback for node 68d3b9eb5180aefab120b4e3 INFO: 172.20.0.1:40430 - "POST /node/68d3b9eb5180aefab120b4e3 HTTP/1.0" 202 Accepted 2025-09-26 09:29:51,631 - lava_callback - INFO - Starting async job submit for node 68d3b9eb5180aefab120b4e3 2025-09-26 09:29:51,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:51,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3b9eb5180aefab120b4e3 HTTP/1.1" 200 None 2025-09-26 09:29:51,645 - lava_callback - DEBUG - Processing node 68d3b9eb5180aefab120b4e3: baseline-arm 2025-09-26 09:29:51,645 - lava_callback - ERROR - Error processing callback for node 68d3b9eb5180aefab120b4e3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:29:52,335 - lava_callback - INFO - Received callback for node 68d3b9fc5180aefab120b527 INFO: 172.20.0.1:40434 - "POST /node/68d3b9fc5180aefab120b527 HTTP/1.0" 202 Accepted 2025-09-26 09:29:52,341 - lava_callback - INFO - Starting async job submit for node 68d3b9fc5180aefab120b527 2025-09-26 09:29:52,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:52,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3b9fc5180aefab120b527 HTTP/1.1" 200 None 2025-09-26 09:29:52,355 - lava_callback - DEBUG - Processing node 68d3b9fc5180aefab120b527: baseline-arm 2025-09-26 09:29:52,355 - lava_callback - ERROR - Error processing callback for node 68d3b9fc5180aefab120b527: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:29:53,031 - lava_callback - INFO - Received callback for node 68d3ba025180aefab120b52a INFO: 172.20.0.1:40436 - "POST /node/68d3ba025180aefab120b52a HTTP/1.0" 202 Accepted 2025-09-26 09:29:53,037 - lava_callback - INFO - Starting async job submit for node 68d3ba025180aefab120b52a 2025-09-26 09:29:53,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:53,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ba025180aefab120b52a HTTP/1.1" 200 None 2025-09-26 09:29:53,052 - lava_callback - DEBUG - Processing node 68d3ba025180aefab120b52a: baseline-arm 2025-09-26 09:29:53,052 - lava_callback - ERROR - Error processing callback for node 68d3ba025180aefab120b52a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:29:55,945 - lava_callback - INFO - Received callback for node 68d408d0cd36afa834e16cf4 INFO: 172.20.0.1:40446 - "POST /node/68d408d0cd36afa834e16cf4 HTTP/1.0" 202 Accepted 2025-09-26 09:29:55,951 - lava_callback - INFO - Starting async job submit for node 68d408d0cd36afa834e16cf4 2025-09-26 09:29:55,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:55,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408d0cd36afa834e16cf4 HTTP/1.1" 200 None 2025-09-26 09:29:55,985 - lava_callback - DEBUG - Processing node 68d408d0cd36afa834e16cf4: baseline-arm 2025-09-26 09:29:56,267 - lava_callback - ERROR - Error processing callback for node 68d408d0cd36afa834e16cf4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:40448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40460 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:29:58,698 - lava_callback - INFO - Received callback for node 68d65c742f83206171a8fdbc INFO: 172.20.0.1:40468 - "POST /node/68d65c742f83206171a8fdbc HTTP/1.0" 202 Accepted 2025-09-26 09:29:58,704 - lava_callback - INFO - Starting async job submit for node 68d65c742f83206171a8fdbc 2025-09-26 09:29:58,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:29:58,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c742f83206171a8fdbc HTTP/1.1" 200 None 2025-09-26 09:29:58,740 - lava_callback - DEBUG - Processing node 68d65c742f83206171a8fdbc: baseline-arm-baylibre 2025-09-26 09:29:58,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:29:59,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:29:59,553 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d65c742f83206171a8fdbc/log.txt.gz 2025-09-26 09:29:59,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:30:01,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:30:01,965 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d65c742f83206171a8fdbc/lava_callback.json.gz 2025-09-26 09:30:01,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:30:02,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c742f83206171a8fdbc HTTP/1.1" 200 None 2025-09-26 09:30:02,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:30:02,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-26 09:30:02,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:30:02,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d65c742f83206171a8fdbc HTTP/1.1" 200 None 2025-09-26 09:30:02,050 - lava_callback - INFO - Completed processing callback for node 68d65c742f83206171a8fdbc INFO: 172.20.0.1:49910 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:30:12,493 - lava_callback - INFO - Received callback for node 68d3ba0a5180aefab120b530 INFO: 172.20.0.1:45996 - "POST /node/68d3ba0a5180aefab120b530 HTTP/1.0" 202 Accepted 2025-09-26 09:30:12,498 - lava_callback - INFO - Starting async job submit for node 68d3ba0a5180aefab120b530 2025-09-26 09:30:12,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:30:12,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ba0a5180aefab120b530 HTTP/1.1" 200 None 2025-09-26 09:30:12,514 - lava_callback - DEBUG - Processing node 68d3ba0a5180aefab120b530: baseline-arm 2025-09-26 09:30:12,515 - lava_callback - ERROR - Error processing callback for node 68d3ba0a5180aefab120b530: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:30:13,209 - lava_callback - INFO - Received callback for node 68d3ba0d5180aefab120b533 INFO: 172.20.0.1:46012 - "POST /node/68d3ba0d5180aefab120b533 HTTP/1.0" 202 Accepted 2025-09-26 09:30:13,214 - lava_callback - INFO - Starting async job submit for node 68d3ba0d5180aefab120b533 2025-09-26 09:30:13,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:30:13,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ba0d5180aefab120b533 HTTP/1.1" 200 None 2025-09-26 09:30:13,228 - lava_callback - DEBUG - Processing node 68d3ba0d5180aefab120b533: baseline-arm 2025-09-26 09:30:13,228 - lava_callback - ERROR - Error processing callback for node 68d3ba0d5180aefab120b533: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:30:13,916 - lava_callback - INFO - Received callback for node 68d3ba145180aefab120b539 INFO: 172.20.0.1:46028 - "POST /node/68d3ba145180aefab120b539 HTTP/1.0" 202 Accepted 2025-09-26 09:30:13,922 - lava_callback - INFO - Starting async job submit for node 68d3ba145180aefab120b539 2025-09-26 09:30:13,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:30:13,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ba145180aefab120b539 HTTP/1.1" 200 None 2025-09-26 09:30:13,936 - lava_callback - DEBUG - Processing node 68d3ba145180aefab120b539: baseline-arm 2025-09-26 09:30:13,937 - lava_callback - ERROR - Error processing callback for node 68d3ba145180aefab120b539: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:30:14,786 - lava_callback - INFO - Received callback for node 68d65c752f83206171a8fdc2 INFO: 172.20.0.1:46034 - "POST /node/68d65c752f83206171a8fdc2 HTTP/1.0" 202 Accepted 2025-09-26 09:30:14,792 - lava_callback - INFO - Starting async job submit for node 68d65c752f83206171a8fdc2 2025-09-26 09:30:14,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:30:14,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c752f83206171a8fdc2 HTTP/1.1" 200 None 2025-09-26 09:30:14,827 - lava_callback - DEBUG - Processing node 68d65c752f83206171a8fdc2: baseline-arm-baylibre 2025-09-26 09:30:15,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:46040 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 09:30:15,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:30:15,813 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d65c752f83206171a8fdc2/log.txt.gz 2025-09-26 09:30:15,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:46046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46050 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:30:18,175 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:30:18,175 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d65c752f83206171a8fdc2/lava_callback.json.gz 2025-09-26 09:30:18,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:30:18,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c752f83206171a8fdc2 HTTP/1.1" 200 None 2025-09-26 09:30:18,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:30:18,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-26 09:30:18,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:30:18,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d65c752f83206171a8fdc2 HTTP/1.1" 200 None 2025-09-26 09:30:18,283 - lava_callback - INFO - Completed processing callback for node 68d65c752f83206171a8fdc2 2025-09-26 09:30:21,186 - lava_callback - INFO - Received callback for node 68d65c912f83206171a8fe52 INFO: 172.20.0.1:34438 - "POST /node/68d65c912f83206171a8fe52 HTTP/1.0" 202 Accepted 2025-09-26 09:30:21,196 - lava_callback - INFO - Starting async job submit for node 68d65c912f83206171a8fe52 2025-09-26 09:30:21,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:30:21,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c912f83206171a8fe52 HTTP/1.1" 200 None 2025-09-26 09:30:21,268 - lava_callback - DEBUG - Processing node 68d65c912f83206171a8fe52: ltp-dio 2025-09-26 09:30:21,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:30:21,860 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:30:21,861 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-68d65c912f83206171a8fe52/log.txt.gz 2025-09-26 09:30:21,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:30:22,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:30:22,020 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-68d65c912f83206171a8fe52/lava_callback.json.gz 2025-09-26 09:30:22,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:30:22,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c912f83206171a8fe52 HTTP/1.1" 200 None 2025-09-26 09:30:22,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:30:22,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-26 09:30:22,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:30:22,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d65c912f83206171a8fe52 HTTP/1.1" 200 None 2025-09-26 09:30:22,152 - lava_callback - INFO - Completed processing callback for node 68d65c912f83206171a8fe52 INFO: 172.20.0.1:34446 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:30:29,772 - lava_callback - INFO - Received callback for node 68d65c752f83206171a8fdbf INFO: 172.20.0.1:36684 - "POST /node/68d65c752f83206171a8fdbf HTTP/1.0" 202 Accepted 2025-09-26 09:30:29,778 - lava_callback - INFO - Starting async job submit for node 68d65c752f83206171a8fdbf 2025-09-26 09:30:29,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:30:29,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c752f83206171a8fdbf HTTP/1.1" 200 None 2025-09-26 09:30:29,814 - lava_callback - DEBUG - Processing node 68d65c752f83206171a8fdbf: baseline-arm-baylibre 2025-09-26 09:30:30,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:30:30,168 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:30:30,168 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d65c752f83206171a8fdbf/log.txt.gz 2025-09-26 09:30:30,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:30:31,963 - lava_callback - INFO - Received callback for node 68d3ba195180aefab120b53c INFO: 172.20.0.1:36696 - "POST /node/68d3ba195180aefab120b53c HTTP/1.0" 202 Accepted 2025-09-26 09:30:31,968 - lava_callback - INFO - Starting async job submit for node 68d3ba195180aefab120b53c 2025-09-26 09:30:31,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:30:32,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ba195180aefab120b53c HTTP/1.1" 200 None 2025-09-26 09:30:32,003 - lava_callback - DEBUG - Processing node 68d3ba195180aefab120b53c: baseline-arm 2025-09-26 09:30:32,004 - lava_callback - ERROR - Error processing callback for node 68d3ba195180aefab120b53c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:30:32,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:30:32,449 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d65c752f83206171a8fdbf/lava_callback.json.gz 2025-09-26 09:30:32,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:30:32,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c752f83206171a8fdbf HTTP/1.1" 200 None 2025-09-26 09:30:32,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:30:32,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-26 09:30:32,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:30:32,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d65c752f83206171a8fdbf HTTP/1.1" 200 None 2025-09-26 09:30:32,559 - lava_callback - INFO - Completed processing callback for node 68d65c752f83206171a8fdbf 2025-09-26 09:30:32,645 - lava_callback - INFO - Received callback for node 68d3ba255180aefab120b545 INFO: 172.20.0.1:36698 - "POST /node/68d3ba255180aefab120b545 HTTP/1.0" 202 Accepted 2025-09-26 09:30:32,654 - lava_callback - INFO - Starting async job submit for node 68d3ba255180aefab120b545 2025-09-26 09:30:32,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:30:32,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ba255180aefab120b545 HTTP/1.1" 200 None 2025-09-26 09:30:32,670 - lava_callback - DEBUG - Processing node 68d3ba255180aefab120b545: baseline-arm 2025-09-26 09:30:32,671 - lava_callback - ERROR - Error processing callback for node 68d3ba255180aefab120b545: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:36704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48524 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:31:01,626 - lava_callback - INFO - Received callback for node 68d65c862f83206171a8fe19 INFO: 172.20.0.1:58622 - "POST /node/68d65c862f83206171a8fe19 HTTP/1.0" 202 Accepted 2025-09-26 09:31:01,632 - lava_callback - INFO - Starting async job submit for node 68d65c862f83206171a8fe19 2025-09-26 09:31:01,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:31:01,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c862f83206171a8fe19 HTTP/1.1" 200 None 2025-09-26 09:31:01,682 - lava_callback - DEBUG - Processing node 68d65c862f83206171a8fe19: baseline-arm-clabbe 2025-09-26 09:31:01,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:31:03,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:31:03,095 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d65c862f83206171a8fe19/log.txt.gz 2025-09-26 09:31:03,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:31:05,741 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:31:05,742 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d65c862f83206171a8fe19/lava_callback.json.gz 2025-09-26 09:31:05,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:31:05,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c862f83206171a8fe19 HTTP/1.1" 200 None 2025-09-26 09:31:05,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:31:05,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-26 09:31:05,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:31:05,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d65c862f83206171a8fe19 HTTP/1.1" 200 None 2025-09-26 09:31:05,878 - lava_callback - INFO - Completed processing callback for node 68d65c862f83206171a8fe19 INFO: 172.20.0.1:58632 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:31:12,176 - lava_callback - INFO - Received callback for node 68d659725d85f2a87334b2c4 INFO: 172.20.0.1:32876 - "POST /node/68d659725d85f2a87334b2c4 HTTP/1.0" 202 Accepted 2025-09-26 09:31:12,181 - lava_callback - INFO - Starting async job submit for node 68d659725d85f2a87334b2c4 2025-09-26 09:31:12,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:31:12,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d659725d85f2a87334b2c4 HTTP/1.1" 200 None 2025-09-26 09:31:12,216 - lava_callback - DEBUG - Processing node 68d659725d85f2a87334b2c4: baseline-arm64-pengutronix 2025-09-26 09:31:12,408 - lava_callback - ERROR - Error processing callback for node 68d659725d85f2a87334b2c4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:32884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53688 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:32:12,855 - lava_callback - INFO - Received callback for node 68d408d1cd36afa834e16cf7 INFO: 172.20.0.1:41594 - "POST /node/68d408d1cd36afa834e16cf7 HTTP/1.0" 202 Accepted 2025-09-26 09:32:12,864 - lava_callback - INFO - Starting async job submit for node 68d408d1cd36afa834e16cf7 2025-09-26 09:32:12,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:32:12,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408d1cd36afa834e16cf7 HTTP/1.1" 200 None 2025-09-26 09:32:12,906 - lava_callback - DEBUG - Processing node 68d408d1cd36afa834e16cf7: baseline-arm 2025-09-26 09:32:13,136 - lava_callback - ERROR - Error processing callback for node 68d408d1cd36afa834e16cf7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:41604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54792 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:32:32,308 - lava_callback - INFO - Received callback for node 68d3ba9f5180aefab120b609 INFO: 172.20.0.1:36602 - "POST /node/68d3ba9f5180aefab120b609 HTTP/1.0" 202 Accepted 2025-09-26 09:32:32,314 - lava_callback - INFO - Starting async job submit for node 68d3ba9f5180aefab120b609 2025-09-26 09:32:32,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:32:32,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ba9f5180aefab120b609 HTTP/1.1" 200 None 2025-09-26 09:32:32,330 - lava_callback - DEBUG - Processing node 68d3ba9f5180aefab120b609: baseline-arm 2025-09-26 09:32:32,330 - lava_callback - ERROR - Error processing callback for node 68d3ba9f5180aefab120b609: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:32:32,707 - lava_callback - INFO - Received callback for node 68d65c872f83206171a8fe1c INFO: 172.20.0.1:36618 - "POST /node/68d65c872f83206171a8fe1c HTTP/1.0" 202 Accepted 2025-09-26 09:32:32,714 - lava_callback - INFO - Starting async job submit for node 68d65c872f83206171a8fe1c 2025-09-26 09:32:32,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:32:32,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c872f83206171a8fe1c HTTP/1.1" 200 None 2025-09-26 09:32:32,777 - lava_callback - DEBUG - Processing node 68d65c872f83206171a8fe1c: baseline-arm-clabbe 2025-09-26 09:32:33,004 - lava_callback - INFO - Received callback for node 68d3ba9c5180aefab120b606 INFO: 172.20.0.1:36622 - "POST /node/68d3ba9c5180aefab120b606 HTTP/1.0" 202 Accepted 2025-09-26 09:32:33,010 - lava_callback - INFO - Starting async job submit for node 68d3ba9c5180aefab120b606 2025-09-26 09:32:33,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:32:33,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:32:33,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ba9c5180aefab120b606 HTTP/1.1" 200 None 2025-09-26 09:32:33,025 - lava_callback - DEBUG - Processing node 68d3ba9c5180aefab120b606: baseline-arm 2025-09-26 09:32:33,025 - lava_callback - ERROR - Error processing callback for node 68d3ba9c5180aefab120b606: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:32:34,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:32:34,405 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d65c872f83206171a8fe1c/log.txt.gz 2025-09-26 09:32:34,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:36638 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:32:36,973 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:32:36,974 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d65c872f83206171a8fe1c/lava_callback.json.gz 2025-09-26 09:32:37,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:32:37,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c872f83206171a8fe1c HTTP/1.1" 200 None 2025-09-26 09:32:37,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:32:37,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-26 09:32:37,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:32:37,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d65c872f83206171a8fe1c HTTP/1.1" 200 None 2025-09-26 09:32:37,069 - lava_callback - INFO - Completed processing callback for node 68d65c872f83206171a8fe1c INFO: 172.20.0.1:53508 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:32:52,283 - lava_callback - INFO - Received callback for node 68d3baa25180aefab120b610 INFO: 172.20.0.1:47128 - "POST /node/68d3baa25180aefab120b610 HTTP/1.0" 202 Accepted 2025-09-26 09:32:52,289 - lava_callback - INFO - Starting async job submit for node 68d3baa25180aefab120b610 2025-09-26 09:32:52,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:32:52,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3baa25180aefab120b610 HTTP/1.1" 200 None 2025-09-26 09:32:52,302 - lava_callback - DEBUG - Processing node 68d3baa25180aefab120b610: baseline-arm 2025-09-26 09:32:52,302 - lava_callback - ERROR - Error processing callback for node 68d3baa25180aefab120b610: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:32:53,009 - lava_callback - INFO - Received callback for node 68d3baa85180aefab120b618 INFO: 172.20.0.1:47136 - "POST /node/68d3baa85180aefab120b618 HTTP/1.0" 202 Accepted 2025-09-26 09:32:53,017 - lava_callback - INFO - Starting async job submit for node 68d3baa85180aefab120b618 2025-09-26 09:32:53,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:32:53,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3baa85180aefab120b618 HTTP/1.1" 200 None 2025-09-26 09:32:53,034 - lava_callback - DEBUG - Processing node 68d3baa85180aefab120b618: baseline-arm 2025-09-26 09:32:53,034 - lava_callback - ERROR - Error processing callback for node 68d3baa85180aefab120b618: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:32:53,713 - lava_callback - INFO - Received callback for node 68d3baa85180aefab120b615 INFO: 172.20.0.1:47140 - "POST /node/68d3baa85180aefab120b615 HTTP/1.0" 202 Accepted 2025-09-26 09:32:53,719 - lava_callback - INFO - Starting async job submit for node 68d3baa85180aefab120b615 2025-09-26 09:32:53,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:32:53,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3baa85180aefab120b615 HTTP/1.1" 200 None 2025-09-26 09:32:53,736 - lava_callback - DEBUG - Processing node 68d3baa85180aefab120b615: baseline-arm 2025-09-26 09:32:53,736 - lava_callback - ERROR - Error processing callback for node 68d3baa85180aefab120b615: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:32:54,432 - lava_callback - INFO - Received callback for node 68d3babc5180aefab120b65a INFO: 172.20.0.1:47150 - "POST /node/68d3babc5180aefab120b65a HTTP/1.0" 202 Accepted 2025-09-26 09:32:54,437 - lava_callback - INFO - Starting async job submit for node 68d3babc5180aefab120b65a 2025-09-26 09:32:54,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:32:54,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3babc5180aefab120b65a HTTP/1.1" 200 None 2025-09-26 09:32:54,451 - lava_callback - DEBUG - Processing node 68d3babc5180aefab120b65a: baseline-arm 2025-09-26 09:32:54,451 - lava_callback - ERROR - Error processing callback for node 68d3babc5180aefab120b65a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:47156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58424 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:33:07,272 - lava_callback - INFO - Received callback for node 68d65c792f83206171a8fdd1 INFO: 172.20.0.1:58438 - "POST /node/68d65c792f83206171a8fdd1 HTTP/1.0" 202 Accepted 2025-09-26 09:33:07,278 - lava_callback - INFO - Starting async job submit for node 68d65c792f83206171a8fdd1 2025-09-26 09:33:07,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:33:07,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c792f83206171a8fdd1 HTTP/1.1" 200 None 2025-09-26 09:33:07,323 - lava_callback - DEBUG - Processing node 68d65c792f83206171a8fdd1: baseline-arm-baylibre 2025-09-26 09:33:07,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:33:08,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:33:08,766 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d65c792f83206171a8fdd1/log.txt.gz 2025-09-26 09:33:08,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:33:11,254 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:33:11,255 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d65c792f83206171a8fdd1/lava_callback.json.gz 2025-09-26 09:33:11,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:33:11,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c792f83206171a8fdd1 HTTP/1.1" 200 None 2025-09-26 09:33:11,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:33:11,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-26 09:33:11,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:33:11,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d65c792f83206171a8fdd1 HTTP/1.1" 200 None 2025-09-26 09:33:11,407 - lava_callback - INFO - Completed processing callback for node 68d65c792f83206171a8fdd1 2025-09-26 09:33:12,557 - lava_callback - INFO - Received callback for node 68d3bac35180aefab120b667 INFO: 172.20.0.1:58730 - "POST /node/68d3bac35180aefab120b667 HTTP/1.0" 202 Accepted 2025-09-26 09:33:12,562 - lava_callback - INFO - Starting async job submit for node 68d3bac35180aefab120b667 2025-09-26 09:33:12,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:33:12,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bac35180aefab120b667 HTTP/1.1" 200 None 2025-09-26 09:33:12,577 - lava_callback - DEBUG - Processing node 68d3bac35180aefab120b667: baseline-arm 2025-09-26 09:33:12,577 - lava_callback - ERROR - Error processing callback for node 68d3bac35180aefab120b667: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:58738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47462 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:33:32,588 - lava_callback - INFO - Received callback for node 68d3bad85180aefab120b684 INFO: 172.20.0.1:36650 - "POST /node/68d3bad85180aefab120b684 HTTP/1.0" 202 Accepted 2025-09-26 09:33:32,594 - lava_callback - INFO - Starting async job submit for node 68d3bad85180aefab120b684 2025-09-26 09:33:32,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:33:32,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bad85180aefab120b684 HTTP/1.1" 200 None 2025-09-26 09:33:32,608 - lava_callback - DEBUG - Processing node 68d3bad85180aefab120b684: baseline-arm 2025-09-26 09:33:32,608 - lava_callback - ERROR - Error processing callback for node 68d3bad85180aefab120b684: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:33:33,264 - lava_callback - INFO - Received callback for node 68d3bae25180aefab120b690 INFO: 172.20.0.1:36656 - "POST /node/68d3bae25180aefab120b690 HTTP/1.0" 202 Accepted 2025-09-26 09:33:33,270 - lava_callback - INFO - Starting async job submit for node 68d3bae25180aefab120b690 2025-09-26 09:33:33,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:33:33,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bae25180aefab120b690 HTTP/1.1" 200 None 2025-09-26 09:33:33,287 - lava_callback - DEBUG - Processing node 68d3bae25180aefab120b690: baseline-arm 2025-09-26 09:33:33,287 - lava_callback - ERROR - Error processing callback for node 68d3bae25180aefab120b690: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:36660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48170 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:33:52,204 - lava_callback - INFO - Received callback for node 68d3badd5180aefab120b68d INFO: 172.20.0.1:49558 - "POST /node/68d3badd5180aefab120b68d HTTP/1.0" 202 Accepted 2025-09-26 09:33:52,213 - lava_callback - INFO - Starting async job submit for node 68d3badd5180aefab120b68d 2025-09-26 09:33:52,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:33:52,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3badd5180aefab120b68d HTTP/1.1" 200 None 2025-09-26 09:33:52,231 - lava_callback - DEBUG - Processing node 68d3badd5180aefab120b68d: baseline-arm 2025-09-26 09:33:52,231 - lava_callback - ERROR - Error processing callback for node 68d3badd5180aefab120b68d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:33:52,892 - lava_callback - INFO - Received callback for node 68d3bae25180aefab120b693 INFO: 172.20.0.1:49572 - "POST /node/68d3bae25180aefab120b693 HTTP/1.0" 202 Accepted 2025-09-26 09:33:52,898 - lava_callback - INFO - Starting async job submit for node 68d3bae25180aefab120b693 2025-09-26 09:33:52,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:33:52,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bae25180aefab120b693 HTTP/1.1" 200 None 2025-09-26 09:33:52,932 - lava_callback - DEBUG - Processing node 68d3bae25180aefab120b693: baseline-arm 2025-09-26 09:33:52,932 - lava_callback - ERROR - Error processing callback for node 68d3bae25180aefab120b693: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:33:53,604 - lava_callback - INFO - Received callback for node 68d3baeb5180aefab120b6a1 INFO: 172.20.0.1:49578 - "POST /node/68d3baeb5180aefab120b6a1 HTTP/1.0" 202 Accepted 2025-09-26 09:33:53,610 - lava_callback - INFO - Starting async job submit for node 68d3baeb5180aefab120b6a1 2025-09-26 09:33:53,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:33:53,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3baeb5180aefab120b6a1 HTTP/1.1" 200 None 2025-09-26 09:33:53,626 - lava_callback - DEBUG - Processing node 68d3baeb5180aefab120b6a1: baseline-arm 2025-09-26 09:33:53,626 - lava_callback - ERROR - Error processing callback for node 68d3baeb5180aefab120b6a1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:33:54,319 - lava_callback - INFO - Received callback for node 68d3baf25180aefab120b6aa INFO: 172.20.0.1:49584 - "POST /node/68d3baf25180aefab120b6aa HTTP/1.0" 202 Accepted 2025-09-26 09:33:54,327 - lava_callback - INFO - Starting async job submit for node 68d3baf25180aefab120b6aa 2025-09-26 09:33:54,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:33:54,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3baf25180aefab120b6aa HTTP/1.1" 200 None 2025-09-26 09:33:54,347 - lava_callback - DEBUG - Processing node 68d3baf25180aefab120b6aa: baseline-arm 2025-09-26 09:33:54,347 - lava_callback - ERROR - Error processing callback for node 68d3baf25180aefab120b6aa: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:49594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49610 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:34:05,403 - lava_callback - INFO - Received callback for node 68d3bad15180aefab120b679 INFO: 172.20.0.1:43276 - "POST /node/68d3bad15180aefab120b679 HTTP/1.0" 202 Accepted 2025-09-26 09:34:05,411 - lava_callback - INFO - Starting async job submit for node 68d3bad15180aefab120b679 2025-09-26 09:34:05,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:34:05,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bad15180aefab120b679 HTTP/1.1" 200 None 2025-09-26 09:34:05,542 - lava_callback - DEBUG - Processing node 68d3bad15180aefab120b679: ltp-containers 2025-09-26 09:34:06,369 - lava_callback - ERROR - Error processing callback for node 68d3bad15180aefab120b679: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:43282 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:34:12,383 - lava_callback - INFO - Received callback for node 68d3bafc5180aefab120b6db INFO: 172.20.0.1:40844 - "POST /node/68d3bafc5180aefab120b6db HTTP/1.0" 202 Accepted 2025-09-26 09:34:12,389 - lava_callback - INFO - Starting async job submit for node 68d3bafc5180aefab120b6db 2025-09-26 09:34:12,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:34:12,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bafc5180aefab120b6db HTTP/1.1" 200 None 2025-09-26 09:34:12,403 - lava_callback - DEBUG - Processing node 68d3bafc5180aefab120b6db: baseline-arm 2025-09-26 09:34:12,403 - lava_callback - ERROR - Error processing callback for node 68d3bafc5180aefab120b6db: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:34:13,098 - lava_callback - INFO - Received callback for node 68d3bafe5180aefab120b6de INFO: 172.20.0.1:40854 - "POST /node/68d3bafe5180aefab120b6de HTTP/1.0" 202 Accepted 2025-09-26 09:34:13,104 - lava_callback - INFO - Starting async job submit for node 68d3bafe5180aefab120b6de 2025-09-26 09:34:13,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:34:13,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bafe5180aefab120b6de HTTP/1.1" 200 None 2025-09-26 09:34:13,118 - lava_callback - DEBUG - Processing node 68d3bafe5180aefab120b6de: baseline-arm 2025-09-26 09:34:13,118 - lava_callback - ERROR - Error processing callback for node 68d3bafe5180aefab120b6de: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:34:13,818 - lava_callback - INFO - Received callback for node 68d3bb055180aefab120b6ec INFO: 172.20.0.1:40870 - "POST /node/68d3bb055180aefab120b6ec HTTP/1.0" 202 Accepted 2025-09-26 09:34:13,823 - lava_callback - INFO - Starting async job submit for node 68d3bb055180aefab120b6ec 2025-09-26 09:34:13,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:34:13,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bb055180aefab120b6ec HTTP/1.1" 200 None 2025-09-26 09:34:13,844 - lava_callback - DEBUG - Processing node 68d3bb055180aefab120b6ec: baseline-arm 2025-09-26 09:34:13,844 - lava_callback - ERROR - Error processing callback for node 68d3bb055180aefab120b6ec: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:40882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37492 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:34:32,470 - lava_callback - INFO - Received callback for node 68d3bb0c5180aefab120b6f2 INFO: 172.20.0.1:46056 - "POST /node/68d3bb0c5180aefab120b6f2 HTTP/1.0" 202 Accepted 2025-09-26 09:34:32,475 - lava_callback - INFO - Starting async job submit for node 68d3bb0c5180aefab120b6f2 2025-09-26 09:34:32,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:34:32,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bb0c5180aefab120b6f2 HTTP/1.1" 200 None 2025-09-26 09:34:32,490 - lava_callback - DEBUG - Processing node 68d3bb0c5180aefab120b6f2: baseline-arm 2025-09-26 09:34:32,490 - lava_callback - ERROR - Error processing callback for node 68d3bb0c5180aefab120b6f2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:34:32,995 - lava_callback - INFO - Received callback for node 68d408d9cd36afa834e16d0f INFO: 172.20.0.1:46058 - "POST /node/68d408d9cd36afa834e16d0f HTTP/1.0" 202 Accepted 2025-09-26 09:34:33,001 - lava_callback - INFO - Starting async job submit for node 68d408d9cd36afa834e16d0f 2025-09-26 09:34:33,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:34:33,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408d9cd36afa834e16d0f HTTP/1.1" 200 None 2025-09-26 09:34:33,037 - lava_callback - DEBUG - Processing node 68d408d9cd36afa834e16d0f: baseline-arm 2025-09-26 09:34:33,167 - lava_callback - INFO - Received callback for node 68d3bb185180aefab120b706 INFO: 172.20.0.1:46068 - "POST /node/68d3bb185180aefab120b706 HTTP/1.0" 202 Accepted 2025-09-26 09:34:33,186 - lava_callback - INFO - Starting async job submit for node 68d3bb185180aefab120b706 2025-09-26 09:34:33,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:34:33,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bb185180aefab120b706 HTTP/1.1" 200 None 2025-09-26 09:34:33,280 - lava_callback - DEBUG - Processing node 68d3bb185180aefab120b706: baseline-arm 2025-09-26 09:34:33,280 - lava_callback - ERROR - Error processing callback for node 68d3bb185180aefab120b706: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:34:33,310 - lava_callback - ERROR - Error processing callback for node 68d408d9cd36afa834e16d0f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:46074 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:34:45,651 - lava_callback - INFO - Received callback for node 68d3bb295180aefab120b718 INFO: 172.20.0.1:45488 - "POST /node/68d3bb295180aefab120b718 HTTP/1.0" 202 Accepted 2025-09-26 09:34:45,660 - lava_callback - INFO - Starting async job submit for node 68d3bb295180aefab120b718 2025-09-26 09:34:45,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:34:45,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bb295180aefab120b718 HTTP/1.1" 200 None 2025-09-26 09:34:45,702 - lava_callback - DEBUG - Processing node 68d3bb295180aefab120b718: ltp-containers 2025-09-26 09:34:45,702 - lava_callback - ERROR - Error processing callback for node 68d3bb295180aefab120b718: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:45498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38324 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:35:05,631 - lava_callback - INFO - Received callback for node 68d3bb2d5180aefab120b71e INFO: 172.20.0.1:58982 - "POST /node/68d3bb2d5180aefab120b71e HTTP/1.0" 202 Accepted 2025-09-26 09:35:05,637 - lava_callback - INFO - Starting async job submit for node 68d3bb2d5180aefab120b71e 2025-09-26 09:35:05,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:35:05,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bb2d5180aefab120b71e HTTP/1.1" 200 None 2025-09-26 09:35:05,652 - lava_callback - DEBUG - Processing node 68d3bb2d5180aefab120b71e: ltp-cve 2025-09-26 09:35:05,652 - lava_callback - ERROR - Error processing callback for node 68d3bb2d5180aefab120b71e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:58990 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:35:07,014 - lava_callback - INFO - Received callback for node 68d6594b5d85f2a87334b218 INFO: 172.20.0.1:58998 - "POST /node/68d6594b5d85f2a87334b218 HTTP/1.0" 202 Accepted 2025-09-26 09:35:07,022 - lava_callback - INFO - Starting async job submit for node 68d6594b5d85f2a87334b218 2025-09-26 09:35:07,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:35:07,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6594b5d85f2a87334b218 HTTP/1.1" 200 None 2025-09-26 09:35:07,104 - lava_callback - DEBUG - Processing node 68d6594b5d85f2a87334b218: baseline-arm64 2025-09-26 09:35:07,428 - lava_callback - INFO - Received callback for node 68d659505d85f2a87334b233 INFO: 172.20.0.1:59000 - "POST /node/68d659505d85f2a87334b233 HTTP/1.0" 202 Accepted 2025-09-26 09:35:07,457 - lava_callback - INFO - Starting async job submit for node 68d659505d85f2a87334b233 2025-09-26 09:35:07,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:35:07,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d659505d85f2a87334b233 HTTP/1.1" 200 None 2025-09-26 09:35:07,641 - lava_callback - DEBUG - Processing node 68d659505d85f2a87334b233: baseline-arm64 2025-09-26 09:35:09,056 - lava_callback - ERROR - Error processing callback for node 68d6594b5d85f2a87334b218: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 09:35:09,808 - lava_callback - ERROR - Error processing callback for node 68d659505d85f2a87334b233: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:43966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43992 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:35:25,648 - lava_callback - INFO - Received callback for node 68d3bb495180aefab120b76c INFO: 172.20.0.1:58950 - "POST /node/68d3bb495180aefab120b76c HTTP/1.0" 202 Accepted 2025-09-26 09:35:25,659 - lava_callback - INFO - Starting async job submit for node 68d3bb495180aefab120b76c 2025-09-26 09:35:25,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:35:25,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bb495180aefab120b76c HTTP/1.1" 200 None 2025-09-26 09:35:25,681 - lava_callback - DEBUG - Processing node 68d3bb495180aefab120b76c: ltp-controllers 2025-09-26 09:35:25,681 - lava_callback - ERROR - Error processing callback for node 68d3bb495180aefab120b76c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:58966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55418 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:35:45,629 - lava_callback - INFO - Received callback for node 68d3bb5a5180aefab120b784 INFO: 172.20.0.1:57326 - "POST /node/68d3bb5a5180aefab120b784 HTTP/1.0" 202 Accepted 2025-09-26 09:35:45,635 - lava_callback - INFO - Starting async job submit for node 68d3bb5a5180aefab120b784 2025-09-26 09:35:45,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:35:45,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bb5a5180aefab120b784 HTTP/1.1" 200 None 2025-09-26 09:35:45,683 - lava_callback - DEBUG - Processing node 68d3bb5a5180aefab120b784: ltp-controllers 2025-09-26 09:35:45,683 - lava_callback - ERROR - Error processing callback for node 68d3bb5a5180aefab120b784: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:57334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43306 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:36:05,731 - lava_callback - INFO - Received callback for node 68d3bb685180aefab120b796 INFO: 172.20.0.1:52312 - "POST /node/68d3bb685180aefab120b796 HTTP/1.0" 202 Accepted 2025-09-26 09:36:05,739 - lava_callback - INFO - Starting async job submit for node 68d3bb685180aefab120b796 2025-09-26 09:36:05,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:36:05,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bb685180aefab120b796 HTTP/1.1" 200 None 2025-09-26 09:36:05,760 - lava_callback - DEBUG - Processing node 68d3bb685180aefab120b796: baseline-arm-broonie 2025-09-26 09:36:05,760 - lava_callback - ERROR - Error processing callback for node 68d3bb685180aefab120b796: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:52326 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:36:06,546 - lava_callback - INFO - Received callback for node 68d3bb6d5180aefab120b79a INFO: 172.20.0.1:52332 - "POST /node/68d3bb6d5180aefab120b79a HTTP/1.0" 202 Accepted 2025-09-26 09:36:06,555 - lava_callback - INFO - Starting async job submit for node 68d3bb6d5180aefab120b79a 2025-09-26 09:36:06,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:36:06,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bb6d5180aefab120b79a HTTP/1.1" 200 None 2025-09-26 09:36:06,573 - lava_callback - DEBUG - Processing node 68d3bb6d5180aefab120b79a: baseline-arm-broonie 2025-09-26 09:36:06,573 - lava_callback - ERROR - Error processing callback for node 68d3bb6d5180aefab120b79a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:36:07,341 - lava_callback - INFO - Received callback for node 68d3bb725180aefab120b7b5 INFO: 172.20.0.1:52348 - "POST /node/68d3bb725180aefab120b7b5 HTTP/1.0" 202 Accepted 2025-09-26 09:36:07,351 - lava_callback - INFO - Starting async job submit for node 68d3bb725180aefab120b7b5 2025-09-26 09:36:07,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:36:07,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bb725180aefab120b7b5 HTTP/1.1" 200 None 2025-09-26 09:36:07,398 - lava_callback - DEBUG - Processing node 68d3bb725180aefab120b7b5: baseline-arm-broonie 2025-09-26 09:36:07,398 - lava_callback - ERROR - Error processing callback for node 68d3bb725180aefab120b7b5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:36:08,239 - lava_callback - INFO - Received callback for node 68d3bb765180aefab120b7ca INFO: 172.20.0.1:52358 - "POST /node/68d3bb765180aefab120b7ca HTTP/1.0" 202 Accepted 2025-09-26 09:36:08,248 - lava_callback - INFO - Starting async job submit for node 68d3bb765180aefab120b7ca 2025-09-26 09:36:08,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:36:08,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bb765180aefab120b7ca HTTP/1.1" 200 None 2025-09-26 09:36:08,271 - lava_callback - DEBUG - Processing node 68d3bb765180aefab120b7ca: ltp-cve 2025-09-26 09:36:08,271 - lava_callback - ERROR - Error processing callback for node 68d3bb765180aefab120b7ca: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:54486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54498 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:36:25,798 - lava_callback - INFO - Received callback for node 68d3bb7d5180aefab120b7d3 INFO: 172.20.0.1:60102 - "POST /node/68d3bb7d5180aefab120b7d3 HTTP/1.0" 202 Accepted 2025-09-26 09:36:25,807 - lava_callback - INFO - Starting async job submit for node 68d3bb7d5180aefab120b7d3 2025-09-26 09:36:25,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:36:25,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bb7d5180aefab120b7d3 HTTP/1.1" 200 None 2025-09-26 09:36:25,828 - lava_callback - DEBUG - Processing node 68d3bb7d5180aefab120b7d3: ltp-fs-bind 2025-09-26 09:36:25,828 - lava_callback - ERROR - Error processing callback for node 68d3bb7d5180aefab120b7d3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60116 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:36:26,579 - lava_callback - INFO - Received callback for node 68d3bb895180aefab120b7e7 INFO: 172.20.0.1:60122 - "POST /node/68d3bb895180aefab120b7e7 HTTP/1.0" 202 Accepted 2025-09-26 09:36:26,588 - lava_callback - INFO - Starting async job submit for node 68d3bb895180aefab120b7e7 2025-09-26 09:36:26,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:36:26,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bb895180aefab120b7e7 HTTP/1.1" 200 None 2025-09-26 09:36:26,605 - lava_callback - DEBUG - Processing node 68d3bb895180aefab120b7e7: ltp-cve 2025-09-26 09:36:26,605 - lava_callback - ERROR - Error processing callback for node 68d3bb895180aefab120b7e7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:36:27,341 - lava_callback - INFO - Received callback for node 68d3bb8c5180aefab120b7eb INFO: 172.20.0.1:60128 - "POST /node/68d3bb8c5180aefab120b7eb HTTP/1.0" 202 Accepted 2025-09-26 09:36:27,347 - lava_callback - INFO - Starting async job submit for node 68d3bb8c5180aefab120b7eb 2025-09-26 09:36:27,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:36:27,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bb8c5180aefab120b7eb HTTP/1.1" 200 None 2025-09-26 09:36:27,365 - lava_callback - DEBUG - Processing node 68d3bb8c5180aefab120b7eb: ltp-fsx 2025-09-26 09:36:27,365 - lava_callback - ERROR - Error processing callback for node 68d3bb8c5180aefab120b7eb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:46512 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:36:45,693 - lava_callback - INFO - Received callback for node 68d3bb8f5180aefab120b7f4 INFO: 172.20.0.1:53200 - "POST /node/68d3bb8f5180aefab120b7f4 HTTP/1.0" 202 Accepted 2025-09-26 09:36:45,702 - lava_callback - INFO - Starting async job submit for node 68d3bb8f5180aefab120b7f4 2025-09-26 09:36:45,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:36:45,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bb8f5180aefab120b7f4 HTTP/1.1" 200 None 2025-09-26 09:36:45,730 - lava_callback - DEBUG - Processing node 68d3bb8f5180aefab120b7f4: baseline-arm-broonie 2025-09-26 09:36:45,730 - lava_callback - ERROR - Error processing callback for node 68d3bb8f5180aefab120b7f4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:36:46,461 - lava_callback - INFO - Received callback for node 68d3bb995180aefab120b800 INFO: 172.20.0.1:53212 - "POST /node/68d3bb995180aefab120b800 HTTP/1.0" 202 Accepted 2025-09-26 09:36:46,469 - lava_callback - INFO - Starting async job submit for node 68d3bb995180aefab120b800 2025-09-26 09:36:46,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:36:46,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bb995180aefab120b800 HTTP/1.1" 200 None 2025-09-26 09:36:46,485 - lava_callback - DEBUG - Processing node 68d3bb995180aefab120b800: ltp-input 2025-09-26 09:36:46,485 - lava_callback - ERROR - Error processing callback for node 68d3bb995180aefab120b800: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:53222 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:36:47,226 - lava_callback - INFO - Received callback for node 68d3bb945180aefab120b7fa INFO: 172.20.0.1:53238 - "POST /node/68d3bb945180aefab120b7fa HTTP/1.0" 202 Accepted 2025-09-26 09:36:47,232 - lava_callback - INFO - Starting async job submit for node 68d3bb945180aefab120b7fa 2025-09-26 09:36:47,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:36:47,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bb945180aefab120b7fa HTTP/1.1" 200 None 2025-09-26 09:36:47,249 - lava_callback - DEBUG - Processing node 68d3bb945180aefab120b7fa: baseline-arm-broonie 2025-09-26 09:36:47,249 - lava_callback - ERROR - Error processing callback for node 68d3bb945180aefab120b7fa: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:36:48,043 - lava_callback - INFO - Received callback for node 68d3bb995180aefab120b7fe INFO: 172.20.0.1:53254 - "POST /node/68d3bb995180aefab120b7fe HTTP/1.0" 202 Accepted 2025-09-26 09:36:48,049 - lava_callback - INFO - Starting async job submit for node 68d3bb995180aefab120b7fe 2025-09-26 09:36:48,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:36:48,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bb995180aefab120b7fe HTTP/1.1" 200 None 2025-09-26 09:36:48,063 - lava_callback - DEBUG - Processing node 68d3bb995180aefab120b7fe: baseline-arm-broonie 2025-09-26 09:36:48,063 - lava_callback - ERROR - Error processing callback for node 68d3bb995180aefab120b7fe: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:36:51,837 - lava_callback - INFO - Received callback for node 68d408d9cd36afa834e16d12 INFO: 172.20.0.1:51606 - "POST /node/68d408d9cd36afa834e16d12 HTTP/1.0" 202 Accepted 2025-09-26 09:36:51,847 - lava_callback - INFO - Starting async job submit for node 68d408d9cd36afa834e16d12 2025-09-26 09:36:51,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:36:51,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408d9cd36afa834e16d12 HTTP/1.1" 200 None 2025-09-26 09:36:51,908 - lava_callback - DEBUG - Processing node 68d408d9cd36afa834e16d12: baseline-arm 2025-09-26 09:36:52,301 - lava_callback - ERROR - Error processing callback for node 68d408d9cd36afa834e16d12: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:51616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51618 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:37:05,719 - lava_callback - INFO - Received callback for node 68d3bba55180aefab120b80f INFO: 172.20.0.1:58646 - "POST /node/68d3bba55180aefab120b80f HTTP/1.0" 202 Accepted 2025-09-26 09:37:05,725 - lava_callback - INFO - Starting async job submit for node 68d3bba55180aefab120b80f 2025-09-26 09:37:05,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:37:05,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bba55180aefab120b80f HTTP/1.1" 200 None 2025-09-26 09:37:05,739 - lava_callback - DEBUG - Processing node 68d3bba55180aefab120b80f: ltp-ipc 2025-09-26 09:37:05,739 - lava_callback - ERROR - Error processing callback for node 68d3bba55180aefab120b80f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:37:06,495 - lava_callback - INFO - Received callback for node 68d3bbb85180aefab120b848 INFO: 172.20.0.1:58662 - "POST /node/68d3bbb85180aefab120b848 HTTP/1.0" 202 Accepted 2025-09-26 09:37:06,505 - lava_callback - INFO - Starting async job submit for node 68d3bbb85180aefab120b848 2025-09-26 09:37:06,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:58676 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:37:06,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bbb85180aefab120b848 HTTP/1.1" 200 None 2025-09-26 09:37:06,520 - lava_callback - DEBUG - Processing node 68d3bbb85180aefab120b848: ltp-pty 2025-09-26 09:37:06,520 - lava_callback - ERROR - Error processing callback for node 68d3bbb85180aefab120b848: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:44080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44098 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:37:25,720 - lava_callback - INFO - Received callback for node 68d3bbc35180aefab120b85c INFO: 172.20.0.1:34580 - "POST /node/68d3bbc35180aefab120b85c HTTP/1.0" 202 Accepted 2025-09-26 09:37:25,730 - lava_callback - INFO - Starting async job submit for node 68d3bbc35180aefab120b85c 2025-09-26 09:37:25,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:37:25,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bbc35180aefab120b85c HTTP/1.1" 200 None 2025-09-26 09:37:25,750 - lava_callback - DEBUG - Processing node 68d3bbc35180aefab120b85c: ltp-sched 2025-09-26 09:37:25,750 - lava_callback - ERROR - Error processing callback for node 68d3bbc35180aefab120b85c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:37:26,509 - lava_callback - INFO - Received callback for node 68d3bbc65180aefab120b85f INFO: 172.20.0.1:34586 - "POST /node/68d3bbc65180aefab120b85f HTTP/1.0" 202 Accepted 2025-09-26 09:37:26,516 - lava_callback - INFO - Starting async job submit for node 68d3bbc65180aefab120b85f 2025-09-26 09:37:26,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:34598 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:37:26,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bbc65180aefab120b85f HTTP/1.1" 200 None 2025-09-26 09:37:26,538 - lava_callback - DEBUG - Processing node 68d3bbc65180aefab120b85f: ltp-fs-bind 2025-09-26 09:37:26,538 - lava_callback - ERROR - Error processing callback for node 68d3bbc65180aefab120b85f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:34614 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:37:45,801 - lava_callback - INFO - Received callback for node 68d3bbd05180aefab120b871 INFO: 172.20.0.1:48854 - "POST /node/68d3bbd05180aefab120b871 HTTP/1.0" 202 Accepted 2025-09-26 09:37:45,811 - lava_callback - INFO - Starting async job submit for node 68d3bbd05180aefab120b871 2025-09-26 09:37:45,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:37:45,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bbd05180aefab120b871 HTTP/1.1" 200 None 2025-09-26 09:37:45,834 - lava_callback - DEBUG - Processing node 68d3bbd05180aefab120b871: ltp-smoketest 2025-09-26 09:37:45,834 - lava_callback - ERROR - Error processing callback for node 68d3bbd05180aefab120b871: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:48868 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:37:46,559 - lava_callback - INFO - Received callback for node 68d3bbd55180aefab120b874 INFO: 172.20.0.1:48878 - "POST /node/68d3bbd55180aefab120b874 HTTP/1.0" 202 Accepted 2025-09-26 09:37:46,569 - lava_callback - INFO - Starting async job submit for node 68d3bbd55180aefab120b874 2025-09-26 09:37:46,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:37:46,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bbd55180aefab120b874 HTTP/1.1" 200 None 2025-09-26 09:37:46,596 - lava_callback - DEBUG - Processing node 68d3bbd55180aefab120b874: ltp-fsx 2025-09-26 09:37:46,597 - lava_callback - ERROR - Error processing callback for node 68d3bbd55180aefab120b874: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:37:47,370 - lava_callback - INFO - Received callback for node 68d3bbd95180aefab120b87e INFO: 172.20.0.1:48890 - "POST /node/68d3bbd95180aefab120b87e HTTP/1.0" 202 Accepted 2025-09-26 09:37:47,380 - lava_callback - INFO - Starting async job submit for node 68d3bbd95180aefab120b87e 2025-09-26 09:37:47,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:37:47,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bbd95180aefab120b87e HTTP/1.1" 200 None 2025-09-26 09:37:47,534 - lava_callback - DEBUG - Processing node 68d3bbd95180aefab120b87e: ltp-fs-bind 2025-09-26 09:37:47,534 - lava_callback - ERROR - Error processing callback for node 68d3bbd95180aefab120b87e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:37:48,128 - lava_callback - INFO - Received callback for node 68d3bbdb5180aefab120b880 INFO: 172.20.0.1:48902 - "POST /node/68d3bbdb5180aefab120b880 HTTP/1.0" 202 Accepted 2025-09-26 09:37:48,138 - lava_callback - INFO - Starting async job submit for node 68d3bbdb5180aefab120b880 2025-09-26 09:37:48,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:37:48,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bbdb5180aefab120b880 HTTP/1.1" 200 None 2025-09-26 09:37:48,193 - lava_callback - DEBUG - Processing node 68d3bbdb5180aefab120b880: ltp-syscalls 2025-09-26 09:37:48,193 - lava_callback - ERROR - Error processing callback for node 68d3bbdb5180aefab120b880: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:37:48,913 - lava_callback - INFO - Received callback for node 68d3bbdf5180aefab120b886 INFO: 172.20.0.1:48908 - "POST /node/68d3bbdf5180aefab120b886 HTTP/1.0" 202 Accepted 2025-09-26 09:37:48,922 - lava_callback - INFO - Starting async job submit for node 68d3bbdf5180aefab120b886 2025-09-26 09:37:48,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:37:48,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bbdf5180aefab120b886 HTTP/1.1" 200 None 2025-09-26 09:37:48,941 - lava_callback - DEBUG - Processing node 68d3bbdf5180aefab120b886: ltp-input 2025-09-26 09:37:48,941 - lava_callback - ERROR - Error processing callback for node 68d3bbdf5180aefab120b886: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:37:49,639 - lava_callback - INFO - Received callback for node 68d3bbd95180aefab120b87c INFO: 172.20.0.1:49614 - "POST /node/68d3bbd95180aefab120b87c HTTP/1.0" 202 Accepted 2025-09-26 09:37:49,650 - lava_callback - INFO - Starting async job submit for node 68d3bbd95180aefab120b87c 2025-09-26 09:37:49,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:37:49,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bbd95180aefab120b87c HTTP/1.1" 200 None 2025-09-26 09:37:49,686 - lava_callback - DEBUG - Processing node 68d3bbd95180aefab120b87c: baseline-arm-clabbe 2025-09-26 09:37:49,686 - lava_callback - ERROR - Error processing callback for node 68d3bbd95180aefab120b87c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:37:50,315 - lava_callback - INFO - Received callback for node 68d3bbdd5180aefab120b884 INFO: 172.20.0.1:49616 - "POST /node/68d3bbdd5180aefab120b884 HTTP/1.0" 202 Accepted 2025-09-26 09:37:50,323 - lava_callback - INFO - Starting async job submit for node 68d3bbdd5180aefab120b884 2025-09-26 09:37:50,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:37:50,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bbdd5180aefab120b884 HTTP/1.1" 200 None 2025-09-26 09:37:50,352 - lava_callback - DEBUG - Processing node 68d3bbdd5180aefab120b884: baseline-arm-clabbe 2025-09-26 09:37:50,352 - lava_callback - ERROR - Error processing callback for node 68d3bbdd5180aefab120b884: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:37:50,969 - lava_callback - INFO - Received callback for node 68d3bbe25180aefab120b889 INFO: 172.20.0.1:49620 - "POST /node/68d3bbe25180aefab120b889 HTTP/1.0" 202 Accepted 2025-09-26 09:37:50,979 - lava_callback - INFO - Starting async job submit for node 68d3bbe25180aefab120b889 2025-09-26 09:37:50,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:37:51,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bbe25180aefab120b889 HTTP/1.1" 200 None 2025-09-26 09:37:51,020 - lava_callback - DEBUG - Processing node 68d3bbe25180aefab120b889: baseline-arm-clabbe 2025-09-26 09:37:51,020 - lava_callback - ERROR - Error processing callback for node 68d3bbe25180aefab120b889: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:49632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41012 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:38:05,728 - lava_callback - INFO - Received callback for node 68d3bbe45180aefab120b88c INFO: 172.20.0.1:41014 - "POST /node/68d3bbe45180aefab120b88c HTTP/1.0" 202 Accepted 2025-09-26 09:38:05,737 - lava_callback - INFO - Starting async job submit for node 68d3bbe45180aefab120b88c 2025-09-26 09:38:05,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:38:05,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bbe45180aefab120b88c HTTP/1.1" 200 None 2025-09-26 09:38:05,751 - lava_callback - DEBUG - Processing node 68d3bbe45180aefab120b88c: ltp-fsx 2025-09-26 09:38:05,751 - lava_callback - ERROR - Error processing callback for node 68d3bbe45180aefab120b88c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:41018 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:38:06,514 - lava_callback - INFO - Received callback for node 68d3bbe75180aefab120b894 INFO: 172.20.0.1:41026 - "POST /node/68d3bbe75180aefab120b894 HTTP/1.0" 202 Accepted 2025-09-26 09:38:06,522 - lava_callback - INFO - Starting async job submit for node 68d3bbe75180aefab120b894 2025-09-26 09:38:06,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:38:06,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bbe75180aefab120b894 HTTP/1.1" 200 None 2025-09-26 09:38:06,542 - lava_callback - DEBUG - Processing node 68d3bbe75180aefab120b894: ltp-syscalls-ipc 2025-09-26 09:38:06,542 - lava_callback - ERROR - Error processing callback for node 68d3bbe75180aefab120b894: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:38:07,267 - lava_callback - INFO - Received callback for node 68d3bbec5180aefab120b89d INFO: 172.20.0.1:41036 - "POST /node/68d3bbec5180aefab120b89d HTTP/1.0" 202 Accepted 2025-09-26 09:38:07,273 - lava_callback - INFO - Starting async job submit for node 68d3bbec5180aefab120b89d 2025-09-26 09:38:07,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:38:07,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bbec5180aefab120b89d HTTP/1.1" 200 None 2025-09-26 09:38:07,286 - lava_callback - DEBUG - Processing node 68d3bbec5180aefab120b89d: ltp-ipc 2025-09-26 09:38:07,286 - lava_callback - ERROR - Error processing callback for node 68d3bbec5180aefab120b89d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:38:08,003 - lava_callback - INFO - Received callback for node 68d3bbf35180aefab120b8c4 INFO: 172.20.0.1:41050 - "POST /node/68d3bbf35180aefab120b8c4 HTTP/1.0" 202 Accepted 2025-09-26 09:38:08,009 - lava_callback - INFO - Starting async job submit for node 68d3bbf35180aefab120b8c4 2025-09-26 09:38:08,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:38:08,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bbf35180aefab120b8c4 HTTP/1.1" 200 None 2025-09-26 09:38:08,025 - lava_callback - DEBUG - Processing node 68d3bbf35180aefab120b8c4: ltp-input 2025-09-26 09:38:08,025 - lava_callback - ERROR - Error processing callback for node 68d3bbf35180aefab120b8c4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:38:09,637 - lava_callback - INFO - Received callback for node 68d3bbee5180aefab120b8a2 INFO: 172.20.0.1:58592 - "POST /node/68d3bbee5180aefab120b8a2 HTTP/1.0" 202 Accepted 2025-09-26 09:38:09,644 - lava_callback - INFO - Starting async job submit for node 68d3bbee5180aefab120b8a2 2025-09-26 09:38:09,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:38:09,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bbee5180aefab120b8a2 HTTP/1.1" 200 None 2025-09-26 09:38:09,659 - lava_callback - DEBUG - Processing node 68d3bbee5180aefab120b8a2: baseline-arm-clabbe 2025-09-26 09:38:09,659 - lava_callback - ERROR - Error processing callback for node 68d3bbee5180aefab120b8a2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:58600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58620 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:38:25,917 - lava_callback - INFO - Received callback for node 68d3bbfa5180aefab120b8cd INFO: 172.20.0.1:47558 - "POST /node/68d3bbfa5180aefab120b8cd HTTP/1.0" 202 Accepted 2025-09-26 09:38:25,923 - lava_callback - INFO - Starting async job submit for node 68d3bbfa5180aefab120b8cd 2025-09-26 09:38:25,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:38:25,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bbfa5180aefab120b8cd HTTP/1.1" 200 None 2025-09-26 09:38:25,949 - lava_callback - DEBUG - Processing node 68d3bbfa5180aefab120b8cd: ltp-pty 2025-09-26 09:38:25,949 - lava_callback - ERROR - Error processing callback for node 68d3bbfa5180aefab120b8cd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:47560 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:38:26,661 - lava_callback - INFO - Received callback for node 68d3bbff5180aefab120b8d3 INFO: 172.20.0.1:47566 - "POST /node/68d3bbff5180aefab120b8d3 HTTP/1.0" 202 Accepted 2025-09-26 09:38:26,670 - lava_callback - INFO - Starting async job submit for node 68d3bbff5180aefab120b8d3 2025-09-26 09:38:26,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:38:26,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bbff5180aefab120b8d3 HTTP/1.1" 200 None 2025-09-26 09:38:26,695 - lava_callback - DEBUG - Processing node 68d3bbff5180aefab120b8d3: ltp-ipc 2025-09-26 09:38:26,695 - lava_callback - ERROR - Error processing callback for node 68d3bbff5180aefab120b8d3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:38:27,416 - lava_callback - INFO - Received callback for node 68d3bc035180aefab120b8d9 INFO: 172.20.0.1:47572 - "POST /node/68d3bc035180aefab120b8d9 HTTP/1.0" 202 Accepted 2025-09-26 09:38:27,423 - lava_callback - INFO - Starting async job submit for node 68d3bc035180aefab120b8d9 2025-09-26 09:38:27,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:38:27,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc035180aefab120b8d9 HTTP/1.1" 200 None 2025-09-26 09:38:27,439 - lava_callback - DEBUG - Processing node 68d3bc035180aefab120b8d9: ltp-watchqueue 2025-09-26 09:38:27,439 - lava_callback - ERROR - Error processing callback for node 68d3bc035180aefab120b8d9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:38:28,193 - lava_callback - INFO - Received callback for node 68d3bc075180aefab120b8e1 INFO: 172.20.0.1:47588 - "POST /node/68d3bc075180aefab120b8e1 HTTP/1.0" 202 Accepted 2025-09-26 09:38:28,203 - lava_callback - INFO - Starting async job submit for node 68d3bc075180aefab120b8e1 2025-09-26 09:38:28,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:38:28,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc075180aefab120b8e1 HTTP/1.1" 200 None 2025-09-26 09:38:28,220 - lava_callback - DEBUG - Processing node 68d3bc075180aefab120b8e1: ltp-sched 2025-09-26 09:38:28,220 - lava_callback - ERROR - Error processing callback for node 68d3bc075180aefab120b8e1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:38:29,645 - lava_callback - INFO - Received callback for node 68d3bbf65180aefab120b8c8 INFO: 172.20.0.1:56252 - "POST /node/68d3bbf65180aefab120b8c8 HTTP/1.0" 202 Accepted 2025-09-26 09:38:29,651 - lava_callback - INFO - Starting async job submit for node 68d3bbf65180aefab120b8c8 2025-09-26 09:38:29,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:38:29,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bbf65180aefab120b8c8 HTTP/1.1" 200 None 2025-09-26 09:38:29,665 - lava_callback - DEBUG - Processing node 68d3bbf65180aefab120b8c8: baseline-arm-clabbe 2025-09-26 09:38:29,665 - lava_callback - ERROR - Error processing callback for node 68d3bbf65180aefab120b8c8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:38:30,317 - lava_callback - INFO - Received callback for node 68d3bbfa5180aefab120b8d0 INFO: 172.20.0.1:56262 - "POST /node/68d3bbfa5180aefab120b8d0 HTTP/1.0" 202 Accepted 2025-09-26 09:38:30,323 - lava_callback - INFO - Starting async job submit for node 68d3bbfa5180aefab120b8d0 2025-09-26 09:38:30,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:38:30,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bbfa5180aefab120b8d0 HTTP/1.1" 200 None 2025-09-26 09:38:30,339 - lava_callback - DEBUG - Processing node 68d3bbfa5180aefab120b8d0: baseline-arm-clabbe 2025-09-26 09:38:30,339 - lava_callback - ERROR - Error processing callback for node 68d3bbfa5180aefab120b8d0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:38:30,982 - lava_callback - INFO - Received callback for node 68d3bc005180aefab120b8d6 INFO: 172.20.0.1:56268 - "POST /node/68d3bc005180aefab120b8d6 HTTP/1.0" 202 Accepted 2025-09-26 09:38:30,988 - lava_callback - INFO - Starting async job submit for node 68d3bc005180aefab120b8d6 2025-09-26 09:38:30,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:38:31,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc005180aefab120b8d6 HTTP/1.1" 200 None 2025-09-26 09:38:31,003 - lava_callback - DEBUG - Processing node 68d3bc005180aefab120b8d6: baseline-arm-clabbe 2025-09-26 09:38:31,003 - lava_callback - ERROR - Error processing callback for node 68d3bc005180aefab120b8d6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:38:31,623 - lava_callback - INFO - Received callback for node 68d3bc035180aefab120b8dc INFO: 172.20.0.1:56282 - "POST /node/68d3bc035180aefab120b8dc HTTP/1.0" 202 Accepted 2025-09-26 09:38:31,631 - lava_callback - INFO - Starting async job submit for node 68d3bc035180aefab120b8dc 2025-09-26 09:38:31,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:38:31,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc035180aefab120b8dc HTTP/1.1" 200 None 2025-09-26 09:38:31,672 - lava_callback - DEBUG - Processing node 68d3bc035180aefab120b8dc: baseline-arm-clabbe 2025-09-26 09:38:31,672 - lava_callback - ERROR - Error processing callback for node 68d3bc035180aefab120b8dc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:56290 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:38:45,754 - lava_callback - INFO - Received callback for node 68d3bc0d5180aefab120b8e7 INFO: 172.20.0.1:60332 - "POST /node/68d3bc0d5180aefab120b8e7 HTTP/1.0" 202 Accepted 2025-09-26 09:38:45,760 - lava_callback - INFO - Starting async job submit for node 68d3bc0d5180aefab120b8e7 2025-09-26 09:38:45,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:38:45,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc0d5180aefab120b8e7 HTTP/1.1" 200 None 2025-09-26 09:38:45,774 - lava_callback - DEBUG - Processing node 68d3bc0d5180aefab120b8e7: ltp-pty 2025-09-26 09:38:45,774 - lava_callback - ERROR - Error processing callback for node 68d3bc0d5180aefab120b8e7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60336 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:38:46,657 - lava_callback - INFO - Received callback for node 68d3bc145180aefab120b8f3 INFO: 172.20.0.1:60344 - "POST /node/68d3bc145180aefab120b8f3 HTTP/1.0" 202 Accepted 2025-09-26 09:38:46,666 - lava_callback - INFO - Starting async job submit for node 68d3bc145180aefab120b8f3 2025-09-26 09:38:46,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:38:46,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc145180aefab120b8f3 HTTP/1.1" 200 None 2025-09-26 09:38:46,682 - lava_callback - DEBUG - Processing node 68d3bc145180aefab120b8f3: ltp-smoketest 2025-09-26 09:38:46,682 - lava_callback - ERROR - Error processing callback for node 68d3bc145180aefab120b8f3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:38:47,518 - lava_callback - INFO - Received callback for node 68d3bc195180aefab120b8fc INFO: 172.20.0.1:60354 - "POST /node/68d3bc195180aefab120b8fc HTTP/1.0" 202 Accepted 2025-09-26 09:38:47,524 - lava_callback - INFO - Starting async job submit for node 68d3bc195180aefab120b8fc 2025-09-26 09:38:47,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:38:47,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc195180aefab120b8fc HTTP/1.1" 200 None 2025-09-26 09:38:47,540 - lava_callback - DEBUG - Processing node 68d3bc195180aefab120b8fc: ltp-sched 2025-09-26 09:38:47,540 - lava_callback - ERROR - Error processing callback for node 68d3bc195180aefab120b8fc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:38:48,341 - lava_callback - INFO - Received callback for node 68d3bc1e5180aefab120b905 INFO: 172.20.0.1:60364 - "POST /node/68d3bc1e5180aefab120b905 HTTP/1.0" 202 Accepted 2025-09-26 09:38:48,347 - lava_callback - INFO - Starting async job submit for node 68d3bc1e5180aefab120b905 2025-09-26 09:38:48,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:38:48,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc1e5180aefab120b905 HTTP/1.1" 200 None 2025-09-26 09:38:48,363 - lava_callback - DEBUG - Processing node 68d3bc1e5180aefab120b905: ltp-syscalls 2025-09-26 09:38:48,363 - lava_callback - ERROR - Error processing callback for node 68d3bc1e5180aefab120b905: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:38:49,694 - lava_callback - INFO - Received callback for node 68d3bc0a5180aefab120b8e4 INFO: 172.20.0.1:53456 - "POST /node/68d3bc0a5180aefab120b8e4 HTTP/1.0" 202 Accepted 2025-09-26 09:38:49,702 - lava_callback - INFO - Starting async job submit for node 68d3bc0a5180aefab120b8e4 2025-09-26 09:38:49,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:38:49,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc0a5180aefab120b8e4 HTTP/1.1" 200 None 2025-09-26 09:38:49,717 - lava_callback - DEBUG - Processing node 68d3bc0a5180aefab120b8e4: baseline-arm-clabbe 2025-09-26 09:38:49,717 - lava_callback - ERROR - Error processing callback for node 68d3bc0a5180aefab120b8e4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:53466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41174 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:39:05,817 - lava_callback - INFO - Received callback for node 68d3bc245180aefab120b911 INFO: 172.20.0.1:41176 - "POST /node/68d3bc245180aefab120b911 HTTP/1.0" 202 Accepted 2025-09-26 09:39:05,823 - lava_callback - INFO - Starting async job submit for node 68d3bc245180aefab120b911 2025-09-26 09:39:05,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:39:05,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc245180aefab120b911 HTTP/1.1" 200 None 2025-09-26 09:39:05,857 - lava_callback - DEBUG - Processing node 68d3bc245180aefab120b911: ltp-smoketest 2025-09-26 09:39:05,857 - lava_callback - ERROR - Error processing callback for node 68d3bc245180aefab120b911: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:41182 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:39:06,613 - lava_callback - INFO - Received callback for node 68d3bc285180aefab120b919 INFO: 172.20.0.1:41188 - "POST /node/68d3bc285180aefab120b919 HTTP/1.0" 202 Accepted 2025-09-26 09:39:06,623 - lava_callback - INFO - Starting async job submit for node 68d3bc285180aefab120b919 2025-09-26 09:39:06,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:39:06,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc285180aefab120b919 HTTP/1.1" 200 None 2025-09-26 09:39:06,658 - lava_callback - DEBUG - Processing node 68d3bc285180aefab120b919: ltp-syscalls-ipc 2025-09-26 09:39:06,658 - lava_callback - ERROR - Error processing callback for node 68d3bc285180aefab120b919: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:39:07,369 - lava_callback - INFO - Received callback for node 68d3bc2b5180aefab120b922 INFO: 172.20.0.1:41200 - "POST /node/68d3bc2b5180aefab120b922 HTTP/1.0" 202 Accepted 2025-09-26 09:39:07,375 - lava_callback - INFO - Starting async job submit for node 68d3bc2b5180aefab120b922 2025-09-26 09:39:07,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:39:07,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc2b5180aefab120b922 HTTP/1.1" 200 None 2025-09-26 09:39:07,389 - lava_callback - DEBUG - Processing node 68d3bc2b5180aefab120b922: ltp-syscalls 2025-09-26 09:39:07,389 - lava_callback - ERROR - Error processing callback for node 68d3bc2b5180aefab120b922: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:39:08,179 - lava_callback - INFO - Received callback for node 68d3bc315180aefab120b956 INFO: 172.20.0.1:41204 - "POST /node/68d3bc315180aefab120b956 HTTP/1.0" 202 Accepted 2025-09-26 09:39:08,188 - lava_callback - INFO - Starting async job submit for node 68d3bc315180aefab120b956 2025-09-26 09:39:08,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:39:08,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc315180aefab120b956 HTTP/1.1" 200 None 2025-09-26 09:39:08,203 - lava_callback - DEBUG - Processing node 68d3bc315180aefab120b956: ltp-timers 2025-09-26 09:39:08,203 - lava_callback - ERROR - Error processing callback for node 68d3bc315180aefab120b956: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:54344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54354 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:39:20,216 - lava_callback - INFO - Received callback for node 68d408dfcd36afa834e16d1b INFO: 172.20.0.1:57272 - "POST /node/68d408dfcd36afa834e16d1b HTTP/1.0" 202 Accepted 2025-09-26 09:39:20,222 - lava_callback - INFO - Starting async job submit for node 68d408dfcd36afa834e16d1b 2025-09-26 09:39:20,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:39:20,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408dfcd36afa834e16d1b HTTP/1.1" 200 None 2025-09-26 09:39:20,257 - lava_callback - DEBUG - Processing node 68d408dfcd36afa834e16d1b: baseline-arm 2025-09-26 09:39:20,486 - lava_callback - ERROR - Error processing callback for node 68d408dfcd36afa834e16d1b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 09:39:25,823 - lava_callback - INFO - Received callback for node 68d3bc365180aefab120b960 INFO: 172.20.0.1:57278 - "POST /node/68d3bc365180aefab120b960 HTTP/1.0" 202 Accepted 2025-09-26 09:39:25,829 - lava_callback - INFO - Starting async job submit for node 68d3bc365180aefab120b960 2025-09-26 09:39:25,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:39:25,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc365180aefab120b960 HTTP/1.1" 200 None 2025-09-26 09:39:25,842 - lava_callback - DEBUG - Processing node 68d3bc365180aefab120b960: ltp-syscalls-ipc 2025-09-26 09:39:25,843 - lava_callback - ERROR - Error processing callback for node 68d3bc365180aefab120b960: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:57288 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:39:26,560 - lava_callback - INFO - Received callback for node 68d3bc395180aefab120b968 INFO: 172.20.0.1:57300 - "POST /node/68d3bc395180aefab120b968 HTTP/1.0" 202 Accepted 2025-09-26 09:39:26,569 - lava_callback - INFO - Starting async job submit for node 68d3bc395180aefab120b968 2025-09-26 09:39:26,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:39:26,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc395180aefab120b968 HTTP/1.1" 200 None 2025-09-26 09:39:26,585 - lava_callback - DEBUG - Processing node 68d3bc395180aefab120b968: ltp-watchqueue 2025-09-26 09:39:26,585 - lava_callback - ERROR - Error processing callback for node 68d3bc395180aefab120b968: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:39:27,367 - lava_callback - INFO - Received callback for node 68d3bc3f5180aefab120b975 INFO: 172.20.0.1:57302 - "POST /node/68d3bc3f5180aefab120b975 HTTP/1.0" 202 Accepted 2025-09-26 09:39:27,373 - lava_callback - INFO - Starting async job submit for node 68d3bc3f5180aefab120b975 2025-09-26 09:39:27,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:39:27,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc3f5180aefab120b975 HTTP/1.1" 200 None 2025-09-26 09:39:27,388 - lava_callback - DEBUG - Processing node 68d3bc3f5180aefab120b975: ltp-timers 2025-09-26 09:39:27,388 - lava_callback - ERROR - Error processing callback for node 68d3bc3f5180aefab120b975: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:39:28,131 - lava_callback - INFO - Received callback for node 68d3bc485180aefab120b985 INFO: 172.20.0.1:57306 - "POST /node/68d3bc485180aefab120b985 HTTP/1.0" 202 Accepted 2025-09-26 09:39:28,137 - lava_callback - INFO - Starting async job submit for node 68d3bc485180aefab120b985 2025-09-26 09:39:28,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:39:28,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc485180aefab120b985 HTTP/1.1" 200 None 2025-09-26 09:39:28,151 - lava_callback - DEBUG - Processing node 68d3bc485180aefab120b985: ltp-watchqueue 2025-09-26 09:39:28,151 - lava_callback - ERROR - Error processing callback for node 68d3bc485180aefab120b985: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:39:29,689 - lava_callback - INFO - Received callback for node 68d3bc315180aefab120b952 INFO: 172.20.0.1:56782 - "POST /node/68d3bc315180aefab120b952 HTTP/1.0" 202 Accepted 2025-09-26 09:39:29,697 - lava_callback - INFO - Starting async job submit for node 68d3bc315180aefab120b952 2025-09-26 09:39:29,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:39:29,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc315180aefab120b952 HTTP/1.1" 200 None 2025-09-26 09:39:29,717 - lava_callback - DEBUG - Processing node 68d3bc315180aefab120b952: baseline-arm-clabbe 2025-09-26 09:39:29,717 - lava_callback - ERROR - Error processing callback for node 68d3bc315180aefab120b952: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:39:30,360 - lava_callback - INFO - Received callback for node 68d3bc385180aefab120b966 INFO: 172.20.0.1:56794 - "POST /node/68d3bc385180aefab120b966 HTTP/1.0" 202 Accepted 2025-09-26 09:39:30,365 - lava_callback - INFO - Starting async job submit for node 68d3bc385180aefab120b966 2025-09-26 09:39:30,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:39:30,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc385180aefab120b966 HTTP/1.1" 200 None 2025-09-26 09:39:30,387 - lava_callback - DEBUG - Processing node 68d3bc385180aefab120b966: baseline-arm-clabbe 2025-09-26 09:39:30,387 - lava_callback - ERROR - Error processing callback for node 68d3bc385180aefab120b966: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:39:31,030 - lava_callback - INFO - Received callback for node 68d3bc3d5180aefab120b96f INFO: 172.20.0.1:56802 - "POST /node/68d3bc3d5180aefab120b96f HTTP/1.0" 202 Accepted 2025-09-26 09:39:31,038 - lava_callback - INFO - Starting async job submit for node 68d3bc3d5180aefab120b96f 2025-09-26 09:39:31,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:39:31,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc3d5180aefab120b96f HTTP/1.1" 200 None 2025-09-26 09:39:31,073 - lava_callback - DEBUG - Processing node 68d3bc3d5180aefab120b96f: baseline-arm-clabbe 2025-09-26 09:39:31,073 - lava_callback - ERROR - Error processing callback for node 68d3bc3d5180aefab120b96f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:56804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56682 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:40:05,585 - lava_callback - INFO - Received callback for node 68d3bb165180aefab120b700 INFO: 172.20.0.1:56692 - "POST /node/68d3bb165180aefab120b700 HTTP/1.0" 202 Accepted 2025-09-26 09:40:05,593 - lava_callback - INFO - Starting async job submit for node 68d3bb165180aefab120b700 2025-09-26 09:40:05,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:40:05,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bb165180aefab120b700 HTTP/1.1" 200 None 2025-09-26 09:40:05,738 - lava_callback - DEBUG - Processing node 68d3bb165180aefab120b700: ltp-containers INFO: 172.20.0.1:56706 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:40:06,652 - lava_callback - ERROR - Error processing callback for node 68d3bb165180aefab120b700: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:55152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33106 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:40:45,878 - lava_callback - INFO - Received callback for node 68d3bc875180aefab120ba22 INFO: 172.20.0.1:53622 - "POST /node/68d3bc875180aefab120ba22 HTTP/1.0" 202 Accepted 2025-09-26 09:40:45,888 - lava_callback - INFO - Starting async job submit for node 68d3bc875180aefab120ba22 2025-09-26 09:40:45,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:40:45,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc875180aefab120ba22 HTTP/1.1" 200 None 2025-09-26 09:40:45,903 - lava_callback - DEBUG - Processing node 68d3bc875180aefab120ba22: ltp-cap-bounds 2025-09-26 09:40:45,903 - lava_callback - ERROR - Error processing callback for node 68d3bc875180aefab120ba22: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:53628 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:40:46,708 - lava_callback - INFO - Received callback for node 68d3bc8a5180aefab120ba28 INFO: 172.20.0.1:53642 - "POST /node/68d3bc8a5180aefab120ba28 HTTP/1.0" 202 Accepted 2025-09-26 09:40:46,718 - lava_callback - INFO - Starting async job submit for node 68d3bc8a5180aefab120ba28 2025-09-26 09:40:46,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:40:46,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc8a5180aefab120ba28 HTTP/1.1" 200 None 2025-09-26 09:40:46,739 - lava_callback - DEBUG - Processing node 68d3bc8a5180aefab120ba28: ltp-cap-bounds 2025-09-26 09:40:46,739 - lava_callback - ERROR - Error processing callback for node 68d3bc8a5180aefab120ba28: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:40:47,536 - lava_callback - INFO - Received callback for node 68d3bc8d5180aefab120ba2c INFO: 172.20.0.1:53644 - "POST /node/68d3bc8d5180aefab120ba2c HTTP/1.0" 202 Accepted 2025-09-26 09:40:47,546 - lava_callback - INFO - Starting async job submit for node 68d3bc8d5180aefab120ba2c 2025-09-26 09:40:47,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:40:47,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc8d5180aefab120ba2c HTTP/1.1" 200 None 2025-09-26 09:40:47,564 - lava_callback - DEBUG - Processing node 68d3bc8d5180aefab120ba2c: ltp-containers 2025-09-26 09:40:47,564 - lava_callback - ERROR - Error processing callback for node 68d3bc8d5180aefab120ba2c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:40:48,296 - lava_callback - INFO - Received callback for node 68d3bc905180aefab120ba30 INFO: 172.20.0.1:53654 - "POST /node/68d3bc905180aefab120ba30 HTTP/1.0" 202 Accepted 2025-09-26 09:40:48,305 - lava_callback - INFO - Starting async job submit for node 68d3bc905180aefab120ba30 2025-09-26 09:40:48,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:40:48,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc905180aefab120ba30 HTTP/1.1" 200 None 2025-09-26 09:40:48,326 - lava_callback - DEBUG - Processing node 68d3bc905180aefab120ba30: ltp-containers 2025-09-26 09:40:48,326 - lava_callback - ERROR - Error processing callback for node 68d3bc905180aefab120ba30: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:40:49,065 - lava_callback - INFO - Received callback for node 68d3bc955180aefab120ba39 INFO: 172.20.0.1:53664 - "POST /node/68d3bc955180aefab120ba39 HTTP/1.0" 202 Accepted 2025-09-26 09:40:49,071 - lava_callback - INFO - Starting async job submit for node 68d3bc955180aefab120ba39 2025-09-26 09:40:49,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:40:49,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc955180aefab120ba39 HTTP/1.1" 200 None 2025-09-26 09:40:49,086 - lava_callback - DEBUG - Processing node 68d3bc955180aefab120ba39: ltp-containers 2025-09-26 09:40:49,086 - lava_callback - ERROR - Error processing callback for node 68d3bc955180aefab120ba39: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:40320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57024 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:41:05,936 - lava_callback - INFO - Received callback for node 68d3bc985180aefab120ba3e INFO: 172.20.0.1:57040 - "POST /node/68d3bc985180aefab120ba3e HTTP/1.0" 202 Accepted 2025-09-26 09:41:05,942 - lava_callback - INFO - Starting async job submit for node 68d3bc985180aefab120ba3e 2025-09-26 09:41:05,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:41:05,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc985180aefab120ba3e HTTP/1.1" 200 None 2025-09-26 09:41:05,956 - lava_callback - DEBUG - Processing node 68d3bc985180aefab120ba3e: ltp-controllers 2025-09-26 09:41:05,956 - lava_callback - ERROR - Error processing callback for node 68d3bc985180aefab120ba3e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:57050 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:41:06,684 - lava_callback - INFO - Received callback for node 68d3bc9b5180aefab120ba47 INFO: 172.20.0.1:57062 - "POST /node/68d3bc9b5180aefab120ba47 HTTP/1.0" 202 Accepted 2025-09-26 09:41:06,690 - lava_callback - INFO - Starting async job submit for node 68d3bc9b5180aefab120ba47 2025-09-26 09:41:06,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:41:06,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc9b5180aefab120ba47 HTTP/1.1" 200 None 2025-09-26 09:41:06,704 - lava_callback - DEBUG - Processing node 68d3bc9b5180aefab120ba47: ltp-controllers 2025-09-26 09:41:06,705 - lava_callback - ERROR - Error processing callback for node 68d3bc9b5180aefab120ba47: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:41:07,477 - lava_callback - INFO - Received callback for node 68d3bc9f5180aefab120ba53 INFO: 172.20.0.1:57064 - "POST /node/68d3bc9f5180aefab120ba53 HTTP/1.0" 202 Accepted 2025-09-26 09:41:07,490 - lava_callback - INFO - Starting async job submit for node 68d3bc9f5180aefab120ba53 2025-09-26 09:41:07,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:41:07,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc9f5180aefab120ba53 HTTP/1.1" 200 None 2025-09-26 09:41:07,509 - lava_callback - DEBUG - Processing node 68d3bc9f5180aefab120ba53: ltp-controllers 2025-09-26 09:41:07,509 - lava_callback - ERROR - Error processing callback for node 68d3bc9f5180aefab120ba53: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:41:08,243 - lava_callback - INFO - Received callback for node 68d3bca45180aefab120ba5c INFO: 172.20.0.1:57080 - "POST /node/68d3bca45180aefab120ba5c HTTP/1.0" 202 Accepted 2025-09-26 09:41:08,250 - lava_callback - INFO - Starting async job submit for node 68d3bca45180aefab120ba5c 2025-09-26 09:41:08,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:41:08,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bca45180aefab120ba5c HTTP/1.1" 200 None 2025-09-26 09:41:08,265 - lava_callback - DEBUG - Processing node 68d3bca45180aefab120ba5c: ltp-cve 2025-09-26 09:41:08,265 - lava_callback - ERROR - Error processing callback for node 68d3bca45180aefab120ba5c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:41:09,011 - lava_callback - INFO - Received callback for node 68d3bca65180aefab120ba64 INFO: 172.20.0.1:57092 - "POST /node/68d3bca65180aefab120ba64 HTTP/1.0" 202 Accepted 2025-09-26 09:41:09,017 - lava_callback - INFO - Starting async job submit for node 68d3bca65180aefab120ba64 2025-09-26 09:41:09,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:41:09,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bca65180aefab120ba64 HTTP/1.1" 200 None 2025-09-26 09:41:09,051 - lava_callback - DEBUG - Processing node 68d3bca65180aefab120ba64: ltp-cve 2025-09-26 09:41:09,051 - lava_callback - ERROR - Error processing callback for node 68d3bca65180aefab120ba64: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:41:09,790 - lava_callback - INFO - Received callback for node 68d3bca95180aefab120ba6c INFO: 172.20.0.1:34732 - "POST /node/68d3bca95180aefab120ba6c HTTP/1.0" 202 Accepted 2025-09-26 09:41:09,796 - lava_callback - INFO - Starting async job submit for node 68d3bca95180aefab120ba6c 2025-09-26 09:41:09,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:41:09,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bca95180aefab120ba6c HTTP/1.1" 200 None 2025-09-26 09:41:09,832 - lava_callback - DEBUG - Processing node 68d3bca95180aefab120ba6c: ltp-cve 2025-09-26 09:41:09,832 - lava_callback - ERROR - Error processing callback for node 68d3bca95180aefab120ba6c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:34742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34760 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:41:25,905 - lava_callback - INFO - Received callback for node 68d3bcb55180aefab120baa0 INFO: 172.20.0.1:36766 - "POST /node/68d3bcb55180aefab120baa0 HTTP/1.0" 202 Accepted 2025-09-26 09:41:25,921 - lava_callback - INFO - Starting async job submit for node 68d3bcb55180aefab120baa0 2025-09-26 09:41:25,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:41:25,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bcb55180aefab120baa0 HTTP/1.1" 200 None 2025-09-26 09:41:25,947 - lava_callback - DEBUG - Processing node 68d3bcb55180aefab120baa0: ltp-fs-bind 2025-09-26 09:41:25,947 - lava_callback - ERROR - Error processing callback for node 68d3bcb55180aefab120baa0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:36778 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:41:26,702 - lava_callback - INFO - Received callback for node 68d3bcb95180aefab120baaa INFO: 172.20.0.1:36782 - "POST /node/68d3bcb95180aefab120baaa HTTP/1.0" 202 Accepted 2025-09-26 09:41:26,712 - lava_callback - INFO - Starting async job submit for node 68d3bcb95180aefab120baaa 2025-09-26 09:41:26,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:41:26,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bcb95180aefab120baaa HTTP/1.1" 200 None 2025-09-26 09:41:26,733 - lava_callback - DEBUG - Processing node 68d3bcb95180aefab120baaa: ltp-fs-bind 2025-09-26 09:41:26,733 - lava_callback - ERROR - Error processing callback for node 68d3bcb95180aefab120baaa: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:41:27,461 - lava_callback - INFO - Received callback for node 68d3bcbb5180aefab120bab0 INFO: 172.20.0.1:36788 - "POST /node/68d3bcbb5180aefab120bab0 HTTP/1.0" 202 Accepted 2025-09-26 09:41:27,473 - lava_callback - INFO - Starting async job submit for node 68d3bcbb5180aefab120bab0 2025-09-26 09:41:27,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:41:27,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bcbb5180aefab120bab0 HTTP/1.1" 200 None 2025-09-26 09:41:27,495 - lava_callback - DEBUG - Processing node 68d3bcbb5180aefab120bab0: ltp-fs-bind 2025-09-26 09:41:27,495 - lava_callback - ERROR - Error processing callback for node 68d3bcbb5180aefab120bab0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:49378 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:41:38,557 - lava_callback - INFO - Received callback for node 68d408e0cd36afa834e16d1e INFO: 172.20.0.1:49392 - "POST /node/68d408e0cd36afa834e16d1e HTTP/1.0" 202 Accepted 2025-09-26 09:41:38,565 - lava_callback - INFO - Starting async job submit for node 68d408e0cd36afa834e16d1e 2025-09-26 09:41:38,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:41:38,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408e0cd36afa834e16d1e HTTP/1.1" 200 None 2025-09-26 09:41:38,599 - lava_callback - DEBUG - Processing node 68d408e0cd36afa834e16d1e: baseline-arm 2025-09-26 09:41:38,872 - lava_callback - ERROR - Error processing callback for node 68d408e0cd36afa834e16d1e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 09:41:45,854 - lava_callback - INFO - Received callback for node 68d3bcbe5180aefab120bab4 INFO: 172.20.0.1:41854 - "POST /node/68d3bcbe5180aefab120bab4 HTTP/1.0" 202 Accepted 2025-09-26 09:41:45,863 - lava_callback - INFO - Starting async job submit for node 68d3bcbe5180aefab120bab4 2025-09-26 09:41:45,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:41:45,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bcbe5180aefab120bab4 HTTP/1.1" 200 None 2025-09-26 09:41:45,883 - lava_callback - DEBUG - Processing node 68d3bcbe5180aefab120bab4: ltp-fsx 2025-09-26 09:41:45,883 - lava_callback - ERROR - Error processing callback for node 68d3bcbe5180aefab120bab4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:41860 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:41:46,627 - lava_callback - INFO - Received callback for node 68d3bcc25180aefab120baba INFO: 172.20.0.1:41862 - "POST /node/68d3bcc25180aefab120baba HTTP/1.0" 202 Accepted 2025-09-26 09:41:46,632 - lava_callback - INFO - Starting async job submit for node 68d3bcc25180aefab120baba 2025-09-26 09:41:46,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:41:46,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bcc25180aefab120baba HTTP/1.1" 200 None 2025-09-26 09:41:46,647 - lava_callback - DEBUG - Processing node 68d3bcc25180aefab120baba: ltp-fsx 2025-09-26 09:41:46,647 - lava_callback - ERROR - Error processing callback for node 68d3bcc25180aefab120baba: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:41:47,372 - lava_callback - INFO - Received callback for node 68d3bcc65180aefab120bac0 INFO: 172.20.0.1:41866 - "POST /node/68d3bcc65180aefab120bac0 HTTP/1.0" 202 Accepted 2025-09-26 09:41:47,378 - lava_callback - INFO - Starting async job submit for node 68d3bcc65180aefab120bac0 2025-09-26 09:41:47,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:41:47,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bcc65180aefab120bac0 HTTP/1.1" 200 None 2025-09-26 09:41:47,398 - lava_callback - DEBUG - Processing node 68d3bcc65180aefab120bac0: ltp-fsx 2025-09-26 09:41:47,398 - lava_callback - ERROR - Error processing callback for node 68d3bcc65180aefab120bac0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:41:48,120 - lava_callback - INFO - Received callback for node 68d3bccc5180aefab120bac9 INFO: 172.20.0.1:41876 - "POST /node/68d3bccc5180aefab120bac9 HTTP/1.0" 202 Accepted 2025-09-26 09:41:48,132 - lava_callback - INFO - Starting async job submit for node 68d3bccc5180aefab120bac9 2025-09-26 09:41:48,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:41:48,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bccc5180aefab120bac9 HTTP/1.1" 200 None 2025-09-26 09:41:48,152 - lava_callback - DEBUG - Processing node 68d3bccc5180aefab120bac9: ltp-input 2025-09-26 09:41:48,152 - lava_callback - ERROR - Error processing callback for node 68d3bccc5180aefab120bac9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:41:48,936 - lava_callback - INFO - Received callback for node 68d3bcd05180aefab120bad1 INFO: 172.20.0.1:41878 - "POST /node/68d3bcd05180aefab120bad1 HTTP/1.0" 202 Accepted 2025-09-26 09:41:48,942 - lava_callback - INFO - Starting async job submit for node 68d3bcd05180aefab120bad1 2025-09-26 09:41:48,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:41:48,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bcd05180aefab120bad1 HTTP/1.1" 200 None 2025-09-26 09:41:48,957 - lava_callback - DEBUG - Processing node 68d3bcd05180aefab120bad1: ltp-input 2025-09-26 09:41:48,957 - lava_callback - ERROR - Error processing callback for node 68d3bcd05180aefab120bad1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:43570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39988 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:42:05,912 - lava_callback - INFO - Received callback for node 68d3bcd45180aefab120bad5 INFO: 172.20.0.1:39998 - "POST /node/68d3bcd45180aefab120bad5 HTTP/1.0" 202 Accepted 2025-09-26 09:42:05,921 - lava_callback - INFO - Starting async job submit for node 68d3bcd45180aefab120bad5 2025-09-26 09:42:05,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:42:05,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bcd45180aefab120bad5 HTTP/1.1" 200 None 2025-09-26 09:42:05,940 - lava_callback - DEBUG - Processing node 68d3bcd45180aefab120bad5: ltp-input 2025-09-26 09:42:05,941 - lava_callback - ERROR - Error processing callback for node 68d3bcd45180aefab120bad5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:40008 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:42:06,686 - lava_callback - INFO - Received callback for node 68d3bcd75180aefab120badd INFO: 172.20.0.1:40022 - "POST /node/68d3bcd75180aefab120badd HTTP/1.0" 202 Accepted 2025-09-26 09:42:06,696 - lava_callback - INFO - Starting async job submit for node 68d3bcd75180aefab120badd 2025-09-26 09:42:06,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:42:06,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bcd75180aefab120badd HTTP/1.1" 200 None 2025-09-26 09:42:06,713 - lava_callback - DEBUG - Processing node 68d3bcd75180aefab120badd: ltp-ipc 2025-09-26 09:42:06,713 - lava_callback - ERROR - Error processing callback for node 68d3bcd75180aefab120badd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:42:07,575 - lava_callback - INFO - Received callback for node 68d3bcda5180aefab120bae1 INFO: 172.20.0.1:40036 - "POST /node/68d3bcda5180aefab120bae1 HTTP/1.0" 202 Accepted 2025-09-26 09:42:07,585 - lava_callback - INFO - Starting async job submit for node 68d3bcda5180aefab120bae1 2025-09-26 09:42:07,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:42:07,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bcda5180aefab120bae1 HTTP/1.1" 200 None 2025-09-26 09:42:07,612 - lava_callback - DEBUG - Processing node 68d3bcda5180aefab120bae1: ltp-ipc 2025-09-26 09:42:07,613 - lava_callback - ERROR - Error processing callback for node 68d3bcda5180aefab120bae1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:42:08,366 - lava_callback - INFO - Received callback for node 68d3bcde5180aefab120bae6 INFO: 172.20.0.1:40040 - "POST /node/68d3bcde5180aefab120bae6 HTTP/1.0" 202 Accepted 2025-09-26 09:42:08,376 - lava_callback - INFO - Starting async job submit for node 68d3bcde5180aefab120bae6 2025-09-26 09:42:08,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:42:08,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bcde5180aefab120bae6 HTTP/1.1" 200 None 2025-09-26 09:42:08,389 - lava_callback - DEBUG - Processing node 68d3bcde5180aefab120bae6: ltp-ipc 2025-09-26 09:42:08,389 - lava_callback - ERROR - Error processing callback for node 68d3bcde5180aefab120bae6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:42:09,124 - lava_callback - INFO - Received callback for node 68d3bce15180aefab120baed INFO: 172.20.0.1:40044 - "POST /node/68d3bce15180aefab120baed HTTP/1.0" 202 Accepted 2025-09-26 09:42:09,133 - lava_callback - INFO - Starting async job submit for node 68d3bce15180aefab120baed 2025-09-26 09:42:09,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:42:09,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bce15180aefab120baed HTTP/1.1" 200 None 2025-09-26 09:42:09,154 - lava_callback - DEBUG - Processing node 68d3bce15180aefab120baed: ltp-pty 2025-09-26 09:42:09,154 - lava_callback - ERROR - Error processing callback for node 68d3bce15180aefab120baed: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:42:09,870 - lava_callback - INFO - Received callback for node 68d3bce55180aefab120baf3 INFO: 172.20.0.1:45804 - "POST /node/68d3bce55180aefab120baf3 HTTP/1.0" 202 Accepted 2025-09-26 09:42:09,876 - lava_callback - INFO - Starting async job submit for node 68d3bce55180aefab120baf3 2025-09-26 09:42:09,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:42:09,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bce55180aefab120baf3 HTTP/1.1" 200 None 2025-09-26 09:42:09,893 - lava_callback - DEBUG - Processing node 68d3bce55180aefab120baf3: ltp-pty 2025-09-26 09:42:09,893 - lava_callback - ERROR - Error processing callback for node 68d3bce55180aefab120baf3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:42:10,796 - lava_callback - INFO - Received callback for node 68d3bbf75180aefab120b8ca INFO: 172.20.0.1:45806 - "POST /node/68d3bbf75180aefab120b8ca HTTP/1.0" 202 Accepted 2025-09-26 09:42:10,802 - lava_callback - INFO - Starting async job submit for node 68d3bbf75180aefab120b8ca 2025-09-26 09:42:10,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:42:10,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bbf75180aefab120b8ca HTTP/1.1" 200 None 2025-09-26 09:42:10,842 - lava_callback - DEBUG - Processing node 68d3bbf75180aefab120b8ca: ltp-timers 2025-09-26 09:42:11,163 - lava_callback - ERROR - Error processing callback for node 68d3bbf75180aefab120b8ca: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:45812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45838 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:42:26,089 - lava_callback - INFO - Received callback for node 68d3bceb5180aefab120bafd INFO: 172.20.0.1:58228 - "POST /node/68d3bceb5180aefab120bafd HTTP/1.0" 202 Accepted 2025-09-26 09:42:26,095 - lava_callback - INFO - Starting async job submit for node 68d3bceb5180aefab120bafd 2025-09-26 09:42:26,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:42:26,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bceb5180aefab120bafd HTTP/1.1" 200 None 2025-09-26 09:42:26,111 - lava_callback - DEBUG - Processing node 68d3bceb5180aefab120bafd: ltp-sched 2025-09-26 09:42:26,111 - lava_callback - ERROR - Error processing callback for node 68d3bceb5180aefab120bafd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:58238 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:42:26,854 - lava_callback - INFO - Received callback for node 68d3bcf15180aefab120bb23 INFO: 172.20.0.1:58250 - "POST /node/68d3bcf15180aefab120bb23 HTTP/1.0" 202 Accepted 2025-09-26 09:42:26,859 - lava_callback - INFO - Starting async job submit for node 68d3bcf15180aefab120bb23 2025-09-26 09:42:26,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:42:26,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bcf15180aefab120bb23 HTTP/1.1" 200 None 2025-09-26 09:42:26,903 - lava_callback - DEBUG - Processing node 68d3bcf15180aefab120bb23: ltp-sched 2025-09-26 09:42:26,903 - lava_callback - ERROR - Error processing callback for node 68d3bcf15180aefab120bb23: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:42:27,712 - lava_callback - INFO - Received callback for node 68d3bcf35180aefab120bb28 INFO: 172.20.0.1:58252 - "POST /node/68d3bcf35180aefab120bb28 HTTP/1.0" 202 Accepted 2025-09-26 09:42:27,720 - lava_callback - INFO - Starting async job submit for node 68d3bcf35180aefab120bb28 2025-09-26 09:42:27,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:42:27,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bcf35180aefab120bb28 HTTP/1.1" 200 None 2025-09-26 09:42:27,753 - lava_callback - DEBUG - Processing node 68d3bcf35180aefab120bb28: ltp-sched 2025-09-26 09:42:27,753 - lava_callback - ERROR - Error processing callback for node 68d3bcf35180aefab120bb28: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:42:28,452 - lava_callback - INFO - Received callback for node 68d3bcf65180aefab120bb30 INFO: 172.20.0.1:58258 - "POST /node/68d3bcf65180aefab120bb30 HTTP/1.0" 202 Accepted 2025-09-26 09:42:28,461 - lava_callback - INFO - Starting async job submit for node 68d3bcf65180aefab120bb30 2025-09-26 09:42:28,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:42:28,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bcf65180aefab120bb30 HTTP/1.1" 200 None 2025-09-26 09:42:28,476 - lava_callback - DEBUG - Processing node 68d3bcf65180aefab120bb30: ltp-smoketest 2025-09-26 09:42:28,476 - lava_callback - ERROR - Error processing callback for node 68d3bcf65180aefab120bb30: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:42:29,285 - lava_callback - INFO - Received callback for node 68d3bcf95180aefab120bb36 INFO: 172.20.0.1:58260 - "POST /node/68d3bcf95180aefab120bb36 HTTP/1.0" 202 Accepted 2025-09-26 09:42:29,294 - lava_callback - INFO - Starting async job submit for node 68d3bcf95180aefab120bb36 2025-09-26 09:42:29,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:42:29,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bcf95180aefab120bb36 HTTP/1.1" 200 None 2025-09-26 09:42:29,321 - lava_callback - DEBUG - Processing node 68d3bcf95180aefab120bb36: ltp-smoketest 2025-09-26 09:42:29,321 - lava_callback - ERROR - Error processing callback for node 68d3bcf95180aefab120bb36: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:42:30,027 - lava_callback - INFO - Received callback for node 68d3bcfb5180aefab120bb39 INFO: 172.20.0.1:44906 - "POST /node/68d3bcfb5180aefab120bb39 HTTP/1.0" 202 Accepted 2025-09-26 09:42:30,033 - lava_callback - INFO - Starting async job submit for node 68d3bcfb5180aefab120bb39 2025-09-26 09:42:30,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:42:30,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bcfb5180aefab120bb39 HTTP/1.1" 200 None 2025-09-26 09:42:30,058 - lava_callback - DEBUG - Processing node 68d3bcfb5180aefab120bb39: ltp-smoketest 2025-09-26 09:42:30,058 - lava_callback - ERROR - Error processing callback for node 68d3bcfb5180aefab120bb39: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:44912 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:42:45,894 - lava_callback - INFO - Received callback for node 68d3bcff5180aefab120bb42 INFO: 172.20.0.1:44628 - "POST /node/68d3bcff5180aefab120bb42 HTTP/1.0" 202 Accepted 2025-09-26 09:42:45,903 - lava_callback - INFO - Starting async job submit for node 68d3bcff5180aefab120bb42 2025-09-26 09:42:45,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:42:45,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bcff5180aefab120bb42 HTTP/1.1" 200 None 2025-09-26 09:42:45,925 - lava_callback - DEBUG - Processing node 68d3bcff5180aefab120bb42: ltp-syscalls 2025-09-26 09:42:45,925 - lava_callback - ERROR - Error processing callback for node 68d3bcff5180aefab120bb42: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:44638 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:42:46,729 - lava_callback - INFO - Received callback for node 68d3bd015180aefab120bb48 INFO: 172.20.0.1:44648 - "POST /node/68d3bd015180aefab120bb48 HTTP/1.0" 202 Accepted 2025-09-26 09:42:46,735 - lava_callback - INFO - Starting async job submit for node 68d3bd015180aefab120bb48 2025-09-26 09:42:46,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:42:46,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bd015180aefab120bb48 HTTP/1.1" 200 None 2025-09-26 09:42:46,750 - lava_callback - DEBUG - Processing node 68d3bd015180aefab120bb48: ltp-syscalls 2025-09-26 09:42:46,750 - lava_callback - ERROR - Error processing callback for node 68d3bd015180aefab120bb48: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:42:47,568 - lava_callback - INFO - Received callback for node 68d3bd055180aefab120bb4b INFO: 172.20.0.1:44662 - "POST /node/68d3bd055180aefab120bb4b HTTP/1.0" 202 Accepted 2025-09-26 09:42:47,574 - lava_callback - INFO - Starting async job submit for node 68d3bd055180aefab120bb4b 2025-09-26 09:42:47,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:42:47,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bd055180aefab120bb4b HTTP/1.1" 200 None 2025-09-26 09:42:47,589 - lava_callback - DEBUG - Processing node 68d3bd055180aefab120bb4b: ltp-syscalls 2025-09-26 09:42:47,589 - lava_callback - ERROR - Error processing callback for node 68d3bd055180aefab120bb4b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:42:48,305 - lava_callback - INFO - Received callback for node 68d3bd075180aefab120bb55 INFO: 172.20.0.1:44668 - "POST /node/68d3bd075180aefab120bb55 HTTP/1.0" 202 Accepted 2025-09-26 09:42:48,315 - lava_callback - INFO - Starting async job submit for node 68d3bd075180aefab120bb55 2025-09-26 09:42:48,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:42:48,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bd075180aefab120bb55 HTTP/1.1" 200 None 2025-09-26 09:42:48,332 - lava_callback - DEBUG - Processing node 68d3bd075180aefab120bb55: ltp-syscalls-ipc 2025-09-26 09:42:48,332 - lava_callback - ERROR - Error processing callback for node 68d3bd075180aefab120bb55: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:42:49,057 - lava_callback - INFO - Received callback for node 68d3bd0a5180aefab120bb61 INFO: 172.20.0.1:44674 - "POST /node/68d3bd0a5180aefab120bb61 HTTP/1.0" 202 Accepted 2025-09-26 09:42:49,066 - lava_callback - INFO - Starting async job submit for node 68d3bd0a5180aefab120bb61 2025-09-26 09:42:49,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:42:49,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bd0a5180aefab120bb61 HTTP/1.1" 200 None 2025-09-26 09:42:49,087 - lava_callback - DEBUG - Processing node 68d3bd0a5180aefab120bb61: ltp-syscalls-ipc 2025-09-26 09:42:49,087 - lava_callback - ERROR - Error processing callback for node 68d3bd0a5180aefab120bb61: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:48566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43284 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:43:05,960 - lava_callback - INFO - Received callback for node 68d3bd0e5180aefab120bb65 INFO: 172.20.0.1:43298 - "POST /node/68d3bd0e5180aefab120bb65 HTTP/1.0" 202 Accepted 2025-09-26 09:43:05,970 - lava_callback - INFO - Starting async job submit for node 68d3bd0e5180aefab120bb65 2025-09-26 09:43:05,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:43:05,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bd0e5180aefab120bb65 HTTP/1.1" 200 None 2025-09-26 09:43:05,988 - lava_callback - DEBUG - Processing node 68d3bd0e5180aefab120bb65: ltp-syscalls-ipc 2025-09-26 09:43:05,988 - lava_callback - ERROR - Error processing callback for node 68d3bd0e5180aefab120bb65: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:43314 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:43:06,724 - lava_callback - INFO - Received callback for node 68d3bd135180aefab120bb6d INFO: 172.20.0.1:43330 - "POST /node/68d3bd135180aefab120bb6d HTTP/1.0" 202 Accepted 2025-09-26 09:43:06,741 - lava_callback - INFO - Starting async job submit for node 68d3bd135180aefab120bb6d 2025-09-26 09:43:06,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:43:06,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bd135180aefab120bb6d HTTP/1.1" 200 None 2025-09-26 09:43:06,763 - lava_callback - DEBUG - Processing node 68d3bd135180aefab120bb6d: ltp-timers 2025-09-26 09:43:06,763 - lava_callback - ERROR - Error processing callback for node 68d3bd135180aefab120bb6d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:43:07,472 - lava_callback - INFO - Received callback for node 68d3bd155180aefab120bb71 INFO: 172.20.0.1:43342 - "POST /node/68d3bd155180aefab120bb71 HTTP/1.0" 202 Accepted 2025-09-26 09:43:07,481 - lava_callback - INFO - Starting async job submit for node 68d3bd155180aefab120bb71 2025-09-26 09:43:07,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:43:07,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bd155180aefab120bb71 HTTP/1.1" 200 None 2025-09-26 09:43:07,502 - lava_callback - DEBUG - Processing node 68d3bd155180aefab120bb71: ltp-timers 2025-09-26 09:43:07,502 - lava_callback - ERROR - Error processing callback for node 68d3bd155180aefab120bb71: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:43:08,243 - lava_callback - INFO - Received callback for node 68d3bd1a5180aefab120bb77 INFO: 172.20.0.1:43358 - "POST /node/68d3bd1a5180aefab120bb77 HTTP/1.0" 202 Accepted 2025-09-26 09:43:08,252 - lava_callback - INFO - Starting async job submit for node 68d3bd1a5180aefab120bb77 2025-09-26 09:43:08,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:43:08,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bd1a5180aefab120bb77 HTTP/1.1" 200 None 2025-09-26 09:43:08,279 - lava_callback - DEBUG - Processing node 68d3bd1a5180aefab120bb77: ltp-timers 2025-09-26 09:43:08,279 - lava_callback - ERROR - Error processing callback for node 68d3bd1a5180aefab120bb77: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:43:09,003 - lava_callback - INFO - Received callback for node 68d3bd1e5180aefab120bb7f INFO: 172.20.0.1:43372 - "POST /node/68d3bd1e5180aefab120bb7f HTTP/1.0" 202 Accepted 2025-09-26 09:43:09,012 - lava_callback - INFO - Starting async job submit for node 68d3bd1e5180aefab120bb7f 2025-09-26 09:43:09,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:43:09,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bd1e5180aefab120bb7f HTTP/1.1" 200 None 2025-09-26 09:43:09,037 - lava_callback - DEBUG - Processing node 68d3bd1e5180aefab120bb7f: ltp-watchqueue 2025-09-26 09:43:09,037 - lava_callback - ERROR - Error processing callback for node 68d3bd1e5180aefab120bb7f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:43:09,751 - lava_callback - INFO - Received callback for node 68d3bd215180aefab120bb85 INFO: 172.20.0.1:53514 - "POST /node/68d3bd215180aefab120bb85 HTTP/1.0" 202 Accepted 2025-09-26 09:43:09,761 - lava_callback - INFO - Starting async job submit for node 68d3bd215180aefab120bb85 2025-09-26 09:43:09,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:43:09,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bd215180aefab120bb85 HTTP/1.1" 200 None 2025-09-26 09:43:09,778 - lava_callback - DEBUG - Processing node 68d3bd215180aefab120bb85: ltp-watchqueue 2025-09-26 09:43:09,778 - lava_callback - ERROR - Error processing callback for node 68d3bd215180aefab120bb85: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:53518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53530 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:43:26,051 - lava_callback - INFO - Received callback for node 68d3bd255180aefab120bb8b INFO: 172.20.0.1:47698 - "POST /node/68d3bd255180aefab120bb8b HTTP/1.0" 202 Accepted 2025-09-26 09:43:26,061 - lava_callback - INFO - Starting async job submit for node 68d3bd255180aefab120bb8b 2025-09-26 09:43:26,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:43:26,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bd255180aefab120bb8b HTTP/1.1" 200 None 2025-09-26 09:43:26,091 - lava_callback - DEBUG - Processing node 68d3bd255180aefab120bb8b: ltp-watchqueue 2025-09-26 09:43:26,091 - lava_callback - ERROR - Error processing callback for node 68d3bd255180aefab120bb8b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:47702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42384 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:43:57,806 - lava_callback - INFO - Received callback for node 68d408e9cd36afa834e16d27 INFO: 172.20.0.1:42400 - "POST /node/68d408e9cd36afa834e16d27 HTTP/1.0" 202 Accepted 2025-09-26 09:43:57,817 - lava_callback - INFO - Starting async job submit for node 68d408e9cd36afa834e16d27 2025-09-26 09:43:57,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:43:57,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408e9cd36afa834e16d27 HTTP/1.1" 200 None 2025-09-26 09:43:57,873 - lava_callback - DEBUG - Processing node 68d408e9cd36afa834e16d27: baseline-arm 2025-09-26 09:43:58,300 - lava_callback - ERROR - Error processing callback for node 68d408e9cd36afa834e16d27: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:42040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42048 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:44:12,947 - lava_callback - INFO - Received callback for node 68d3bd555180aefab120bbf5 INFO: 172.20.0.1:58288 - "POST /node/68d3bd555180aefab120bbf5 HTTP/1.0" 202 Accepted 2025-09-26 09:44:12,955 - lava_callback - INFO - Starting async job submit for node 68d3bd555180aefab120bbf5 2025-09-26 09:44:12,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:44:12,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bd555180aefab120bbf5 HTTP/1.1" 200 None 2025-09-26 09:44:12,989 - lava_callback - DEBUG - Processing node 68d3bd555180aefab120bbf5: baseline-arm64 2025-09-26 09:44:12,989 - lava_callback - ERROR - Error processing callback for node 68d3bd555180aefab120bbf5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:44:13,651 - lava_callback - INFO - Received callback for node 68d3bd5f5180aefab120bc10 INFO: 172.20.0.1:58296 - "POST /node/68d3bd5f5180aefab120bc10 HTTP/1.0" 202 Accepted 2025-09-26 09:44:13,660 - lava_callback - INFO - Starting async job submit for node 68d3bd5f5180aefab120bc10 2025-09-26 09:44:13,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:44:13,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bd5f5180aefab120bc10 HTTP/1.1" 200 None 2025-09-26 09:44:13,688 - lava_callback - DEBUG - Processing node 68d3bd5f5180aefab120bc10: baseline-arm64 2025-09-26 09:44:13,688 - lava_callback - ERROR - Error processing callback for node 68d3bd5f5180aefab120bc10: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:58300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59558 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:44:32,866 - lava_callback - INFO - Received callback for node 68d3bd705180aefab120bc3d INFO: 172.20.0.1:47006 - "POST /node/68d3bd705180aefab120bc3d HTTP/1.0" 202 Accepted 2025-09-26 09:44:32,874 - lava_callback - INFO - Starting async job submit for node 68d3bd705180aefab120bc3d 2025-09-26 09:44:32,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:44:32,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bd705180aefab120bc3d HTTP/1.1" 200 None 2025-09-26 09:44:32,911 - lava_callback - DEBUG - Processing node 68d3bd705180aefab120bc3d: baseline-arm 2025-09-26 09:44:32,911 - lava_callback - ERROR - Error processing callback for node 68d3bd705180aefab120bc3d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:47010 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:44:45,507 - lava_callback - INFO - Received callback for node 68d3bc835180aefab120ba1a INFO: 172.20.0.1:60550 - "POST /node/68d3bc835180aefab120ba1a HTTP/1.0" 202 Accepted 2025-09-26 09:44:45,513 - lava_callback - INFO - Starting async job submit for node 68d3bc835180aefab120ba1a 2025-09-26 09:44:45,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:44:45,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bc835180aefab120ba1a HTTP/1.1" 200 None 2025-09-26 09:44:45,554 - lava_callback - DEBUG - Processing node 68d3bc835180aefab120ba1a: ltp-cap-bounds 2025-09-26 09:44:46,046 - lava_callback - ERROR - Error processing callback for node 68d3bc835180aefab120ba1a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:60562 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:44:52,984 - lava_callback - INFO - Received callback for node 68d3bd815180aefab120be29 INFO: 172.20.0.1:54680 - "POST /node/68d3bd815180aefab120be29 HTTP/1.0" 202 Accepted 2025-09-26 09:44:52,990 - lava_callback - INFO - Starting async job submit for node 68d3bd815180aefab120be29 2025-09-26 09:44:52,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:44:53,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bd815180aefab120be29 HTTP/1.1" 200 None 2025-09-26 09:44:53,005 - lava_callback - DEBUG - Processing node 68d3bd815180aefab120be29: baseline-arm 2025-09-26 09:44:53,005 - lava_callback - ERROR - Error processing callback for node 68d3bd815180aefab120be29: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:44:53,706 - lava_callback - INFO - Received callback for node 68d3bd875180aefab120be39 INFO: 172.20.0.1:54692 - "POST /node/68d3bd875180aefab120be39 HTTP/1.0" 202 Accepted 2025-09-26 09:44:53,712 - lava_callback - INFO - Starting async job submit for node 68d3bd875180aefab120be39 2025-09-26 09:44:53,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:44:53,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bd875180aefab120be39 HTTP/1.1" 200 None 2025-09-26 09:44:53,746 - lava_callback - DEBUG - Processing node 68d3bd875180aefab120be39: baseline-arm 2025-09-26 09:44:53,746 - lava_callback - ERROR - Error processing callback for node 68d3bd875180aefab120be39: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:54704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44440 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:45:08,273 - lava_callback - INFO - Received callback for node 68d3bd375180aefab120bbb7 INFO: 172.20.0.1:44454 - "POST /node/68d3bd375180aefab120bbb7 HTTP/1.0" 202 Accepted 2025-09-26 09:45:08,281 - lava_callback - INFO - Starting async job submit for node 68d3bd375180aefab120bbb7 2025-09-26 09:45:08,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:45:08,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bd375180aefab120bbb7 HTTP/1.1" 200 None 2025-09-26 09:45:08,359 - lava_callback - DEBUG - Processing node 68d3bd375180aefab120bbb7: baseline-arm64 2025-09-26 09:45:09,340 - lava_callback - ERROR - Error processing callback for node 68d3bd375180aefab120bbb7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 09:45:13,157 - lava_callback - INFO - Received callback for node 68d3bd8d5180aefab120be45 INFO: 172.20.0.1:59884 - "POST /node/68d3bd8d5180aefab120be45 HTTP/1.0" 202 Accepted 2025-09-26 09:45:13,165 - lava_callback - INFO - Starting async job submit for node 68d3bd8d5180aefab120be45 2025-09-26 09:45:13,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:45:13,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bd8d5180aefab120be45 HTTP/1.1" 200 None 2025-09-26 09:45:13,182 - lava_callback - DEBUG - Processing node 68d3bd8d5180aefab120be45: baseline-arm 2025-09-26 09:45:13,182 - lava_callback - ERROR - Error processing callback for node 68d3bd8d5180aefab120be45: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:45:13,857 - lava_callback - INFO - Received callback for node 68d3bda15180aefab120be71 INFO: 172.20.0.1:59898 - "POST /node/68d3bda15180aefab120be71 HTTP/1.0" 202 Accepted 2025-09-26 09:45:13,868 - lava_callback - INFO - Starting async job submit for node 68d3bda15180aefab120be71 2025-09-26 09:45:13,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:45:13,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bda15180aefab120be71 HTTP/1.1" 200 None 2025-09-26 09:45:13,890 - lava_callback - DEBUG - Processing node 68d3bda15180aefab120be71: baseline-arm 2025-09-26 09:45:13,890 - lava_callback - ERROR - Error processing callback for node 68d3bda15180aefab120be71: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:59904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36530 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:45:31,443 - lava_callback - INFO - Received callback for node 68d660492f83206171a900d2 INFO: 172.20.0.1:43034 - "POST /node/68d660492f83206171a900d2 HTTP/1.0" 202 Accepted 2025-09-26 09:45:31,453 - lava_callback - INFO - Starting async job submit for node 68d660492f83206171a900d2 2025-09-26 09:45:31,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:45:31,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660492f83206171a900d2 HTTP/1.1" 200 None 2025-09-26 09:45:31,544 - lava_callback - DEBUG - Processing node 68d660492f83206171a900d2: baseline-arm 2025-09-26 09:45:31,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:45:32,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:45:32,065 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d660492f83206171a900d2/log.txt.gz 2025-09-26 09:45:32,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:45:32,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:45:32,238 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d660492f83206171a900d2/lava_callback.json.gz 2025-09-26 09:45:32,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:45:32,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660492f83206171a900d2 HTTP/1.1" 200 None 2025-09-26 09:45:32,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:45:32,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c942f83206171a8fe61 HTTP/1.1" 200 None 2025-09-26 09:45:32,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:45:32,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660492f83206171a900d2 HTTP/1.1" 200 None 2025-09-26 09:45:32,377 - lava_callback - INFO - Completed processing callback for node 68d660492f83206171a900d2 2025-09-26 09:45:33,084 - lava_callback - INFO - Received callback for node 68d3bda95180aefab120bea1 INFO: 172.20.0.1:43046 - "POST /node/68d3bda95180aefab120bea1 HTTP/1.0" 202 Accepted 2025-09-26 09:45:33,094 - lava_callback - INFO - Starting async job submit for node 68d3bda95180aefab120bea1 2025-09-26 09:45:33,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:45:33,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bda95180aefab120bea1 HTTP/1.1" 200 None 2025-09-26 09:45:33,117 - lava_callback - DEBUG - Processing node 68d3bda95180aefab120bea1: baseline-arm 2025-09-26 09:45:33,117 - lava_callback - ERROR - Error processing callback for node 68d3bda95180aefab120bea1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:43050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58606 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:45:59,364 - lava_callback - INFO - Received callback for node 68d65c712f83206171a8fdb6 INFO: 172.20.0.1:42792 - "POST /node/68d65c712f83206171a8fdb6 HTTP/1.0" 202 Accepted 2025-09-26 09:45:59,373 - lava_callback - INFO - Starting async job submit for node 68d65c712f83206171a8fdb6 2025-09-26 09:45:59,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:45:59,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c712f83206171a8fdb6 HTTP/1.1" 200 None 2025-09-26 09:45:59,455 - lava_callback - DEBUG - Processing node 68d65c712f83206171a8fdb6: baseline-arm 2025-09-26 09:46:00,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:46:00,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:46:00,354 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d65c712f83206171a8fdb6/log.txt.gz 2025-09-26 09:46:00,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:46:00,728 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:46:00,728 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d65c712f83206171a8fdb6/lava_callback.json.gz DEBUG: Setup failed for 68d65c712f83206171a8fdb6. Transitting job node result: incomplete -> fail 2025-09-26 09:46:00,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:00,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c712f83206171a8fdb6 HTTP/1.1" 200 None 2025-09-26 09:46:00,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:00,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-26 09:46:00,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:01,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d65c712f83206171a8fdb6 HTTP/1.1" 200 None 2025-09-26 09:46:01,008 - lava_callback - INFO - Completed processing callback for node 68d65c712f83206171a8fdb6 INFO: 172.20.0.1:42794 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:46:01,843 - lava_callback - INFO - Received callback for node 68d3bd435180aefab120bbc4 INFO: 172.20.0.1:42800 - "POST /node/68d3bd435180aefab120bbc4 HTTP/1.0" 202 Accepted 2025-09-26 09:46:01,862 - lava_callback - INFO - Starting async job submit for node 68d3bd435180aefab120bbc4 2025-09-26 09:46:01,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:02,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bd435180aefab120bbc4 HTTP/1.1" 200 None 2025-09-26 09:46:02,027 - lava_callback - DEBUG - Processing node 68d3bd435180aefab120bbc4: baseline-arm64 2025-09-26 09:46:03,571 - lava_callback - ERROR - Error processing callback for node 68d3bd435180aefab120bbc4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:42808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60916 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:46:18,738 - lava_callback - INFO - Received callback for node 68d408eacd36afa834e16d2a INFO: 172.20.0.1:60926 - "POST /node/68d408eacd36afa834e16d2a HTTP/1.0" 202 Accepted 2025-09-26 09:46:18,744 - lava_callback - INFO - Starting async job submit for node 68d408eacd36afa834e16d2a 2025-09-26 09:46:18,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:18,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408eacd36afa834e16d2a HTTP/1.1" 200 None 2025-09-26 09:46:18,783 - lava_callback - DEBUG - Processing node 68d408eacd36afa834e16d2a: baseline-arm 2025-09-26 09:46:19,033 - lava_callback - ERROR - Error processing callback for node 68d408eacd36afa834e16d2a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 09:46:26,086 - lava_callback - INFO - Received callback for node 68d3bde65180aefab120bfa2 INFO: 172.20.0.1:48706 - "POST /node/68d3bde65180aefab120bfa2 HTTP/1.0" 202 Accepted 2025-09-26 09:46:26,092 - lava_callback - INFO - Starting async job submit for node 68d3bde65180aefab120bfa2 2025-09-26 09:46:26,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:26,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bde65180aefab120bfa2 HTTP/1.1" 200 None 2025-09-26 09:46:26,117 - lava_callback - DEBUG - Processing node 68d3bde65180aefab120bfa2: baseline-arm-broonie 2025-09-26 09:46:26,117 - lava_callback - ERROR - Error processing callback for node 68d3bde65180aefab120bfa2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:48722 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:46:26,793 - lava_callback - INFO - Received callback for node 68d660ae2f83206171a900f3 INFO: 172.20.0.1:48730 - "POST /node/68d660ae2f83206171a900f3 HTTP/1.0" 202 Accepted 2025-09-26 09:46:26,799 - lava_callback - INFO - Starting async job submit for node 68d660ae2f83206171a900f3 2025-09-26 09:46:26,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:26,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660ae2f83206171a900f3 HTTP/1.1" 200 None 2025-09-26 09:46:26,848 - lava_callback - DEBUG - Processing node 68d660ae2f83206171a900f3: baseline-arm 2025-09-26 09:46:27,091 - lava_callback - INFO - Received callback for node 68d3bd445180aefab120bbc8 INFO: 172.20.0.1:48742 - "POST /node/68d3bd445180aefab120bbc8 HTTP/1.0" 202 Accepted 2025-09-26 09:46:27,139 - lava_callback - INFO - Starting async job submit for node 68d3bd445180aefab120bbc8 2025-09-26 09:46:27,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:27,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:46:27,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bd445180aefab120bbc8 HTTP/1.1" 200 None 2025-09-26 09:46:27,314 - lava_callback - DEBUG - Processing node 68d3bd445180aefab120bbc8: baseline-arm64 2025-09-26 09:46:28,255 - lava_callback - ERROR - Error processing callback for node 68d3bd445180aefab120bbc8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 09:46:29,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:46:29,397 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d660ae2f83206171a900f3/log.txt.gz 2025-09-26 09:46:29,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:46:29,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:46:29,629 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d660ae2f83206171a900f3/lava_callback.json.gz 2025-09-26 09:46:29,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:29,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660ae2f83206171a900f3 HTTP/1.1" 200 None 2025-09-26 09:46:29,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:29,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-26 09:46:29,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:29,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660ae2f83206171a900f3 HTTP/1.1" 200 None 2025-09-26 09:46:29,751 - lava_callback - INFO - Completed processing callback for node 68d660ae2f83206171a900f3 INFO: 172.20.0.1:39526 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:46:38,741 - lava_callback - INFO - Received callback for node 68d660aa2f83206171a900e7 INFO: 172.20.0.1:39530 - "POST /node/68d660aa2f83206171a900e7 HTTP/1.0" 202 Accepted 2025-09-26 09:46:38,747 - lava_callback - INFO - Starting async job submit for node 68d660aa2f83206171a900e7 2025-09-26 09:46:38,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:38,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660aa2f83206171a900e7 HTTP/1.1" 200 None 2025-09-26 09:46:38,784 - lava_callback - DEBUG - Processing node 68d660aa2f83206171a900e7: baseline-arm 2025-09-26 09:46:39,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:46:41,185 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:46:41,186 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d660aa2f83206171a900e7/log.txt.gz 2025-09-26 09:46:41,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:46:43,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:46:43,528 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d660aa2f83206171a900e7/lava_callback.json.gz 2025-09-26 09:46:43,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:43,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660aa2f83206171a900e7 HTTP/1.1" 200 None 2025-09-26 09:46:43,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:43,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-26 09:46:43,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:43,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660aa2f83206171a900e7 HTTP/1.1" 200 None 2025-09-26 09:46:43,635 - lava_callback - INFO - Completed processing callback for node 68d660aa2f83206171a900e7 2025-09-26 09:46:46,176 - lava_callback - INFO - Received callback for node 68d3bdeb5180aefab120bfc9 INFO: 172.20.0.1:33838 - "POST /node/68d3bdeb5180aefab120bfc9 HTTP/1.0" 202 Accepted 2025-09-26 09:46:46,181 - lava_callback - INFO - Starting async job submit for node 68d3bdeb5180aefab120bfc9 2025-09-26 09:46:46,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:46,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bdeb5180aefab120bfc9 HTTP/1.1" 200 None 2025-09-26 09:46:46,197 - lava_callback - DEBUG - Processing node 68d3bdeb5180aefab120bfc9: baseline-arm-broonie 2025-09-26 09:46:46,197 - lava_callback - ERROR - Error processing callback for node 68d3bdeb5180aefab120bfc9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:33842 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:46:46,955 - lava_callback - INFO - Received callback for node 68d3bdf65180aefab120c06e INFO: 172.20.0.1:33854 - "POST /node/68d3bdf65180aefab120c06e HTTP/1.0" 202 Accepted 2025-09-26 09:46:46,960 - lava_callback - INFO - Starting async job submit for node 68d3bdf65180aefab120c06e 2025-09-26 09:46:46,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:46,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bdf65180aefab120c06e HTTP/1.1" 200 None 2025-09-26 09:46:46,976 - lava_callback - DEBUG - Processing node 68d3bdf65180aefab120c06e: baseline-arm-broonie 2025-09-26 09:46:46,976 - lava_callback - ERROR - Error processing callback for node 68d3bdf65180aefab120c06e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:46:47,809 - lava_callback - INFO - Received callback for node 68d3be015180aefab120c1c0 INFO: 172.20.0.1:33868 - "POST /node/68d3be015180aefab120c1c0 HTTP/1.0" 202 Accepted 2025-09-26 09:46:47,814 - lava_callback - INFO - Starting async job submit for node 68d3be015180aefab120c1c0 2025-09-26 09:46:47,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:47,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be015180aefab120c1c0 HTTP/1.1" 200 None 2025-09-26 09:46:47,829 - lava_callback - DEBUG - Processing node 68d3be015180aefab120c1c0: baseline-arm-broonie 2025-09-26 09:46:47,829 - lava_callback - ERROR - Error processing callback for node 68d3be015180aefab120c1c0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:46:49,735 - lava_callback - INFO - Received callback for node 68d660cb2f83206171a90169 INFO: 172.20.0.1:42470 - "POST /node/68d660cb2f83206171a90169 HTTP/1.0" 202 Accepted 2025-09-26 09:46:49,787 - lava_callback - INFO - Starting async job submit for node 68d660cb2f83206171a90169 2025-09-26 09:46:49,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:49,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660cb2f83206171a90169 HTTP/1.1" 200 None 2025-09-26 09:46:49,837 - lava_callback - DEBUG - Processing node 68d660cb2f83206171a90169: baseline-arm-pengutronix 2025-09-26 09:46:49,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:46:50,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:46:50,609 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d660cb2f83206171a90169/log.txt.gz 2025-09-26 09:46:50,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:46:50,756 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:46:50,757 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d660cb2f83206171a90169/lava_callback.json.gz 2025-09-26 09:46:50,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:50,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660cb2f83206171a90169 HTTP/1.1" 200 None 2025-09-26 09:46:50,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:50,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-26 09:46:50,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:50,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660cb2f83206171a90169 HTTP/1.1" 200 None 2025-09-26 09:46:50,844 - lava_callback - INFO - Completed processing callback for node 68d660cb2f83206171a90169 2025-09-26 09:46:54,968 - lava_callback - INFO - Received callback for node 68d660c82f83206171a90160 INFO: 172.20.0.1:42476 - "POST /node/68d660c82f83206171a90160 HTTP/1.0" 202 Accepted 2025-09-26 09:46:54,974 - lava_callback - INFO - Starting async job submit for node 68d660c82f83206171a90160 2025-09-26 09:46:54,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:55,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660c82f83206171a90160 HTTP/1.1" 200 None 2025-09-26 09:46:55,012 - lava_callback - DEBUG - Processing node 68d660c82f83206171a90160: baseline-arm-pengutronix 2025-09-26 09:46:55,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:46:55,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:46:55,254 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d660c82f83206171a90160/log.txt.gz 2025-09-26 09:46:55,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:46:56,191 - lava_callback - INFO - Received callback for node 68d660ca2f83206171a90166 INFO: 172.20.0.1:42490 - "POST /node/68d660ca2f83206171a90166 HTTP/1.0" 202 Accepted 2025-09-26 09:46:56,197 - lava_callback - INFO - Starting async job submit for node 68d660ca2f83206171a90166 2025-09-26 09:46:56,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:56,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660ca2f83206171a90166 HTTP/1.1" 200 None 2025-09-26 09:46:56,231 - lava_callback - DEBUG - Processing node 68d660ca2f83206171a90166: baseline-arm-pengutronix 2025-09-26 09:46:56,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:42502 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:46:57,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:46:57,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:46:57,603 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d660c82f83206171a90160/lava_callback.json.gz 2025-09-26 09:46:57,608 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d660ca2f83206171a90166/log.txt.gz 2025-09-26 09:46:57,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:57,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:46:57,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660c82f83206171a90160 HTTP/1.1" 200 None 2025-09-26 09:46:57,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:57,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-26 09:46:57,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:57,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660c82f83206171a90160 HTTP/1.1" 200 None 2025-09-26 09:46:57,691 - lava_callback - INFO - Completed processing callback for node 68d660c82f83206171a90160 2025-09-26 09:46:59,461 - lava_callback - INFO - Received callback for node 68d660ab2f83206171a900ea INFO: 172.20.0.1:56342 - "POST /node/68d660ab2f83206171a900ea HTTP/1.0" 202 Accepted 2025-09-26 09:46:59,468 - lava_callback - INFO - Starting async job submit for node 68d660ab2f83206171a900ea 2025-09-26 09:46:59,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:46:59,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660ab2f83206171a900ea HTTP/1.1" 200 None 2025-09-26 09:46:59,503 - lava_callback - DEBUG - Processing node 68d660ab2f83206171a900ea: baseline-arm 2025-09-26 09:46:59,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:47:00,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:47:00,005 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d660ca2f83206171a90166/lava_callback.json.gz 2025-09-26 09:47:00,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:47:00,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:00,032 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d660ab2f83206171a900ea/log.txt.gz 2025-09-26 09:47:00,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:47:00,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660ca2f83206171a90166 HTTP/1.1" 200 None 2025-09-26 09:47:00,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:00,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-26 09:47:00,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:00,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660ca2f83206171a90166 HTTP/1.1" 200 None 2025-09-26 09:47:00,106 - lava_callback - INFO - Completed processing callback for node 68d660ca2f83206171a90166 2025-09-26 09:47:00,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:47:00,221 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d660ab2f83206171a900ea/lava_callback.json.gz 2025-09-26 09:47:00,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:00,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660ab2f83206171a900ea HTTP/1.1" 200 None 2025-09-26 09:47:00,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:00,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-26 09:47:00,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:00,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660ab2f83206171a900ea HTTP/1.1" 200 None 2025-09-26 09:47:00,316 - lava_callback - INFO - Completed processing callback for node 68d660ab2f83206171a900ea INFO: 172.20.0.1:56346 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:47:06,223 - lava_callback - INFO - Received callback for node 68d3be0a5180aefab120c1dd INFO: 172.20.0.1:56352 - "POST /node/68d3be0a5180aefab120c1dd HTTP/1.0" 202 Accepted 2025-09-26 09:47:06,231 - lava_callback - INFO - Starting async job submit for node 68d3be0a5180aefab120c1dd 2025-09-26 09:47:06,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:06,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be0a5180aefab120c1dd HTTP/1.1" 200 None 2025-09-26 09:47:06,246 - lava_callback - DEBUG - Processing node 68d3be0a5180aefab120c1dd: baseline-arm-broonie 2025-09-26 09:47:06,246 - lava_callback - ERROR - Error processing callback for node 68d3be0a5180aefab120c1dd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:56368 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:47:07,094 - lava_callback - INFO - Received callback for node 68d3b215ce862aef57f99704 INFO: 172.20.0.1:56378 - "POST /node/68d3b215ce862aef57f99704 HTTP/1.0" 202 Accepted 2025-09-26 09:47:07,121 - lava_callback - INFO - Starting async job submit for node 68d3b215ce862aef57f99704 2025-09-26 09:47:09,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:09,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3b215ce862aef57f99704 HTTP/1.1" 200 None 2025-09-26 09:47:09,085 - lava_callback - DEBUG - Processing node 68d3b215ce862aef57f99704: ltp-syscalls 2025-09-26 09:47:10,064 - lava_callback - INFO - Received callback for node 68d3be0d5180aefab120c1e4 INFO: 172.20.0.1:40420 - "POST /node/68d3be0d5180aefab120c1e4 HTTP/1.0" 202 Accepted 2025-09-26 09:47:10,086 - lava_callback - INFO - Starting async job submit for node 68d3be0d5180aefab120c1e4 2025-09-26 09:47:10,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:10,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be0d5180aefab120c1e4 HTTP/1.1" 200 None 2025-09-26 09:47:10,184 - lava_callback - DEBUG - Processing node 68d3be0d5180aefab120c1e4: baseline-arm-clabbe 2025-09-26 09:47:10,189 - lava_callback - ERROR - Error processing callback for node 68d3be0d5180aefab120c1e4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:47:10,765 - lava_callback - INFO - Received callback for node 68d3be165180aefab120c204 INFO: 172.20.0.1:40436 - "POST /node/68d3be165180aefab120c204 HTTP/1.0" 202 Accepted 2025-09-26 09:47:10,776 - lava_callback - INFO - Starting async job submit for node 68d3be165180aefab120c204 2025-09-26 09:47:10,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:10,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be165180aefab120c204 HTTP/1.1" 200 None 2025-09-26 09:47:10,878 - lava_callback - DEBUG - Processing node 68d3be165180aefab120c204: baseline-arm-clabbe 2025-09-26 09:47:10,878 - lava_callback - ERROR - Error processing callback for node 68d3be165180aefab120c204: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:47:10,894 - lava_callback - INFO - Received callback for node 68d660bb2f83206171a90119 INFO: 172.20.0.1:40442 - "POST /node/68d660bb2f83206171a90119 HTTP/1.0" 202 Accepted 2025-09-26 09:47:10,931 - lava_callback - INFO - Starting async job submit for node 68d660bb2f83206171a90119 2025-09-26 09:47:10,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:11,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660bb2f83206171a90119 HTTP/1.1" 200 None 2025-09-26 09:47:11,060 - lava_callback - DEBUG - Processing node 68d660bb2f83206171a90119: baseline-arm-broonie 2025-09-26 09:47:11,594 - lava_callback - INFO - Received callback for node 68d660a72f83206171a900de 2025-09-26 09:47:11,631 - lava_callback - INFO - Starting async job submit for node 68d660a72f83206171a900de INFO: 172.20.0.1:40444 - "POST /node/68d660a72f83206171a900de HTTP/1.0" 202 Accepted 2025-09-26 09:47:11,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:47:11,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:11,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660a72f83206171a900de HTTP/1.1" 200 None 2025-09-26 09:47:11,767 - lava_callback - DEBUG - Processing node 68d660a72f83206171a900de: baseline-arm 2025-09-26 09:47:12,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:47:13,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:47:13,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:47:13,681 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d660bb2f83206171a90119/log.txt.gz 2025-09-26 09:47:13,706 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d660a72f83206171a900de/log.txt.gz 2025-09-26 09:47:13,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:47:13,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:40448 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 09:47:15,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:47:15,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:47:15,844 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d660bb2f83206171a90119/lava_callback.json.gz 2025-09-26 09:47:16,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:16,174 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d660a72f83206171a900de/lava_callback.json.gz 2025-09-26 09:47:16,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:16,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660bb2f83206171a90119 HTTP/1.1" 200 None 2025-09-26 09:47:16,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:16,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660a72f83206171a900de HTTP/1.1" 200 None 2025-09-26 09:47:16,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-26 09:47:16,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:16,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:16,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-26 09:47:16,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:16,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660bb2f83206171a90119 HTTP/1.1" 200 None 2025-09-26 09:47:16,447 - lava_callback - INFO - Completed processing callback for node 68d660bb2f83206171a90119 2025-09-26 09:47:16,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660a72f83206171a900de HTTP/1.1" 200 None 2025-09-26 09:47:16,518 - lava_callback - INFO - Completed processing callback for node 68d660a72f83206171a900de INFO: 172.20.0.1:40450 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:47:17,461 - lava_callback - ERROR - Error processing callback for node 68d3b215ce862aef57f99704: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:40456 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:47:20,535 - lava_callback - INFO - Received callback for node 68d660c12f83206171a9013c INFO: 172.20.0.1:51738 - "POST /node/68d660c12f83206171a9013c HTTP/1.0" 202 Accepted 2025-09-26 09:47:20,541 - lava_callback - INFO - Starting async job submit for node 68d660c12f83206171a9013c 2025-09-26 09:47:20,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:20,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660c12f83206171a9013c HTTP/1.1" 200 None 2025-09-26 09:47:20,589 - lava_callback - DEBUG - Processing node 68d660c12f83206171a9013c: baseline-arm-clabbe 2025-09-26 09:47:20,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:47:23,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:47:23,072 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d660c12f83206171a9013c/log.txt.gz 2025-09-26 09:47:23,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:47:25,401 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:47:25,401 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d660c12f83206171a9013c/lava_callback.json.gz 2025-09-26 09:47:25,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:25,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660c12f83206171a9013c HTTP/1.1" 200 None 2025-09-26 09:47:25,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:25,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-26 09:47:25,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:25,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660c12f83206171a9013c HTTP/1.1" 200 None 2025-09-26 09:47:25,496 - lava_callback - INFO - Completed processing callback for node 68d660c12f83206171a9013c INFO: 172.20.0.1:51752 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:47:28,985 - lava_callback - INFO - Received callback for node 68d660b12f83206171a900f9 INFO: 172.20.0.1:51758 - "POST /node/68d660b12f83206171a900f9 HTTP/1.0" 202 Accepted 2025-09-26 09:47:28,991 - lava_callback - INFO - Starting async job submit for node 68d660b12f83206171a900f9 2025-09-26 09:47:29,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:29,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660b12f83206171a900f9 HTTP/1.1" 200 None 2025-09-26 09:47:29,029 - lava_callback - DEBUG - Processing node 68d660b12f83206171a900f9: baseline-arm-baylibre 2025-09-26 09:47:29,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:47:29,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:47:29,409 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d660b12f83206171a900f9/log.txt.gz 2025-09-26 09:47:29,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:47:29,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:47:29,568 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d660b12f83206171a900f9/lava_callback.json.gz 2025-09-26 09:47:29,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:29,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660b12f83206171a900f9 HTTP/1.1" 200 None 2025-09-26 09:47:29,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:29,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-26 09:47:29,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:29,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660b12f83206171a900f9 HTTP/1.1" 200 None 2025-09-26 09:47:29,645 - lava_callback - INFO - Completed processing callback for node 68d660b12f83206171a900f9 2025-09-26 09:47:30,149 - lava_callback - INFO - Received callback for node 68d3be1d5180aefab120c21c INFO: 172.20.0.1:58966 - "POST /node/68d3be1d5180aefab120c21c HTTP/1.0" 202 Accepted 2025-09-26 09:47:30,155 - lava_callback - INFO - Starting async job submit for node 68d3be1d5180aefab120c21c 2025-09-26 09:47:30,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:30,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be1d5180aefab120c21c HTTP/1.1" 200 None 2025-09-26 09:47:30,168 - lava_callback - DEBUG - Processing node 68d3be1d5180aefab120c21c: baseline-arm-clabbe 2025-09-26 09:47:30,168 - lava_callback - ERROR - Error processing callback for node 68d3be1d5180aefab120c21c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:47:30,805 - lava_callback - INFO - Received callback for node 68d3be285180aefab120c25c INFO: 172.20.0.1:58968 - "POST /node/68d3be285180aefab120c25c HTTP/1.0" 202 Accepted 2025-09-26 09:47:30,811 - lava_callback - INFO - Starting async job submit for node 68d3be285180aefab120c25c 2025-09-26 09:47:30,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:30,812 - lava_callback - INFO - Received callback for node 68d660bb2f83206171a9011d INFO: 172.20.0.1:58980 - "POST /node/68d660bb2f83206171a9011d HTTP/1.0" 202 Accepted 2025-09-26 09:47:30,818 - lava_callback - INFO - Starting async job submit for node 68d660bb2f83206171a9011d 2025-09-26 09:47:30,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:30,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be285180aefab120c25c HTTP/1.1" 200 None 2025-09-26 09:47:30,851 - lava_callback - DEBUG - Processing node 68d3be285180aefab120c25c: baseline-arm-clabbe 2025-09-26 09:47:30,851 - lava_callback - ERROR - Error processing callback for node 68d3be285180aefab120c25c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:47:30,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660bb2f83206171a9011d HTTP/1.1" 200 None 2025-09-26 09:47:30,879 - lava_callback - DEBUG - Processing node 68d660bb2f83206171a9011d: baseline-arm-broonie 2025-09-26 09:47:31,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:47:31,471 - lava_callback - INFO - Received callback for node 68d3be1b5180aefab120c213 INFO: 172.20.0.1:58992 - "POST /node/68d3be1b5180aefab120c213 HTTP/1.0" 202 Accepted 2025-09-26 09:47:31,477 - lava_callback - INFO - Starting async job submit for node 68d3be1b5180aefab120c213 2025-09-26 09:47:31,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:31,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be1b5180aefab120c213 HTTP/1.1" 200 None 2025-09-26 09:47:31,491 - lava_callback - DEBUG - Processing node 68d3be1b5180aefab120c213: baseline-arm-clabbe 2025-09-26 09:47:31,491 - lava_callback - ERROR - Error processing callback for node 68d3be1b5180aefab120c213: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:47:32,137 - lava_callback - INFO - Received callback for node 68d660b92f83206171a9010b INFO: 172.20.0.1:59008 - "POST /node/68d660b92f83206171a9010b HTTP/1.0" 202 Accepted 2025-09-26 09:47:32,143 - lava_callback - INFO - Starting async job submit for node 68d660b92f83206171a9010b 2025-09-26 09:47:32,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:32,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660b92f83206171a9010b HTTP/1.1" 200 None 2025-09-26 09:47:32,183 - lava_callback - DEBUG - Processing node 68d660b92f83206171a9010b: baseline-arm-baylibre 2025-09-26 09:47:32,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:47:32,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:47:32,551 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d660bb2f83206171a9011d/log.txt.gz 2025-09-26 09:47:32,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:47:32,553 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d660b92f83206171a9010b/log.txt.gz 2025-09-26 09:47:32,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:47:32,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:47:34,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:47:34,881 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d660bb2f83206171a9011d/lava_callback.json.gz 2025-09-26 09:47:34,897 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:47:34,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:34,905 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d660b92f83206171a9010b/lava_callback.json.gz 2025-09-26 09:47:34,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:34,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660bb2f83206171a9011d HTTP/1.1" 200 None 2025-09-26 09:47:34,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:34,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660b92f83206171a9010b HTTP/1.1" 200 None 2025-09-26 09:47:34,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:34,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-26 09:47:34,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:34,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-26 09:47:34,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:35,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660b92f83206171a9010b HTTP/1.1" 200 None 2025-09-26 09:47:35,018 - lava_callback - INFO - Completed processing callback for node 68d660b92f83206171a9010b 2025-09-26 09:47:35,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660bb2f83206171a9011d HTTP/1.1" 200 None 2025-09-26 09:47:35,019 - lava_callback - INFO - Completed processing callback for node 68d660bb2f83206171a9011d INFO: 172.20.0.1:59012 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:47:40,208 - lava_callback - INFO - Received callback for node 68d660c72f83206171a90157 INFO: 172.20.0.1:60042 - "POST /node/68d660c72f83206171a90157 HTTP/1.0" 202 Accepted 2025-09-26 09:47:40,214 - lava_callback - INFO - Starting async job submit for node 68d660c72f83206171a90157 2025-09-26 09:47:40,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:40,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660c72f83206171a90157 HTTP/1.1" 200 None 2025-09-26 09:47:40,262 - lava_callback - DEBUG - Processing node 68d660c72f83206171a90157: baseline-arm-kontron 2025-09-26 09:47:40,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:47:40,513 - lava_callback - INFO - Received callback for node 68d3bd525180aefab120bbf3 INFO: 172.20.0.1:60048 - "POST /node/68d3bd525180aefab120bbf3 HTTP/1.0" 202 Accepted 2025-09-26 09:47:40,521 - lava_callback - INFO - Starting async job submit for node 68d3bd525180aefab120bbf3 2025-09-26 09:47:40,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:40,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bd525180aefab120bbf3 HTTP/1.1" 200 None 2025-09-26 09:47:40,577 - lava_callback - DEBUG - Processing node 68d3bd525180aefab120bbf3: baseline-arm64 2025-09-26 09:47:41,505 - lava_callback - ERROR - Error processing callback for node 68d3bd525180aefab120bbf3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 09:47:41,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:47:41,942 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-68d660c72f83206171a90157/log.txt.gz 2025-09-26 09:47:41,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:47:43,900 - lava_callback - INFO - Received callback for node 68d660b92f83206171a90111 INFO: 172.20.0.1:60062 - "POST /node/68d660b92f83206171a90111 HTTP/1.0" 202 Accepted 2025-09-26 09:47:43,906 - lava_callback - INFO - Starting async job submit for node 68d660b92f83206171a90111 2025-09-26 09:47:43,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:43,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660b92f83206171a90111 HTTP/1.1" 200 None 2025-09-26 09:47:43,960 - lava_callback - DEBUG - Processing node 68d660b92f83206171a90111: baseline-arm-baylibre 2025-09-26 09:47:44,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:47:44,255 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:47:44,256 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-68d660c72f83206171a90157/lava_callback.json.gz 2025-09-26 09:47:44,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:44,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660c72f83206171a90157 HTTP/1.1" 200 None 2025-09-26 09:47:44,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:44,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-26 09:47:44,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:44,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660c72f83206171a90157 HTTP/1.1" 200 None 2025-09-26 09:47:44,350 - lava_callback - INFO - Completed processing callback for node 68d660c72f83206171a90157 2025-09-26 09:47:44,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:47:44,472 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d660b92f83206171a90111/log.txt.gz 2025-09-26 09:47:44,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:47:44,663 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:47:44,663 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d660b92f83206171a90111/lava_callback.json.gz 2025-09-26 09:47:44,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:44,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660b92f83206171a90111 HTTP/1.1" 200 None 2025-09-26 09:47:44,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:44,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-26 09:47:44,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:44,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660b92f83206171a90111 HTTP/1.1" 200 None 2025-09-26 09:47:44,766 - lava_callback - INFO - Completed processing callback for node 68d660b92f83206171a90111 2025-09-26 09:47:45,412 - lava_callback - INFO - Received callback for node 68d660b32f83206171a900fc INFO: 172.20.0.1:60070 - "POST /node/68d660b32f83206171a900fc HTTP/1.0" 202 Accepted 2025-09-26 09:47:45,418 - lava_callback - INFO - Starting async job submit for node 68d660b32f83206171a900fc 2025-09-26 09:47:45,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:45,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660b32f83206171a900fc HTTP/1.1" 200 None 2025-09-26 09:47:45,452 - lava_callback - DEBUG - Processing node 68d660b32f83206171a900fc: baseline-arm-baylibre 2025-09-26 09:47:45,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:47:45,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:47:45,765 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d660b32f83206171a900fc/log.txt.gz 2025-09-26 09:47:45,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:47:45,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:47:45,884 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d660b32f83206171a900fc/lava_callback.json.gz 2025-09-26 09:47:45,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:45,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660b32f83206171a900fc HTTP/1.1" 200 None 2025-09-26 09:47:45,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:45,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-26 09:47:45,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:45,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660b32f83206171a900fc HTTP/1.1" 200 None 2025-09-26 09:47:45,984 - lava_callback - INFO - Completed processing callback for node 68d660b32f83206171a900fc INFO: 172.20.0.1:60082 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:47:50,046 - lava_callback - INFO - Received callback for node 68d3be2c5180aefab120c266 INFO: 172.20.0.1:45988 - "POST /node/68d3be2c5180aefab120c266 HTTP/1.0" 202 Accepted 2025-09-26 09:47:50,054 - lava_callback - INFO - Starting async job submit for node 68d3be2c5180aefab120c266 2025-09-26 09:47:50,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:50,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be2c5180aefab120c266 HTTP/1.1" 200 None 2025-09-26 09:47:50,072 - lava_callback - DEBUG - Processing node 68d3be2c5180aefab120c266: baseline-arm-clabbe 2025-09-26 09:47:50,072 - lava_callback - ERROR - Error processing callback for node 68d3be2c5180aefab120c266: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:47:50,681 - lava_callback - INFO - Received callback for node 68d3be355180aefab120c27f INFO: 172.20.0.1:45998 - "POST /node/68d3be355180aefab120c27f HTTP/1.0" 202 Accepted 2025-09-26 09:47:50,686 - lava_callback - INFO - Starting async job submit for node 68d3be355180aefab120c27f 2025-09-26 09:47:50,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:50,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be355180aefab120c27f HTTP/1.1" 200 None 2025-09-26 09:47:50,701 - lava_callback - DEBUG - Processing node 68d3be355180aefab120c27f: baseline-arm-clabbe 2025-09-26 09:47:50,701 - lava_callback - ERROR - Error processing callback for node 68d3be355180aefab120c27f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:47:51,314 - lava_callback - INFO - Received callback for node 68d3be365180aefab120c285 INFO: 172.20.0.1:46014 - "POST /node/68d3be365180aefab120c285 HTTP/1.0" 202 Accepted 2025-09-26 09:47:51,321 - lava_callback - INFO - Starting async job submit for node 68d3be365180aefab120c285 2025-09-26 09:47:51,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:51,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be365180aefab120c285 HTTP/1.1" 200 None 2025-09-26 09:47:51,338 - lava_callback - DEBUG - Processing node 68d3be365180aefab120c285: baseline-arm-clabbe 2025-09-26 09:47:51,338 - lava_callback - ERROR - Error processing callback for node 68d3be365180aefab120c285: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:47:52,584 - lava_callback - INFO - Received callback for node 68d3be335180aefab120c279 INFO: 172.20.0.1:46016 - "POST /node/68d3be335180aefab120c279 HTTP/1.0" 202 Accepted 2025-09-26 09:47:52,592 - lava_callback - INFO - Starting async job submit for node 68d3be335180aefab120c279 2025-09-26 09:47:52,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:52,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be335180aefab120c279 HTTP/1.1" 200 None 2025-09-26 09:47:52,610 - lava_callback - DEBUG - Processing node 68d3be335180aefab120c279: baseline-arm-clabbe 2025-09-26 09:47:52,610 - lava_callback - ERROR - Error processing callback for node 68d3be335180aefab120c279: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:47:53,215 - lava_callback - INFO - Received callback for node 68d3be3c5180aefab120c459 INFO: 172.20.0.1:46018 - "POST /node/68d3be3c5180aefab120c459 HTTP/1.0" 202 Accepted 2025-09-26 09:47:53,220 - lava_callback - INFO - Starting async job submit for node 68d3be3c5180aefab120c459 2025-09-26 09:47:53,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:53,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be3c5180aefab120c459 HTTP/1.1" 200 None 2025-09-26 09:47:53,238 - lava_callback - DEBUG - Processing node 68d3be3c5180aefab120c459: baseline-arm-clabbe 2025-09-26 09:47:53,238 - lava_callback - ERROR - Error processing callback for node 68d3be3c5180aefab120c459: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:47:54,640 - lava_callback - INFO - Received callback for node 68d660b82f83206171a90102 INFO: 172.20.0.1:46024 - "POST /node/68d660b82f83206171a90102 HTTP/1.0" 202 Accepted 2025-09-26 09:47:54,646 - lava_callback - INFO - Starting async job submit for node 68d660b82f83206171a90102 2025-09-26 09:47:54,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:54,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660b82f83206171a90102 HTTP/1.1" 200 None 2025-09-26 09:47:54,682 - lava_callback - DEBUG - Processing node 68d660b82f83206171a90102: baseline-arm-baylibre 2025-09-26 09:47:54,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:47:56,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:47:56,194 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d660b82f83206171a90102/log.txt.gz 2025-09-26 09:47:56,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:46040 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:47:58,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:47:58,527 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d660b82f83206171a90102/lava_callback.json.gz 2025-09-26 09:47:58,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:58,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660b82f83206171a90102 HTTP/1.1" 200 None 2025-09-26 09:47:58,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:58,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-26 09:47:58,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:47:58,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660b82f83206171a90102 HTTP/1.1" 200 None 2025-09-26 09:47:58,624 - lava_callback - INFO - Completed processing callback for node 68d660b82f83206171a90102 2025-09-26 09:48:00,226 - lava_callback - INFO - Received callback for node 68d660c82f83206171a9015d INFO: 172.20.0.1:58636 - "POST /node/68d660c82f83206171a9015d HTTP/1.0" 202 Accepted 2025-09-26 09:48:00,232 - lava_callback - INFO - Starting async job submit for node 68d660c82f83206171a9015d 2025-09-26 09:48:00,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:48:00,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660c82f83206171a9015d HTTP/1.1" 200 None 2025-09-26 09:48:00,270 - lava_callback - DEBUG - Processing node 68d660c82f83206171a9015d: baseline-arm-kontron 2025-09-26 09:48:00,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:48:00,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:48:00,888 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-68d660c82f83206171a9015d/log.txt.gz 2025-09-26 09:48:00,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:48:01,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:48:01,024 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-68d660c82f83206171a9015d/lava_callback.json.gz 2025-09-26 09:48:01,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:48:01,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660c82f83206171a9015d HTTP/1.1" 200 None 2025-09-26 09:48:01,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:48:01,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-26 09:48:01,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:48:01,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660c82f83206171a9015d HTTP/1.1" 200 None 2025-09-26 09:48:01,134 - lava_callback - INFO - Completed processing callback for node 68d660c82f83206171a9015d INFO: 172.20.0.1:58640 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:48:02,636 - lava_callback - INFO - Received callback for node 68d3b9ab5180aefab120b492 INFO: 172.20.0.1:58650 - "POST /node/68d3b9ab5180aefab120b492 HTTP/1.0" 202 Accepted 2025-09-26 09:48:02,642 - lava_callback - INFO - Starting async job submit for node 68d3b9ab5180aefab120b492 2025-09-26 09:48:02,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:48:02,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3b9ab5180aefab120b492 HTTP/1.1" 200 None 2025-09-26 09:48:02,686 - lava_callback - DEBUG - Processing node 68d3b9ab5180aefab120b492: baseline-arm 2025-09-26 09:48:02,899 - lava_callback - INFO - Received callback for node 68d660b52f83206171a900ff INFO: 172.20.0.1:58652 - "POST /node/68d660b52f83206171a900ff HTTP/1.0" 202 Accepted 2025-09-26 09:48:02,910 - lava_callback - INFO - Starting async job submit for node 68d660b52f83206171a900ff 2025-09-26 09:48:02,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:48:03,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660b52f83206171a900ff HTTP/1.1" 200 None 2025-09-26 09:48:03,012 - lava_callback - ERROR - Error processing callback for node 68d3b9ab5180aefab120b492: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 09:48:03,013 - lava_callback - DEBUG - Processing node 68d660b52f83206171a900ff: baseline-arm-baylibre 2025-09-26 09:48:03,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:48:03,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:48:03,317 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d660b52f83206171a900ff/log.txt.gz 2025-09-26 09:48:03,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:48:05,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:48:05,652 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d660b52f83206171a900ff/lava_callback.json.gz 2025-09-26 09:48:05,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:48:05,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660b52f83206171a900ff HTTP/1.1" 200 None 2025-09-26 09:48:05,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:48:05,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-26 09:48:05,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:48:05,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660b52f83206171a900ff HTTP/1.1" 200 None 2025-09-26 09:48:05,741 - lava_callback - INFO - Completed processing callback for node 68d660b52f83206171a900ff INFO: 172.20.0.1:58654 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:48:10,077 - lava_callback - INFO - Received callback for node 68d3be4b5180aefab120c487 INFO: 172.20.0.1:50896 - "POST /node/68d3be4b5180aefab120c487 HTTP/1.0" 202 Accepted 2025-09-26 09:48:10,082 - lava_callback - INFO - Starting async job submit for node 68d3be4b5180aefab120c487 2025-09-26 09:48:10,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:48:10,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be4b5180aefab120c487 HTTP/1.1" 200 None 2025-09-26 09:48:10,102 - lava_callback - DEBUG - Processing node 68d3be4b5180aefab120c487: baseline-arm-clabbe 2025-09-26 09:48:10,102 - lava_callback - ERROR - Error processing callback for node 68d3be4b5180aefab120c487: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:50900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50920 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:48:26,449 - lava_callback - INFO - Received callback for node 68d3be5c5180aefab120c4af INFO: 172.20.0.1:45418 - "POST /node/68d3be5c5180aefab120c4af HTTP/1.0" 202 Accepted 2025-09-26 09:48:26,455 - lava_callback - INFO - Starting async job submit for node 68d3be5c5180aefab120c4af 2025-09-26 09:48:26,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:48:26,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be5c5180aefab120c4af HTTP/1.1" 200 None 2025-09-26 09:48:26,469 - lava_callback - DEBUG - Processing node 68d3be5c5180aefab120c4af: ltp-cap-bounds 2025-09-26 09:48:26,469 - lava_callback - ERROR - Error processing callback for node 68d3be5c5180aefab120c4af: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:45432 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:48:30,071 - lava_callback - INFO - Received callback for node 68d3be555180aefab120c4a0 INFO: 172.20.0.1:52154 - "POST /node/68d3be555180aefab120c4a0 HTTP/1.0" 202 Accepted 2025-09-26 09:48:30,076 - lava_callback - INFO - Starting async job submit for node 68d3be555180aefab120c4a0 2025-09-26 09:48:30,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:48:30,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be555180aefab120c4a0 HTTP/1.1" 200 None 2025-09-26 09:48:30,099 - lava_callback - DEBUG - Processing node 68d3be555180aefab120c4a0: baseline-arm-clabbe 2025-09-26 09:48:30,099 - lava_callback - ERROR - Error processing callback for node 68d3be555180aefab120c4a0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:48:30,495 - lava_callback - INFO - Received callback for node 68d408f2cd36afa834e16d33 INFO: 172.20.0.1:52162 - "POST /node/68d408f2cd36afa834e16d33 HTTP/1.0" 202 Accepted 2025-09-26 09:48:30,501 - lava_callback - INFO - Starting async job submit for node 68d408f2cd36afa834e16d33 2025-09-26 09:48:30,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:48:30,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408f2cd36afa834e16d33 HTTP/1.1" 200 None 2025-09-26 09:48:30,541 - lava_callback - DEBUG - Processing node 68d408f2cd36afa834e16d33: baseline-arm 2025-09-26 09:48:30,761 - lava_callback - ERROR - Error processing callback for node 68d408f2cd36afa834e16d33: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:52166 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:48:46,276 - lava_callback - INFO - Received callback for node 68d3be635180aefab120c4c0 INFO: 172.20.0.1:37508 - "POST /node/68d3be635180aefab120c4c0 HTTP/1.0" 202 Accepted 2025-09-26 09:48:46,282 - lava_callback - INFO - Starting async job submit for node 68d3be635180aefab120c4c0 2025-09-26 09:48:46,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:48:46,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be635180aefab120c4c0 HTTP/1.1" 200 None 2025-09-26 09:48:46,295 - lava_callback - DEBUG - Processing node 68d3be635180aefab120c4c0: ltp-containers 2025-09-26 09:48:46,295 - lava_callback - ERROR - Error processing callback for node 68d3be635180aefab120c4c0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:37512 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:48:47,049 - lava_callback - INFO - Received callback for node 68d3be6e5180aefab120c4f4 INFO: 172.20.0.1:37526 - "POST /node/68d3be6e5180aefab120c4f4 HTTP/1.0" 202 Accepted 2025-09-26 09:48:47,055 - lava_callback - INFO - Starting async job submit for node 68d3be6e5180aefab120c4f4 2025-09-26 09:48:47,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:48:47,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be6e5180aefab120c4f4 HTTP/1.1" 200 None 2025-09-26 09:48:47,068 - lava_callback - DEBUG - Processing node 68d3be6e5180aefab120c4f4: ltp-controllers 2025-09-26 09:48:47,068 - lava_callback - ERROR - Error processing callback for node 68d3be6e5180aefab120c4f4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:48:47,835 - lava_callback - INFO - Received callback for node 68d3be765180aefab120c508 INFO: 172.20.0.1:37538 - "POST /node/68d3be765180aefab120c508 HTTP/1.0" 202 Accepted 2025-09-26 09:48:47,844 - lava_callback - INFO - Starting async job submit for node 68d3be765180aefab120c508 2025-09-26 09:48:47,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:48:47,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be765180aefab120c508 HTTP/1.1" 200 None 2025-09-26 09:48:47,861 - lava_callback - DEBUG - Processing node 68d3be765180aefab120c508: ltp-cve 2025-09-26 09:48:47,862 - lava_callback - ERROR - Error processing callback for node 68d3be765180aefab120c508: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:48674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34272 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:49:03,608 - lava_callback - INFO - Received callback for node 68d660c32f83206171a9014b INFO: 172.20.0.1:34276 - "POST /node/68d660c32f83206171a9014b HTTP/1.0" 202 Accepted 2025-09-26 09:49:03,614 - lava_callback - INFO - Starting async job submit for node 68d660c32f83206171a9014b 2025-09-26 09:49:03,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:03,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660c32f83206171a9014b HTTP/1.1" 200 None 2025-09-26 09:49:03,647 - lava_callback - DEBUG - Processing node 68d660c32f83206171a9014b: baseline-arm-clabbe 2025-09-26 09:49:03,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:49:04,999 - lava_callback - INFO - Received callback for node 68d660d02f83206171a9017b INFO: 172.20.0.1:34282 - "POST /node/68d660d02f83206171a9017b HTTP/1.0" 202 Accepted 2025-09-26 09:49:05,005 - lava_callback - INFO - Starting async job submit for node 68d660d02f83206171a9017b 2025-09-26 09:49:05,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:05,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660d02f83206171a9017b HTTP/1.1" 200 None 2025-09-26 09:49:05,052 - lava_callback - DEBUG - Processing node 68d660d02f83206171a9017b: ltp-dio 2025-09-26 09:49:05,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:49:05,754 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:49:05,755 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d660c32f83206171a9014b/log.txt.gz 2025-09-26 09:49:05,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:49:05,766 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:49:05,767 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-68d660d02f83206171a9017b/log.txt.gz 2025-09-26 09:49:05,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:49:06,229 - lava_callback - INFO - Received callback for node 68d3be7c5180aefab120c512 INFO: 172.20.0.1:34286 - "POST /node/68d3be7c5180aefab120c512 HTTP/1.0" 202 Accepted 2025-09-26 09:49:06,235 - lava_callback - INFO - Starting async job submit for node 68d3be7c5180aefab120c512 2025-09-26 09:49:06,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:06,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be7c5180aefab120c512 HTTP/1.1" 200 None 2025-09-26 09:49:06,248 - lava_callback - DEBUG - Processing node 68d3be7c5180aefab120c512: ltp-cap-bounds 2025-09-26 09:49:06,248 - lava_callback - ERROR - Error processing callback for node 68d3be7c5180aefab120c512: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:34296 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:49:07,033 - lava_callback - INFO - Received callback for node 68d3be825180aefab120c523 INFO: 172.20.0.1:34298 - "POST /node/68d3be825180aefab120c523 HTTP/1.0" 202 Accepted 2025-09-26 09:49:07,039 - lava_callback - INFO - Starting async job submit for node 68d3be825180aefab120c523 2025-09-26 09:49:07,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:07,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be825180aefab120c523 HTTP/1.1" 200 None 2025-09-26 09:49:07,052 - lava_callback - DEBUG - Processing node 68d3be825180aefab120c523: ltp-containers 2025-09-26 09:49:07,052 - lava_callback - ERROR - Error processing callback for node 68d3be825180aefab120c523: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:49:07,849 - lava_callback - INFO - Received callback for node 68d3be845180aefab120c527 INFO: 172.20.0.1:34302 - "POST /node/68d3be845180aefab120c527 HTTP/1.0" 202 Accepted 2025-09-26 09:49:07,858 - lava_callback - INFO - Starting async job submit for node 68d3be845180aefab120c527 2025-09-26 09:49:07,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:07,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be845180aefab120c527 HTTP/1.1" 200 None 2025-09-26 09:49:07,893 - lava_callback - DEBUG - Processing node 68d3be845180aefab120c527: ltp-fs-bind 2025-09-26 09:49:07,893 - lava_callback - ERROR - Error processing callback for node 68d3be845180aefab120c527: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:49:08,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:49:08,086 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-68d660d02f83206171a9017b/lava_callback.json.gz 2025-09-26 09:49:08,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:49:08,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:08,138 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d660c32f83206171a9014b/lava_callback.json.gz 2025-09-26 09:49:08,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:08,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660d02f83206171a9017b HTTP/1.1" 200 None 2025-09-26 09:49:08,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:08,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660c32f83206171a9014b HTTP/1.1" 200 None 2025-09-26 09:49:08,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:08,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-26 09:49:08,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:08,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-26 09:49:08,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:08,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660c32f83206171a9014b HTTP/1.1" 200 None 2025-09-26 09:49:08,239 - lava_callback - INFO - Completed processing callback for node 68d660c32f83206171a9014b 2025-09-26 09:49:08,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660d02f83206171a9017b HTTP/1.1" 200 None 2025-09-26 09:49:08,272 - lava_callback - INFO - Completed processing callback for node 68d660d02f83206171a9017b 2025-09-26 09:49:08,630 - lava_callback - INFO - Received callback for node 68d3be885180aefab120c530 INFO: 172.20.0.1:34314 - "POST /node/68d3be885180aefab120c530 HTTP/1.0" 202 Accepted 2025-09-26 09:49:08,639 - lava_callback - INFO - Starting async job submit for node 68d3be885180aefab120c530 2025-09-26 09:49:08,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:08,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be885180aefab120c530 HTTP/1.1" 200 None 2025-09-26 09:49:08,653 - lava_callback - DEBUG - Processing node 68d3be885180aefab120c530: ltp-cap-bounds 2025-09-26 09:49:08,654 - lava_callback - ERROR - Error processing callback for node 68d3be885180aefab120c530: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:49:09,399 - lava_callback - INFO - Received callback for node 68d3be8a5180aefab120c533 INFO: 172.20.0.1:47900 - "POST /node/68d3be8a5180aefab120c533 HTTP/1.0" 202 Accepted 2025-09-26 09:49:09,409 - lava_callback - INFO - Starting async job submit for node 68d3be8a5180aefab120c533 2025-09-26 09:49:09,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:09,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be8a5180aefab120c533 HTTP/1.1" 200 None 2025-09-26 09:49:09,425 - lava_callback - DEBUG - Processing node 68d3be8a5180aefab120c533: ltp-controllers 2025-09-26 09:49:09,425 - lava_callback - ERROR - Error processing callback for node 68d3be8a5180aefab120c533: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:49:10,152 - lava_callback - INFO - Received callback for node 68d3be8d5180aefab120c53b INFO: 172.20.0.1:47916 - "POST /node/68d3be8d5180aefab120c53b HTTP/1.0" 202 Accepted 2025-09-26 09:49:10,157 - lava_callback - INFO - Starting async job submit for node 68d3be8d5180aefab120c53b 2025-09-26 09:49:10,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:10,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be8d5180aefab120c53b HTTP/1.1" 200 None 2025-09-26 09:49:10,173 - lava_callback - DEBUG - Processing node 68d3be8d5180aefab120c53b: ltp-fsx 2025-09-26 09:49:10,173 - lava_callback - ERROR - Error processing callback for node 68d3be8d5180aefab120c53b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:47932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47950 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:49:26,225 - lava_callback - INFO - Received callback for node 68d3be905180aefab120c544 INFO: 172.20.0.1:40038 - "POST /node/68d3be905180aefab120c544 HTTP/1.0" 202 Accepted 2025-09-26 09:49:26,234 - lava_callback - INFO - Starting async job submit for node 68d3be905180aefab120c544 2025-09-26 09:49:26,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:26,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be905180aefab120c544 HTTP/1.1" 200 None 2025-09-26 09:49:26,251 - lava_callback - DEBUG - Processing node 68d3be905180aefab120c544: ltp-containers 2025-09-26 09:49:26,251 - lava_callback - ERROR - Error processing callback for node 68d3be905180aefab120c544: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:40050 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:49:27,010 - lava_callback - INFO - Received callback for node 68d3be925180aefab120c54a INFO: 172.20.0.1:40062 - "POST /node/68d3be925180aefab120c54a HTTP/1.0" 202 Accepted 2025-09-26 09:49:27,019 - lava_callback - INFO - Starting async job submit for node 68d3be925180aefab120c54a 2025-09-26 09:49:27,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:27,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be925180aefab120c54a HTTP/1.1" 200 None 2025-09-26 09:49:27,035 - lava_callback - DEBUG - Processing node 68d3be925180aefab120c54a: ltp-cve 2025-09-26 09:49:27,035 - lava_callback - ERROR - Error processing callback for node 68d3be925180aefab120c54a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:49:27,744 - lava_callback - INFO - Received callback for node 68d3be955180aefab120c551 INFO: 172.20.0.1:40072 - "POST /node/68d3be955180aefab120c551 HTTP/1.0" 202 Accepted 2025-09-26 09:49:27,754 - lava_callback - INFO - Starting async job submit for node 68d3be955180aefab120c551 2025-09-26 09:49:27,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:27,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be955180aefab120c551 HTTP/1.1" 200 None 2025-09-26 09:49:27,769 - lava_callback - DEBUG - Processing node 68d3be955180aefab120c551: ltp-input 2025-09-26 09:49:27,769 - lava_callback - ERROR - Error processing callback for node 68d3be955180aefab120c551: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:49:28,515 - lava_callback - INFO - Received callback for node 68d3be985180aefab120c557 INFO: 172.20.0.1:40080 - "POST /node/68d3be985180aefab120c557 HTTP/1.0" 202 Accepted 2025-09-26 09:49:28,521 - lava_callback - INFO - Starting async job submit for node 68d3be985180aefab120c557 2025-09-26 09:49:28,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:28,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be985180aefab120c557 HTTP/1.1" 200 None 2025-09-26 09:49:28,561 - lava_callback - DEBUG - Processing node 68d3be985180aefab120c557: ltp-controllers 2025-09-26 09:49:28,561 - lava_callback - ERROR - Error processing callback for node 68d3be985180aefab120c557: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:49:29,256 - lava_callback - INFO - Received callback for node 68d3be995180aefab120c55d INFO: 172.20.0.1:40088 - "POST /node/68d3be995180aefab120c55d HTTP/1.0" 202 Accepted 2025-09-26 09:49:29,262 - lava_callback - INFO - Starting async job submit for node 68d3be995180aefab120c55d 2025-09-26 09:49:29,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:29,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be995180aefab120c55d HTTP/1.1" 200 None 2025-09-26 09:49:29,278 - lava_callback - DEBUG - Processing node 68d3be995180aefab120c55d: ltp-ipc 2025-09-26 09:49:29,278 - lava_callback - ERROR - Error processing callback for node 68d3be995180aefab120c55d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:49:30,073 - lava_callback - INFO - Received callback for node 68d3be9c5180aefab120c569 INFO: 172.20.0.1:59766 - "POST /node/68d3be9c5180aefab120c569 HTTP/1.0" 202 Accepted 2025-09-26 09:49:30,079 - lava_callback - INFO - Starting async job submit for node 68d3be9c5180aefab120c569 2025-09-26 09:49:30,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:30,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be9c5180aefab120c569 HTTP/1.1" 200 None 2025-09-26 09:49:30,101 - lava_callback - DEBUG - Processing node 68d3be9c5180aefab120c569: ltp-cve 2025-09-26 09:49:30,101 - lava_callback - ERROR - Error processing callback for node 68d3be9c5180aefab120c569: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:49:30,846 - lava_callback - INFO - Received callback for node 68d3be9e5180aefab120c571 INFO: 172.20.0.1:59774 - "POST /node/68d3be9e5180aefab120c571 HTTP/1.0" 202 Accepted 2025-09-26 09:49:30,851 - lava_callback - INFO - Starting async job submit for node 68d3be9e5180aefab120c571 2025-09-26 09:49:30,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:30,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be9e5180aefab120c571 HTTP/1.1" 200 None 2025-09-26 09:49:30,873 - lava_callback - DEBUG - Processing node 68d3be9e5180aefab120c571: ltp-fs-bind 2025-09-26 09:49:30,873 - lava_callback - ERROR - Error processing callback for node 68d3be9e5180aefab120c571: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:49:31,595 - lava_callback - INFO - Received callback for node 68d3bea05180aefab120c575 INFO: 172.20.0.1:59786 - "POST /node/68d3bea05180aefab120c575 HTTP/1.0" 202 Accepted 2025-09-26 09:49:31,604 - lava_callback - INFO - Starting async job submit for node 68d3bea05180aefab120c575 2025-09-26 09:49:31,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:31,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bea05180aefab120c575 HTTP/1.1" 200 None 2025-09-26 09:49:31,619 - lava_callback - DEBUG - Processing node 68d3bea05180aefab120c575: ltp-pty 2025-09-26 09:49:31,619 - lava_callback - ERROR - Error processing callback for node 68d3bea05180aefab120c575: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:59794 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:49:46,305 - lava_callback - INFO - Received callback for node 68d3bea55180aefab120c58e INFO: 172.20.0.1:47758 - "POST /node/68d3bea55180aefab120c58e HTTP/1.0" 202 Accepted 2025-09-26 09:49:46,312 - lava_callback - INFO - Starting async job submit for node 68d3bea55180aefab120c58e 2025-09-26 09:49:46,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:46,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bea55180aefab120c58e HTTP/1.1" 200 None 2025-09-26 09:49:46,330 - lava_callback - DEBUG - Processing node 68d3bea55180aefab120c58e: ltp-fsx 2025-09-26 09:49:46,330 - lava_callback - ERROR - Error processing callback for node 68d3bea55180aefab120c58e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:47760 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:49:47,080 - lava_callback - INFO - Received callback for node 68d3bea75180aefab120c5ae INFO: 172.20.0.1:47768 - "POST /node/68d3bea75180aefab120c5ae HTTP/1.0" 202 Accepted 2025-09-26 09:49:47,085 - lava_callback - INFO - Starting async job submit for node 68d3bea75180aefab120c5ae 2025-09-26 09:49:47,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:47,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bea75180aefab120c5ae HTTP/1.1" 200 None 2025-09-26 09:49:47,106 - lava_callback - DEBUG - Processing node 68d3bea75180aefab120c5ae: ltp-sched 2025-09-26 09:49:47,106 - lava_callback - ERROR - Error processing callback for node 68d3bea75180aefab120c5ae: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:49:47,900 - lava_callback - INFO - Received callback for node 68d3beab5180aefab120c5b8 INFO: 172.20.0.1:47780 - "POST /node/68d3beab5180aefab120c5b8 HTTP/1.0" 202 Accepted 2025-09-26 09:49:47,906 - lava_callback - INFO - Starting async job submit for node 68d3beab5180aefab120c5b8 2025-09-26 09:49:47,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:47,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3beab5180aefab120c5b8 HTTP/1.1" 200 None 2025-09-26 09:49:47,941 - lava_callback - DEBUG - Processing node 68d3beab5180aefab120c5b8: ltp-fs-bind 2025-09-26 09:49:47,941 - lava_callback - ERROR - Error processing callback for node 68d3beab5180aefab120c5b8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:49:48,660 - lava_callback - INFO - Received callback for node 68d3bead5180aefab120c5c0 INFO: 172.20.0.1:47796 - "POST /node/68d3bead5180aefab120c5c0 HTTP/1.0" 202 Accepted 2025-09-26 09:49:48,666 - lava_callback - INFO - Starting async job submit for node 68d3bead5180aefab120c5c0 2025-09-26 09:49:48,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:48,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bead5180aefab120c5c0 HTTP/1.1" 200 None 2025-09-26 09:49:48,680 - lava_callback - DEBUG - Processing node 68d3bead5180aefab120c5c0: ltp-input 2025-09-26 09:49:48,680 - lava_callback - ERROR - Error processing callback for node 68d3bead5180aefab120c5c0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:49:49,411 - lava_callback - INFO - Received callback for node 68d3beaf5180aefab120c5c6 INFO: 172.20.0.1:36902 - "POST /node/68d3beaf5180aefab120c5c6 HTTP/1.0" 202 Accepted 2025-09-26 09:49:49,417 - lava_callback - INFO - Starting async job submit for node 68d3beaf5180aefab120c5c6 2025-09-26 09:49:49,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:49,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3beaf5180aefab120c5c6 HTTP/1.1" 200 None 2025-09-26 09:49:49,441 - lava_callback - DEBUG - Processing node 68d3beaf5180aefab120c5c6: ltp-smoketest 2025-09-26 09:49:49,441 - lava_callback - ERROR - Error processing callback for node 68d3beaf5180aefab120c5c6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:49:50,165 - lava_callback - INFO - Received callback for node 68d3beb35180aefab120c5ce INFO: 172.20.0.1:36918 - "POST /node/68d3beb35180aefab120c5ce HTTP/1.0" 202 Accepted 2025-09-26 09:49:50,171 - lava_callback - INFO - Starting async job submit for node 68d3beb35180aefab120c5ce 2025-09-26 09:49:50,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:50,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3beb35180aefab120c5ce HTTP/1.1" 200 None 2025-09-26 09:49:50,185 - lava_callback - DEBUG - Processing node 68d3beb35180aefab120c5ce: ltp-fsx 2025-09-26 09:49:50,185 - lava_callback - ERROR - Error processing callback for node 68d3beb35180aefab120c5ce: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:49:50,957 - lava_callback - INFO - Received callback for node 68d3beb45180aefab120c5d2 INFO: 172.20.0.1:36934 - "POST /node/68d3beb45180aefab120c5d2 HTTP/1.0" 202 Accepted 2025-09-26 09:49:50,963 - lava_callback - INFO - Starting async job submit for node 68d3beb45180aefab120c5d2 2025-09-26 09:49:50,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:50,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3beb45180aefab120c5d2 HTTP/1.1" 200 None 2025-09-26 09:49:50,976 - lava_callback - DEBUG - Processing node 68d3beb45180aefab120c5d2: ltp-ipc 2025-09-26 09:49:50,976 - lava_callback - ERROR - Error processing callback for node 68d3beb45180aefab120c5d2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:49:53,171 - lava_callback - INFO - Received callback for node 68d3bead5180aefab120c5bc INFO: 172.20.0.1:36942 - "POST /node/68d3bead5180aefab120c5bc HTTP/1.0" 202 Accepted 2025-09-26 09:49:53,177 - lava_callback - INFO - Starting async job submit for node 68d3bead5180aefab120c5bc 2025-09-26 09:49:53,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:53,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bead5180aefab120c5bc HTTP/1.1" 200 None 2025-09-26 09:49:53,213 - lava_callback - DEBUG - Processing node 68d3bead5180aefab120c5bc: baseline-arm64 2025-09-26 09:49:53,213 - lava_callback - ERROR - Error processing callback for node 68d3bead5180aefab120c5bc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:49:53,879 - lava_callback - INFO - Received callback for node 68d3beb25180aefab120c5cb INFO: 172.20.0.1:36956 - "POST /node/68d3beb25180aefab120c5cb HTTP/1.0" 202 Accepted 2025-09-26 09:49:53,884 - lava_callback - INFO - Starting async job submit for node 68d3beb25180aefab120c5cb 2025-09-26 09:49:53,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:49:53,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3beb25180aefab120c5cb HTTP/1.1" 200 None 2025-09-26 09:49:53,897 - lava_callback - DEBUG - Processing node 68d3beb25180aefab120c5cb: baseline-arm64 2025-09-26 09:49:53,897 - lava_callback - ERROR - Error processing callback for node 68d3beb25180aefab120c5cb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:36968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50434 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:50:06,317 - lava_callback - INFO - Received callback for node 68d3beb95180aefab120c5de INFO: 172.20.0.1:50440 - "POST /node/68d3beb95180aefab120c5de HTTP/1.0" 202 Accepted 2025-09-26 09:50:06,323 - lava_callback - INFO - Starting async job submit for node 68d3beb95180aefab120c5de 2025-09-26 09:50:06,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:06,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3beb95180aefab120c5de HTTP/1.1" 200 None 2025-09-26 09:50:06,339 - lava_callback - DEBUG - Processing node 68d3beb95180aefab120c5de: ltp-input 2025-09-26 09:50:06,339 - lava_callback - ERROR - Error processing callback for node 68d3beb95180aefab120c5de: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:50448 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:50:07,066 - lava_callback - INFO - Received callback for node 68d3bebb5180aefab120c5e2 INFO: 172.20.0.1:50450 - "POST /node/68d3bebb5180aefab120c5e2 HTTP/1.0" 202 Accepted 2025-09-26 09:50:07,072 - lava_callback - INFO - Starting async job submit for node 68d3bebb5180aefab120c5e2 2025-09-26 09:50:07,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:07,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bebb5180aefab120c5e2 HTTP/1.1" 200 None 2025-09-26 09:50:07,112 - lava_callback - DEBUG - Processing node 68d3bebb5180aefab120c5e2: ltp-pty 2025-09-26 09:50:07,112 - lava_callback - ERROR - Error processing callback for node 68d3bebb5180aefab120c5e2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:50:07,841 - lava_callback - INFO - Received callback for node 68d3bebd5180aefab120c5e5 INFO: 172.20.0.1:50460 - "POST /node/68d3bebd5180aefab120c5e5 HTTP/1.0" 202 Accepted 2025-09-26 09:50:07,850 - lava_callback - INFO - Starting async job submit for node 68d3bebd5180aefab120c5e5 2025-09-26 09:50:07,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:07,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bebd5180aefab120c5e5 HTTP/1.1" 200 None 2025-09-26 09:50:07,867 - lava_callback - DEBUG - Processing node 68d3bebd5180aefab120c5e5: ltp-syscalls-ipc 2025-09-26 09:50:07,867 - lava_callback - ERROR - Error processing callback for node 68d3bebd5180aefab120c5e5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:50:08,589 - lava_callback - INFO - Received callback for node 68d3bebf5180aefab120c5ed INFO: 172.20.0.1:50468 - "POST /node/68d3bebf5180aefab120c5ed HTTP/1.0" 202 Accepted 2025-09-26 09:50:08,595 - lava_callback - INFO - Starting async job submit for node 68d3bebf5180aefab120c5ed 2025-09-26 09:50:08,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:08,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bebf5180aefab120c5ed HTTP/1.1" 200 None 2025-09-26 09:50:08,621 - lava_callback - DEBUG - Processing node 68d3bebf5180aefab120c5ed: ltp-ipc 2025-09-26 09:50:08,621 - lava_callback - ERROR - Error processing callback for node 68d3bebf5180aefab120c5ed: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:50:09,384 - lava_callback - INFO - Received callback for node 68d3bec25180aefab120c5f5 INFO: 172.20.0.1:60088 - "POST /node/68d3bec25180aefab120c5f5 HTTP/1.0" 202 Accepted 2025-09-26 09:50:09,390 - lava_callback - INFO - Starting async job submit for node 68d3bec25180aefab120c5f5 2025-09-26 09:50:09,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:09,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bec25180aefab120c5f5 HTTP/1.1" 200 None 2025-09-26 09:50:09,405 - lava_callback - DEBUG - Processing node 68d3bec25180aefab120c5f5: ltp-sched 2025-09-26 09:50:09,405 - lava_callback - ERROR - Error processing callback for node 68d3bec25180aefab120c5f5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:50:10,133 - lava_callback - INFO - Received callback for node 68d3bec45180aefab120c5f9 INFO: 172.20.0.1:60102 - "POST /node/68d3bec45180aefab120c5f9 HTTP/1.0" 202 Accepted 2025-09-26 09:50:10,139 - lava_callback - INFO - Starting async job submit for node 68d3bec45180aefab120c5f9 2025-09-26 09:50:10,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:10,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bec45180aefab120c5f9 HTTP/1.1" 200 None 2025-09-26 09:50:10,179 - lava_callback - DEBUG - Processing node 68d3bec45180aefab120c5f9: ltp-timers 2025-09-26 09:50:10,179 - lava_callback - ERROR - Error processing callback for node 68d3bec45180aefab120c5f9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:50:10,886 - lava_callback - INFO - Received callback for node 68d3bec65180aefab120c5ff INFO: 172.20.0.1:60112 - "POST /node/68d3bec65180aefab120c5ff HTTP/1.0" 202 Accepted 2025-09-26 09:50:10,892 - lava_callback - INFO - Starting async job submit for node 68d3bec65180aefab120c5ff 2025-09-26 09:50:10,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:10,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bec65180aefab120c5ff HTTP/1.1" 200 None 2025-09-26 09:50:10,906 - lava_callback - DEBUG - Processing node 68d3bec65180aefab120c5ff: ltp-pty 2025-09-26 09:50:10,906 - lava_callback - ERROR - Error processing callback for node 68d3bec65180aefab120c5ff: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:50:11,641 - lava_callback - INFO - Received callback for node 68d3bec85180aefab120c604 INFO: 172.20.0.1:60124 - "POST /node/68d3bec85180aefab120c604 HTTP/1.0" 202 Accepted 2025-09-26 09:50:11,647 - lava_callback - INFO - Starting async job submit for node 68d3bec85180aefab120c604 2025-09-26 09:50:11,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:11,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bec85180aefab120c604 HTTP/1.1" 200 None 2025-09-26 09:50:11,661 - lava_callback - DEBUG - Processing node 68d3bec85180aefab120c604: ltp-smoketest 2025-09-26 09:50:11,661 - lava_callback - ERROR - Error processing callback for node 68d3bec85180aefab120c604: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:50:12,376 - lava_callback - INFO - Received callback for node 68d3beca5180aefab120c608 INFO: 172.20.0.1:60130 - "POST /node/68d3beca5180aefab120c608 HTTP/1.0" 202 Accepted 2025-09-26 09:50:12,382 - lava_callback - INFO - Starting async job submit for node 68d3beca5180aefab120c608 2025-09-26 09:50:12,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:12,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3beca5180aefab120c608 HTTP/1.1" 200 None 2025-09-26 09:50:12,396 - lava_callback - DEBUG - Processing node 68d3beca5180aefab120c608: ltp-watchqueue 2025-09-26 09:50:12,396 - lava_callback - ERROR - Error processing callback for node 68d3beca5180aefab120c608: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:50:13,125 - lava_callback - INFO - Received callback for node 68d3becd5180aefab120c60e INFO: 172.20.0.1:60144 - "POST /node/68d3becd5180aefab120c60e HTTP/1.0" 202 Accepted 2025-09-26 09:50:13,131 - lava_callback - INFO - Starting async job submit for node 68d3becd5180aefab120c60e 2025-09-26 09:50:13,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:13,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3becd5180aefab120c60e HTTP/1.1" 200 None 2025-09-26 09:50:13,146 - lava_callback - DEBUG - Processing node 68d3becd5180aefab120c60e: ltp-sched 2025-09-26 09:50:13,146 - lava_callback - ERROR - Error processing callback for node 68d3becd5180aefab120c60e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:50:13,704 - lava_callback - INFO - Received callback for node 68d3bed05180aefab120c616 INFO: 172.20.0.1:60160 - "POST /node/68d3bed05180aefab120c616 HTTP/1.0" 202 Accepted 2025-09-26 09:50:13,710 - lava_callback - INFO - Starting async job submit for node 68d3bed05180aefab120c616 2025-09-26 09:50:13,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:13,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bed05180aefab120c616 HTTP/1.1" 200 None 2025-09-26 09:50:13,725 - lava_callback - DEBUG - Processing node 68d3bed05180aefab120c616: baseline-arm64 2025-09-26 09:50:13,725 - lava_callback - ERROR - Error processing callback for node 68d3bed05180aefab120c616: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60172 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:50:25,560 - lava_callback - INFO - Received callback for node 68d3bdd05180aefab120bf0f INFO: 172.20.0.1:54778 - "POST /node/68d3bdd05180aefab120bf0f HTTP/1.0" 202 Accepted 2025-09-26 09:50:25,566 - lava_callback - INFO - Starting async job submit for node 68d3bdd05180aefab120bf0f 2025-09-26 09:50:25,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:25,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bdd05180aefab120bf0f HTTP/1.1" 200 None 2025-09-26 09:50:25,628 - lava_callback - DEBUG - Processing node 68d3bdd05180aefab120bf0f: baseline-arm-broonie 2025-09-26 09:50:25,859 - lava_callback - ERROR - Error processing callback for node 68d3bdd05180aefab120bf0f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 09:50:26,460 - lava_callback - INFO - Received callback for node 68d3becf5180aefab120c612 INFO: 172.20.0.1:54788 - "POST /node/68d3becf5180aefab120c612 HTTP/1.0" 202 Accepted 2025-09-26 09:50:26,466 - lava_callback - INFO - Starting async job submit for node 68d3becf5180aefab120c612 2025-09-26 09:50:26,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:26,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3becf5180aefab120c612 HTTP/1.1" 200 None 2025-09-26 09:50:26,480 - lava_callback - DEBUG - Processing node 68d3becf5180aefab120c612: ltp-syscalls 2025-09-26 09:50:26,480 - lava_callback - ERROR - Error processing callback for node 68d3becf5180aefab120c612: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:54796 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:50:27,273 - lava_callback - INFO - Received callback for node 68d3bed35180aefab120c620 INFO: 172.20.0.1:54800 - "POST /node/68d3bed35180aefab120c620 HTTP/1.0" 202 Accepted 2025-09-26 09:50:27,282 - lava_callback - INFO - Starting async job submit for node 68d3bed35180aefab120c620 2025-09-26 09:50:27,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:27,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bed35180aefab120c620 HTTP/1.1" 200 None 2025-09-26 09:50:27,301 - lava_callback - DEBUG - Processing node 68d3bed35180aefab120c620: ltp-smoketest 2025-09-26 09:50:27,301 - lava_callback - ERROR - Error processing callback for node 68d3bed35180aefab120c620: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:50:28,213 - lava_callback - INFO - Received callback for node 68d3bed55180aefab120c626 INFO: 172.20.0.1:54808 - "POST /node/68d3bed55180aefab120c626 HTTP/1.0" 202 Accepted 2025-09-26 09:50:28,219 - lava_callback - INFO - Starting async job submit for node 68d3bed55180aefab120c626 2025-09-26 09:50:28,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:28,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bed55180aefab120c626 HTTP/1.1" 200 None 2025-09-26 09:50:28,271 - lava_callback - DEBUG - Processing node 68d3bed55180aefab120c626: ltp-syscalls-ipc 2025-09-26 09:50:28,271 - lava_callback - ERROR - Error processing callback for node 68d3bed55180aefab120c626: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:50:28,965 - lava_callback - INFO - Received callback for node 68d3bed85180aefab120c634 INFO: 172.20.0.1:54822 - "POST /node/68d3bed85180aefab120c634 HTTP/1.0" 202 Accepted 2025-09-26 09:50:28,971 - lava_callback - INFO - Starting async job submit for node 68d3bed85180aefab120c634 2025-09-26 09:50:28,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:28,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bed85180aefab120c634 HTTP/1.1" 200 None 2025-09-26 09:50:28,985 - lava_callback - DEBUG - Processing node 68d3bed85180aefab120c634: ltp-syscalls 2025-09-26 09:50:28,985 - lava_callback - ERROR - Error processing callback for node 68d3bed85180aefab120c634: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:50:29,710 - lava_callback - INFO - Received callback for node 68d3beda5180aefab120c639 INFO: 172.20.0.1:54994 - "POST /node/68d3beda5180aefab120c639 HTTP/1.0" 202 Accepted 2025-09-26 09:50:29,720 - lava_callback - INFO - Starting async job submit for node 68d3beda5180aefab120c639 2025-09-26 09:50:29,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:29,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3beda5180aefab120c639 HTTP/1.1" 200 None 2025-09-26 09:50:29,740 - lava_callback - DEBUG - Processing node 68d3beda5180aefab120c639: ltp-timers 2025-09-26 09:50:29,740 - lava_callback - ERROR - Error processing callback for node 68d3beda5180aefab120c639: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:50:30,475 - lava_callback - INFO - Received callback for node 68d3bedd5180aefab120c643 INFO: 172.20.0.1:55002 - "POST /node/68d3bedd5180aefab120c643 HTTP/1.0" 202 Accepted 2025-09-26 09:50:30,481 - lava_callback - INFO - Starting async job submit for node 68d3bedd5180aefab120c643 2025-09-26 09:50:30,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:30,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bedd5180aefab120c643 HTTP/1.1" 200 None 2025-09-26 09:50:30,496 - lava_callback - DEBUG - Processing node 68d3bedd5180aefab120c643: ltp-syscalls-ipc 2025-09-26 09:50:30,496 - lava_callback - ERROR - Error processing callback for node 68d3bedd5180aefab120c643: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:50:31,233 - lava_callback - INFO - Received callback for node 68d3bee05180aefab120c64c INFO: 172.20.0.1:55012 - "POST /node/68d3bee05180aefab120c64c HTTP/1.0" 202 Accepted 2025-09-26 09:50:31,239 - lava_callback - INFO - Starting async job submit for node 68d3bee05180aefab120c64c 2025-09-26 09:50:31,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:31,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bee05180aefab120c64c HTTP/1.1" 200 None 2025-09-26 09:50:31,254 - lava_callback - DEBUG - Processing node 68d3bee05180aefab120c64c: ltp-watchqueue 2025-09-26 09:50:31,254 - lava_callback - ERROR - Error processing callback for node 68d3bee05180aefab120c64c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:50:33,872 - lava_callback - INFO - Received callback for node 68d3bed55180aefab120c623 INFO: 172.20.0.1:55022 - "POST /node/68d3bed55180aefab120c623 HTTP/1.0" 202 Accepted 2025-09-26 09:50:33,878 - lava_callback - INFO - Starting async job submit for node 68d3bed55180aefab120c623 2025-09-26 09:50:33,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:33,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bed55180aefab120c623 HTTP/1.1" 200 None 2025-09-26 09:50:33,891 - lava_callback - DEBUG - Processing node 68d3bed55180aefab120c623: baseline-arm64 2025-09-26 09:50:33,891 - lava_callback - ERROR - Error processing callback for node 68d3bed55180aefab120c623: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:50:34,602 - lava_callback - INFO - Received callback for node 68d3bed65180aefab120c62b INFO: 172.20.0.1:55036 - "POST /node/68d3bed65180aefab120c62b HTTP/1.0" 202 Accepted 2025-09-26 09:50:34,610 - lava_callback - INFO - Starting async job submit for node 68d3bed65180aefab120c62b 2025-09-26 09:50:34,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:34,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bed65180aefab120c62b HTTP/1.1" 200 None 2025-09-26 09:50:34,637 - lava_callback - DEBUG - Processing node 68d3bed65180aefab120c62b: baseline-arm64 2025-09-26 09:50:34,637 - lava_callback - ERROR - Error processing callback for node 68d3bed65180aefab120c62b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:50:35,336 - lava_callback - INFO - Received callback for node 68d3bedd5180aefab120c640 INFO: 172.20.0.1:55048 - "POST /node/68d3bedd5180aefab120c640 HTTP/1.0" 202 Accepted 2025-09-26 09:50:35,342 - lava_callback - INFO - Starting async job submit for node 68d3bedd5180aefab120c640 2025-09-26 09:50:35,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:35,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bedd5180aefab120c640 HTTP/1.1" 200 None 2025-09-26 09:50:35,356 - lava_callback - DEBUG - Processing node 68d3bedd5180aefab120c640: baseline-arm64 2025-09-26 09:50:35,356 - lava_callback - ERROR - Error processing callback for node 68d3bedd5180aefab120c640: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:50:36,058 - lava_callback - INFO - Received callback for node 68d3bedf5180aefab120c647 INFO: 172.20.0.1:55056 - "POST /node/68d3bedf5180aefab120c647 HTTP/1.0" 202 Accepted 2025-09-26 09:50:36,063 - lava_callback - INFO - Starting async job submit for node 68d3bedf5180aefab120c647 2025-09-26 09:50:36,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:36,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bedf5180aefab120c647 HTTP/1.1" 200 None 2025-09-26 09:50:36,081 - lava_callback - DEBUG - Processing node 68d3bedf5180aefab120c647: baseline-arm64 2025-09-26 09:50:36,081 - lava_callback - ERROR - Error processing callback for node 68d3bedf5180aefab120c647: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:55064 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:50:39,607 - lava_callback - INFO - Received callback for node 68d408f3cd36afa834e16d36 INFO: 172.20.0.1:52480 - "POST /node/68d408f3cd36afa834e16d36 HTTP/1.0" 202 Accepted 2025-09-26 09:50:39,616 - lava_callback - INFO - Starting async job submit for node 68d408f3cd36afa834e16d36 2025-09-26 09:50:39,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:39,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408f3cd36afa834e16d36 HTTP/1.1" 200 None 2025-09-26 09:50:39,670 - lava_callback - DEBUG - Processing node 68d408f3cd36afa834e16d36: baseline-arm 2025-09-26 09:50:40,054 - lava_callback - ERROR - Error processing callback for node 68d408f3cd36afa834e16d36: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 09:50:46,427 - lava_callback - INFO - Received callback for node 68d3bee95180aefab120c689 INFO: 172.20.0.1:52484 - "POST /node/68d3bee95180aefab120c689 HTTP/1.0" 202 Accepted 2025-09-26 09:50:46,433 - lava_callback - INFO - Starting async job submit for node 68d3bee95180aefab120c689 2025-09-26 09:50:46,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:46,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bee95180aefab120c689 HTTP/1.1" 200 None 2025-09-26 09:50:46,448 - lava_callback - DEBUG - Processing node 68d3bee95180aefab120c689: ltp-watchqueue 2025-09-26 09:50:46,449 - lava_callback - ERROR - Error processing callback for node 68d3bee95180aefab120c689: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:52500 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:50:50,981 - lava_callback - INFO - Received callback for node 68d660c42f83206171a9014e INFO: 172.20.0.1:53600 - "POST /node/68d660c42f83206171a9014e HTTP/1.0" 202 Accepted 2025-09-26 09:50:50,987 - lava_callback - INFO - Starting async job submit for node 68d660c42f83206171a9014e 2025-09-26 09:50:51,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:51,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660c42f83206171a9014e HTTP/1.1" 200 None 2025-09-26 09:50:51,029 - lava_callback - DEBUG - Processing node 68d660c42f83206171a9014e: baseline-arm-clabbe 2025-09-26 09:50:51,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:50:52,175 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:50:52,176 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d660c42f83206171a9014e/log.txt.gz 2025-09-26 09:50:52,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:50:53,236 - lava_callback - INFO - Received callback for node 68d3bee65180aefab120c679 INFO: 172.20.0.1:53612 - "POST /node/68d3bee65180aefab120c679 HTTP/1.0" 202 Accepted 2025-09-26 09:50:53,245 - lava_callback - INFO - Starting async job submit for node 68d3bee65180aefab120c679 2025-09-26 09:50:53,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:53,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bee65180aefab120c679 HTTP/1.1" 200 None 2025-09-26 09:50:53,259 - lava_callback - DEBUG - Processing node 68d3bee65180aefab120c679: baseline-arm64 2025-09-26 09:50:53,259 - lava_callback - ERROR - Error processing callback for node 68d3bee65180aefab120c679: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:50:53,948 - lava_callback - INFO - Received callback for node 68d3beea5180aefab120c68d INFO: 172.20.0.1:53616 - "POST /node/68d3beea5180aefab120c68d HTTP/1.0" 202 Accepted 2025-09-26 09:50:53,956 - lava_callback - INFO - Starting async job submit for node 68d3beea5180aefab120c68d 2025-09-26 09:50:53,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:53,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3beea5180aefab120c68d HTTP/1.1" 200 None 2025-09-26 09:50:53,970 - lava_callback - DEBUG - Processing node 68d3beea5180aefab120c68d: baseline-arm64 2025-09-26 09:50:53,970 - lava_callback - ERROR - Error processing callback for node 68d3beea5180aefab120c68d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:50:54,665 - lava_callback - INFO - Received callback for node 68d3bee85180aefab120c684 INFO: 172.20.0.1:53630 - "POST /node/68d3bee85180aefab120c684 HTTP/1.0" 202 Accepted 2025-09-26 09:50:54,674 - lava_callback - INFO - Starting async job submit for node 68d3bee85180aefab120c684 2025-09-26 09:50:54,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:54,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bee85180aefab120c684 HTTP/1.1" 200 None 2025-09-26 09:50:54,691 - lava_callback - DEBUG - Processing node 68d3bee85180aefab120c684: baseline-arm64 2025-09-26 09:50:54,691 - lava_callback - ERROR - Error processing callback for node 68d3bee85180aefab120c684: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:50:54,755 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:50:54,756 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d660c42f83206171a9014e/lava_callback.json.gz 2025-09-26 09:50:54,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:54,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660c42f83206171a9014e HTTP/1.1" 200 None 2025-09-26 09:50:54,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:54,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-26 09:50:54,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:54,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660c42f83206171a9014e HTTP/1.1" 200 None 2025-09-26 09:50:54,886 - lava_callback - INFO - Completed processing callback for node 68d660c42f83206171a9014e 2025-09-26 09:50:55,379 - lava_callback - INFO - Received callback for node 68d3beec5180aefab120c690 INFO: 172.20.0.1:53642 - "POST /node/68d3beec5180aefab120c690 HTTP/1.0" 202 Accepted 2025-09-26 09:50:55,384 - lava_callback - INFO - Starting async job submit for node 68d3beec5180aefab120c690 2025-09-26 09:50:55,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:55,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3beec5180aefab120c690 HTTP/1.1" 200 None 2025-09-26 09:50:55,405 - lava_callback - DEBUG - Processing node 68d3beec5180aefab120c690: baseline-arm64 2025-09-26 09:50:55,405 - lava_callback - ERROR - Error processing callback for node 68d3beec5180aefab120c690: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:50:56,104 - lava_callback - INFO - Received callback for node 68d3bef45180aefab120c6a3 INFO: 172.20.0.1:53644 - "POST /node/68d3bef45180aefab120c6a3 HTTP/1.0" 202 Accepted 2025-09-26 09:50:56,110 - lava_callback - INFO - Starting async job submit for node 68d3bef45180aefab120c6a3 2025-09-26 09:50:56,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:50:56,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bef45180aefab120c6a3 HTTP/1.1" 200 None 2025-09-26 09:50:56,124 - lava_callback - DEBUG - Processing node 68d3bef45180aefab120c6a3: baseline-arm64 2025-09-26 09:50:56,124 - lava_callback - ERROR - Error processing callback for node 68d3bef45180aefab120c6a3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:53650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49062 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:51:13,082 - lava_callback - INFO - Received callback for node 68d3bef75180aefab120c6b1 INFO: 172.20.0.1:43952 - "POST /node/68d3bef75180aefab120c6b1 HTTP/1.0" 202 Accepted 2025-09-26 09:51:13,087 - lava_callback - INFO - Starting async job submit for node 68d3bef75180aefab120c6b1 2025-09-26 09:51:13,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:51:13,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bef75180aefab120c6b1 HTTP/1.1" 200 None 2025-09-26 09:51:13,126 - lava_callback - DEBUG - Processing node 68d3bef75180aefab120c6b1: baseline-arm64 2025-09-26 09:51:13,126 - lava_callback - ERROR - Error processing callback for node 68d3bef75180aefab120c6b1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:51:13,788 - lava_callback - INFO - Received callback for node 68d3bef95180aefab120c6b4 INFO: 172.20.0.1:43966 - "POST /node/68d3bef95180aefab120c6b4 HTTP/1.0" 202 Accepted 2025-09-26 09:51:13,794 - lava_callback - INFO - Starting async job submit for node 68d3bef95180aefab120c6b4 2025-09-26 09:51:13,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:51:13,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bef95180aefab120c6b4 HTTP/1.1" 200 None 2025-09-26 09:51:13,807 - lava_callback - DEBUG - Processing node 68d3bef95180aefab120c6b4: baseline-arm64 2025-09-26 09:51:13,807 - lava_callback - ERROR - Error processing callback for node 68d3bef95180aefab120c6b4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:51:14,481 - lava_callback - INFO - Received callback for node 68d3beff5180aefab120c6c5 INFO: 172.20.0.1:43982 - "POST /node/68d3beff5180aefab120c6c5 HTTP/1.0" 202 Accepted 2025-09-26 09:51:14,486 - lava_callback - INFO - Starting async job submit for node 68d3beff5180aefab120c6c5 2025-09-26 09:51:14,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:51:14,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3beff5180aefab120c6c5 HTTP/1.1" 200 None 2025-09-26 09:51:14,522 - lava_callback - DEBUG - Processing node 68d3beff5180aefab120c6c5: baseline-arm64 2025-09-26 09:51:14,522 - lava_callback - ERROR - Error processing callback for node 68d3beff5180aefab120c6c5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:43996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47242 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:51:33,081 - lava_callback - INFO - Received callback for node 68d3bf095180aefab120c6df INFO: 172.20.0.1:59472 - "POST /node/68d3bf095180aefab120c6df HTTP/1.0" 202 Accepted 2025-09-26 09:51:33,094 - lava_callback - INFO - Starting async job submit for node 68d3bf095180aefab120c6df 2025-09-26 09:51:33,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:51:33,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bf095180aefab120c6df HTTP/1.1" 200 None 2025-09-26 09:51:33,112 - lava_callback - DEBUG - Processing node 68d3bf095180aefab120c6df: baseline-arm64 2025-09-26 09:51:33,112 - lava_callback - ERROR - Error processing callback for node 68d3bf095180aefab120c6df: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:51:33,777 - lava_callback - INFO - Received callback for node 68d3bf165180aefab120c6fb INFO: 172.20.0.1:59486 - "POST /node/68d3bf165180aefab120c6fb HTTP/1.0" 202 Accepted 2025-09-26 09:51:33,785 - lava_callback - INFO - Starting async job submit for node 68d3bf165180aefab120c6fb 2025-09-26 09:51:33,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:51:33,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bf165180aefab120c6fb HTTP/1.1" 200 None 2025-09-26 09:51:33,808 - lava_callback - DEBUG - Processing node 68d3bf165180aefab120c6fb: baseline-arm64 2025-09-26 09:51:33,808 - lava_callback - ERROR - Error processing callback for node 68d3bf165180aefab120c6fb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:59488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44460 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:51:51,305 - lava_callback - INFO - Received callback for node 68d3bce75180aefab120baf8 INFO: 172.20.0.1:45608 - "POST /node/68d3bce75180aefab120baf8 HTTP/1.0" 202 Accepted 2025-09-26 09:51:51,311 - lava_callback - INFO - Starting async job submit for node 68d3bce75180aefab120baf8 2025-09-26 09:51:51,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:51:51,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bce75180aefab120baf8 HTTP/1.1" 200 None 2025-09-26 09:51:51,364 - lava_callback - DEBUG - Processing node 68d3bce75180aefab120baf8: ltp-pty 2025-09-26 09:51:51,893 - lava_callback - ERROR - Error processing callback for node 68d3bce75180aefab120baf8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 09:51:53,059 - lava_callback - INFO - Received callback for node 68d3bf205180aefab120c711 INFO: 172.20.0.1:45610 - "POST /node/68d3bf205180aefab120c711 HTTP/1.0" 202 Accepted 2025-09-26 09:51:53,067 - lava_callback - INFO - Starting async job submit for node 68d3bf205180aefab120c711 2025-09-26 09:51:53,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:51:53,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bf205180aefab120c711 HTTP/1.1" 200 None 2025-09-26 09:51:53,084 - lava_callback - DEBUG - Processing node 68d3bf205180aefab120c711: baseline-arm64 2025-09-26 09:51:53,084 - lava_callback - ERROR - Error processing callback for node 68d3bf205180aefab120c711: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:45612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35120 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:52:33,069 - lava_callback - INFO - Received callback for node 68d3bf525180aefab120c7a7 INFO: 172.20.0.1:43864 - "POST /node/68d3bf525180aefab120c7a7 HTTP/1.0" 202 Accepted 2025-09-26 09:52:33,078 - lava_callback - INFO - Starting async job submit for node 68d3bf525180aefab120c7a7 2025-09-26 09:52:33,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:52:33,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bf525180aefab120c7a7 HTTP/1.1" 200 None 2025-09-26 09:52:33,100 - lava_callback - DEBUG - Processing node 68d3bf525180aefab120c7a7: baseline-arm64 2025-09-26 09:52:33,100 - lava_callback - ERROR - Error processing callback for node 68d3bf525180aefab120c7a7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:43866 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:52:37,718 - lava_callback - INFO - Received callback for node 68d3bf4f5180aefab120c79e INFO: 172.20.0.1:43868 - "POST /node/68d3bf4f5180aefab120c79e HTTP/1.0" 202 Accepted 2025-09-26 09:52:37,726 - lava_callback - INFO - Starting async job submit for node 68d3bf4f5180aefab120c79e 2025-09-26 09:52:37,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:52:37,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bf4f5180aefab120c79e HTTP/1.1" 200 None 2025-09-26 09:52:37,756 - lava_callback - DEBUG - Processing node 68d3bf4f5180aefab120c79e: baseline-arm64-baylibre 2025-09-26 09:52:37,756 - lava_callback - ERROR - Error processing callback for node 68d3bf4f5180aefab120c79e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:43146 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:52:53,056 - lava_callback - INFO - Received callback for node 68d3bf5f5180aefab120c7bd INFO: 172.20.0.1:51480 - "POST /node/68d3bf5f5180aefab120c7bd HTTP/1.0" 202 Accepted 2025-09-26 09:52:53,062 - lava_callback - INFO - Starting async job submit for node 68d3bf5f5180aefab120c7bd 2025-09-26 09:52:53,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:52:53,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bf5f5180aefab120c7bd HTTP/1.1" 200 None 2025-09-26 09:52:53,078 - lava_callback - DEBUG - Processing node 68d3bf5f5180aefab120c7bd: baseline-arm64 2025-09-26 09:52:53,078 - lava_callback - ERROR - Error processing callback for node 68d3bf5f5180aefab120c7bd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:52:56,454 - lava_callback - INFO - Received callback for node 68d408f7cd36afa834e16d3f INFO: 172.20.0.1:51482 - "POST /node/68d408f7cd36afa834e16d3f HTTP/1.0" 202 Accepted 2025-09-26 09:52:56,461 - lava_callback - INFO - Starting async job submit for node 68d408f7cd36afa834e16d3f 2025-09-26 09:52:56,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:52:56,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408f7cd36afa834e16d3f HTTP/1.1" 200 None 2025-09-26 09:52:56,499 - lava_callback - DEBUG - Processing node 68d408f7cd36afa834e16d3f: baseline-arm INFO: 172.20.0.1:51496 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:52:56,723 - lava_callback - ERROR - Error processing callback for node 68d408f7cd36afa834e16d3f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:42828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47172 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:53:37,760 - lava_callback - INFO - Received callback for node 68d3bf925180aefab120c897 INFO: 172.20.0.1:47188 - "POST /node/68d3bf925180aefab120c897 HTTP/1.0" 202 Accepted 2025-09-26 09:53:37,769 - lava_callback - INFO - Starting async job submit for node 68d3bf925180aefab120c897 2025-09-26 09:53:37,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:53:37,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bf925180aefab120c897 HTTP/1.1" 200 None 2025-09-26 09:53:37,786 - lava_callback - DEBUG - Processing node 68d3bf925180aefab120c897: baseline-arm64-baylibre 2025-09-26 09:53:37,786 - lava_callback - ERROR - Error processing callback for node 68d3bf925180aefab120c897: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:39446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40330 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:53:57,773 - lava_callback - INFO - Received callback for node 68d3bf9d5180aefab120c8a9 INFO: 172.20.0.1:40334 - "POST /node/68d3bf9d5180aefab120c8a9 HTTP/1.0" 202 Accepted 2025-09-26 09:53:57,781 - lava_callback - INFO - Starting async job submit for node 68d3bf9d5180aefab120c8a9 2025-09-26 09:53:57,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:53:57,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bf9d5180aefab120c8a9 HTTP/1.1" 200 None 2025-09-26 09:53:57,796 - lava_callback - DEBUG - Processing node 68d3bf9d5180aefab120c8a9: baseline-arm64-baylibre 2025-09-26 09:53:57,796 - lava_callback - ERROR - Error processing callback for node 68d3bf9d5180aefab120c8a9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:48970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40278 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:54:37,810 - lava_callback - INFO - Received callback for node 68d3bfc35180aefab120c8f6 INFO: 172.20.0.1:40288 - "POST /node/68d3bfc35180aefab120c8f6 HTTP/1.0" 202 Accepted 2025-09-26 09:54:37,817 - lava_callback - INFO - Starting async job submit for node 68d3bfc35180aefab120c8f6 2025-09-26 09:54:37,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:54:37,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bfc35180aefab120c8f6 HTTP/1.1" 200 None 2025-09-26 09:54:37,840 - lava_callback - DEBUG - Processing node 68d3bfc35180aefab120c8f6: baseline-arm64-baylibre 2025-09-26 09:54:37,841 - lava_callback - ERROR - Error processing callback for node 68d3bfc35180aefab120c8f6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:34666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45710 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:55:05,984 - lava_callback - INFO - Received callback for node 68d3bee25180aefab120c650 INFO: 172.20.0.1:45726 - "POST /node/68d3bee25180aefab120c650 HTTP/1.0" 202 Accepted 2025-09-26 09:55:05,992 - lava_callback - INFO - Starting async job submit for node 68d3bee25180aefab120c650 2025-09-26 09:55:06,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:55:06,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bee25180aefab120c650 HTTP/1.1" 200 None 2025-09-26 09:55:06,040 - lava_callback - DEBUG - Processing node 68d3bee25180aefab120c650: ltp-timers 2025-09-26 09:55:06,461 - lava_callback - ERROR - Error processing callback for node 68d3bee25180aefab120c650: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:45730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38906 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:55:17,830 - lava_callback - INFO - Received callback for node 68d3bfea5180aefab120c96f INFO: 172.20.0.1:38912 - "POST /node/68d3bfea5180aefab120c96f HTTP/1.0" 202 Accepted 2025-09-26 09:55:17,838 - lava_callback - INFO - Starting async job submit for node 68d3bfea5180aefab120c96f 2025-09-26 09:55:17,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:55:17,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bfea5180aefab120c96f HTTP/1.1" 200 None 2025-09-26 09:55:17,854 - lava_callback - DEBUG - Processing node 68d3bfea5180aefab120c96f: baseline-arm64-baylibre 2025-09-26 09:55:17,854 - lava_callback - ERROR - Error processing callback for node 68d3bfea5180aefab120c96f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:55:18,513 - lava_callback - INFO - Received callback for node 68d3bffb5180aefab120c985 INFO: 172.20.0.1:38924 - "POST /node/68d3bffb5180aefab120c985 HTTP/1.0" 202 Accepted 2025-09-26 09:55:18,518 - lava_callback - INFO - Starting async job submit for node 68d3bffb5180aefab120c985 2025-09-26 09:55:18,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:55:18,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bffb5180aefab120c985 HTTP/1.1" 200 None 2025-09-26 09:55:18,531 - lava_callback - DEBUG - Processing node 68d3bffb5180aefab120c985: baseline-arm64-baylibre 2025-09-26 09:55:18,532 - lava_callback - ERROR - Error processing callback for node 68d3bffb5180aefab120c985: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:38926 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:55:20,308 - lava_callback - INFO - Received callback for node 68d662e22f83206171a9022d INFO: 172.20.0.1:50674 - "POST /node/68d662e22f83206171a9022d HTTP/1.0" 202 Accepted 2025-09-26 09:55:20,316 - lava_callback - INFO - Starting async job submit for node 68d662e22f83206171a9022d 2025-09-26 09:55:20,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:55:20,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d662e22f83206171a9022d HTTP/1.1" 200 None 2025-09-26 09:55:20,356 - lava_callback - DEBUG - Processing node 68d662e22f83206171a9022d: baseline-x86 2025-09-26 09:55:20,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:55:21,118 - lava_callback - INFO - Received callback for node 68d408f9cd36afa834e16d42 INFO: 172.20.0.1:50688 - "POST /node/68d408f9cd36afa834e16d42 HTTP/1.0" 202 Accepted 2025-09-26 09:55:21,126 - lava_callback - INFO - Starting async job submit for node 68d408f9cd36afa834e16d42 2025-09-26 09:55:21,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:55:21,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408f9cd36afa834e16d42 HTTP/1.1" 200 None 2025-09-26 09:55:21,178 - lava_callback - DEBUG - Processing node 68d408f9cd36afa834e16d42: baseline-arm 2025-09-26 09:55:21,557 - lava_callback - ERROR - Error processing callback for node 68d408f9cd36afa834e16d42: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 09:55:23,391 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:55:23,392 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d662e22f83206171a9022d/log.txt.gz 2025-09-26 09:55:23,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:55:26,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:55:26,017 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d662e22f83206171a9022d/lava_callback.json.gz 2025-09-26 09:55:26,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:55:26,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d662e22f83206171a9022d HTTP/1.1" 200 None 2025-09-26 09:55:26,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:55:26,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65cb12f83206171a8fe90 HTTP/1.1" 200 None 2025-09-26 09:55:26,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:55:26,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d662e22f83206171a9022d HTTP/1.1" 200 None 2025-09-26 09:55:26,113 - lava_callback - INFO - Completed processing callback for node 68d662e22f83206171a9022d INFO: 172.20.0.1:50702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59376 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:55:37,864 - lava_callback - INFO - Received callback for node 68d3c0085180aefab120c999 INFO: 172.20.0.1:59386 - "POST /node/68d3c0085180aefab120c999 HTTP/1.0" 202 Accepted 2025-09-26 09:55:37,872 - lava_callback - INFO - Starting async job submit for node 68d3c0085180aefab120c999 2025-09-26 09:55:37,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:55:37,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c0085180aefab120c999 HTTP/1.1" 200 None 2025-09-26 09:55:37,886 - lava_callback - DEBUG - Processing node 68d3c0085180aefab120c999: baseline-arm64-baylibre 2025-09-26 09:55:37,886 - lava_callback - ERROR - Error processing callback for node 68d3c0085180aefab120c999: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:41710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48324 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:56:11,570 - lava_callback - INFO - Received callback for node 68d3c2e9cd36afa834e0d76d INFO: 172.20.0.1:48726 - "POST /node/68d3c2e9cd36afa834e0d76d HTTP/1.0" 202 Accepted 2025-09-26 09:56:11,576 - lava_callback - INFO - Starting async job submit for node 68d3c2e9cd36afa834e0d76d 2025-09-26 09:56:11,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:56:11,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c2e9cd36afa834e0d76d HTTP/1.1" 200 None 2025-09-26 09:56:11,615 - lava_callback - DEBUG - Processing node 68d3c2e9cd36afa834e0d76d: ltp-ipc 2025-09-26 09:56:12,080 - lava_callback - ERROR - Error processing callback for node 68d3c2e9cd36afa834e0d76d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:48738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48744 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:56:17,877 - lava_callback - INFO - Received callback for node 68d3c01c5180aefab120c9b7 INFO: 172.20.0.1:48750 - "POST /node/68d3c01c5180aefab120c9b7 HTTP/1.0" 202 Accepted 2025-09-26 09:56:17,883 - lava_callback - INFO - Starting async job submit for node 68d3c01c5180aefab120c9b7 2025-09-26 09:56:17,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:56:17,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c01c5180aefab120c9b7 HTTP/1.1" 200 None 2025-09-26 09:56:17,896 - lava_callback - DEBUG - Processing node 68d3c01c5180aefab120c9b7: baseline-arm64-baylibre 2025-09-26 09:56:17,896 - lava_callback - ERROR - Error processing callback for node 68d3c01c5180aefab120c9b7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:48766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37586 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:56:26,591 - lava_callback - INFO - Received callback for node 68d3bb045180aefab120b6e9 INFO: 172.20.0.1:37592 - "POST /node/68d3bb045180aefab120b6e9 HTTP/1.0" 202 Accepted 2025-09-26 09:56:26,619 - lava_callback - INFO - Starting async job submit for node 68d3bb045180aefab120b6e9 2025-09-26 09:56:27,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:56:27,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bb045180aefab120b6e9 HTTP/1.1" 200 None 2025-09-26 09:56:27,326 - lava_callback - DEBUG - Processing node 68d3bb045180aefab120b6e9: ltp-controllers 2025-09-26 09:56:29,101 - lava_callback - INFO - Received callback for node 68d662e22f83206171a90230 INFO: 172.20.0.1:37604 - "POST /node/68d662e22f83206171a90230 HTTP/1.0" 202 Accepted 2025-09-26 09:56:29,120 - lava_callback - INFO - Starting async job submit for node 68d662e22f83206171a90230 2025-09-26 09:56:29,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:56:29,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d662e22f83206171a90230 HTTP/1.1" 200 None 2025-09-26 09:56:29,243 - lava_callback - DEBUG - Processing node 68d662e22f83206171a90230: baseline-x86 2025-09-26 09:56:30,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:56:32,295 - lava_callback - ERROR - Error processing callback for node 68d3bb045180aefab120b6e9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 09:56:32,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:56:32,819 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d662e22f83206171a90230/log.txt.gz 2025-09-26 09:56:32,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 09:56:33,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 09:56:33,353 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d662e22f83206171a90230/lava_callback.json.gz 2025-09-26 09:56:33,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:56:33,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d662e22f83206171a90230 HTTP/1.1" 200 None 2025-09-26 09:56:33,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:56:33,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65cb12f83206171a8fe90 HTTP/1.1" 200 None 2025-09-26 09:56:33,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:56:33,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d662e22f83206171a90230 HTTP/1.1" 200 None 2025-09-26 09:56:33,470 - lava_callback - INFO - Completed processing callback for node 68d662e22f83206171a90230 INFO: 172.20.0.1:57358 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:56:37,928 - lava_callback - INFO - Received callback for node 68d3c03a5180aefab120ca18 INFO: 172.20.0.1:57364 - "POST /node/68d3c03a5180aefab120ca18 HTTP/1.0" 202 Accepted 2025-09-26 09:56:37,936 - lava_callback - INFO - Starting async job submit for node 68d3c03a5180aefab120ca18 2025-09-26 09:56:37,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:56:37,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c03a5180aefab120ca18 HTTP/1.1" 200 None 2025-09-26 09:56:37,955 - lava_callback - DEBUG - Processing node 68d3c03a5180aefab120ca18: baseline-arm64-baylibre 2025-09-26 09:56:37,955 - lava_callback - ERROR - Error processing callback for node 68d3c03a5180aefab120ca18: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:46676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44816 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:57:17,939 - lava_callback - INFO - Received callback for node 68d3c0705180aefab120ca90 INFO: 172.20.0.1:44818 - "POST /node/68d3c0705180aefab120ca90 HTTP/1.0" 202 Accepted 2025-09-26 09:57:17,948 - lava_callback - INFO - Starting async job submit for node 68d3c0705180aefab120ca90 2025-09-26 09:57:17,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:57:17,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c0705180aefab120ca90 HTTP/1.1" 200 None 2025-09-26 09:57:17,966 - lava_callback - DEBUG - Processing node 68d3c0705180aefab120ca90: baseline-arm64-baylibre 2025-09-26 09:57:17,966 - lava_callback - ERROR - Error processing callback for node 68d3c0705180aefab120ca90: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:44820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34890 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:57:37,937 - lava_callback - INFO - Received callback for node 68d3c0755180aefab120ca96 INFO: 172.20.0.1:34896 - "POST /node/68d3c0755180aefab120ca96 HTTP/1.0" 202 Accepted 2025-09-26 09:57:37,946 - lava_callback - INFO - Starting async job submit for node 68d3c0755180aefab120ca96 2025-09-26 09:57:37,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:57:37,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c0755180aefab120ca96 HTTP/1.1" 200 None 2025-09-26 09:57:37,981 - lava_callback - DEBUG - Processing node 68d3c0755180aefab120ca96: baseline-arm64-baylibre 2025-09-26 09:57:37,981 - lava_callback - ERROR - Error processing callback for node 68d3c0755180aefab120ca96: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:57:38,343 - lava_callback - INFO - Received callback for node 68d40900cd36afa834e16d4b INFO: 172.20.0.1:34908 - "POST /node/68d40900cd36afa834e16d4b HTTP/1.0" 202 Accepted 2025-09-26 09:57:38,359 - lava_callback - INFO - Starting async job submit for node 68d40900cd36afa834e16d4b 2025-09-26 09:57:38,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:57:38,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40900cd36afa834e16d4b HTTP/1.1" 200 None 2025-09-26 09:57:38,426 - lava_callback - DEBUG - Processing node 68d40900cd36afa834e16d4b: baseline-arm 2025-09-26 09:57:38,603 - lava_callback - INFO - Received callback for node 68d3c07f5180aefab120caa8 INFO: 172.20.0.1:34912 - "POST /node/68d3c07f5180aefab120caa8 HTTP/1.0" 202 Accepted 2025-09-26 09:57:38,611 - lava_callback - INFO - Starting async job submit for node 68d3c07f5180aefab120caa8 2025-09-26 09:57:38,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:57:38,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c07f5180aefab120caa8 HTTP/1.1" 200 None 2025-09-26 09:57:38,703 - lava_callback - DEBUG - Processing node 68d3c07f5180aefab120caa8: baseline-arm64-baylibre 2025-09-26 09:57:38,703 - lava_callback - ERROR - Error processing callback for node 68d3c07f5180aefab120caa8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:57:38,848 - lava_callback - ERROR - Error processing callback for node 68d40900cd36afa834e16d4b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 09:57:39,273 - lava_callback - INFO - Received callback for node 68d3c0865180aefab120caaf INFO: 172.20.0.1:34926 - "POST /node/68d3c0865180aefab120caaf HTTP/1.0" 202 Accepted 2025-09-26 09:57:39,282 - lava_callback - INFO - Starting async job submit for node 68d3c0865180aefab120caaf 2025-09-26 09:57:39,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:57:39,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c0865180aefab120caaf HTTP/1.1" 200 None 2025-09-26 09:57:39,307 - lava_callback - DEBUG - Processing node 68d3c0865180aefab120caaf: baseline-arm64-baylibre 2025-09-26 09:57:39,307 - lava_callback - ERROR - Error processing callback for node 68d3c0865180aefab120caaf: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:58254 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:57:50,616 - lava_callback - INFO - Received callback for node 68d3c08a5180aefab120cab5 INFO: 172.20.0.1:52060 - "POST /node/68d3c08a5180aefab120cab5 HTTP/1.0" 202 Accepted 2025-09-26 09:57:50,625 - lava_callback - INFO - Starting async job submit for node 68d3c08a5180aefab120cab5 2025-09-26 09:57:50,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:57:50,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c08a5180aefab120cab5 HTTP/1.1" 200 None 2025-09-26 09:57:50,641 - lava_callback - DEBUG - Processing node 68d3c08a5180aefab120cab5: baseline-arm64-clabbe 2025-09-26 09:57:50,641 - lava_callback - ERROR - Error processing callback for node 68d3c08a5180aefab120cab5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:52076 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:57:57,961 - lava_callback - INFO - Received callback for node 68d3c08e5180aefab120cab7 INFO: 172.20.0.1:52082 - "POST /node/68d3c08e5180aefab120cab7 HTTP/1.0" 202 Accepted 2025-09-26 09:57:57,970 - lava_callback - INFO - Starting async job submit for node 68d3c08e5180aefab120cab7 2025-09-26 09:57:57,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:57:57,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c08e5180aefab120cab7 HTTP/1.1" 200 None 2025-09-26 09:57:57,989 - lava_callback - DEBUG - Processing node 68d3c08e5180aefab120cab7: baseline-arm64-baylibre 2025-09-26 09:57:57,989 - lava_callback - ERROR - Error processing callback for node 68d3c08e5180aefab120cab7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:57:58,634 - lava_callback - INFO - Received callback for node 68d3c0935180aefab120cabe INFO: 172.20.0.1:52086 - "POST /node/68d3c0935180aefab120cabe HTTP/1.0" 202 Accepted 2025-09-26 09:57:58,643 - lava_callback - INFO - Starting async job submit for node 68d3c0935180aefab120cabe 2025-09-26 09:57:58,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:57:58,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c0935180aefab120cabe HTTP/1.1" 200 None 2025-09-26 09:57:58,669 - lava_callback - DEBUG - Processing node 68d3c0935180aefab120cabe: baseline-arm64-baylibre 2025-09-26 09:57:58,669 - lava_callback - ERROR - Error processing callback for node 68d3c0935180aefab120cabe: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:38212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58468 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:58:50,591 - lava_callback - INFO - Received callback for node 68d3c0b85180aefab120cb09 INFO: 172.20.0.1:41700 - "POST /node/68d3c0b85180aefab120cb09 HTTP/1.0" 202 Accepted 2025-09-26 09:58:50,597 - lava_callback - INFO - Starting async job submit for node 68d3c0b85180aefab120cb09 2025-09-26 09:58:50,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:58:50,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c0b85180aefab120cb09 HTTP/1.1" 200 None 2025-09-26 09:58:50,611 - lava_callback - DEBUG - Processing node 68d3c0b85180aefab120cb09: baseline-arm64-clabbe 2025-09-26 09:58:50,611 - lava_callback - ERROR - Error processing callback for node 68d3c0b85180aefab120cb09: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 09:58:51,266 - lava_callback - INFO - Received callback for node 68d3c0ca5180aefab120cb21 INFO: 172.20.0.1:41712 - "POST /node/68d3c0ca5180aefab120cb21 HTTP/1.0" 202 Accepted 2025-09-26 09:58:51,271 - lava_callback - INFO - Starting async job submit for node 68d3c0ca5180aefab120cb21 2025-09-26 09:58:51,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:58:51,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c0ca5180aefab120cb21 HTTP/1.1" 200 None 2025-09-26 09:58:51,286 - lava_callback - DEBUG - Processing node 68d3c0ca5180aefab120cb21: baseline-arm64-clabbe 2025-09-26 09:58:51,287 - lava_callback - ERROR - Error processing callback for node 68d3c0ca5180aefab120cb21: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:41718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43084 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:59:10,575 - lava_callback - INFO - Received callback for node 68d3c0d75180aefab120cb33 INFO: 172.20.0.1:47210 - "POST /node/68d3c0d75180aefab120cb33 HTTP/1.0" 202 Accepted 2025-09-26 09:59:10,584 - lava_callback - INFO - Starting async job submit for node 68d3c0d75180aefab120cb33 2025-09-26 09:59:10,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:59:10,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c0d75180aefab120cb33 HTTP/1.1" 200 None 2025-09-26 09:59:10,601 - lava_callback - DEBUG - Processing node 68d3c0d75180aefab120cb33: baseline-arm64-clabbe 2025-09-26 09:59:10,601 - lava_callback - ERROR - Error processing callback for node 68d3c0d75180aefab120cb33: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:47226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37932 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:59:30,593 - lava_callback - INFO - Received callback for node 68d3c0ef5180aefab120cb5f INFO: 172.20.0.1:36140 - "POST /node/68d3c0ef5180aefab120cb5f HTTP/1.0" 202 Accepted 2025-09-26 09:59:30,599 - lava_callback - INFO - Starting async job submit for node 68d3c0ef5180aefab120cb5f 2025-09-26 09:59:30,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:59:30,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c0ef5180aefab120cb5f HTTP/1.1" 200 None 2025-09-26 09:59:30,615 - lava_callback - DEBUG - Processing node 68d3c0ef5180aefab120cb5f: baseline-arm64-clabbe 2025-09-26 09:59:30,615 - lava_callback - ERROR - Error processing callback for node 68d3c0ef5180aefab120cb5f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:36154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55628 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:59:50,655 - lava_callback - INFO - Received callback for node 68d3c1025180aefab120cb79 INFO: 172.20.0.1:56436 - "POST /node/68d3c1025180aefab120cb79 HTTP/1.0" 202 Accepted 2025-09-26 09:59:50,664 - lava_callback - INFO - Starting async job submit for node 68d3c1025180aefab120cb79 2025-09-26 09:59:50,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:59:50,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c1025180aefab120cb79 HTTP/1.1" 200 None 2025-09-26 09:59:50,678 - lava_callback - DEBUG - Processing node 68d3c1025180aefab120cb79: baseline-arm64-clabbe 2025-09-26 09:59:50,678 - lava_callback - ERROR - Error processing callback for node 68d3c1025180aefab120cb79: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:56442 - "GET / HTTP/1.0" 200 OK 2025-09-26 09:59:57,472 - lava_callback - INFO - Received callback for node 68d40901cd36afa834e16d4e INFO: 172.20.0.1:56450 - "POST /node/68d40901cd36afa834e16d4e HTTP/1.0" 202 Accepted 2025-09-26 09:59:57,478 - lava_callback - INFO - Starting async job submit for node 68d40901cd36afa834e16d4e 2025-09-26 09:59:57,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 09:59:57,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40901cd36afa834e16d4e HTTP/1.1" 200 None 2025-09-26 09:59:57,528 - lava_callback - DEBUG - Processing node 68d40901cd36afa834e16d4e: baseline-arm 2025-09-26 09:59:57,752 - lava_callback - ERROR - Error processing callback for node 68d40901cd36afa834e16d4e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:36338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34620 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:00:32,613 - lava_callback - INFO - Received callback for node 68d3c2fecd36afa834e0d776 INFO: 172.20.0.1:56174 - "POST /node/68d3c2fecd36afa834e0d776 HTTP/1.0" 202 Accepted 2025-09-26 10:00:32,620 - lava_callback - INFO - Starting async job submit for node 68d3c2fecd36afa834e0d776 2025-09-26 10:00:32,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:00:32,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c2fecd36afa834e0d776 HTTP/1.1" 200 None 2025-09-26 10:00:32,671 - lava_callback - DEBUG - Processing node 68d3c2fecd36afa834e0d776: ltp-input 2025-09-26 10:00:33,066 - lava_callback - ERROR - Error processing callback for node 68d3c2fecd36afa834e0d776: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:56182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58558 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:00:50,699 - lava_callback - INFO - Received callback for node 68d3c13d5180aefab120cd3c INFO: 172.20.0.1:41052 - "POST /node/68d3c13d5180aefab120cd3c HTTP/1.0" 202 Accepted 2025-09-26 10:00:50,705 - lava_callback - INFO - Starting async job submit for node 68d3c13d5180aefab120cd3c 2025-09-26 10:00:50,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:00:50,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c13d5180aefab120cd3c HTTP/1.1" 200 None 2025-09-26 10:00:50,724 - lava_callback - DEBUG - Processing node 68d3c13d5180aefab120cd3c: baseline-arm64-clabbe 2025-09-26 10:00:50,724 - lava_callback - ERROR - Error processing callback for node 68d3c13d5180aefab120cd3c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:00:51,372 - lava_callback - INFO - Received callback for node 68d3c1355180aefab120cd33 INFO: 172.20.0.1:41056 - "POST /node/68d3c1355180aefab120cd33 HTTP/1.0" 202 Accepted 2025-09-26 10:00:51,378 - lava_callback - INFO - Starting async job submit for node 68d3c1355180aefab120cd33 2025-09-26 10:00:51,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:00:51,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c1355180aefab120cd33 HTTP/1.1" 200 None 2025-09-26 10:00:51,397 - lava_callback - DEBUG - Processing node 68d3c1355180aefab120cd33: baseline-arm64-clabbe 2025-09-26 10:00:51,397 - lava_callback - ERROR - Error processing callback for node 68d3c1355180aefab120cd33: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:41064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54900 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:01:10,719 - lava_callback - INFO - Received callback for node 68d3c14a5180aefab120cd5b INFO: 172.20.0.1:46294 - "POST /node/68d3c14a5180aefab120cd5b HTTP/1.0" 202 Accepted 2025-09-26 10:01:10,724 - lava_callback - INFO - Starting async job submit for node 68d3c14a5180aefab120cd5b 2025-09-26 10:01:10,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:01:10,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c14a5180aefab120cd5b HTTP/1.1" 200 None 2025-09-26 10:01:10,738 - lava_callback - DEBUG - Processing node 68d3c14a5180aefab120cd5b: baseline-arm64-clabbe 2025-09-26 10:01:10,738 - lava_callback - ERROR - Error processing callback for node 68d3c14a5180aefab120cd5b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:46304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35570 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:01:30,719 - lava_callback - INFO - Received callback for node 68d3c1575180aefab120cd72 INFO: 172.20.0.1:52518 - "POST /node/68d3c1575180aefab120cd72 HTTP/1.0" 202 Accepted 2025-09-26 10:01:30,728 - lava_callback - INFO - Starting async job submit for node 68d3c1575180aefab120cd72 2025-09-26 10:01:30,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:01:30,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c1575180aefab120cd72 HTTP/1.1" 200 None 2025-09-26 10:01:30,751 - lava_callback - DEBUG - Processing node 68d3c1575180aefab120cd72: baseline-arm64-clabbe 2025-09-26 10:01:30,751 - lava_callback - ERROR - Error processing callback for node 68d3c1575180aefab120cd72: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:01:31,374 - lava_callback - INFO - Received callback for node 68d3c1615180aefab120cdcd INFO: 172.20.0.1:52532 - "POST /node/68d3c1615180aefab120cdcd HTTP/1.0" 202 Accepted 2025-09-26 10:01:31,379 - lava_callback - INFO - Starting async job submit for node 68d3c1615180aefab120cdcd 2025-09-26 10:01:31,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:01:31,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c1615180aefab120cdcd HTTP/1.1" 200 None 2025-09-26 10:01:31,412 - lava_callback - DEBUG - Processing node 68d3c1615180aefab120cdcd: baseline-arm64-clabbe 2025-09-26 10:01:31,412 - lava_callback - ERROR - Error processing callback for node 68d3c1615180aefab120cdcd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:52534 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:01:38,187 - lava_callback - INFO - Received callback for node 68d3c16d5180aefab120cdff INFO: 172.20.0.1:52548 - "POST /node/68d3c16d5180aefab120cdff HTTP/1.0" 202 Accepted 2025-09-26 10:01:38,193 - lava_callback - INFO - Starting async job submit for node 68d3c16d5180aefab120cdff 2025-09-26 10:01:38,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:01:38,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c16d5180aefab120cdff HTTP/1.1" 200 None 2025-09-26 10:01:38,207 - lava_callback - DEBUG - Processing node 68d3c16d5180aefab120cdff: baseline-arm64-baylibre 2025-09-26 10:01:38,207 - lava_callback - ERROR - Error processing callback for node 68d3c16d5180aefab120cdff: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:43974 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:01:50,766 - lava_callback - INFO - Received callback for node 68d3c1755180aefab120ce09 INFO: 172.20.0.1:52258 - "POST /node/68d3c1755180aefab120ce09 HTTP/1.0" 202 Accepted 2025-09-26 10:01:50,772 - lava_callback - INFO - Starting async job submit for node 68d3c1755180aefab120ce09 2025-09-26 10:01:50,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:01:50,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c1755180aefab120ce09 HTTP/1.1" 200 None 2025-09-26 10:01:50,787 - lava_callback - DEBUG - Processing node 68d3c1755180aefab120ce09: baseline-arm64-clabbe 2025-09-26 10:01:50,787 - lava_callback - ERROR - Error processing callback for node 68d3c1755180aefab120ce09: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:52266 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:01:58,205 - lava_callback - INFO - Received callback for node 68d3c1825180aefab120ce14 INFO: 172.20.0.1:52278 - "POST /node/68d3c1825180aefab120ce14 HTTP/1.0" 202 Accepted 2025-09-26 10:01:58,211 - lava_callback - INFO - Starting async job submit for node 68d3c1825180aefab120ce14 2025-09-26 10:01:58,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:01:58,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c1825180aefab120ce14 HTTP/1.1" 200 None 2025-09-26 10:01:58,226 - lava_callback - DEBUG - Processing node 68d3c1825180aefab120ce14: baseline-arm64-baylibre 2025-09-26 10:01:58,226 - lava_callback - ERROR - Error processing callback for node 68d3c1825180aefab120ce14: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:55806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50894 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:02:18,220 - lava_callback - INFO - Received callback for node 68d3c1965180aefab120ce26 INFO: 172.20.0.1:50902 - "POST /node/68d3c1965180aefab120ce26 HTTP/1.0" 202 Accepted 2025-09-26 10:02:18,228 - lava_callback - INFO - Starting async job submit for node 68d3c1965180aefab120ce26 2025-09-26 10:02:18,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:02:18,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c1965180aefab120ce26 HTTP/1.1" 200 None 2025-09-26 10:02:18,255 - lava_callback - DEBUG - Processing node 68d3c1965180aefab120ce26: baseline-arm64-baylibre 2025-09-26 10:02:18,255 - lava_callback - ERROR - Error processing callback for node 68d3c1965180aefab120ce26: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:50912 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:02:24,321 - lava_callback - INFO - Received callback for node 68d40908cd36afa834e16d57 INFO: 172.20.0.1:53782 - "POST /node/68d40908cd36afa834e16d57 HTTP/1.0" 202 Accepted 2025-09-26 10:02:24,330 - lava_callback - INFO - Starting async job submit for node 68d40908cd36afa834e16d57 2025-09-26 10:02:24,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:02:24,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40908cd36afa834e16d57 HTTP/1.1" 200 None 2025-09-26 10:02:24,364 - lava_callback - DEBUG - Processing node 68d40908cd36afa834e16d57: baseline-arm 2025-09-26 10:02:24,587 - lava_callback - ERROR - Error processing callback for node 68d40908cd36afa834e16d57: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:53798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41478 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:03:13,939 - lava_callback - INFO - Received callback for node 68d3c1ce5180aefab120ce7c INFO: 172.20.0.1:34054 - "POST /node/68d3c1ce5180aefab120ce7c HTTP/1.0" 202 Accepted 2025-09-26 10:03:13,945 - lava_callback - INFO - Starting async job submit for node 68d3c1ce5180aefab120ce7c 2025-09-26 10:03:13,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:03:13,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c1ce5180aefab120ce7c HTTP/1.1" 200 None 2025-09-26 10:03:13,960 - lava_callback - DEBUG - Processing node 68d3c1ce5180aefab120ce7c: baseline-arm64 2025-09-26 10:03:13,960 - lava_callback - ERROR - Error processing callback for node 68d3c1ce5180aefab120ce7c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:34062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37686 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:03:34,082 - lava_callback - INFO - Received callback for node 68d6604b2f83206171a900d5 INFO: 172.20.0.1:35116 - "POST /node/68d6604b2f83206171a900d5 HTTP/1.0" 202 Accepted 2025-09-26 10:03:34,088 - lava_callback - INFO - Starting async job submit for node 68d6604b2f83206171a900d5 2025-09-26 10:03:34,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:03:34,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6604b2f83206171a900d5 HTTP/1.1" 200 None 2025-09-26 10:03:34,179 - lava_callback - DEBUG - Processing node 68d6604b2f83206171a900d5: ltp-smoketest 2025-09-26 10:03:34,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:35120 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:03:37,182 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:03:37,183 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d6604b2f83206171a900d5/log.txt.gz 2025-09-26 10:03:37,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:03:39,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:03:39,589 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d6604b2f83206171a900d5/lava_callback.json.gz 2025-09-26 10:03:39,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:03:39,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6604b2f83206171a900d5 HTTP/1.1" 200 None 2025-09-26 10:03:39,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:03:39,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c942f83206171a8fe61 HTTP/1.1" 200 None 2025-09-26 10:03:39,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:03:39,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6604b2f83206171a900d5 HTTP/1.1" 200 None 2025-09-26 10:03:39,868 - lava_callback - INFO - Completed processing callback for node 68d6604b2f83206171a900d5 2025-09-26 10:03:46,287 - lava_callback - INFO - Received callback for node 68d3c314cd36afa834e0d7ab INFO: 172.20.0.1:34946 - "POST /node/68d3c314cd36afa834e0d7ab HTTP/1.0" 202 Accepted 2025-09-26 10:03:46,294 - lava_callback - INFO - Starting async job submit for node 68d3c314cd36afa834e0d7ab 2025-09-26 10:03:46,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:03:46,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c314cd36afa834e0d7ab HTTP/1.1" 200 None 2025-09-26 10:03:46,343 - lava_callback - DEBUG - Processing node 68d3c314cd36afa834e0d7ab: ltp-sched INFO: 172.20.0.1:34950 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:03:46,808 - lava_callback - ERROR - Error processing callback for node 68d3c314cd36afa834e0d7ab: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:41994 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:04:00,157 - lava_callback - INFO - Received callback for node 68d660b02f83206171a900f6 INFO: 172.20.0.1:49924 - "POST /node/68d660b02f83206171a900f6 HTTP/1.0" 202 Accepted 2025-09-26 10:04:00,167 - lava_callback - INFO - Starting async job submit for node 68d660b02f83206171a900f6 2025-09-26 10:04:00,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:04:00,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660b02f83206171a900f6 HTTP/1.1" 200 None 2025-09-26 10:04:00,270 - lava_callback - DEBUG - Processing node 68d660b02f83206171a900f6: baseline-arm 2025-09-26 10:04:00,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:04:02,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:04:02,909 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d660b02f83206171a900f6/log.txt.gz 2025-09-26 10:04:02,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:04:05,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:04:05,590 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d660b02f83206171a900f6/lava_callback.json.gz DEBUG: Setup failed for 68d660b02f83206171a900f6. Transitting job node result: incomplete -> fail 2025-09-26 10:04:05,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:04:05,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660b02f83206171a900f6 HTTP/1.1" 200 None 2025-09-26 10:04:05,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:04:05,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-26 10:04:05,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:04:05,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660b02f83206171a900f6 HTTP/1.1" 200 None 2025-09-26 10:04:05,750 - lava_callback - INFO - Completed processing callback for node 68d660b02f83206171a900f6 INFO: 172.20.0.1:49930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44328 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:04:33,608 - lava_callback - INFO - Received callback for node 68d40909cd36afa834e16d5a INFO: 172.20.0.1:53722 - "POST /node/68d40909cd36afa834e16d5a HTTP/1.0" 202 Accepted 2025-09-26 10:04:33,618 - lava_callback - INFO - Starting async job submit for node 68d40909cd36afa834e16d5a 2025-09-26 10:04:33,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:04:33,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40909cd36afa834e16d5a HTTP/1.1" 200 None 2025-09-26 10:04:33,785 - lava_callback - DEBUG - Processing node 68d40909cd36afa834e16d5a: baseline-arm 2025-09-26 10:04:34,018 - lava_callback - ERROR - Error processing callback for node 68d40909cd36afa834e16d5a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:53738 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:04:43,732 - lava_callback - INFO - Received callback for node 68d660d92f83206171a9019d INFO: 172.20.0.1:54644 - "POST /node/68d660d92f83206171a9019d HTTP/1.0" 202 Accepted 2025-09-26 10:04:43,741 - lava_callback - INFO - Starting async job submit for node 68d660d92f83206171a9019d 2025-09-26 10:04:43,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:04:43,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660d92f83206171a9019d HTTP/1.1" 200 None 2025-09-26 10:04:43,807 - lava_callback - DEBUG - Processing node 68d660d92f83206171a9019d: baseline-arm 2025-09-26 10:04:44,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:54658 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:04:46,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:04:46,620 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d660d92f83206171a9019d/log.txt.gz 2025-09-26 10:04:46,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:04:48,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:04:48,941 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d660d92f83206171a9019d/lava_callback.json.gz DEBUG: Setup failed for 68d660d92f83206171a9019d. Transitting job node result: incomplete -> fail 2025-09-26 10:04:49,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:04:49,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d660d92f83206171a9019d HTTP/1.1" 200 None 2025-09-26 10:04:49,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:04:49,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-26 10:04:49,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:04:49,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d660d92f83206171a9019d HTTP/1.1" 200 None 2025-09-26 10:04:49,125 - lava_callback - INFO - Completed processing callback for node 68d660d92f83206171a9019d 2025-09-26 10:04:53,893 - lava_callback - INFO - Received callback for node 68d3c2285180aefab120cf05 INFO: 172.20.0.1:37764 - "POST /node/68d3c2285180aefab120cf05 HTTP/1.0" 202 Accepted 2025-09-26 10:04:53,898 - lava_callback - INFO - Starting async job submit for node 68d3c2285180aefab120cf05 2025-09-26 10:04:53,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:04:53,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c2285180aefab120cf05 HTTP/1.1" 200 None 2025-09-26 10:04:53,922 - lava_callback - DEBUG - Processing node 68d3c2285180aefab120cf05: baseline-arm64 2025-09-26 10:04:53,922 - lava_callback - ERROR - Error processing callback for node 68d3c2285180aefab120cf05: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:04:55,305 - lava_callback - INFO - Received callback for node 68d3c32acd36afa834e0d7bf INFO: 172.20.0.1:37774 - "POST /node/68d3c32acd36afa834e0d7bf HTTP/1.0" 202 Accepted 2025-09-26 10:04:55,312 - lava_callback - INFO - Starting async job submit for node 68d3c32acd36afa834e0d7bf 2025-09-26 10:04:55,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:04:55,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c32acd36afa834e0d7bf HTTP/1.1" 200 None 2025-09-26 10:04:55,365 - lava_callback - DEBUG - Processing node 68d3c32acd36afa834e0d7bf: ltp-ipc 2025-09-26 10:04:55,709 - lava_callback - ERROR - Error processing callback for node 68d3c32acd36afa834e0d7bf: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:37786 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:04:58,363 - lava_callback - INFO - Received callback for node 68d3c22c5180aefab120cf09 INFO: 172.20.0.1:37800 - "POST /node/68d3c22c5180aefab120cf09 HTTP/1.0" 202 Accepted 2025-09-26 10:04:58,368 - lava_callback - INFO - Starting async job submit for node 68d3c22c5180aefab120cf09 2025-09-26 10:04:58,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:04:58,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c22c5180aefab120cf09 HTTP/1.1" 200 None 2025-09-26 10:04:58,383 - lava_callback - DEBUG - Processing node 68d3c22c5180aefab120cf09: baseline-arm64-baylibre 2025-09-26 10:04:58,384 - lava_callback - ERROR - Error processing callback for node 68d3c22c5180aefab120cf09: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:43184 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:05:06,329 - lava_callback - INFO - Received callback for node 68d3c2f7cd36afa834e0d773 INFO: 172.20.0.1:43196 - "POST /node/68d3c2f7cd36afa834e0d773 HTTP/1.0" 202 Accepted 2025-09-26 10:05:06,336 - lava_callback - INFO - Starting async job submit for node 68d3c2f7cd36afa834e0d773 2025-09-26 10:05:06,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:05:06,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c2f7cd36afa834e0d773 HTTP/1.1" 200 None 2025-09-26 10:05:06,398 - lava_callback - DEBUG - Processing node 68d3c2f7cd36afa834e0d773: ltp-pty INFO: 172.20.0.1:43200 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:05:06,791 - lava_callback - ERROR - Error processing callback for node 68d3c2f7cd36afa834e0d773: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:35392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35402 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:05:18,386 - lava_callback - INFO - Received callback for node 68d3c2435180aefab120cf1d INFO: 172.20.0.1:35414 - "POST /node/68d3c2435180aefab120cf1d HTTP/1.0" 202 Accepted 2025-09-26 10:05:18,394 - lava_callback - INFO - Starting async job submit for node 68d3c2435180aefab120cf1d 2025-09-26 10:05:18,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:05:18,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c2435180aefab120cf1d HTTP/1.1" 200 None 2025-09-26 10:05:18,412 - lava_callback - DEBUG - Processing node 68d3c2435180aefab120cf1d: baseline-arm64-baylibre 2025-09-26 10:05:18,412 - lava_callback - ERROR - Error processing callback for node 68d3c2435180aefab120cf1d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:35422 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:05:19,063 - lava_callback - INFO - Received callback for node 68d3c2485180aefab120cf23 INFO: 172.20.0.1:35426 - "POST /node/68d3c2485180aefab120cf23 HTTP/1.0" 202 Accepted 2025-09-26 10:05:19,071 - lava_callback - INFO - Starting async job submit for node 68d3c2485180aefab120cf23 2025-09-26 10:05:19,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:05:19,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c2485180aefab120cf23 HTTP/1.1" 200 None 2025-09-26 10:05:19,091 - lava_callback - DEBUG - Processing node 68d3c2485180aefab120cf23: baseline-arm64-baylibre 2025-09-26 10:05:19,091 - lava_callback - ERROR - Error processing callback for node 68d3c2485180aefab120cf23: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:55912 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:05:32,572 - lava_callback - INFO - Received callback for node 68d3be8e5180aefab120c540 INFO: 172.20.0.1:52584 - "POST /node/68d3be8e5180aefab120c540 HTTP/1.0" 202 Accepted 2025-09-26 10:05:32,580 - lava_callback - INFO - Starting async job submit for node 68d3be8e5180aefab120c540 2025-09-26 10:05:32,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:05:32,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be8e5180aefab120c540 HTTP/1.1" 200 None 2025-09-26 10:05:32,647 - lava_callback - DEBUG - Processing node 68d3be8e5180aefab120c540: baseline-arm64 2025-09-26 10:05:33,679 - lava_callback - ERROR - Error processing callback for node 68d3be8e5180aefab120c540: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:52598 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:05:38,391 - lava_callback - INFO - Received callback for node 68d3c2505180aefab120cf8a INFO: 172.20.0.1:52600 - "POST /node/68d3c2505180aefab120cf8a HTTP/1.0" 202 Accepted 2025-09-26 10:05:38,399 - lava_callback - INFO - Starting async job submit for node 68d3c2505180aefab120cf8a 2025-09-26 10:05:38,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:05:38,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c2505180aefab120cf8a HTTP/1.1" 200 None 2025-09-26 10:05:38,425 - lava_callback - DEBUG - Processing node 68d3c2505180aefab120cf8a: baseline-arm64-baylibre 2025-09-26 10:05:38,425 - lava_callback - ERROR - Error processing callback for node 68d3c2505180aefab120cf8a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:49480 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:05:52,101 - lava_callback - INFO - Received callback for node 68d43cbba5c2c05277bc96c1 INFO: 172.20.0.1:54552 - "POST /node/68d43cbba5c2c05277bc96c1 HTTP/1.0" 202 Accepted 2025-09-26 10:05:52,108 - lava_callback - INFO - Starting async job submit for node 68d43cbba5c2c05277bc96c1 2025-09-26 10:05:52,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:05:52,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d43cbba5c2c05277bc96c1 HTTP/1.1" 200 None 2025-09-26 10:05:52,143 - lava_callback - DEBUG - Processing node 68d43cbba5c2c05277bc96c1: baseline-arm64-broonie 2025-09-26 10:05:52,457 - lava_callback - ERROR - Error processing callback for node 68d43cbba5c2c05277bc96c1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:54562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39712 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:06:41,065 - lava_callback - INFO - Received callback for node 68d3be935180aefab120c54d INFO: 172.20.0.1:53258 - "POST /node/68d3be935180aefab120c54d HTTP/1.0" 202 Accepted 2025-09-26 10:06:41,077 - lava_callback - INFO - Starting async job submit for node 68d3be935180aefab120c54d 2025-09-26 10:06:41,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:06:41,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be935180aefab120c54d HTTP/1.1" 200 None 2025-09-26 10:06:41,135 - lava_callback - DEBUG - Processing node 68d3be935180aefab120c54d: baseline-arm64 2025-09-26 10:06:42,040 - lava_callback - ERROR - Error processing callback for node 68d3be935180aefab120c54d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:53264 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:06:55,713 - lava_callback - INFO - Received callback for node 68d40912cd36afa834e16d63 INFO: 172.20.0.1:59192 - "POST /node/68d40912cd36afa834e16d63 HTTP/1.0" 202 Accepted 2025-09-26 10:06:55,721 - lava_callback - INFO - Starting async job submit for node 68d40912cd36afa834e16d63 2025-09-26 10:06:55,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:06:55,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40912cd36afa834e16d63 HTTP/1.1" 200 None 2025-09-26 10:06:55,782 - lava_callback - DEBUG - Processing node 68d40912cd36afa834e16d63: baseline-arm 2025-09-26 10:06:56,136 - lava_callback - ERROR - Error processing callback for node 68d40912cd36afa834e16d63: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:59202 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:07:02,178 - lava_callback - INFO - Received callback for node 68d3be9d5180aefab120c56b INFO: 172.20.0.1:41390 - "POST /node/68d3be9d5180aefab120c56b HTTP/1.0" 202 Accepted 2025-09-26 10:07:02,185 - lava_callback - INFO - Starting async job submit for node 68d3be9d5180aefab120c56b 2025-09-26 10:07:02,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:07:02,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3be9d5180aefab120c56b HTTP/1.1" 200 None 2025-09-26 10:07:02,260 - lava_callback - DEBUG - Processing node 68d3be9d5180aefab120c56b: baseline-arm64 2025-09-26 10:07:03,087 - lava_callback - ERROR - Error processing callback for node 68d3be9d5180aefab120c56b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:07:05,547 - lava_callback - INFO - Received callback for node 68d3c31dcd36afa834e0d7b6 INFO: 172.20.0.1:41406 - "POST /node/68d3c31dcd36afa834e0d7b6 HTTP/1.0" 202 Accepted 2025-09-26 10:07:05,564 - lava_callback - INFO - Starting async job submit for node 68d3c31dcd36afa834e0d7b6 2025-09-26 10:07:05,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:07:05,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c31dcd36afa834e0d7b6 HTTP/1.1" 200 None 2025-09-26 10:07:05,750 - lava_callback - DEBUG - Processing node 68d3c31dcd36afa834e0d7b6: baseline-arm64 INFO: 172.20.0.1:41420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41432 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:07:10,455 - lava_callback - ERROR - Error processing callback for node 68d3c31dcd36afa834e0d7b6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:45774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49344 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:07:42,547 - lava_callback - INFO - Received callback for node 68d3c41fcd36afa834e0d9ce INFO: 172.20.0.1:44232 - "POST /node/68d3c41fcd36afa834e0d9ce HTTP/1.0" 202 Accepted 2025-09-26 10:07:42,556 - lava_callback - INFO - Starting async job submit for node 68d3c41fcd36afa834e0d9ce 2025-09-26 10:07:42,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:07:42,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c41fcd36afa834e0d9ce HTTP/1.1" 200 None 2025-09-26 10:07:42,624 - lava_callback - DEBUG - Processing node 68d3c41fcd36afa834e0d9ce: baseline-arm 2025-09-26 10:07:42,980 - lava_callback - ERROR - Error processing callback for node 68d3c41fcd36afa834e0d9ce: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:44238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51650 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:08:14,707 - lava_callback - INFO - Received callback for node 68d43d30a5c2c05277bc9753 INFO: 172.20.0.1:52630 - "POST /node/68d43d30a5c2c05277bc9753 HTTP/1.0" 202 Accepted 2025-09-26 10:08:14,716 - lava_callback - INFO - Starting async job submit for node 68d43d30a5c2c05277bc9753 2025-09-26 10:08:14,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:08:14,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d43d30a5c2c05277bc9753 HTTP/1.1" 200 None 2025-09-26 10:08:14,753 - lava_callback - DEBUG - Processing node 68d43d30a5c2c05277bc9753: baseline-arm64-broonie 2025-09-26 10:08:14,905 - lava_callback - INFO - Received callback for node 68d3c353cd36afa834e0d80d INFO: 172.20.0.1:52632 - "POST /node/68d3c353cd36afa834e0d80d HTTP/1.0" 202 Accepted 2025-09-26 10:08:14,924 - lava_callback - INFO - Starting async job submit for node 68d3c353cd36afa834e0d80d 2025-09-26 10:08:14,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:08:15,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c353cd36afa834e0d80d HTTP/1.1" 200 None 2025-09-26 10:08:15,080 - lava_callback - DEBUG - Processing node 68d3c353cd36afa834e0d80d: baseline-arm64 INFO: 172.20.0.1:52646 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 10:08:15,501 - lava_callback - ERROR - Error processing callback for node 68d43d30a5c2c05277bc9753: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:08:15,716 - lava_callback - ERROR - Error processing callback for node 68d3c353cd36afa834e0d80d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:52648 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:08:17,321 - lava_callback - INFO - Received callback for node 68d3c4efcd36afa834e0dbaa INFO: 172.20.0.1:52650 - "POST /node/68d3c4efcd36afa834e0dbaa HTTP/1.0" 202 Accepted 2025-09-26 10:08:17,332 - lava_callback - INFO - Starting async job submit for node 68d3c4efcd36afa834e0dbaa 2025-09-26 10:08:17,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:08:17,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4efcd36afa834e0dbaa HTTP/1.1" 200 None 2025-09-26 10:08:17,392 - lava_callback - DEBUG - Processing node 68d3c4efcd36afa834e0dbaa: baseline-arm64 2025-09-26 10:08:18,283 - lava_callback - ERROR - Error processing callback for node 68d3c4efcd36afa834e0dbaa: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:52658 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:08:21,032 - lava_callback - INFO - Received callback for node 68d3bea15180aefab120c578 INFO: 172.20.0.1:58440 - "POST /node/68d3bea15180aefab120c578 HTTP/1.0" 202 Accepted 2025-09-26 10:08:21,044 - lava_callback - INFO - Starting async job submit for node 68d3bea15180aefab120c578 2025-09-26 10:08:21,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:08:21,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3bea15180aefab120c578 HTTP/1.1" 200 None 2025-09-26 10:08:21,178 - lava_callback - DEBUG - Processing node 68d3bea15180aefab120c578: baseline-arm64 2025-09-26 10:08:22,194 - lava_callback - ERROR - Error processing callback for node 68d3bea15180aefab120c578: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:58454 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:08:33,178 - lava_callback - INFO - Received callback for node 68d3c4f9cd36afa834e0dbce INFO: 172.20.0.1:47368 - "POST /node/68d3c4f9cd36afa834e0dbce HTTP/1.0" 202 Accepted 2025-09-26 10:08:33,188 - lava_callback - INFO - Starting async job submit for node 68d3c4f9cd36afa834e0dbce 2025-09-26 10:08:33,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:08:33,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4f9cd36afa834e0dbce HTTP/1.1" 200 None 2025-09-26 10:08:33,246 - lava_callback - DEBUG - Processing node 68d3c4f9cd36afa834e0dbce: baseline-arm64 2025-09-26 10:08:33,804 - lava_callback - ERROR - Error processing callback for node 68d3c4f9cd36afa834e0dbce: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:47372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57416 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:09:09,756 - lava_callback - INFO - Received callback for node 68d665d82f83206171a902a2 INFO: 172.20.0.1:44116 - "POST /node/68d665d82f83206171a902a2 HTTP/1.0" 202 Accepted 2025-09-26 10:09:09,763 - lava_callback - INFO - Starting async job submit for node 68d665d82f83206171a902a2 2025-09-26 10:09:09,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:09,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665d82f83206171a902a2 HTTP/1.1" 200 None 2025-09-26 10:09:09,812 - lava_callback - DEBUG - Processing node 68d665d82f83206171a902a2: baseline-arm64 2025-09-26 10:09:10,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:12,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:12,568 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665d82f83206171a902a2/log.txt.gz 2025-09-26 10:09:12,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:12,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:12,983 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665d82f83206171a902a2/lava_callback.json.gz 2025-09-26 10:09:13,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:13,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665d82f83206171a902a2 HTTP/1.1" 200 None 2025-09-26 10:09:13,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:13,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:09:13,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:13,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665d82f83206171a902a2 HTTP/1.1" 200 None 2025-09-26 10:09:13,123 - lava_callback - INFO - Completed processing callback for node 68d665d82f83206171a902a2 2025-09-26 10:09:13,218 - lava_callback - INFO - Received callback for node 68d40914cd36afa834e16d66 INFO: 172.20.0.1:44122 - "POST /node/68d40914cd36afa834e16d66 HTTP/1.0" 202 Accepted 2025-09-26 10:09:13,228 - lava_callback - INFO - Starting async job submit for node 68d40914cd36afa834e16d66 2025-09-26 10:09:13,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:13,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40914cd36afa834e16d66 HTTP/1.1" 200 None 2025-09-26 10:09:13,268 - lava_callback - DEBUG - Processing node 68d40914cd36afa834e16d66: baseline-arm 2025-09-26 10:09:13,685 - lava_callback - ERROR - Error processing callback for node 68d40914cd36afa834e16d66: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:09:13,986 - lava_callback - INFO - Received callback for node 68d6660d2f83206171a90344 INFO: 172.20.0.1:44136 - "POST /node/68d6660d2f83206171a90344 HTTP/1.0" 202 Accepted 2025-09-26 10:09:13,996 - lava_callback - INFO - Starting async job submit for node 68d6660d2f83206171a90344 2025-09-26 10:09:14,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:14,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6660d2f83206171a90344 HTTP/1.1" 200 None 2025-09-26 10:09:14,069 - lava_callback - DEBUG - Processing node 68d6660d2f83206171a90344: baseline-arm64-foundriesio 2025-09-26 10:09:14,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:14,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:14,621 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6660d2f83206171a90344/log.txt.gz 2025-09-26 10:09:14,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:14,868 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:14,869 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6660d2f83206171a90344/lava_callback.json.gz 2025-09-26 10:09:14,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:14,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6660d2f83206171a90344 HTTP/1.1" 200 None 2025-09-26 10:09:14,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:14,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:09:14,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:14,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6660d2f83206171a90344 HTTP/1.1" 200 None 2025-09-26 10:09:14,990 - lava_callback - INFO - Completed processing callback for node 68d6660d2f83206171a90344 INFO: 172.20.0.1:44146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44158 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:09:16,683 - lava_callback - INFO - Received callback for node 68d665f02f83206171a902e7 INFO: 172.20.0.1:44172 - "POST /node/68d665f02f83206171a902e7 HTTP/1.0" 202 Accepted 2025-09-26 10:09:16,692 - lava_callback - INFO - Starting async job submit for node 68d665f02f83206171a902e7 2025-09-26 10:09:16,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:16,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665f02f83206171a902e7 HTTP/1.1" 200 None 2025-09-26 10:09:16,755 - lava_callback - DEBUG - Processing node 68d665f02f83206171a902e7: baseline-arm64-broonie 2025-09-26 10:09:16,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:18,358 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:18,359 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d665f02f83206171a902e7/log.txt.gz 2025-09-26 10:09:18,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:18,551 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:18,551 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d665f02f83206171a902e7/lava_callback.json.gz 2025-09-26 10:09:18,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:18,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665f02f83206171a902e7 HTTP/1.1" 200 None 2025-09-26 10:09:18,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:18,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:09:18,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:18,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665f02f83206171a902e7 HTTP/1.1" 200 None 2025-09-26 10:09:18,631 - lava_callback - INFO - Completed processing callback for node 68d665f02f83206171a902e7 INFO: 172.20.0.1:44182 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:09:20,130 - lava_callback - INFO - Received callback for node 68d665f62f83206171a902fc INFO: 172.20.0.1:48342 - "POST /node/68d665f62f83206171a902fc HTTP/1.0" 202 Accepted 2025-09-26 10:09:20,139 - lava_callback - INFO - Starting async job submit for node 68d665f62f83206171a902fc 2025-09-26 10:09:20,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:20,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665f62f83206171a902fc HTTP/1.1" 200 None 2025-09-26 10:09:20,200 - lava_callback - DEBUG - Processing node 68d665f62f83206171a902fc: baseline-arm64-broonie 2025-09-26 10:09:20,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:20,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:20,692 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d665f62f83206171a902fc/log.txt.gz 2025-09-26 10:09:20,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:20,812 - lava_callback - INFO - Received callback for node 68d6660c2f83206171a90341 2025-09-26 10:09:20,813 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 INFO: 172.20.0.1:48354 - "POST /node/68d6660c2f83206171a90341 HTTP/1.0" 202 Accepted 2025-09-26 10:09:20,819 - lava_callback - INFO - Starting async job submit for node 68d6660c2f83206171a90341 2025-09-26 10:09:20,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:20,841 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d665f62f83206171a902fc/lava_callback.json.gz 2025-09-26 10:09:20,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:20,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6660c2f83206171a90341 HTTP/1.1" 200 None 2025-09-26 10:09:20,877 - lava_callback - DEBUG - Processing node 68d6660c2f83206171a90341: baseline-arm64-foundriesio 2025-09-26 10:09:20,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665f62f83206171a902fc HTTP/1.1" 200 None 2025-09-26 10:09:20,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:20,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:09:21,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:21,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665f62f83206171a902fc HTTP/1.1" 200 None 2025-09-26 10:09:21,121 - lava_callback - INFO - Completed processing callback for node 68d665f62f83206171a902fc 2025-09-26 10:09:21,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:23,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:23,762 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6660c2f83206171a90341/log.txt.gz 2025-09-26 10:09:23,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:23,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:23,939 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6660c2f83206171a90341/lava_callback.json.gz 2025-09-26 10:09:23,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:23,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6660c2f83206171a90341 HTTP/1.1" 200 None 2025-09-26 10:09:23,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:23,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:09:23,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:24,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6660c2f83206171a90341 HTTP/1.1" 200 None 2025-09-26 10:09:24,019 - lava_callback - INFO - Completed processing callback for node 68d6660c2f83206171a90341 2025-09-26 10:09:24,696 - lava_callback - INFO - Received callback for node 68d666082f83206171a9033b INFO: 172.20.0.1:48358 - "POST /node/68d666082f83206171a9033b HTTP/1.0" 202 Accepted 2025-09-26 10:09:24,705 - lava_callback - INFO - Starting async job submit for node 68d666082f83206171a9033b 2025-09-26 10:09:24,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:24,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d666082f83206171a9033b HTTP/1.1" 200 None 2025-09-26 10:09:24,762 - lava_callback - DEBUG - Processing node 68d666082f83206171a9033b: baseline-arm64-pengutronix 2025-09-26 10:09:25,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:25,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:25,184 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d666082f83206171a9033b/log.txt.gz 2025-09-26 10:09:25,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:25,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:25,351 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d666082f83206171a9033b/lava_callback.json.gz 2025-09-26 10:09:25,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:25,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d666082f83206171a9033b HTTP/1.1" 200 None 2025-09-26 10:09:25,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:25,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:09:25,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:25,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d666082f83206171a9033b HTTP/1.1" 200 None 2025-09-26 10:09:25,472 - lava_callback - INFO - Completed processing callback for node 68d666082f83206171a9033b INFO: 172.20.0.1:48364 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:09:29,636 - lava_callback - INFO - Received callback for node 68d666092f83206171a9033e INFO: 172.20.0.1:36384 - "POST /node/68d666092f83206171a9033e HTTP/1.0" 202 Accepted 2025-09-26 10:09:29,642 - lava_callback - INFO - Starting async job submit for node 68d666092f83206171a9033e 2025-09-26 10:09:29,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:29,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d666092f83206171a9033e HTTP/1.1" 200 None 2025-09-26 10:09:29,680 - lava_callback - DEBUG - Processing node 68d666092f83206171a9033e: baseline-arm64-pengutronix 2025-09-26 10:09:29,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:30,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:30,153 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d666092f83206171a9033e/log.txt.gz 2025-09-26 10:09:30,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:30,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:30,333 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d666092f83206171a9033e/lava_callback.json.gz 2025-09-26 10:09:30,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:30,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d666092f83206171a9033e HTTP/1.1" 200 None 2025-09-26 10:09:30,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:30,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:09:30,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:30,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d666092f83206171a9033e HTTP/1.1" 200 None 2025-09-26 10:09:30,416 - lava_callback - INFO - Completed processing callback for node 68d666092f83206171a9033e 2025-09-26 10:09:33,956 - lava_callback - INFO - Received callback for node 68d665d32f83206171a9029c INFO: 172.20.0.1:36390 - "POST /node/68d665d32f83206171a9029c HTTP/1.0" 202 Accepted 2025-09-26 10:09:33,962 - lava_callback - INFO - Starting async job submit for node 68d665d32f83206171a9029c 2025-09-26 10:09:33,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:33,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665d32f83206171a9029c HTTP/1.1" 200 None 2025-09-26 10:09:33,997 - lava_callback - DEBUG - Processing node 68d665d32f83206171a9029c: baseline-arm64 2025-09-26 10:09:34,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:34,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:34,624 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665d32f83206171a9029c/log.txt.gz 2025-09-26 10:09:34,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:35,324 - lava_callback - INFO - Received callback for node 68d665de2f83206171a902b7 INFO: 172.20.0.1:36392 - "POST /node/68d665de2f83206171a902b7 HTTP/1.0" 202 Accepted 2025-09-26 10:09:35,331 - lava_callback - INFO - Starting async job submit for node 68d665de2f83206171a902b7 2025-09-26 10:09:35,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:35,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665de2f83206171a902b7 HTTP/1.1" 200 None 2025-09-26 10:09:35,377 - lava_callback - DEBUG - Processing node 68d665de2f83206171a902b7: baseline-arm64 2025-09-26 10:09:35,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:36408 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:09:36,549 - lava_callback - INFO - Received callback for node 68d665cf2f83206171a9028a INFO: 172.20.0.1:36420 - "POST /node/68d665cf2f83206171a9028a HTTP/1.0" 202 Accepted 2025-09-26 10:09:36,555 - lava_callback - INFO - Starting async job submit for node 68d665cf2f83206171a9028a 2025-09-26 10:09:36,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:36,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665cf2f83206171a9028a HTTP/1.1" 200 None 2025-09-26 10:09:36,588 - lava_callback - DEBUG - Processing node 68d665cf2f83206171a9028a: baseline-arm64 2025-09-26 10:09:36,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:37,024 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:37,025 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665cf2f83206171a9028a/log.txt.gz 2025-09-26 10:09:37,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:37,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:37,161 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665de2f83206171a902b7/log.txt.gz 2025-09-26 10:09:37,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:37,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:37,306 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665d32f83206171a9029c/lava_callback.json.gz 2025-09-26 10:09:37,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:37,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665d32f83206171a9029c HTTP/1.1" 200 None 2025-09-26 10:09:37,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:37,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:09:37,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:37,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665d32f83206171a9029c HTTP/1.1" 200 None 2025-09-26 10:09:37,426 - lava_callback - INFO - Completed processing callback for node 68d665d32f83206171a9029c 2025-09-26 10:09:37,790 - lava_callback - INFO - Received callback for node 68d665e22f83206171a902bd INFO: 172.20.0.1:36432 - "POST /node/68d665e22f83206171a902bd HTTP/1.0" 202 Accepted 2025-09-26 10:09:37,796 - lava_callback - INFO - Starting async job submit for node 68d665e22f83206171a902bd 2025-09-26 10:09:37,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:37,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665e22f83206171a902bd HTTP/1.1" 200 None 2025-09-26 10:09:37,843 - lava_callback - DEBUG - Processing node 68d665e22f83206171a902bd: baseline-arm64 2025-09-26 10:09:38,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:38,673 - lava_callback - INFO - Received callback for node 68d3c93dcd36afa834e0ec01 2025-09-26 10:09:38,679 - lava_callback - INFO - Starting async job submit for node 68d3c93dcd36afa834e0ec01 INFO: 172.20.0.1:36436 - "POST /node/68d3c93dcd36afa834e0ec01 HTTP/1.0" 202 Accepted 2025-09-26 10:09:38,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:38,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c93dcd36afa834e0ec01 HTTP/1.1" 200 None 2025-09-26 10:09:38,715 - lava_callback - DEBUG - Processing node 68d3c93dcd36afa834e0ec01: baseline-arm64 2025-09-26 10:09:39,027 - lava_callback - ERROR - Error processing callback for node 68d3c93dcd36afa834e0ec01: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:09:39,615 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:39,615 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665de2f83206171a902b7/lava_callback.json.gz 2025-09-26 10:09:39,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:39,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665de2f83206171a902b7 HTTP/1.1" 200 None 2025-09-26 10:09:39,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:39,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:39,687 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665cf2f83206171a9028a/lava_callback.json.gz 2025-09-26 10:09:39,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:09:39,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:39,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:39,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665cf2f83206171a9028a HTTP/1.1" 200 None 2025-09-26 10:09:39,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:39,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665de2f83206171a902b7 HTTP/1.1" 200 None 2025-09-26 10:09:39,791 - lava_callback - INFO - Completed processing callback for node 68d665de2f83206171a902b7 2025-09-26 10:09:39,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:09:39,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:39,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665cf2f83206171a9028a HTTP/1.1" 200 None 2025-09-26 10:09:39,835 - lava_callback - INFO - Completed processing callback for node 68d665cf2f83206171a9028a 2025-09-26 10:09:40,024 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:40,025 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665e22f83206171a902bd/log.txt.gz 2025-09-26 10:09:40,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:40,238 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:40,239 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665e22f83206171a902bd/lava_callback.json.gz 2025-09-26 10:09:40,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:40,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665e22f83206171a902bd HTTP/1.1" 200 None 2025-09-26 10:09:40,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:40,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:09:40,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:40,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665e22f83206171a902bd HTTP/1.1" 200 None 2025-09-26 10:09:40,333 - lava_callback - INFO - Completed processing callback for node 68d665e22f83206171a902bd 2025-09-26 10:09:40,806 - lava_callback - INFO - Received callback for node 68d666032f83206171a9032c INFO: 172.20.0.1:37332 - "POST /node/68d666032f83206171a9032c HTTP/1.0" 202 Accepted 2025-09-26 10:09:40,815 - lava_callback - INFO - Starting async job submit for node 68d666032f83206171a9032c 2025-09-26 10:09:40,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:40,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d666032f83206171a9032c HTTP/1.1" 200 None 2025-09-26 10:09:40,880 - lava_callback - DEBUG - Processing node 68d666032f83206171a9032c: baseline-arm64-clabbe 2025-09-26 10:09:41,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:41,276 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:41,277 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d666032f83206171a9032c/log.txt.gz 2025-09-26 10:09:41,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:41,407 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:41,408 - lava_callback - INFO - Received callback for node 68d666072f83206171a90335 2025-09-26 10:09:41,408 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d666032f83206171a9032c/lava_callback.json.gz INFO: 172.20.0.1:37346 - "POST /node/68d666072f83206171a90335 HTTP/1.0" 202 Accepted 2025-09-26 10:09:41,429 - lava_callback - INFO - Starting async job submit for node 68d666072f83206171a90335 2025-09-26 10:09:41,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:41,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:41,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d666032f83206171a9032c HTTP/1.1" 200 None 2025-09-26 10:09:41,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d666072f83206171a90335 HTTP/1.1" 200 None 2025-09-26 10:09:41,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:41,510 - lava_callback - DEBUG - Processing node 68d666072f83206171a90335: baseline-arm64-kontron 2025-09-26 10:09:41,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:09:41,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:41,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d666032f83206171a9032c HTTP/1.1" 200 None 2025-09-26 10:09:41,640 - lava_callback - INFO - Completed processing callback for node 68d666032f83206171a9032c 2025-09-26 10:09:42,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:42,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:42,230 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d666072f83206171a90335/log.txt.gz 2025-09-26 10:09:42,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:42,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:42,406 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d666072f83206171a90335/lava_callback.json.gz 2025-09-26 10:09:42,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:42,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d666072f83206171a90335 HTTP/1.1" 200 None 2025-09-26 10:09:42,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:42,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:09:42,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:42,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d666072f83206171a90335 HTTP/1.1" 200 None 2025-09-26 10:09:42,503 - lava_callback - INFO - Completed processing callback for node 68d666072f83206171a90335 INFO: 172.20.0.1:37362 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:09:46,546 - lava_callback - INFO - Received callback for node 68d3c36bcd36afa834e0d826 INFO: 172.20.0.1:37376 - "POST /node/68d3c36bcd36afa834e0d826 HTTP/1.0" 202 Accepted 2025-09-26 10:09:46,557 - lava_callback - INFO - Starting async job submit for node 68d3c36bcd36afa834e0d826 2025-09-26 10:09:46,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:46,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c36bcd36afa834e0d826 HTTP/1.1" 200 None 2025-09-26 10:09:46,622 - lava_callback - DEBUG - Processing node 68d3c36bcd36afa834e0d826: ltp-cap-bounds 2025-09-26 10:09:47,162 - lava_callback - ERROR - Error processing callback for node 68d3c36bcd36afa834e0d826: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:09:48,065 - lava_callback - INFO - Received callback for node 68d665f92f83206171a9030d INFO: 172.20.0.1:37390 - "POST /node/68d665f92f83206171a9030d HTTP/1.0" 202 Accepted 2025-09-26 10:09:48,071 - lava_callback - INFO - Starting async job submit for node 68d665f92f83206171a9030d 2025-09-26 10:09:48,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:48,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665f92f83206171a9030d HTTP/1.1" 200 None 2025-09-26 10:09:48,109 - lava_callback - DEBUG - Processing node 68d665f92f83206171a9030d: baseline-arm64-broonie 2025-09-26 10:09:48,251 - lava_callback - INFO - Received callback for node 68d665da2f83206171a902ab INFO: 172.20.0.1:37396 - "POST /node/68d665da2f83206171a902ab HTTP/1.0" 202 Accepted 2025-09-26 10:09:48,267 - lava_callback - INFO - Starting async job submit for node 68d665da2f83206171a902ab 2025-09-26 10:09:48,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:48,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665da2f83206171a902ab HTTP/1.1" 200 None 2025-09-26 10:09:48,412 - lava_callback - DEBUG - Processing node 68d665da2f83206171a902ab: baseline-arm64 2025-09-26 10:09:48,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:48,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:48,883 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d665f92f83206171a9030d/log.txt.gz 2025-09-26 10:09:48,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:49,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:49,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:49,111 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d665f92f83206171a9030d/lava_callback.json.gz 2025-09-26 10:09:49,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:49,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665f92f83206171a9030d HTTP/1.1" 200 None 2025-09-26 10:09:49,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:49,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:09:49,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:49,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665f92f83206171a9030d HTTP/1.1" 200 None 2025-09-26 10:09:49,220 - lava_callback - INFO - Completed processing callback for node 68d665f92f83206171a9030d 2025-09-26 10:09:49,262 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:49,263 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665da2f83206171a902ab/log.txt.gz 2025-09-26 10:09:49,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:49,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:49,534 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665da2f83206171a902ab/lava_callback.json.gz 2025-09-26 10:09:49,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:49,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665da2f83206171a902ab HTTP/1.1" 200 None 2025-09-26 10:09:49,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:49,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:09:49,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:49,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665da2f83206171a902ab HTTP/1.1" 200 None 2025-09-26 10:09:49,634 - lava_callback - INFO - Completed processing callback for node 68d665da2f83206171a902ab 2025-09-26 10:09:51,344 - lava_callback - INFO - Received callback for node 68d3c932cd36afa834e0ebd7 INFO: 172.20.0.1:43802 - "POST /node/68d3c932cd36afa834e0ebd7 HTTP/1.0" 202 Accepted 2025-09-26 10:09:51,354 - lava_callback - INFO - Starting async job submit for node 68d3c932cd36afa834e0ebd7 2025-09-26 10:09:51,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:51,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c932cd36afa834e0ebd7 HTTP/1.1" 200 None 2025-09-26 10:09:51,408 - lava_callback - DEBUG - Processing node 68d3c932cd36afa834e0ebd7: baseline-arm64 2025-09-26 10:09:51,872 - lava_callback - ERROR - Error processing callback for node 68d3c932cd36afa834e0ebd7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:09:56,273 - lava_callback - INFO - Received callback for node 68d665d32f83206171a90296 INFO: 172.20.0.1:43818 - "POST /node/68d665d32f83206171a90296 HTTP/1.0" 202 Accepted 2025-09-26 10:09:56,280 - lava_callback - INFO - Starting async job submit for node 68d665d32f83206171a90296 2025-09-26 10:09:56,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:56,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665d32f83206171a90296 HTTP/1.1" 200 None 2025-09-26 10:09:56,326 - lava_callback - DEBUG - Processing node 68d665d32f83206171a90296: baseline-arm64 INFO: 172.20.0.1:43832 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:09:56,641 - lava_callback - INFO - Received callback for node 68d665d22f83206171a90290 INFO: 172.20.0.1:43844 - "POST /node/68d665d22f83206171a90290 HTTP/1.0" 202 Accepted 2025-09-26 10:09:56,666 - lava_callback - INFO - Starting async job submit for node 68d665d22f83206171a90290 2025-09-26 10:09:56,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:56,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:56,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665d22f83206171a90290 HTTP/1.1" 200 None 2025-09-26 10:09:56,755 - lava_callback - DEBUG - Processing node 68d665d22f83206171a90290: baseline-arm64 2025-09-26 10:09:57,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:57,423 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:57,424 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665d32f83206171a90296/log.txt.gz 2025-09-26 10:09:57,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:57,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:57,597 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665d22f83206171a90290/log.txt.gz 2025-09-26 10:09:57,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:57,599 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665d32f83206171a90296/lava_callback.json.gz 2025-09-26 10:09:57,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:57,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:57,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665d32f83206171a90296 HTTP/1.1" 200 None 2025-09-26 10:09:57,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:57,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:09:57,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:57,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665d32f83206171a90296 HTTP/1.1" 200 None 2025-09-26 10:09:57,689 - lava_callback - INFO - Completed processing callback for node 68d665d32f83206171a90296 2025-09-26 10:09:57,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:57,850 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665d22f83206171a90290/lava_callback.json.gz 2025-09-26 10:09:57,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:57,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665d22f83206171a90290 HTTP/1.1" 200 None 2025-09-26 10:09:57,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:57,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:09:57,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:57,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665d22f83206171a90290 HTTP/1.1" 200 None 2025-09-26 10:09:57,935 - lava_callback - INFO - Completed processing callback for node 68d665d22f83206171a90290 2025-09-26 10:09:58,095 - lava_callback - INFO - Received callback for node 68d665db2f83206171a902b4 INFO: 172.20.0.1:43860 - "POST /node/68d665db2f83206171a902b4 HTTP/1.0" 202 Accepted 2025-09-26 10:09:58,102 - lava_callback - INFO - Starting async job submit for node 68d665db2f83206171a902b4 2025-09-26 10:09:58,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:58,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665db2f83206171a902b4 HTTP/1.1" 200 None 2025-09-26 10:09:58,136 - lava_callback - DEBUG - Processing node 68d665db2f83206171a902b4: baseline-arm64 2025-09-26 10:09:58,204 - lava_callback - INFO - Received callback for node 68d665db2f83206171a902b1 INFO: 172.20.0.1:43862 - "POST /node/68d665db2f83206171a902b1 HTTP/1.0" 202 Accepted 2025-09-26 10:09:58,232 - lava_callback - INFO - Starting async job submit for node 68d665db2f83206171a902b1 2025-09-26 10:09:58,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:58,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665db2f83206171a902b1 HTTP/1.1" 200 None 2025-09-26 10:09:58,380 - lava_callback - DEBUG - Processing node 68d665db2f83206171a902b1: baseline-arm64 2025-09-26 10:09:59,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:59,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:59,516 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:59,517 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665db2f83206171a902b4/log.txt.gz 2025-09-26 10:09:59,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:59,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:59,607 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665db2f83206171a902b1/log.txt.gz 2025-09-26 10:09:59,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:09:59,830 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:59,831 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665db2f83206171a902b4/lava_callback.json.gz 2025-09-26 10:09:59,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:59,874 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:09:59,875 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665db2f83206171a902b1/lava_callback.json.gz 2025-09-26 10:09:59,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665db2f83206171a902b4 HTTP/1.1" 200 None 2025-09-26 10:09:59,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:59,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:59,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:09:59,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665db2f83206171a902b1 HTTP/1.1" 200 None 2025-09-26 10:09:59,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:59,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:59,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:09:59,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:09:59,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665db2f83206171a902b4 HTTP/1.1" 200 None 2025-09-26 10:09:59,960 - lava_callback - INFO - Completed processing callback for node 68d665db2f83206171a902b4 2025-09-26 10:10:00,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665db2f83206171a902b1 HTTP/1.1" 200 None 2025-09-26 10:10:00,020 - lava_callback - INFO - Completed processing callback for node 68d665db2f83206171a902b1 2025-09-26 10:10:00,335 - lava_callback - INFO - Received callback for node 68d665d32f83206171a90299 INFO: 172.20.0.1:41192 - "POST /node/68d665d32f83206171a90299 HTTP/1.0" 202 Accepted 2025-09-26 10:10:00,344 - lava_callback - INFO - Starting async job submit for node 68d665d32f83206171a90299 2025-09-26 10:10:00,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:00,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665d32f83206171a90299 HTTP/1.1" 200 None 2025-09-26 10:10:00,409 - lava_callback - DEBUG - Processing node 68d665d32f83206171a90299: baseline-arm64 2025-09-26 10:10:00,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:10:01,421 - lava_callback - INFO - Received callback for node 68d666042f83206171a90331 INFO: 172.20.0.1:41196 - "POST /node/68d666042f83206171a90331 HTTP/1.0" 202 Accepted 2025-09-26 10:10:01,427 - lava_callback - INFO - Starting async job submit for node 68d666042f83206171a90331 2025-09-26 10:10:01,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:01,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d666042f83206171a90331 HTTP/1.1" 200 None 2025-09-26 10:10:01,496 - lava_callback - DEBUG - Processing node 68d666042f83206171a90331: baseline-arm64-kontron 2025-09-26 10:10:01,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:10:03,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:10:03,526 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d666042f83206171a90331/log.txt.gz 2025-09-26 10:10:03,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:10:03,544 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:10:03,545 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665d32f83206171a90299/log.txt.gz 2025-09-26 10:10:03,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:10:03,727 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:10:03,727 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665d32f83206171a90299/lava_callback.json.gz 2025-09-26 10:10:03,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:03,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:10:03,750 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d666042f83206171a90331/lava_callback.json.gz 2025-09-26 10:10:03,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:03,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665d32f83206171a90299 HTTP/1.1" 200 None 2025-09-26 10:10:03,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:03,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:10:03,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:03,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d666042f83206171a90331 HTTP/1.1" 200 None 2025-09-26 10:10:03,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:03,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:10:03,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:03,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665d32f83206171a90299 HTTP/1.1" 200 None 2025-09-26 10:10:03,874 - lava_callback - INFO - Completed processing callback for node 68d665d32f83206171a90299 2025-09-26 10:10:03,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d666042f83206171a90331 HTTP/1.1" 200 None 2025-09-26 10:10:03,902 - lava_callback - INFO - Completed processing callback for node 68d666042f83206171a90331 2025-09-26 10:10:05,261 - lava_callback - INFO - Received callback for node 68d665d62f83206171a9029f INFO: 172.20.0.1:41202 - "POST /node/68d665d62f83206171a9029f HTTP/1.0" 202 Accepted 2025-09-26 10:10:05,273 - lava_callback - INFO - Starting async job submit for node 68d665d62f83206171a9029f 2025-09-26 10:10:05,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:05,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665d62f83206171a9029f HTTP/1.1" 200 None 2025-09-26 10:10:05,358 - lava_callback - DEBUG - Processing node 68d665d62f83206171a9029f: baseline-arm64 2025-09-26 10:10:05,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:10:05,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:10:05,971 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665d62f83206171a9029f/log.txt.gz 2025-09-26 10:10:05,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:10:06,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:10:06,119 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665d62f83206171a9029f/lava_callback.json.gz 2025-09-26 10:10:06,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:06,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665d62f83206171a9029f HTTP/1.1" 200 None 2025-09-26 10:10:06,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:06,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:10:06,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:06,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665d62f83206171a9029f HTTP/1.1" 200 None 2025-09-26 10:10:06,204 - lava_callback - INFO - Completed processing callback for node 68d665d62f83206171a9029f 2025-09-26 10:10:06,290 - lava_callback - INFO - Received callback for node 68d665f22f83206171a902f0 INFO: 172.20.0.1:41216 - "POST /node/68d665f22f83206171a902f0 HTTP/1.0" 202 Accepted 2025-09-26 10:10:06,297 - lava_callback - INFO - Starting async job submit for node 68d665f22f83206171a902f0 2025-09-26 10:10:06,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:06,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665f22f83206171a902f0 HTTP/1.1" 200 None 2025-09-26 10:10:06,350 - lava_callback - DEBUG - Processing node 68d665f22f83206171a902f0: baseline-arm64-broonie INFO: 172.20.0.1:41224 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:10:06,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:10:07,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:10:07,210 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d665f22f83206171a902f0/log.txt.gz 2025-09-26 10:10:07,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:10:07,364 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:10:07,365 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d665f22f83206171a902f0/lava_callback.json.gz 2025-09-26 10:10:07,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:07,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665f22f83206171a902f0 HTTP/1.1" 200 None 2025-09-26 10:10:07,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:07,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:10:07,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:07,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665f22f83206171a902f0 HTTP/1.1" 200 None 2025-09-26 10:10:07,462 - lava_callback - INFO - Completed processing callback for node 68d665f22f83206171a902f0 2025-09-26 10:10:07,487 - lava_callback - INFO - Received callback for node 68d3c378cd36afa834e0d84a INFO: 172.20.0.1:41236 - "POST /node/68d3c378cd36afa834e0d84a HTTP/1.0" 202 Accepted 2025-09-26 10:10:07,497 - lava_callback - INFO - Starting async job submit for node 68d3c378cd36afa834e0d84a 2025-09-26 10:10:07,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:41240 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:10:07,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c378cd36afa834e0d84a HTTP/1.1" 200 None 2025-09-26 10:10:07,530 - lava_callback - DEBUG - Processing node 68d3c378cd36afa834e0d84a: ltp-containers 2025-09-26 10:10:07,530 - lava_callback - ERROR - Error processing callback for node 68d3c378cd36afa834e0d84a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:10:07,769 - lava_callback - INFO - Received callback for node 68d665f32f83206171a902f3 INFO: 172.20.0.1:41254 - "POST /node/68d665f32f83206171a902f3 HTTP/1.0" 202 Accepted 2025-09-26 10:10:07,777 - lava_callback - INFO - Starting async job submit for node 68d665f32f83206171a902f3 2025-09-26 10:10:07,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:07,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665f32f83206171a902f3 HTTP/1.1" 200 None 2025-09-26 10:10:07,816 - lava_callback - DEBUG - Processing node 68d665f32f83206171a902f3: baseline-arm64-broonie 2025-09-26 10:10:08,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:10:10,172 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:10:10,173 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d665f32f83206171a902f3/log.txt.gz 2025-09-26 10:10:10,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:10:10,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:10:10,387 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d665f32f83206171a902f3/lava_callback.json.gz 2025-09-26 10:10:10,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:10,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665f32f83206171a902f3 HTTP/1.1" 200 None 2025-09-26 10:10:10,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:10,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:10:10,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:10,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665f32f83206171a902f3 HTTP/1.1" 200 None 2025-09-26 10:10:10,468 - lava_callback - INFO - Completed processing callback for node 68d665f32f83206171a902f3 2025-09-26 10:10:13,370 - lava_callback - INFO - Received callback for node 68d665d92f83206171a902a5 INFO: 172.20.0.1:36246 - "POST /node/68d665d92f83206171a902a5 HTTP/1.0" 202 Accepted 2025-09-26 10:10:13,376 - lava_callback - INFO - Starting async job submit for node 68d665d92f83206171a902a5 2025-09-26 10:10:13,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:13,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665d92f83206171a902a5 HTTP/1.1" 200 None 2025-09-26 10:10:13,415 - lava_callback - DEBUG - Processing node 68d665d92f83206171a902a5: baseline-arm64 2025-09-26 10:10:13,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:36250 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 10:10:15,452 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:10:15,453 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665d92f83206171a902a5/log.txt.gz 2025-09-26 10:10:15,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:10:15,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:10:15,672 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665d92f83206171a902a5/lava_callback.json.gz 2025-09-26 10:10:15,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:15,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665d92f83206171a902a5 HTTP/1.1" 200 None 2025-09-26 10:10:15,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:15,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:10:15,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:15,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665d92f83206171a902a5 HTTP/1.1" 200 None 2025-09-26 10:10:15,784 - lava_callback - INFO - Completed processing callback for node 68d665d92f83206171a902a5 2025-09-26 10:10:16,279 - lava_callback - INFO - Received callback for node 68d43d33a5c2c05277bc9756 INFO: 172.20.0.1:36252 - "POST /node/68d43d33a5c2c05277bc9756 HTTP/1.0" 202 Accepted 2025-09-26 10:10:16,285 - lava_callback - INFO - Starting async job submit for node 68d43d33a5c2c05277bc9756 2025-09-26 10:10:16,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:16,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d43d33a5c2c05277bc9756 HTTP/1.1" 200 None 2025-09-26 10:10:16,332 - lava_callback - DEBUG - Processing node 68d43d33a5c2c05277bc9756: baseline-arm64-broonie INFO: 172.20.0.1:36264 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:10:16,780 - lava_callback - ERROR - Error processing callback for node 68d43d33a5c2c05277bc9756: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:10:17,318 - lava_callback - INFO - Received callback for node 68d665fe2f83206171a90317 INFO: 172.20.0.1:36274 - "POST /node/68d665fe2f83206171a90317 HTTP/1.0" 202 Accepted 2025-09-26 10:10:17,328 - lava_callback - INFO - Starting async job submit for node 68d665fe2f83206171a90317 2025-09-26 10:10:17,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:17,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665fe2f83206171a90317 HTTP/1.1" 200 None 2025-09-26 10:10:17,410 - lava_callback - DEBUG - Processing node 68d665fe2f83206171a90317: baseline-arm64-clabbe 2025-09-26 10:10:17,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:10:18,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:10:18,100 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d665fe2f83206171a90317/log.txt.gz 2025-09-26 10:10:18,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:10:18,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:10:18,249 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d665fe2f83206171a90317/lava_callback.json.gz 2025-09-26 10:10:18,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:18,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665fe2f83206171a90317 HTTP/1.1" 200 None 2025-09-26 10:10:18,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:18,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:10:18,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:18,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665fe2f83206171a90317 HTTP/1.1" 200 None 2025-09-26 10:10:18,325 - lava_callback - INFO - Completed processing callback for node 68d665fe2f83206171a90317 2025-09-26 10:10:18,618 - lava_callback - INFO - Received callback for node 68d3c373cd36afa834e0d844 INFO: 172.20.0.1:36288 - "POST /node/68d3c373cd36afa834e0d844 HTTP/1.0" 202 Accepted 2025-09-26 10:10:18,624 - lava_callback - INFO - Starting async job submit for node 68d3c373cd36afa834e0d844 2025-09-26 10:10:18,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:18,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c373cd36afa834e0d844 HTTP/1.1" 200 None 2025-09-26 10:10:18,639 - lava_callback - DEBUG - Processing node 68d3c373cd36afa834e0d844: baseline-arm64-baylibre 2025-09-26 10:10:18,639 - lava_callback - ERROR - Error processing callback for node 68d3c373cd36afa834e0d844: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:10:18,928 - lava_callback - INFO - Received callback for node 68d665fc2f83206171a90311 INFO: 172.20.0.1:36298 - "POST /node/68d665fc2f83206171a90311 HTTP/1.0" 202 Accepted 2025-09-26 10:10:18,935 - lava_callback - INFO - Starting async job submit for node 68d665fc2f83206171a90311 2025-09-26 10:10:18,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:18,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665fc2f83206171a90311 HTTP/1.1" 200 None 2025-09-26 10:10:18,972 - lava_callback - DEBUG - Processing node 68d665fc2f83206171a90311: baseline-arm64-broonie INFO: 172.20.0.1:36300 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:10:19,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:10:19,712 - lava_callback - INFO - Received callback for node 68d665e02f83206171a902ba INFO: 172.20.0.1:33634 - "POST /node/68d665e02f83206171a902ba HTTP/1.0" 202 Accepted 2025-09-26 10:10:19,718 - lava_callback - INFO - Starting async job submit for node 68d665e02f83206171a902ba 2025-09-26 10:10:19,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:19,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665e02f83206171a902ba HTTP/1.1" 200 None 2025-09-26 10:10:19,751 - lava_callback - DEBUG - Processing node 68d665e02f83206171a902ba: baseline-arm64 2025-09-26 10:10:20,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:10:21,095 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:10:21,095 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d665fc2f83206171a90311/log.txt.gz 2025-09-26 10:10:21,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:10:21,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:10:21,171 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665e02f83206171a902ba/log.txt.gz 2025-09-26 10:10:21,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:10:21,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:10:21,294 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d665fc2f83206171a90311/lava_callback.json.gz 2025-09-26 10:10:21,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:21,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:10:21,337 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665e02f83206171a902ba/lava_callback.json.gz 2025-09-26 10:10:21,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665fc2f83206171a90311 HTTP/1.1" 200 None 2025-09-26 10:10:21,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:21,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:21,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665e02f83206171a902ba HTTP/1.1" 200 None 2025-09-26 10:10:21,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:10:21,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:21,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:21,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:10:21,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:21,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665fc2f83206171a90311 HTTP/1.1" 200 None 2025-09-26 10:10:21,431 - lava_callback - INFO - Completed processing callback for node 68d665fc2f83206171a90311 2025-09-26 10:10:21,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665e02f83206171a902ba HTTP/1.1" 200 None 2025-09-26 10:10:21,455 - lava_callback - INFO - Completed processing callback for node 68d665e02f83206171a902ba INFO: 172.20.0.1:33644 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:10:26,889 - lava_callback - INFO - Received callback for node 68d665f82f83206171a90302 INFO: 172.20.0.1:33652 - "POST /node/68d665f82f83206171a90302 HTTP/1.0" 202 Accepted 2025-09-26 10:10:26,897 - lava_callback - INFO - Starting async job submit for node 68d665f82f83206171a90302 2025-09-26 10:10:26,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:26,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665f82f83206171a90302 HTTP/1.1" 200 None 2025-09-26 10:10:26,947 - lava_callback - DEBUG - Processing node 68d665f82f83206171a90302: baseline-arm64-broonie 2025-09-26 10:10:27,238 - lava_callback - INFO - Received callback for node 68d3c37fcd36afa834e0d851 INFO: 172.20.0.1:33664 - "POST /node/68d3c37fcd36afa834e0d851 HTTP/1.0" 202 Accepted 2025-09-26 10:10:27,261 - lava_callback - INFO - Starting async job submit for node 68d3c37fcd36afa834e0d851 2025-09-26 10:10:27,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:27,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c37fcd36afa834e0d851 HTTP/1.1" 200 None 2025-09-26 10:10:27,331 - lava_callback - DEBUG - Processing node 68d3c37fcd36afa834e0d851: ltp-sched 2025-09-26 10:10:27,331 - lava_callback - ERROR - Error processing callback for node 68d3c37fcd36afa834e0d851: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:10:27,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:10:27,625 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:10:27,625 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d665f82f83206171a90302/log.txt.gz 2025-09-26 10:10:27,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:10:27,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:10:27,760 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d665f82f83206171a90302/lava_callback.json.gz 2025-09-26 10:10:27,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:27,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665f82f83206171a90302 HTTP/1.1" 200 None 2025-09-26 10:10:27,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:27,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:10:27,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:27,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665f82f83206171a90302 HTTP/1.1" 200 None 2025-09-26 10:10:27,863 - lava_callback - INFO - Completed processing callback for node 68d665f82f83206171a90302 2025-09-26 10:10:28,003 - lava_callback - INFO - Received callback for node 68d3c384cd36afa834e0d857 INFO: 172.20.0.1:33666 - "POST /node/68d3c384cd36afa834e0d857 HTTP/1.0" 202 Accepted 2025-09-26 10:10:28,012 - lava_callback - INFO - Starting async job submit for node 68d3c384cd36afa834e0d857 2025-09-26 10:10:28,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:28,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c384cd36afa834e0d857 HTTP/1.1" 200 None 2025-09-26 10:10:28,053 - lava_callback - DEBUG - Processing node 68d3c384cd36afa834e0d857: ltp-controllers 2025-09-26 10:10:28,053 - lava_callback - ERROR - Error processing callback for node 68d3c384cd36afa834e0d857: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:10:36,464 - lava_callback - INFO - Received callback for node 68d665f22f83206171a902ea INFO: 172.20.0.1:37090 - "POST /node/68d665f22f83206171a902ea HTTP/1.0" 202 Accepted 2025-09-26 10:10:36,470 - lava_callback - INFO - Starting async job submit for node 68d665f22f83206171a902ea 2025-09-26 10:10:36,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:36,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665f22f83206171a902ea HTTP/1.1" 200 None 2025-09-26 10:10:36,521 - lava_callback - DEBUG - Processing node 68d665f22f83206171a902ea: baseline-arm64-broonie INFO: 172.20.0.1:37092 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:10:36,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:10:37,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:10:37,226 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d665f22f83206171a902ea/log.txt.gz 2025-09-26 10:10:37,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:10:39,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:10:39,759 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d665f22f83206171a902ea/lava_callback.json.gz 2025-09-26 10:10:39,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:39,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665f22f83206171a902ea HTTP/1.1" 200 None 2025-09-26 10:10:39,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:39,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:10:39,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:39,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665f22f83206171a902ea HTTP/1.1" 200 None 2025-09-26 10:10:39,862 - lava_callback - INFO - Completed processing callback for node 68d665f22f83206171a902ea INFO: 172.20.0.1:51422 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:10:47,329 - lava_callback - INFO - Received callback for node 68d3c390cd36afa834e0d895 INFO: 172.20.0.1:51436 - "POST /node/68d3c390cd36afa834e0d895 HTTP/1.0" 202 Accepted 2025-09-26 10:10:47,343 - lava_callback - INFO - Starting async job submit for node 68d3c390cd36afa834e0d895 2025-09-26 10:10:47,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:47,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c390cd36afa834e0d895 HTTP/1.1" 200 None 2025-09-26 10:10:47,362 - lava_callback - DEBUG - Processing node 68d3c390cd36afa834e0d895: ltp-smoketest 2025-09-26 10:10:47,362 - lava_callback - ERROR - Error processing callback for node 68d3c390cd36afa834e0d895: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:10:48,172 - lava_callback - INFO - Received callback for node 68d3c396cd36afa834e0d89b INFO: 172.20.0.1:51446 - "POST /node/68d3c396cd36afa834e0d89b HTTP/1.0" 202 Accepted 2025-09-26 10:10:48,181 - lava_callback - INFO - Starting async job submit for node 68d3c396cd36afa834e0d89b 2025-09-26 10:10:48,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:48,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c396cd36afa834e0d89b HTTP/1.1" 200 None 2025-09-26 10:10:48,201 - lava_callback - DEBUG - Processing node 68d3c396cd36afa834e0d89b: ltp-containers 2025-09-26 10:10:48,202 - lava_callback - ERROR - Error processing callback for node 68d3c396cd36afa834e0d89b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:10:48,952 - lava_callback - INFO - Received callback for node 68d3c39dcd36afa834e0d8a4 INFO: 172.20.0.1:51452 - "POST /node/68d3c39dcd36afa834e0d8a4 HTTP/1.0" 202 Accepted 2025-09-26 10:10:48,958 - lava_callback - INFO - Starting async job submit for node 68d3c39dcd36afa834e0d8a4 2025-09-26 10:10:48,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:48,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c39dcd36afa834e0d8a4 HTTP/1.1" 200 None 2025-09-26 10:10:48,985 - lava_callback - DEBUG - Processing node 68d3c39dcd36afa834e0d8a4: ltp-syscalls 2025-09-26 10:10:48,985 - lava_callback - ERROR - Error processing callback for node 68d3c39dcd36afa834e0d8a4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:10:49,713 - lava_callback - INFO - Received callback for node 68d3c3a3cd36afa834e0d8aa INFO: 172.20.0.1:45162 - "POST /node/68d3c3a3cd36afa834e0d8aa HTTP/1.0" 202 Accepted 2025-09-26 10:10:49,722 - lava_callback - INFO - Starting async job submit for node 68d3c3a3cd36afa834e0d8aa 2025-09-26 10:10:49,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:49,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c3a3cd36afa834e0d8aa HTTP/1.1" 200 None 2025-09-26 10:10:49,742 - lava_callback - DEBUG - Processing node 68d3c3a3cd36afa834e0d8aa: ltp-input 2025-09-26 10:10:49,742 - lava_callback - ERROR - Error processing callback for node 68d3c3a3cd36afa834e0d8aa: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:10:54,888 - lava_callback - INFO - Received callback for node 68d3cc11cd36afa834e0f393 INFO: 172.20.0.1:45176 - "POST /node/68d3cc11cd36afa834e0f393 HTTP/1.0" 202 Accepted 2025-09-26 10:10:54,897 - lava_callback - INFO - Starting async job submit for node 68d3cc11cd36afa834e0f393 2025-09-26 10:10:54,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:54,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc11cd36afa834e0f393 HTTP/1.1" 200 None 2025-09-26 10:10:54,931 - lava_callback - DEBUG - Processing node 68d3cc11cd36afa834e0f393: baseline-arm64 2025-09-26 10:10:55,258 - lava_callback - ERROR - Error processing callback for node 68d3cc11cd36afa834e0f393: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:45180 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:10:58,671 - lava_callback - INFO - Received callback for node 68d3c3a4cd36afa834e0d8ad INFO: 172.20.0.1:45196 - "POST /node/68d3c3a4cd36afa834e0d8ad HTTP/1.0" 202 Accepted 2025-09-26 10:10:58,677 - lava_callback - INFO - Starting async job submit for node 68d3c3a4cd36afa834e0d8ad 2025-09-26 10:10:58,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:10:58,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c3a4cd36afa834e0d8ad HTTP/1.1" 200 None 2025-09-26 10:10:58,692 - lava_callback - DEBUG - Processing node 68d3c3a4cd36afa834e0d8ad: baseline-arm64-baylibre 2025-09-26 10:10:58,692 - lava_callback - ERROR - Error processing callback for node 68d3c3a4cd36afa834e0d8ad: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:57348 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:11:07,344 - lava_callback - INFO - Received callback for node 68d3c3b0cd36afa834e0d8b9 INFO: 172.20.0.1:57364 - "POST /node/68d3c3b0cd36afa834e0d8b9 HTTP/1.0" 202 Accepted 2025-09-26 10:11:07,351 - lava_callback - INFO - Starting async job submit for node 68d3c3b0cd36afa834e0d8b9 2025-09-26 10:11:07,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:07,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c3b0cd36afa834e0d8b9 HTTP/1.1" 200 None 2025-09-26 10:11:07,365 - lava_callback - DEBUG - Processing node 68d3c3b0cd36afa834e0d8b9: ltp-controllers 2025-09-26 10:11:07,365 - lava_callback - ERROR - Error processing callback for node 68d3c3b0cd36afa834e0d8b9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:57378 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:11:12,408 - lava_callback - INFO - Received callback for node 68d3cc20cd36afa834e0f3bd INFO: 172.20.0.1:50286 - "POST /node/68d3cc20cd36afa834e0f3bd HTTP/1.0" 202 Accepted 2025-09-26 10:11:12,422 - lava_callback - INFO - Starting async job submit for node 68d3cc20cd36afa834e0f3bd 2025-09-26 10:11:12,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:12,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc20cd36afa834e0f3bd HTTP/1.1" 200 None 2025-09-26 10:11:12,467 - lava_callback - DEBUG - Processing node 68d3cc20cd36afa834e0f3bd: baseline-arm64 2025-09-26 10:11:14,400 - lava_callback - ERROR - Error processing callback for node 68d3cc20cd36afa834e0f3bd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:11:15,135 - lava_callback - INFO - Received callback for node 68d665ed2f83206171a902de INFO: 172.20.0.1:50290 - "POST /node/68d665ed2f83206171a902de HTTP/1.0" 202 Accepted 2025-09-26 10:11:15,144 - lava_callback - INFO - Starting async job submit for node 68d665ed2f83206171a902de INFO: 172.20.0.1:50304 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 10:11:15,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:15,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665ed2f83206171a902de HTTP/1.1" 200 None 2025-09-26 10:11:15,206 - lava_callback - DEBUG - Processing node 68d665ed2f83206171a902de: baseline-arm64-baylibre 2025-09-26 10:11:15,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:11:15,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:11:15,718 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d665ed2f83206171a902de/log.txt.gz 2025-09-26 10:11:15,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:11:15,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:11:15,841 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d665ed2f83206171a902de/lava_callback.json.gz 2025-09-26 10:11:15,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:15,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665ed2f83206171a902de HTTP/1.1" 200 None 2025-09-26 10:11:15,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:15,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:11:15,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:15,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665ed2f83206171a902de HTTP/1.1" 200 None 2025-09-26 10:11:15,977 - lava_callback - INFO - Completed processing callback for node 68d665ed2f83206171a902de INFO: 172.20.0.1:50306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34480 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:11:31,649 - lava_callback - INFO - Received callback for node 68d665f62f83206171a902f9 INFO: 172.20.0.1:49292 - "POST /node/68d665f62f83206171a902f9 HTTP/1.0" 202 Accepted 2025-09-26 10:11:31,655 - lava_callback - INFO - Starting async job submit for node 68d665f62f83206171a902f9 2025-09-26 10:11:31,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:31,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665f62f83206171a902f9 HTTP/1.1" 200 None 2025-09-26 10:11:31,705 - lava_callback - DEBUG - Processing node 68d665f62f83206171a902f9: baseline-arm64-broonie 2025-09-26 10:11:32,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:11:33,164 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:11:33,165 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d665f62f83206171a902f9/log.txt.gz 2025-09-26 10:11:33,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:11:34,806 - lava_callback - INFO - Received callback for node 68d40918cd36afa834e16d69 INFO: 172.20.0.1:49296 - "POST /node/68d40918cd36afa834e16d69 HTTP/1.0" 202 Accepted 2025-09-26 10:11:34,815 - lava_callback - INFO - Starting async job submit for node 68d40918cd36afa834e16d69 2025-09-26 10:11:34,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:34,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40918cd36afa834e16d69 HTTP/1.1" 200 None 2025-09-26 10:11:34,857 - lava_callback - DEBUG - Processing node 68d40918cd36afa834e16d69: baseline-arm 2025-09-26 10:11:35,114 - lava_callback - ERROR - Error processing callback for node 68d40918cd36afa834e16d69: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:11:35,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:11:35,551 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d665f62f83206171a902f9/lava_callback.json.gz 2025-09-26 10:11:35,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:35,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665f62f83206171a902f9 HTTP/1.1" 200 None 2025-09-26 10:11:35,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:35,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:11:35,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:35,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665f62f83206171a902f9 HTTP/1.1" 200 None 2025-09-26 10:11:35,673 - lava_callback - INFO - Completed processing callback for node 68d665f62f83206171a902f9 INFO: 172.20.0.1:49310 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:11:38,106 - lava_callback - INFO - Received callback for node 68d665ea2f83206171a902c6 INFO: 172.20.0.1:49318 - "POST /node/68d665ea2f83206171a902c6 HTTP/1.0" 202 Accepted 2025-09-26 10:11:38,115 - lava_callback - INFO - Starting async job submit for node 68d665ea2f83206171a902c6 2025-09-26 10:11:38,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:38,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665ea2f83206171a902c6 HTTP/1.1" 200 None 2025-09-26 10:11:38,156 - lava_callback - DEBUG - Processing node 68d665ea2f83206171a902c6: baseline-arm64-baylibre 2025-09-26 10:11:38,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:11:38,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:11:38,778 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d665ea2f83206171a902c6/log.txt.gz 2025-09-26 10:11:38,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:11:38,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:11:38,920 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d665ea2f83206171a902c6/lava_callback.json.gz 2025-09-26 10:11:38,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:38,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665ea2f83206171a902c6 HTTP/1.1" 200 None 2025-09-26 10:11:38,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:38,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:11:38,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:39,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665ea2f83206171a902c6 HTTP/1.1" 200 None 2025-09-26 10:11:39,035 - lava_callback - INFO - Completed processing callback for node 68d665ea2f83206171a902c6 INFO: 172.20.0.1:41328 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:11:47,393 - lava_callback - INFO - Received callback for node 68d3c3d0cd36afa834e0d90b INFO: 172.20.0.1:41338 - "POST /node/68d3c3d0cd36afa834e0d90b HTTP/1.0" 202 Accepted 2025-09-26 10:11:47,399 - lava_callback - INFO - Starting async job submit for node 68d3c3d0cd36afa834e0d90b 2025-09-26 10:11:47,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:47,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c3d0cd36afa834e0d90b HTTP/1.1" 200 None 2025-09-26 10:11:47,433 - lava_callback - DEBUG - Processing node 68d3c3d0cd36afa834e0d90b: ltp-cve 2025-09-26 10:11:47,433 - lava_callback - ERROR - Error processing callback for node 68d3c3d0cd36afa834e0d90b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:11:48,216 - lava_callback - INFO - Received callback for node 68d3c3d6cd36afa834e0d917 INFO: 172.20.0.1:41354 - "POST /node/68d3c3d6cd36afa834e0d917 HTTP/1.0" 202 Accepted 2025-09-26 10:11:48,222 - lava_callback - INFO - Starting async job submit for node 68d3c3d6cd36afa834e0d917 2025-09-26 10:11:48,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:48,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c3d6cd36afa834e0d917 HTTP/1.1" 200 None 2025-09-26 10:11:48,235 - lava_callback - DEBUG - Processing node 68d3c3d6cd36afa834e0d917: ltp-controllers 2025-09-26 10:11:48,236 - lava_callback - ERROR - Error processing callback for node 68d3c3d6cd36afa834e0d917: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:11:50,054 - lava_callback - INFO - Received callback for node 68d665e82f83206171a902c3 INFO: 172.20.0.1:60550 - "POST /node/68d665e82f83206171a902c3 HTTP/1.0" 202 Accepted 2025-09-26 10:11:50,060 - lava_callback - INFO - Starting async job submit for node 68d665e82f83206171a902c3 2025-09-26 10:11:50,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:50,082 - lava_callback - INFO - Received callback for node 68d665eb2f83206171a902cf INFO: 172.20.0.1:60560 - "POST /node/68d665eb2f83206171a902cf HTTP/1.0" 202 Accepted 2025-09-26 10:11:50,088 - lava_callback - INFO - Starting async job submit for node 68d665eb2f83206171a902cf 2025-09-26 10:11:50,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:50,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665e82f83206171a902c3 HTTP/1.1" 200 None 2025-09-26 10:11:50,118 - lava_callback - DEBUG - Processing node 68d665e82f83206171a902c3: baseline-arm64-baylibre 2025-09-26 10:11:50,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665eb2f83206171a902cf HTTP/1.1" 200 None 2025-09-26 10:11:50,155 - lava_callback - DEBUG - Processing node 68d665eb2f83206171a902cf: baseline-arm64-baylibre 2025-09-26 10:11:50,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:11:50,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:11:51,250 - lava_callback - INFO - Received callback for node 68d3c3e0cd36afa834e0d927 INFO: 172.20.0.1:60572 - "POST /node/68d3c3e0cd36afa834e0d927 HTTP/1.0" 202 Accepted 2025-09-26 10:11:51,258 - lava_callback - INFO - Starting async job submit for node 68d3c3e0cd36afa834e0d927 2025-09-26 10:11:51,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:51,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c3e0cd36afa834e0d927 HTTP/1.1" 200 None 2025-09-26 10:11:51,282 - lava_callback - DEBUG - Processing node 68d3c3e0cd36afa834e0d927: baseline-arm64-clabbe 2025-09-26 10:11:51,282 - lava_callback - ERROR - Error processing callback for node 68d3c3e0cd36afa834e0d927: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:11:51,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:11:51,445 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d665eb2f83206171a902cf/log.txt.gz 2025-09-26 10:11:51,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:11:51,470 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:11:51,470 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d665e82f83206171a902c3/log.txt.gz 2025-09-26 10:11:51,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:11:53,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:11:53,906 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d665e82f83206171a902c3/lava_callback.json.gz 2025-09-26 10:11:53,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:53,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:11:53,945 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d665eb2f83206171a902cf/lava_callback.json.gz 2025-09-26 10:11:53,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:53,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665e82f83206171a902c3 HTTP/1.1" 200 None 2025-09-26 10:11:53,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:53,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665eb2f83206171a902cf HTTP/1.1" 200 None 2025-09-26 10:11:53,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:53,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:11:54,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:54,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:11:54,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:11:54,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665e82f83206171a902c3 HTTP/1.1" 200 None 2025-09-26 10:11:54,031 - lava_callback - INFO - Completed processing callback for node 68d665e82f83206171a902c3 2025-09-26 10:11:54,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665eb2f83206171a902cf HTTP/1.1" 200 None 2025-09-26 10:11:54,063 - lava_callback - INFO - Completed processing callback for node 68d665eb2f83206171a902cf INFO: 172.20.0.1:60574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46562 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:12:11,244 - lava_callback - INFO - Received callback for node 68d3c3f0cd36afa834e0d943 INFO: 172.20.0.1:44462 - "POST /node/68d3c3f0cd36afa834e0d943 HTTP/1.0" 202 Accepted 2025-09-26 10:12:11,249 - lava_callback - INFO - Starting async job submit for node 68d3c3f0cd36afa834e0d943 2025-09-26 10:12:11,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:12:11,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c3f0cd36afa834e0d943 HTTP/1.1" 200 None 2025-09-26 10:12:11,263 - lava_callback - DEBUG - Processing node 68d3c3f0cd36afa834e0d943: baseline-arm64-clabbe 2025-09-26 10:12:11,263 - lava_callback - ERROR - Error processing callback for node 68d3c3f0cd36afa834e0d943: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:12:11,914 - lava_callback - INFO - Received callback for node 68d3c3f3cd36afa834e0d949 INFO: 172.20.0.1:44474 - "POST /node/68d3c3f3cd36afa834e0d949 HTTP/1.0" 202 Accepted 2025-09-26 10:12:11,922 - lava_callback - INFO - Starting async job submit for node 68d3c3f3cd36afa834e0d949 2025-09-26 10:12:11,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:12:11,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c3f3cd36afa834e0d949 HTTP/1.1" 200 None 2025-09-26 10:12:11,941 - lava_callback - DEBUG - Processing node 68d3c3f3cd36afa834e0d949: baseline-arm64-clabbe 2025-09-26 10:12:11,941 - lava_callback - ERROR - Error processing callback for node 68d3c3f3cd36afa834e0d949: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:44486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44500 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:12:17,876 - lava_callback - INFO - Received callback for node 68d665ea2f83206171a902c9 INFO: 172.20.0.1:44508 - "POST /node/68d665ea2f83206171a902c9 HTTP/1.0" 202 Accepted 2025-09-26 10:12:17,882 - lava_callback - INFO - Starting async job submit for node 68d665ea2f83206171a902c9 2025-09-26 10:12:17,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:12:17,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665ea2f83206171a902c9 HTTP/1.1" 200 None 2025-09-26 10:12:17,947 - lava_callback - DEBUG - Processing node 68d665ea2f83206171a902c9: baseline-arm64-baylibre 2025-09-26 10:12:18,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:44514 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:12:19,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:12:19,662 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d665ea2f83206171a902c9/log.txt.gz 2025-09-26 10:12:19,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:12:21,410 - lava_callback - INFO - Received callback for node 68d6667d2f83206171a9039d INFO: 172.20.0.1:49388 - "POST /node/68d6667d2f83206171a9039d HTTP/1.0" 202 Accepted 2025-09-26 10:12:21,417 - lava_callback - INFO - Starting async job submit for node 68d6667d2f83206171a9039d 2025-09-26 10:12:21,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:12:21,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6667d2f83206171a9039d HTTP/1.1" 200 None 2025-09-26 10:12:21,511 - lava_callback - DEBUG - Processing node 68d6667d2f83206171a9039d: baseline-arm64-kontron 2025-09-26 10:12:21,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:12:22,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:12:22,204 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d665ea2f83206171a902c9/lava_callback.json.gz 2025-09-26 10:12:22,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:12:22,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665ea2f83206171a902c9 HTTP/1.1" 200 None 2025-09-26 10:12:22,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:12:22,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:12:22,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:12:22,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:12:22,321 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d6667d2f83206171a9039d/log.txt.gz 2025-09-26 10:12:22,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:12:22,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665ea2f83206171a902c9 HTTP/1.1" 200 None 2025-09-26 10:12:22,347 - lava_callback - INFO - Completed processing callback for node 68d665ea2f83206171a902c9 2025-09-26 10:12:24,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:12:24,839 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d6667d2f83206171a9039d/lava_callback.json.gz 2025-09-26 10:12:24,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:12:24,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6667d2f83206171a9039d HTTP/1.1" 200 None 2025-09-26 10:12:24,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:12:24,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:12:24,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:12:25,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6667d2f83206171a9039d HTTP/1.1" 200 None 2025-09-26 10:12:25,014 - lava_callback - INFO - Completed processing callback for node 68d6667d2f83206171a9039d 2025-09-26 10:12:25,430 - lava_callback - INFO - Received callback for node 68d665ec2f83206171a902d2 INFO: 172.20.0.1:49400 - "POST /node/68d665ec2f83206171a902d2 HTTP/1.0" 202 Accepted 2025-09-26 10:12:25,439 - lava_callback - INFO - Starting async job submit for node 68d665ec2f83206171a902d2 2025-09-26 10:12:25,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:12:25,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665ec2f83206171a902d2 HTTP/1.1" 200 None 2025-09-26 10:12:25,490 - lava_callback - DEBUG - Processing node 68d665ec2f83206171a902d2: baseline-arm64-baylibre 2025-09-26 10:12:25,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:12:26,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:12:26,162 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d665ec2f83206171a902d2/log.txt.gz 2025-09-26 10:12:26,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:12:26,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:12:26,337 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d665ec2f83206171a902d2/lava_callback.json.gz 2025-09-26 10:12:26,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:12:26,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665ec2f83206171a902d2 HTTP/1.1" 200 None 2025-09-26 10:12:26,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:12:26,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:12:26,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:12:26,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665ec2f83206171a902d2 HTTP/1.1" 200 None 2025-09-26 10:12:26,435 - lava_callback - INFO - Completed processing callback for node 68d665ec2f83206171a902d2 INFO: 172.20.0.1:49408 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:12:27,397 - lava_callback - INFO - Received callback for node 68d3c3f3cd36afa834e0d94b INFO: 172.20.0.1:49416 - "POST /node/68d3c3f3cd36afa834e0d94b HTTP/1.0" 202 Accepted 2025-09-26 10:12:27,407 - lava_callback - INFO - Starting async job submit for node 68d3c3f3cd36afa834e0d94b 2025-09-26 10:12:27,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:12:27,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c3f3cd36afa834e0d94b HTTP/1.1" 200 None 2025-09-26 10:12:27,432 - lava_callback - DEBUG - Processing node 68d3c3f3cd36afa834e0d94b: ltp-cve 2025-09-26 10:12:27,432 - lava_callback - ERROR - Error processing callback for node 68d3c3f3cd36afa834e0d94b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:12:28,205 - lava_callback - INFO - Received callback for node 68d3c401cd36afa834e0d972 INFO: 172.20.0.1:49422 - "POST /node/68d3c401cd36afa834e0d972 HTTP/1.0" 202 Accepted 2025-09-26 10:12:28,215 - lava_callback - INFO - Starting async job submit for node 68d3c401cd36afa834e0d972 2025-09-26 10:12:28,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:12:28,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c401cd36afa834e0d972 HTTP/1.1" 200 None 2025-09-26 10:12:28,233 - lava_callback - DEBUG - Processing node 68d3c401cd36afa834e0d972: ltp-ipc 2025-09-26 10:12:28,234 - lava_callback - ERROR - Error processing callback for node 68d3c401cd36afa834e0d972: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:12:31,241 - lava_callback - INFO - Received callback for node 68d3c3f7cd36afa834e0d951 INFO: 172.20.0.1:41240 - "POST /node/68d3c3f7cd36afa834e0d951 HTTP/1.0" 202 Accepted 2025-09-26 10:12:31,246 - lava_callback - INFO - Starting async job submit for node 68d3c3f7cd36afa834e0d951 2025-09-26 10:12:31,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:12:31,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c3f7cd36afa834e0d951 HTTP/1.1" 200 None 2025-09-26 10:12:31,260 - lava_callback - DEBUG - Processing node 68d3c3f7cd36afa834e0d951: baseline-arm64-clabbe 2025-09-26 10:12:31,260 - lava_callback - ERROR - Error processing callback for node 68d3c3f7cd36afa834e0d951: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:12:31,624 - lava_callback - INFO - Received callback for node 68d43ea8a5c2c05277bc98ea INFO: 172.20.0.1:41244 - "POST /node/68d43ea8a5c2c05277bc98ea HTTP/1.0" 202 Accepted 2025-09-26 10:12:31,630 - lava_callback - INFO - Starting async job submit for node 68d43ea8a5c2c05277bc98ea 2025-09-26 10:12:31,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:12:31,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d43ea8a5c2c05277bc98ea HTTP/1.1" 200 None 2025-09-26 10:12:31,662 - lava_callback - DEBUG - Processing node 68d43ea8a5c2c05277bc98ea: baseline-arm64-broonie 2025-09-26 10:12:31,904 - lava_callback - INFO - Received callback for node 68d3c3fdcd36afa834e0d96b INFO: 172.20.0.1:41252 - "POST /node/68d3c3fdcd36afa834e0d96b HTTP/1.0" 202 Accepted 2025-09-26 10:12:31,923 - lava_callback - INFO - Starting async job submit for node 68d3c3fdcd36afa834e0d96b 2025-09-26 10:12:31,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:12:32,033 - lava_callback - ERROR - Error processing callback for node 68d43ea8a5c2c05277bc98ea: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:12:32,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c3fdcd36afa834e0d96b HTTP/1.1" 200 None 2025-09-26 10:12:32,035 - lava_callback - DEBUG - Processing node 68d3c3fdcd36afa834e0d96b: baseline-arm64-clabbe 2025-09-26 10:12:32,036 - lava_callback - ERROR - Error processing callback for node 68d3c3fdcd36afa834e0d96b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:41254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50060 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:12:47,685 - lava_callback - INFO - Received callback for node 68d3c40bcd36afa834e0d9b0 INFO: 172.20.0.1:50064 - "POST /node/68d3c40bcd36afa834e0d9b0 HTTP/1.0" 202 Accepted 2025-09-26 10:12:47,691 - lava_callback - INFO - Starting async job submit for node 68d3c40bcd36afa834e0d9b0 2025-09-26 10:12:47,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:12:47,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c40bcd36afa834e0d9b0 HTTP/1.1" 200 None 2025-09-26 10:12:47,704 - lava_callback - DEBUG - Processing node 68d3c40bcd36afa834e0d9b0: ltp-smoketest 2025-09-26 10:12:47,704 - lava_callback - ERROR - Error processing callback for node 68d3c40bcd36afa834e0d9b0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:12:48,489 - lava_callback - INFO - Received callback for node 68d3c41bcd36afa834e0d9c8 INFO: 172.20.0.1:50080 - "POST /node/68d3c41bcd36afa834e0d9c8 HTTP/1.0" 202 Accepted 2025-09-26 10:12:48,498 - lava_callback - INFO - Starting async job submit for node 68d3c41bcd36afa834e0d9c8 2025-09-26 10:12:48,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:12:48,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c41bcd36afa834e0d9c8 HTTP/1.1" 200 None 2025-09-26 10:12:48,519 - lava_callback - DEBUG - Processing node 68d3c41bcd36afa834e0d9c8: ltp-cve 2025-09-26 10:12:48,519 - lava_callback - ERROR - Error processing callback for node 68d3c41bcd36afa834e0d9c8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:46626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43118 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:13:12,851 - lava_callback - INFO - Received callback for node 68d665f82f83206171a90305 INFO: 172.20.0.1:60530 - "POST /node/68d665f82f83206171a90305 HTTP/1.0" 202 Accepted 2025-09-26 10:13:12,857 - lava_callback - INFO - Starting async job submit for node 68d665f82f83206171a90305 2025-09-26 10:13:12,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:13:12,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665f82f83206171a90305 HTTP/1.1" 200 None 2025-09-26 10:13:12,923 - lava_callback - DEBUG - Processing node 68d665f82f83206171a90305: baseline-arm64-broonie 2025-09-26 10:13:13,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:13:13,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:13:13,557 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d665f82f83206171a90305/log.txt.gz 2025-09-26 10:13:13,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:13:14,053 - lava_callback - INFO - Received callback for node 68d665ec2f83206171a902db INFO: 172.20.0.1:60540 - "POST /node/68d665ec2f83206171a902db HTTP/1.0" 202 Accepted 2025-09-26 10:13:14,059 - lava_callback - INFO - Starting async job submit for node 68d665ec2f83206171a902db 2025-09-26 10:13:14,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:13:14,080 - lava_callback - INFO - Received callback for node 68d3c429cd36afa834e0d9e6 INFO: 172.20.0.1:60546 - "POST /node/68d3c429cd36afa834e0d9e6 HTTP/1.0" 202 Accepted 2025-09-26 10:13:14,085 - lava_callback - INFO - Starting async job submit for node 68d3c429cd36afa834e0d9e6 2025-09-26 10:13:14,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:13:14,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c429cd36afa834e0d9e6 HTTP/1.1" 200 None 2025-09-26 10:13:14,102 - lava_callback - DEBUG - Processing node 68d3c429cd36afa834e0d9e6: baseline-arm 2025-09-26 10:13:14,102 - lava_callback - ERROR - Error processing callback for node 68d3c429cd36afa834e0d9e6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:13:14,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665ec2f83206171a902db HTTP/1.1" 200 None 2025-09-26 10:13:14,105 - lava_callback - DEBUG - Processing node 68d665ec2f83206171a902db: baseline-arm64-baylibre 2025-09-26 10:13:14,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:13:14,620 - lava_callback - INFO - Received callback for node 68d665f92f83206171a90308 INFO: 172.20.0.1:60552 - "POST /node/68d665f92f83206171a90308 HTTP/1.0" 202 Accepted 2025-09-26 10:13:14,628 - lava_callback - INFO - Starting async job submit for node 68d665f92f83206171a90308 2025-09-26 10:13:14,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:13:14,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665f92f83206171a90308 HTTP/1.1" 200 None 2025-09-26 10:13:14,679 - lava_callback - DEBUG - Processing node 68d665f92f83206171a90308: baseline-arm64-broonie 2025-09-26 10:13:14,784 - lava_callback - INFO - Received callback for node 68d3c42dcd36afa834e0d9e9 INFO: 172.20.0.1:60562 - "POST /node/68d3c42dcd36afa834e0d9e9 HTTP/1.0" 202 Accepted 2025-09-26 10:13:14,803 - lava_callback - INFO - Starting async job submit for node 68d3c42dcd36afa834e0d9e9 2025-09-26 10:13:14,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:13:14,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:13:14,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c42dcd36afa834e0d9e9 HTTP/1.1" 200 None 2025-09-26 10:13:14,879 - lava_callback - DEBUG - Processing node 68d3c42dcd36afa834e0d9e9: baseline-arm 2025-09-26 10:13:14,879 - lava_callback - ERROR - Error processing callback for node 68d3c42dcd36afa834e0d9e9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60576 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 10:13:15,987 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:13:15,988 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:13:15,989 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d665f82f83206171a90305/lava_callback.json.gz 2025-09-26 10:13:16,000 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d665ec2f83206171a902db/log.txt.gz 2025-09-26 10:13:16,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:13:16,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:13:16,040 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d665f92f83206171a90308/log.txt.gz 2025-09-26 10:13:16,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:13:16,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:13:16,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665f82f83206171a90305 HTTP/1.1" 200 None 2025-09-26 10:13:16,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:13:16,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:13:16,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:13:16,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665f82f83206171a90305 HTTP/1.1" 200 None 2025-09-26 10:13:16,110 - lava_callback - INFO - Completed processing callback for node 68d665f82f83206171a90305 INFO: 172.20.0.1:60590 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:13:18,530 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:13:18,531 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d665f92f83206171a90308/lava_callback.json.gz 2025-09-26 10:13:18,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:13:18,554 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d665ec2f83206171a902db/lava_callback.json.gz 2025-09-26 10:13:18,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:13:18,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:13:18,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665f92f83206171a90308 HTTP/1.1" 200 None 2025-09-26 10:13:18,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:13:18,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:13:18,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:13:18,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665ec2f83206171a902db HTTP/1.1" 200 None 2025-09-26 10:13:18,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:13:18,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665f92f83206171a90308 HTTP/1.1" 200 None 2025-09-26 10:13:18,676 - lava_callback - INFO - Completed processing callback for node 68d665f92f83206171a90308 2025-09-26 10:13:18,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:13:18,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:13:18,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665ec2f83206171a902db HTTP/1.1" 200 None 2025-09-26 10:13:18,757 - lava_callback - INFO - Completed processing callback for node 68d665ec2f83206171a902db INFO: 172.20.0.1:60606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35832 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:13:27,502 - lava_callback - INFO - Received callback for node 68d3c438cd36afa834e0d9ed INFO: 172.20.0.1:35834 - "POST /node/68d3c438cd36afa834e0d9ed HTTP/1.0" 202 Accepted 2025-09-26 10:13:27,508 - lava_callback - INFO - Starting async job submit for node 68d3c438cd36afa834e0d9ed 2025-09-26 10:13:27,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:13:27,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c438cd36afa834e0d9ed HTTP/1.1" 200 None 2025-09-26 10:13:27,524 - lava_callback - DEBUG - Processing node 68d3c438cd36afa834e0d9ed: ltp-syscalls 2025-09-26 10:13:27,524 - lava_callback - ERROR - Error processing callback for node 68d3c438cd36afa834e0d9ed: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:13:34,038 - lava_callback - INFO - Received callback for node 68d3c43dcd36afa834e0d9f0 INFO: 172.20.0.1:44994 - "POST /node/68d3c43dcd36afa834e0d9f0 HTTP/1.0" 202 Accepted 2025-09-26 10:13:34,044 - lava_callback - INFO - Starting async job submit for node 68d3c43dcd36afa834e0d9f0 2025-09-26 10:13:34,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:13:34,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c43dcd36afa834e0d9f0 HTTP/1.1" 200 None 2025-09-26 10:13:34,063 - lava_callback - DEBUG - Processing node 68d3c43dcd36afa834e0d9f0: baseline-arm 2025-09-26 10:13:34,064 - lava_callback - ERROR - Error processing callback for node 68d3c43dcd36afa834e0d9f0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:13:34,733 - lava_callback - INFO - Received callback for node 68d3c440cd36afa834e0d9f3 INFO: 172.20.0.1:44996 - "POST /node/68d3c440cd36afa834e0d9f3 HTTP/1.0" 202 Accepted 2025-09-26 10:13:34,738 - lava_callback - INFO - Starting async job submit for node 68d3c440cd36afa834e0d9f3 2025-09-26 10:13:34,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:13:34,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c440cd36afa834e0d9f3 HTTP/1.1" 200 None 2025-09-26 10:13:34,755 - lava_callback - DEBUG - Processing node 68d3c440cd36afa834e0d9f3: baseline-arm 2025-09-26 10:13:34,755 - lava_callback - ERROR - Error processing callback for node 68d3c440cd36afa834e0d9f3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:45002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33248 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:13:46,699 - lava_callback - INFO - Received callback for node 68d3c35ecd36afa834e0d815 INFO: 172.20.0.1:33262 - "POST /node/68d3c35ecd36afa834e0d815 HTTP/1.0" 202 Accepted 2025-09-26 10:13:46,706 - lava_callback - INFO - Starting async job submit for node 68d3c35ecd36afa834e0d815 2025-09-26 10:13:46,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:13:46,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c35ecd36afa834e0d815 HTTP/1.1" 200 None 2025-09-26 10:13:46,775 - lava_callback - DEBUG - Processing node 68d3c35ecd36afa834e0d815: ltp-pty 2025-09-26 10:13:47,160 - lava_callback - ERROR - Error processing callback for node 68d3c35ecd36afa834e0d815: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:13:47,532 - lava_callback - INFO - Received callback for node 68d3c457cd36afa834e0da31 INFO: 172.20.0.1:33276 - "POST /node/68d3c457cd36afa834e0da31 HTTP/1.0" 202 Accepted 2025-09-26 10:13:47,538 - lava_callback - INFO - Starting async job submit for node 68d3c457cd36afa834e0da31 2025-09-26 10:13:47,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:13:47,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c457cd36afa834e0da31 HTTP/1.1" 200 None 2025-09-26 10:13:47,555 - lava_callback - DEBUG - Processing node 68d3c457cd36afa834e0da31: ltp-syscalls-ipc 2025-09-26 10:13:47,555 - lava_callback - ERROR - Error processing callback for node 68d3c457cd36afa834e0da31: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:13:53,877 - lava_callback - INFO - Received callback for node 68d3c44bcd36afa834e0da27 INFO: 172.20.0.1:53652 - "POST /node/68d3c44bcd36afa834e0da27 HTTP/1.0" 202 Accepted 2025-09-26 10:13:53,885 - lava_callback - INFO - Starting async job submit for node 68d3c44bcd36afa834e0da27 2025-09-26 10:13:53,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:13:53,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c44bcd36afa834e0da27 HTTP/1.1" 200 None 2025-09-26 10:13:53,900 - lava_callback - DEBUG - Processing node 68d3c44bcd36afa834e0da27: baseline-arm 2025-09-26 10:13:53,900 - lava_callback - ERROR - Error processing callback for node 68d3c44bcd36afa834e0da27: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:13:54,613 - lava_callback - INFO - Received callback for node 68d3c450cd36afa834e0da2a INFO: 172.20.0.1:53656 - "POST /node/68d3c450cd36afa834e0da2a HTTP/1.0" 202 Accepted 2025-09-26 10:13:54,619 - lava_callback - INFO - Starting async job submit for node 68d3c450cd36afa834e0da2a 2025-09-26 10:13:54,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:13:54,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c450cd36afa834e0da2a HTTP/1.1" 200 None 2025-09-26 10:13:54,654 - lava_callback - DEBUG - Processing node 68d3c450cd36afa834e0da2a: baseline-arm 2025-09-26 10:13:54,654 - lava_callback - ERROR - Error processing callback for node 68d3c450cd36afa834e0da2a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:53662 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:13:57,127 - lava_callback - INFO - Received callback for node 68d40919cd36afa834e16d6c INFO: 172.20.0.1:53674 - "POST /node/68d40919cd36afa834e16d6c HTTP/1.0" 202 Accepted 2025-09-26 10:13:57,133 - lava_callback - INFO - Starting async job submit for node 68d40919cd36afa834e16d6c 2025-09-26 10:13:57,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:13:57,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40919cd36afa834e16d6c HTTP/1.1" 200 None 2025-09-26 10:13:57,166 - lava_callback - DEBUG - Processing node 68d40919cd36afa834e16d6c: baseline-arm 2025-09-26 10:13:57,410 - lava_callback - ERROR - Error processing callback for node 68d40919cd36afa834e16d6c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:34414 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:14:07,720 - lava_callback - INFO - Received callback for node 68d3c45ccd36afa834e0da34 INFO: 172.20.0.1:34416 - "POST /node/68d3c45ccd36afa834e0da34 HTTP/1.0" 202 Accepted 2025-09-26 10:14:07,729 - lava_callback - INFO - Starting async job submit for node 68d3c45ccd36afa834e0da34 2025-09-26 10:14:07,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:14:07,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c45ccd36afa834e0da34 HTTP/1.1" 200 None 2025-09-26 10:14:07,755 - lava_callback - DEBUG - Processing node 68d3c45ccd36afa834e0da34: ltp-syscalls 2025-09-26 10:14:07,755 - lava_callback - ERROR - Error processing callback for node 68d3c45ccd36afa834e0da34: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:34428 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:14:08,527 - lava_callback - INFO - Received callback for node 68d3c46bcd36afa834e0da3d INFO: 172.20.0.1:34438 - "POST /node/68d3c46bcd36afa834e0da3d HTTP/1.0" 202 Accepted 2025-09-26 10:14:08,536 - lava_callback - INFO - Starting async job submit for node 68d3c46bcd36afa834e0da3d 2025-09-26 10:14:08,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:14:08,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c46bcd36afa834e0da3d HTTP/1.1" 200 None 2025-09-26 10:14:08,552 - lava_callback - DEBUG - Processing node 68d3c46bcd36afa834e0da3d: ltp-syscalls-ipc 2025-09-26 10:14:08,552 - lava_callback - ERROR - Error processing callback for node 68d3c46bcd36afa834e0da3d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:56410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54272 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:14:34,081 - lava_callback - INFO - Received callback for node 68d3c482cd36afa834e0da59 INFO: 172.20.0.1:48178 - "POST /node/68d3c482cd36afa834e0da59 HTTP/1.0" 202 Accepted 2025-09-26 10:14:34,087 - lava_callback - INFO - Starting async job submit for node 68d3c482cd36afa834e0da59 2025-09-26 10:14:34,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:14:34,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c482cd36afa834e0da59 HTTP/1.1" 200 None 2025-09-26 10:14:34,111 - lava_callback - DEBUG - Processing node 68d3c482cd36afa834e0da59: baseline-arm 2025-09-26 10:14:34,111 - lava_callback - ERROR - Error processing callback for node 68d3c482cd36afa834e0da59: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45312 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:14:47,536 - lava_callback - INFO - Received callback for node 68d3c482cd36afa834e0da5b INFO: 172.20.0.1:45318 - "POST /node/68d3c482cd36afa834e0da5b HTTP/1.0" 202 Accepted 2025-09-26 10:14:47,541 - lava_callback - INFO - Starting async job submit for node 68d3c482cd36afa834e0da5b 2025-09-26 10:14:47,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:14:47,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c482cd36afa834e0da5b HTTP/1.1" 200 None 2025-09-26 10:14:47,556 - lava_callback - DEBUG - Processing node 68d3c482cd36afa834e0da5b: ltp-timers 2025-09-26 10:14:47,556 - lava_callback - ERROR - Error processing callback for node 68d3c482cd36afa834e0da5b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:14:48,331 - lava_callback - INFO - Received callback for node 68d3c488cd36afa834e0da76 INFO: 172.20.0.1:45322 - "POST /node/68d3c488cd36afa834e0da76 HTTP/1.0" 202 Accepted 2025-09-26 10:14:48,337 - lava_callback - INFO - Starting async job submit for node 68d3c488cd36afa834e0da76 2025-09-26 10:14:48,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:14:48,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c488cd36afa834e0da76 HTTP/1.1" 200 None 2025-09-26 10:14:48,351 - lava_callback - DEBUG - Processing node 68d3c488cd36afa834e0da76: ltp-ipc 2025-09-26 10:14:48,351 - lava_callback - ERROR - Error processing callback for node 68d3c488cd36afa834e0da76: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:14:52,098 - lava_callback - INFO - Received callback for node 68d43ebba5c2c05277bc98f6 INFO: 172.20.0.1:53478 - "POST /node/68d43ebba5c2c05277bc98f6 HTTP/1.0" 202 Accepted 2025-09-26 10:14:52,104 - lava_callback - INFO - Starting async job submit for node 68d43ebba5c2c05277bc98f6 2025-09-26 10:14:52,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:14:52,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d43ebba5c2c05277bc98f6 HTTP/1.1" 200 None 2025-09-26 10:14:52,133 - lava_callback - DEBUG - Processing node 68d43ebba5c2c05277bc98f6: baseline-arm64-broonie 2025-09-26 10:14:52,431 - lava_callback - ERROR - Error processing callback for node 68d43ebba5c2c05277bc98f6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:14:53,590 - lava_callback - INFO - Received callback for node 68d6673c2f83206171a903e5 INFO: 172.20.0.1:53494 - "POST /node/68d6673c2f83206171a903e5 HTTP/1.0" 202 Accepted 2025-09-26 10:14:53,596 - lava_callback - INFO - Starting async job submit for node 68d6673c2f83206171a903e5 2025-09-26 10:14:53,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:14:53,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6673c2f83206171a903e5 HTTP/1.1" 200 None 2025-09-26 10:14:53,632 - lava_callback - DEBUG - Processing node 68d6673c2f83206171a903e5: baseline-arm64-broonie 2025-09-26 10:14:53,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:14:54,551 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:14:54,552 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6673c2f83206171a903e5/log.txt.gz 2025-09-26 10:14:54,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:14:54,997 - lava_callback - INFO - Received callback for node 68d3c491cd36afa834e0da90 INFO: 172.20.0.1:53500 - "POST /node/68d3c491cd36afa834e0da90 HTTP/1.0" 202 Accepted 2025-09-26 10:14:55,006 - lava_callback - INFO - Starting async job submit for node 68d3c491cd36afa834e0da90 2025-09-26 10:14:55,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:14:55,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c491cd36afa834e0da90 HTTP/1.1" 200 None 2025-09-26 10:14:55,020 - lava_callback - DEBUG - Processing node 68d3c491cd36afa834e0da90: baseline-arm 2025-09-26 10:14:55,020 - lava_callback - ERROR - Error processing callback for node 68d3c491cd36afa834e0da90: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:53504 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:14:56,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:14:56,858 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6673c2f83206171a903e5/lava_callback.json.gz 2025-09-26 10:14:56,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:14:56,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6673c2f83206171a903e5 HTTP/1.1" 200 None 2025-09-26 10:14:56,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:14:56,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:14:56,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:14:56,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6673c2f83206171a903e5 HTTP/1.1" 200 None 2025-09-26 10:14:56,994 - lava_callback - INFO - Completed processing callback for node 68d6673c2f83206171a903e5 2025-09-26 10:15:01,414 - lava_callback - INFO - Received callback for node 68d6670a2f83206171a903dd INFO: 172.20.0.1:34146 - "POST /node/68d6670a2f83206171a903dd HTTP/1.0" 202 Accepted 2025-09-26 10:15:01,424 - lava_callback - INFO - Starting async job submit for node 68d6670a2f83206171a903dd 2025-09-26 10:15:01,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:01,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6670a2f83206171a903dd HTTP/1.1" 200 None 2025-09-26 10:15:01,498 - lava_callback - DEBUG - Processing node 68d6670a2f83206171a903dd: baseline-arm64-kontron 2025-09-26 10:15:01,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:15:03,983 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:15:03,984 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d6670a2f83206171a903dd/log.txt.gz 2025-09-26 10:15:03,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:15:06,354 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:15:06,355 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d6670a2f83206171a903dd/lava_callback.json.gz 2025-09-26 10:15:06,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:06,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6670a2f83206171a903dd HTTP/1.1" 200 None 2025-09-26 10:15:06,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:06,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:15:06,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:06,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6670a2f83206171a903dd HTTP/1.1" 200 None 2025-09-26 10:15:06,450 - lava_callback - INFO - Completed processing callback for node 68d6670a2f83206171a903dd INFO: 172.20.0.1:34154 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:15:07,595 - lava_callback - INFO - Received callback for node 68d3c4a3cd36afa834e0dab2 INFO: 172.20.0.1:34160 - "POST /node/68d3c4a3cd36afa834e0dab2 HTTP/1.0" 202 Accepted 2025-09-26 10:15:07,601 - lava_callback - INFO - Starting async job submit for node 68d3c4a3cd36afa834e0dab2 2025-09-26 10:15:07,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:07,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4a3cd36afa834e0dab2 HTTP/1.1" 200 None 2025-09-26 10:15:07,619 - lava_callback - DEBUG - Processing node 68d3c4a3cd36afa834e0dab2: ltp-pty 2025-09-26 10:15:07,619 - lava_callback - ERROR - Error processing callback for node 68d3c4a3cd36afa834e0dab2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:08,348 - lava_callback - INFO - Received callback for node 68d3c4a7cd36afa834e0dabb INFO: 172.20.0.1:34168 - "POST /node/68d3c4a7cd36afa834e0dabb HTTP/1.0" 202 Accepted 2025-09-26 10:15:08,354 - lava_callback - INFO - Starting async job submit for node 68d3c4a7cd36afa834e0dabb 2025-09-26 10:15:08,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:08,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4a7cd36afa834e0dabb HTTP/1.1" 200 None 2025-09-26 10:15:08,368 - lava_callback - DEBUG - Processing node 68d3c4a7cd36afa834e0dabb: ltp-syscalls-ipc 2025-09-26 10:15:08,368 - lava_callback - ERROR - Error processing callback for node 68d3c4a7cd36afa834e0dabb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:34178 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:15:12,520 - lava_callback - INFO - Received callback for node 68d665f72f83206171a902ff INFO: 172.20.0.1:60322 - "POST /node/68d665f72f83206171a902ff HTTP/1.0" 202 Accepted 2025-09-26 10:15:12,527 - lava_callback - INFO - Starting async job submit for node 68d665f72f83206171a902ff 2025-09-26 10:15:12,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:12,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665f72f83206171a902ff HTTP/1.1" 200 None 2025-09-26 10:15:12,584 - lava_callback - DEBUG - Processing node 68d665f72f83206171a902ff: baseline-arm64-broonie 2025-09-26 10:15:13,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:15:13,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:15:13,466 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d665f72f83206171a902ff/log.txt.gz 2025-09-26 10:15:13,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:15:13,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:15:13,619 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d665f72f83206171a902ff/lava_callback.json.gz 2025-09-26 10:15:13,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:13,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665f72f83206171a902ff HTTP/1.1" 200 None 2025-09-26 10:15:13,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:13,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:15:13,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:13,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665f72f83206171a902ff HTTP/1.1" 200 None 2025-09-26 10:15:13,713 - lava_callback - INFO - Completed processing callback for node 68d665f72f83206171a902ff 2025-09-26 10:15:13,830 - lava_callback - INFO - Received callback for node 68d3c4aacd36afa834e0dac2 INFO: 172.20.0.1:60338 - "POST /node/68d3c4aacd36afa834e0dac2 HTTP/1.0" 202 Accepted 2025-09-26 10:15:13,840 - lava_callback - INFO - Starting async job submit for node 68d3c4aacd36afa834e0dac2 2025-09-26 10:15:13,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:13,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4aacd36afa834e0dac2 HTTP/1.1" 200 None 2025-09-26 10:15:13,867 - lava_callback - DEBUG - Processing node 68d3c4aacd36afa834e0dac2: baseline-arm 2025-09-26 10:15:13,867 - lava_callback - ERROR - Error processing callback for node 68d3c4aacd36afa834e0dac2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:14,529 - lava_callback - INFO - Received callback for node 68d3c4accd36afa834e0dac8 INFO: 172.20.0.1:60348 - "POST /node/68d3c4accd36afa834e0dac8 HTTP/1.0" 202 Accepted 2025-09-26 10:15:14,536 - lava_callback - INFO - Starting async job submit for node 68d3c4accd36afa834e0dac8 2025-09-26 10:15:14,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:14,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4accd36afa834e0dac8 HTTP/1.1" 200 None 2025-09-26 10:15:14,557 - lava_callback - DEBUG - Processing node 68d3c4accd36afa834e0dac8: baseline-arm 2025-09-26 10:15:14,557 - lava_callback - ERROR - Error processing callback for node 68d3c4accd36afa834e0dac8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57114 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:15:27,545 - lava_callback - INFO - Received callback for node 68d3c4accd36afa834e0dac5 INFO: 172.20.0.1:57130 - "POST /node/68d3c4accd36afa834e0dac5 HTTP/1.0" 202 Accepted 2025-09-26 10:15:27,550 - lava_callback - INFO - Starting async job submit for node 68d3c4accd36afa834e0dac5 2025-09-26 10:15:27,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:27,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4accd36afa834e0dac5 HTTP/1.1" 200 None 2025-09-26 10:15:27,567 - lava_callback - DEBUG - Processing node 68d3c4accd36afa834e0dac5: baseline-arm-broonie 2025-09-26 10:15:27,567 - lava_callback - ERROR - Error processing callback for node 68d3c4accd36afa834e0dac5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:28,300 - lava_callback - INFO - Received callback for node 68d3c4b1cd36afa834e0dad4 INFO: 172.20.0.1:57132 - "POST /node/68d3c4b1cd36afa834e0dad4 HTTP/1.0" 202 Accepted 2025-09-26 10:15:28,308 - lava_callback - INFO - Starting async job submit for node 68d3c4b1cd36afa834e0dad4 2025-09-26 10:15:28,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:28,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4b1cd36afa834e0dad4 HTTP/1.1" 200 None 2025-09-26 10:15:28,324 - lava_callback - DEBUG - Processing node 68d3c4b1cd36afa834e0dad4: baseline-arm-broonie 2025-09-26 10:15:28,324 - lava_callback - ERROR - Error processing callback for node 68d3c4b1cd36afa834e0dad4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:29,064 - lava_callback - INFO - Received callback for node 68d3c4b9cd36afa834e0daed INFO: 172.20.0.1:57148 - "POST /node/68d3c4b9cd36afa834e0daed HTTP/1.0" 202 Accepted 2025-09-26 10:15:29,070 - lava_callback - INFO - Starting async job submit for node 68d3c4b9cd36afa834e0daed 2025-09-26 10:15:29,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:29,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4b9cd36afa834e0daed HTTP/1.1" 200 None 2025-09-26 10:15:29,085 - lava_callback - DEBUG - Processing node 68d3c4b9cd36afa834e0daed: ltp-timers 2025-09-26 10:15:29,086 - lava_callback - ERROR - Error processing callback for node 68d3c4b9cd36afa834e0daed: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:31,424 - lava_callback - INFO - Received callback for node 68d3c4b9cd36afa834e0daf3 INFO: 172.20.0.1:39618 - "POST /node/68d3c4b9cd36afa834e0daf3 HTTP/1.0" 202 Accepted 2025-09-26 10:15:31,430 - lava_callback - INFO - Starting async job submit for node 68d3c4b9cd36afa834e0daf3 2025-09-26 10:15:31,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:31,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4b9cd36afa834e0daf3 HTTP/1.1" 200 None 2025-09-26 10:15:31,444 - lava_callback - DEBUG - Processing node 68d3c4b9cd36afa834e0daf3: baseline-arm-clabbe 2025-09-26 10:15:31,444 - lava_callback - ERROR - Error processing callback for node 68d3c4b9cd36afa834e0daf3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:32,089 - lava_callback - INFO - Received callback for node 68d3c4bdcd36afa834e0db00 INFO: 172.20.0.1:39628 - "POST /node/68d3c4bdcd36afa834e0db00 HTTP/1.0" 202 Accepted 2025-09-26 10:15:32,098 - lava_callback - INFO - Starting async job submit for node 68d3c4bdcd36afa834e0db00 2025-09-26 10:15:32,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:32,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4bdcd36afa834e0db00 HTTP/1.1" 200 None 2025-09-26 10:15:32,112 - lava_callback - DEBUG - Processing node 68d3c4bdcd36afa834e0db00: baseline-arm-clabbe 2025-09-26 10:15:32,112 - lava_callback - ERROR - Error processing callback for node 68d3c4bdcd36afa834e0db00: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:32,753 - lava_callback - INFO - Received callback for node 68d3c4becd36afa834e0db03 INFO: 172.20.0.1:39644 - "POST /node/68d3c4becd36afa834e0db03 HTTP/1.0" 202 Accepted 2025-09-26 10:15:32,761 - lava_callback - INFO - Starting async job submit for node 68d3c4becd36afa834e0db03 2025-09-26 10:15:32,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:32,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4becd36afa834e0db03 HTTP/1.1" 200 None 2025-09-26 10:15:32,775 - lava_callback - DEBUG - Processing node 68d3c4becd36afa834e0db03: baseline-arm-clabbe 2025-09-26 10:15:32,775 - lava_callback - ERROR - Error processing callback for node 68d3c4becd36afa834e0db03: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:33,585 - lava_callback - INFO - Received callback for node 68d3c4b1cd36afa834e0dad6 INFO: 172.20.0.1:39658 - "POST /node/68d3c4b1cd36afa834e0dad6 HTTP/1.0" 202 Accepted 2025-09-26 10:15:33,591 - lava_callback - INFO - Starting async job submit for node 68d3c4b1cd36afa834e0dad6 2025-09-26 10:15:33,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:33,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4b1cd36afa834e0dad6 HTTP/1.1" 200 None 2025-09-26 10:15:33,618 - lava_callback - DEBUG - Processing node 68d3c4b1cd36afa834e0dad6: baseline-arm 2025-09-26 10:15:33,618 - lava_callback - ERROR - Error processing callback for node 68d3c4b1cd36afa834e0dad6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:34,316 - lava_callback - INFO - Received callback for node 68d3c4b2cd36afa834e0dadc INFO: 172.20.0.1:39670 - "POST /node/68d3c4b2cd36afa834e0dadc HTTP/1.0" 202 Accepted 2025-09-26 10:15:34,321 - lava_callback - INFO - Starting async job submit for node 68d3c4b2cd36afa834e0dadc 2025-09-26 10:15:34,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:34,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4b2cd36afa834e0dadc HTTP/1.1" 200 None 2025-09-26 10:15:34,335 - lava_callback - DEBUG - Processing node 68d3c4b2cd36afa834e0dadc: baseline-arm 2025-09-26 10:15:34,335 - lava_callback - ERROR - Error processing callback for node 68d3c4b2cd36afa834e0dadc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:35,002 - lava_callback - INFO - Received callback for node 68d3c4bacd36afa834e0daf6 INFO: 172.20.0.1:39684 - "POST /node/68d3c4bacd36afa834e0daf6 HTTP/1.0" 202 Accepted 2025-09-26 10:15:35,007 - lava_callback - INFO - Starting async job submit for node 68d3c4bacd36afa834e0daf6 2025-09-26 10:15:35,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:35,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4bacd36afa834e0daf6 HTTP/1.1" 200 None 2025-09-26 10:15:35,022 - lava_callback - DEBUG - Processing node 68d3c4bacd36afa834e0daf6: baseline-arm 2025-09-26 10:15:35,022 - lava_callback - ERROR - Error processing callback for node 68d3c4bacd36afa834e0daf6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:35,691 - lava_callback - INFO - Received callback for node 68d3c4bbcd36afa834e0daf9 INFO: 172.20.0.1:39696 - "POST /node/68d3c4bbcd36afa834e0daf9 HTTP/1.0" 202 Accepted 2025-09-26 10:15:35,697 - lava_callback - INFO - Starting async job submit for node 68d3c4bbcd36afa834e0daf9 2025-09-26 10:15:35,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:35,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4bbcd36afa834e0daf9 HTTP/1.1" 200 None 2025-09-26 10:15:35,713 - lava_callback - DEBUG - Processing node 68d3c4bbcd36afa834e0daf9: baseline-arm 2025-09-26 10:15:35,713 - lava_callback - ERROR - Error processing callback for node 68d3c4bbcd36afa834e0daf9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:36,381 - lava_callback - INFO - Received callback for node 68d3c4becd36afa834e0db05 INFO: 172.20.0.1:39708 - "POST /node/68d3c4becd36afa834e0db05 HTTP/1.0" 202 Accepted 2025-09-26 10:15:36,387 - lava_callback - INFO - Starting async job submit for node 68d3c4becd36afa834e0db05 2025-09-26 10:15:36,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:36,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4becd36afa834e0db05 HTTP/1.1" 200 None 2025-09-26 10:15:36,411 - lava_callback - DEBUG - Processing node 68d3c4becd36afa834e0db05: baseline-arm 2025-09-26 10:15:36,411 - lava_callback - ERROR - Error processing callback for node 68d3c4becd36afa834e0db05: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:39714 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:15:37,066 - lava_callback - INFO - Received callback for node 68d3c4bfcd36afa834e0db0b INFO: 172.20.0.1:39724 - "POST /node/68d3c4bfcd36afa834e0db0b HTTP/1.0" 202 Accepted 2025-09-26 10:15:37,073 - lava_callback - INFO - Starting async job submit for node 68d3c4bfcd36afa834e0db0b 2025-09-26 10:15:37,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:37,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4bfcd36afa834e0db0b HTTP/1.1" 200 None 2025-09-26 10:15:37,087 - lava_callback - DEBUG - Processing node 68d3c4bfcd36afa834e0db0b: baseline-arm 2025-09-26 10:15:37,087 - lava_callback - ERROR - Error processing callback for node 68d3c4bfcd36afa834e0db0b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:38782 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:15:47,869 - lava_callback - INFO - Received callback for node 68d3c4c5cd36afa834e0db1d INFO: 172.20.0.1:38786 - "POST /node/68d3c4c5cd36afa834e0db1d HTTP/1.0" 202 Accepted 2025-09-26 10:15:47,875 - lava_callback - INFO - Starting async job submit for node 68d3c4c5cd36afa834e0db1d 2025-09-26 10:15:47,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:47,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4c5cd36afa834e0db1d HTTP/1.1" 200 None 2025-09-26 10:15:47,889 - lava_callback - DEBUG - Processing node 68d3c4c5cd36afa834e0db1d: ltp-watchqueue 2025-09-26 10:15:47,889 - lava_callback - ERROR - Error processing callback for node 68d3c4c5cd36afa834e0db1d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:48,664 - lava_callback - INFO - Received callback for node 68d3c4cdcd36afa834e0db59 INFO: 172.20.0.1:38796 - "POST /node/68d3c4cdcd36afa834e0db59 HTTP/1.0" 202 Accepted 2025-09-26 10:15:48,670 - lava_callback - INFO - Starting async job submit for node 68d3c4cdcd36afa834e0db59 2025-09-26 10:15:48,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:48,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4cdcd36afa834e0db59 HTTP/1.1" 200 None 2025-09-26 10:15:48,690 - lava_callback - DEBUG - Processing node 68d3c4cdcd36afa834e0db59: ltp-containers 2025-09-26 10:15:48,691 - lava_callback - ERROR - Error processing callback for node 68d3c4cdcd36afa834e0db59: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:49,463 - lava_callback - INFO - Received callback for node 68d3c4cbcd36afa834e0db53 INFO: 172.20.0.1:53958 - "POST /node/68d3c4cbcd36afa834e0db53 HTTP/1.0" 202 Accepted 2025-09-26 10:15:49,469 - lava_callback - INFO - Starting async job submit for node 68d3c4cbcd36afa834e0db53 2025-09-26 10:15:49,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:49,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4cbcd36afa834e0db53 HTTP/1.1" 200 None 2025-09-26 10:15:49,482 - lava_callback - DEBUG - Processing node 68d3c4cbcd36afa834e0db53: ltp-cap-bounds 2025-09-26 10:15:49,482 - lava_callback - ERROR - Error processing callback for node 68d3c4cbcd36afa834e0db53: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:50,231 - lava_callback - INFO - Received callback for node 68d3c4cccd36afa834e0db55 INFO: 172.20.0.1:53964 - "POST /node/68d3c4cccd36afa834e0db55 HTTP/1.0" 202 Accepted 2025-09-26 10:15:50,240 - lava_callback - INFO - Starting async job submit for node 68d3c4cccd36afa834e0db55 2025-09-26 10:15:50,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:50,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4cccd36afa834e0db55 HTTP/1.1" 200 None 2025-09-26 10:15:50,257 - lava_callback - DEBUG - Processing node 68d3c4cccd36afa834e0db55: ltp-cap-bounds 2025-09-26 10:15:50,257 - lava_callback - ERROR - Error processing callback for node 68d3c4cccd36afa834e0db55: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:50,991 - lava_callback - INFO - Received callback for node 68d3c4cecd36afa834e0db5c INFO: 172.20.0.1:53978 - "POST /node/68d3c4cecd36afa834e0db5c HTTP/1.0" 202 Accepted 2025-09-26 10:15:50,996 - lava_callback - INFO - Starting async job submit for node 68d3c4cecd36afa834e0db5c 2025-09-26 10:15:50,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:51,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4cecd36afa834e0db5c HTTP/1.1" 200 None 2025-09-26 10:15:51,014 - lava_callback - DEBUG - Processing node 68d3c4cecd36afa834e0db5c: ltp-controllers 2025-09-26 10:15:51,014 - lava_callback - ERROR - Error processing callback for node 68d3c4cecd36afa834e0db5c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:51,431 - lava_callback - INFO - Received callback for node 68d3c4c3cd36afa834e0db15 INFO: 172.20.0.1:53980 - "POST /node/68d3c4c3cd36afa834e0db15 HTTP/1.0" 202 Accepted 2025-09-26 10:15:51,436 - lava_callback - INFO - Starting async job submit for node 68d3c4c3cd36afa834e0db15 2025-09-26 10:15:51,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:51,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4c3cd36afa834e0db15 HTTP/1.1" 200 None 2025-09-26 10:15:51,452 - lava_callback - DEBUG - Processing node 68d3c4c3cd36afa834e0db15: baseline-arm-clabbe 2025-09-26 10:15:51,452 - lava_callback - ERROR - Error processing callback for node 68d3c4c3cd36afa834e0db15: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:51,839 - lava_callback - INFO - Received callback for node 68d3c4d0cd36afa834e0db62 INFO: 172.20.0.1:53994 - "POST /node/68d3c4d0cd36afa834e0db62 HTTP/1.0" 202 Accepted 2025-09-26 10:15:51,845 - lava_callback - INFO - Starting async job submit for node 68d3c4d0cd36afa834e0db62 2025-09-26 10:15:51,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:51,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4d0cd36afa834e0db62 HTTP/1.1" 200 None 2025-09-26 10:15:51,861 - lava_callback - DEBUG - Processing node 68d3c4d0cd36afa834e0db62: ltp-cve 2025-09-26 10:15:51,861 - lava_callback - ERROR - Error processing callback for node 68d3c4d0cd36afa834e0db62: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:52,668 - lava_callback - INFO - Received callback for node 68d3c4d2cd36afa834e0db68 INFO: 172.20.0.1:53998 - "POST /node/68d3c4d2cd36afa834e0db68 HTTP/1.0" 202 Accepted 2025-09-26 10:15:52,678 - lava_callback - INFO - Starting async job submit for node 68d3c4d2cd36afa834e0db68 2025-09-26 10:15:52,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:52,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4d2cd36afa834e0db68 HTTP/1.1" 200 None 2025-09-26 10:15:52,693 - lava_callback - DEBUG - Processing node 68d3c4d2cd36afa834e0db68: ltp-fs-bind 2025-09-26 10:15:52,693 - lava_callback - ERROR - Error processing callback for node 68d3c4d2cd36afa834e0db68: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:53,486 - lava_callback - INFO - Received callback for node 68d3c4d2cd36afa834e0db6b INFO: 172.20.0.1:54008 - "POST /node/68d3c4d2cd36afa834e0db6b HTTP/1.0" 202 Accepted 2025-09-26 10:15:53,495 - lava_callback - INFO - Starting async job submit for node 68d3c4d2cd36afa834e0db6b 2025-09-26 10:15:53,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:53,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4d2cd36afa834e0db6b HTTP/1.1" 200 None 2025-09-26 10:15:53,518 - lava_callback - DEBUG - Processing node 68d3c4d2cd36afa834e0db6b: ltp-fsx 2025-09-26 10:15:53,518 - lava_callback - ERROR - Error processing callback for node 68d3c4d2cd36afa834e0db6b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:54,271 - lava_callback - INFO - Received callback for node 68d3c4d3cd36afa834e0db70 INFO: 172.20.0.1:54014 - "POST /node/68d3c4d3cd36afa834e0db70 HTTP/1.0" 202 Accepted 2025-09-26 10:15:54,277 - lava_callback - INFO - Starting async job submit for node 68d3c4d3cd36afa834e0db70 2025-09-26 10:15:54,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:54,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4d3cd36afa834e0db70 HTTP/1.1" 200 None 2025-09-26 10:15:54,292 - lava_callback - DEBUG - Processing node 68d3c4d3cd36afa834e0db70: ltp-input 2025-09-26 10:15:54,292 - lava_callback - ERROR - Error processing callback for node 68d3c4d3cd36afa834e0db70: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:55,022 - lava_callback - INFO - Received callback for node 68d3c4d5cd36afa834e0db74 INFO: 172.20.0.1:54026 - "POST /node/68d3c4d5cd36afa834e0db74 HTTP/1.0" 202 Accepted 2025-09-26 10:15:55,028 - lava_callback - INFO - Starting async job submit for node 68d3c4d5cd36afa834e0db74 2025-09-26 10:15:55,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:55,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4d5cd36afa834e0db74 HTTP/1.1" 200 None 2025-09-26 10:15:55,044 - lava_callback - DEBUG - Processing node 68d3c4d5cd36afa834e0db74: ltp-ipc 2025-09-26 10:15:55,044 - lava_callback - ERROR - Error processing callback for node 68d3c4d5cd36afa834e0db74: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:55,809 - lava_callback - INFO - Received callback for node 68d3c4d6cd36afa834e0db79 INFO: 172.20.0.1:54030 - "POST /node/68d3c4d6cd36afa834e0db79 HTTP/1.0" 202 Accepted 2025-09-26 10:15:55,815 - lava_callback - INFO - Starting async job submit for node 68d3c4d6cd36afa834e0db79 2025-09-26 10:15:55,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:55,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4d6cd36afa834e0db79 HTTP/1.1" 200 None 2025-09-26 10:15:55,828 - lava_callback - DEBUG - Processing node 68d3c4d6cd36afa834e0db79: ltp-fs-bind 2025-09-26 10:15:55,828 - lava_callback - ERROR - Error processing callback for node 68d3c4d6cd36afa834e0db79: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:54034 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:15:56,628 - lava_callback - INFO - Received callback for node 68d3c4d6cd36afa834e0db77 INFO: 172.20.0.1:54038 - "POST /node/68d3c4d6cd36afa834e0db77 HTTP/1.0" 202 Accepted 2025-09-26 10:15:56,637 - lava_callback - INFO - Starting async job submit for node 68d3c4d6cd36afa834e0db77 2025-09-26 10:15:56,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:56,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4d6cd36afa834e0db77 HTTP/1.1" 200 None 2025-09-26 10:15:56,651 - lava_callback - DEBUG - Processing node 68d3c4d6cd36afa834e0db77: ltp-pty 2025-09-26 10:15:56,651 - lava_callback - ERROR - Error processing callback for node 68d3c4d6cd36afa834e0db77: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:57,439 - lava_callback - INFO - Received callback for node 68d3c4d9cd36afa834e0db7d INFO: 172.20.0.1:54046 - "POST /node/68d3c4d9cd36afa834e0db7d HTTP/1.0" 202 Accepted 2025-09-26 10:15:57,448 - lava_callback - INFO - Starting async job submit for node 68d3c4d9cd36afa834e0db7d 2025-09-26 10:15:57,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:57,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4d9cd36afa834e0db7d HTTP/1.1" 200 None 2025-09-26 10:15:57,483 - lava_callback - DEBUG - Processing node 68d3c4d9cd36afa834e0db7d: ltp-sched 2025-09-26 10:15:57,483 - lava_callback - ERROR - Error processing callback for node 68d3c4d9cd36afa834e0db7d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:58,198 - lava_callback - INFO - Received callback for node 68d3c4dbcd36afa834e0db80 INFO: 172.20.0.1:54052 - "POST /node/68d3c4dbcd36afa834e0db80 HTTP/1.0" 202 Accepted 2025-09-26 10:15:58,203 - lava_callback - INFO - Starting async job submit for node 68d3c4dbcd36afa834e0db80 2025-09-26 10:15:58,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:58,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4dbcd36afa834e0db80 HTTP/1.1" 200 None 2025-09-26 10:15:58,217 - lava_callback - DEBUG - Processing node 68d3c4dbcd36afa834e0db80: ltp-smoketest 2025-09-26 10:15:58,217 - lava_callback - ERROR - Error processing callback for node 68d3c4dbcd36afa834e0db80: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:58,951 - lava_callback - INFO - Received callback for node 68d3c4dbcd36afa834e0db82 INFO: 172.20.0.1:54058 - "POST /node/68d3c4dbcd36afa834e0db82 HTTP/1.0" 202 Accepted 2025-09-26 10:15:58,957 - lava_callback - INFO - Starting async job submit for node 68d3c4dbcd36afa834e0db82 2025-09-26 10:15:58,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:58,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4dbcd36afa834e0db82 HTTP/1.1" 200 None 2025-09-26 10:15:58,975 - lava_callback - DEBUG - Processing node 68d3c4dbcd36afa834e0db82: ltp-cap-bounds 2025-09-26 10:15:58,975 - lava_callback - ERROR - Error processing callback for node 68d3c4dbcd36afa834e0db82: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:15:59,677 - lava_callback - INFO - Received callback for node 68d665da2f83206171a902a8 INFO: 172.20.0.1:33582 - "POST /node/68d665da2f83206171a902a8 HTTP/1.0" 202 Accepted 2025-09-26 10:15:59,683 - lava_callback - INFO - Starting async job submit for node 68d665da2f83206171a902a8 2025-09-26 10:15:59,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:59,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665da2f83206171a902a8 HTTP/1.1" 200 None 2025-09-26 10:15:59,738 - lava_callback - DEBUG - Processing node 68d665da2f83206171a902a8: baseline-arm64 2025-09-26 10:15:59,817 - lava_callback - INFO - Received callback for node 68d3c4dccd36afa834e0db85 INFO: 172.20.0.1:33594 - "POST /node/68d3c4dccd36afa834e0db85 HTTP/1.0" 202 Accepted 2025-09-26 10:15:59,842 - lava_callback - INFO - Starting async job submit for node 68d3c4dccd36afa834e0db85 2025-09-26 10:15:59,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:15:59,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4dccd36afa834e0db85 HTTP/1.1" 200 None 2025-09-26 10:15:59,926 - lava_callback - DEBUG - Processing node 68d3c4dccd36afa834e0db85: ltp-syscalls 2025-09-26 10:15:59,926 - lava_callback - ERROR - Error processing callback for node 68d3c4dccd36afa834e0db85: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:16:00,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:16:00,565 - lava_callback - INFO - Received callback for node 68d3c4ddcd36afa834e0db89 INFO: 172.20.0.1:33600 - "POST /node/68d3c4ddcd36afa834e0db89 HTTP/1.0" 202 Accepted 2025-09-26 10:16:00,573 - lava_callback - INFO - Starting async job submit for node 68d3c4ddcd36afa834e0db89 2025-09-26 10:16:00,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:16:00,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4ddcd36afa834e0db89 HTTP/1.1" 200 None 2025-09-26 10:16:00,587 - lava_callback - DEBUG - Processing node 68d3c4ddcd36afa834e0db89: ltp-syscalls-ipc 2025-09-26 10:16:00,587 - lava_callback - ERROR - Error processing callback for node 68d3c4ddcd36afa834e0db89: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:16:00,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:16:00,620 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665da2f83206171a902a8/log.txt.gz 2025-09-26 10:16:00,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:16:01,320 - lava_callback - INFO - Received callback for node 68d3c4decd36afa834e0db8c INFO: 172.20.0.1:33604 - "POST /node/68d3c4decd36afa834e0db8c HTTP/1.0" 202 Accepted 2025-09-26 10:16:01,326 - lava_callback - INFO - Starting async job submit for node 68d3c4decd36afa834e0db8c 2025-09-26 10:16:01,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:16:01,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4decd36afa834e0db8c HTTP/1.1" 200 None 2025-09-26 10:16:01,340 - lava_callback - DEBUG - Processing node 68d3c4decd36afa834e0db8c: ltp-timers 2025-09-26 10:16:01,340 - lava_callback - ERROR - Error processing callback for node 68d3c4decd36afa834e0db8c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:16:02,073 - lava_callback - INFO - Received callback for node 68d3c4decd36afa834e0db90 INFO: 172.20.0.1:33614 - "POST /node/68d3c4decd36afa834e0db90 HTTP/1.0" 202 Accepted 2025-09-26 10:16:02,079 - lava_callback - INFO - Starting async job submit for node 68d3c4decd36afa834e0db90 2025-09-26 10:16:02,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:16:02,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4decd36afa834e0db90 HTTP/1.1" 200 None 2025-09-26 10:16:02,094 - lava_callback - DEBUG - Processing node 68d3c4decd36afa834e0db90: ltp-watchqueue 2025-09-26 10:16:02,094 - lava_callback - ERROR - Error processing callback for node 68d3c4decd36afa834e0db90: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:16:02,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:16:02,931 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665da2f83206171a902a8/lava_callback.json.gz 2025-09-26 10:16:02,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:16:02,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665da2f83206171a902a8 HTTP/1.1" 200 None 2025-09-26 10:16:02,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:16:03,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:16:03,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:16:03,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665da2f83206171a902a8 HTTP/1.1" 200 None 2025-09-26 10:16:03,040 - lava_callback - INFO - Completed processing callback for node 68d665da2f83206171a902a8 2025-09-26 10:16:03,709 - lava_callback - INFO - Received callback for node 68d665d12f83206171a9028d INFO: 172.20.0.1:33616 - "POST /node/68d665d12f83206171a9028d HTTP/1.0" 202 Accepted 2025-09-26 10:16:03,715 - lava_callback - INFO - Starting async job submit for node 68d665d12f83206171a9028d 2025-09-26 10:16:03,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:16:03,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665d12f83206171a9028d HTTP/1.1" 200 None 2025-09-26 10:16:03,753 - lava_callback - DEBUG - Processing node 68d665d12f83206171a9028d: baseline-arm64 2025-09-26 10:16:04,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:16:05,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:16:05,297 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665d12f83206171a9028d/log.txt.gz 2025-09-26 10:16:05,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:16:05,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:16:05,462 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d665d12f83206171a9028d/lava_callback.json.gz 2025-09-26 10:16:05,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:16:05,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665d12f83206171a9028d HTTP/1.1" 200 None 2025-09-26 10:16:05,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:16:05,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:16:05,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:16:05,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665d12f83206171a9028d HTTP/1.1" 200 None 2025-09-26 10:16:05,552 - lava_callback - INFO - Completed processing callback for node 68d665d12f83206171a9028d INFO: 172.20.0.1:33622 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:16:07,640 - lava_callback - INFO - Received callback for node 68d3c4e2cd36afa834e0db95 INFO: 172.20.0.1:33638 - "POST /node/68d3c4e2cd36afa834e0db95 HTTP/1.0" 202 Accepted 2025-09-26 10:16:07,646 - lava_callback - INFO - Starting async job submit for node 68d3c4e2cd36afa834e0db95 2025-09-26 10:16:07,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:16:07,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4e2cd36afa834e0db95 HTTP/1.1" 200 None 2025-09-26 10:16:07,670 - lava_callback - DEBUG - Processing node 68d3c4e2cd36afa834e0db95: ltp-fs-bind 2025-09-26 10:16:07,670 - lava_callback - ERROR - Error processing callback for node 68d3c4e2cd36afa834e0db95: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:16:08,404 - lava_callback - INFO - Received callback for node 68d3c4e5cd36afa834e0db98 INFO: 172.20.0.1:33654 - "POST /node/68d3c4e5cd36afa834e0db98 HTTP/1.0" 202 Accepted 2025-09-26 10:16:08,411 - lava_callback - INFO - Starting async job submit for node 68d3c4e5cd36afa834e0db98 2025-09-26 10:16:08,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:16:08,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4e5cd36afa834e0db98 HTTP/1.1" 200 None 2025-09-26 10:16:08,425 - lava_callback - DEBUG - Processing node 68d3c4e5cd36afa834e0db98: ltp-containers 2025-09-26 10:16:08,425 - lava_callback - ERROR - Error processing callback for node 68d3c4e5cd36afa834e0db98: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:33668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36978 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:16:19,247 - lava_callback - INFO - Received callback for node 68d40920cd36afa834e16d75 INFO: 172.20.0.1:36980 - "POST /node/68d40920cd36afa834e16d75 HTTP/1.0" 202 Accepted 2025-09-26 10:16:19,253 - lava_callback - INFO - Starting async job submit for node 68d40920cd36afa834e16d75 2025-09-26 10:16:19,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:16:19,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40920cd36afa834e16d75 HTTP/1.1" 200 None 2025-09-26 10:16:19,288 - lava_callback - DEBUG - Processing node 68d40920cd36afa834e16d75: baseline-arm 2025-09-26 10:16:19,577 - lava_callback - ERROR - Error processing callback for node 68d40920cd36afa834e16d75: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:40208 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:16:27,560 - lava_callback - INFO - Received callback for node 68d3c4eccd36afa834e0dba0 INFO: 172.20.0.1:40216 - "POST /node/68d3c4eccd36afa834e0dba0 HTTP/1.0" 202 Accepted 2025-09-26 10:16:27,566 - lava_callback - INFO - Starting async job submit for node 68d3c4eccd36afa834e0dba0 2025-09-26 10:16:27,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:16:27,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4eccd36afa834e0dba0 HTTP/1.1" 200 None 2025-09-26 10:16:27,580 - lava_callback - DEBUG - Processing node 68d3c4eccd36afa834e0dba0: ltp-fsx 2025-09-26 10:16:27,580 - lava_callback - ERROR - Error processing callback for node 68d3c4eccd36afa834e0dba0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:16:28,323 - lava_callback - INFO - Received callback for node 68d3c4efcd36afa834e0dbac INFO: 172.20.0.1:40218 - "POST /node/68d3c4efcd36afa834e0dbac HTTP/1.0" 202 Accepted 2025-09-26 10:16:28,329 - lava_callback - INFO - Starting async job submit for node 68d3c4efcd36afa834e0dbac 2025-09-26 10:16:28,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:16:28,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4efcd36afa834e0dbac HTTP/1.1" 200 None 2025-09-26 10:16:28,345 - lava_callback - DEBUG - Processing node 68d3c4efcd36afa834e0dbac: ltp-timers 2025-09-26 10:16:28,345 - lava_callback - ERROR - Error processing callback for node 68d3c4efcd36afa834e0dbac: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:16:29,075 - lava_callback - INFO - Received callback for node 68d3c4f3cd36afa834e0dbb8 INFO: 172.20.0.1:40234 - "POST /node/68d3c4f3cd36afa834e0dbb8 HTTP/1.0" 202 Accepted 2025-09-26 10:16:29,084 - lava_callback - INFO - Starting async job submit for node 68d3c4f3cd36afa834e0dbb8 2025-09-26 10:16:29,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:16:29,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4f3cd36afa834e0dbb8 HTTP/1.1" 200 None 2025-09-26 10:16:29,100 - lava_callback - DEBUG - Processing node 68d3c4f3cd36afa834e0dbb8: ltp-sched 2025-09-26 10:16:29,100 - lava_callback - ERROR - Error processing callback for node 68d3c4f3cd36afa834e0dbb8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:16:29,831 - lava_callback - INFO - Received callback for node 68d3c4f7cd36afa834e0dbc4 INFO: 172.20.0.1:33050 - "POST /node/68d3c4f7cd36afa834e0dbc4 HTTP/1.0" 202 Accepted 2025-09-26 10:16:29,840 - lava_callback - INFO - Starting async job submit for node 68d3c4f7cd36afa834e0dbc4 2025-09-26 10:16:29,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:16:29,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4f7cd36afa834e0dbc4 HTTP/1.1" 200 None 2025-09-26 10:16:29,854 - lava_callback - DEBUG - Processing node 68d3c4f7cd36afa834e0dbc4: ltp-fs-bind 2025-09-26 10:16:29,855 - lava_callback - ERROR - Error processing callback for node 68d3c4f7cd36afa834e0dbc4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:16:30,618 - lava_callback - INFO - Received callback for node 68d3c4facd36afa834e0dbd0 INFO: 172.20.0.1:33052 - "POST /node/68d3c4facd36afa834e0dbd0 HTTP/1.0" 202 Accepted 2025-09-26 10:16:30,628 - lava_callback - INFO - Starting async job submit for node 68d3c4facd36afa834e0dbd0 2025-09-26 10:16:30,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:16:30,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4facd36afa834e0dbd0 HTTP/1.1" 200 None 2025-09-26 10:16:30,645 - lava_callback - DEBUG - Processing node 68d3c4facd36afa834e0dbd0: ltp-pty 2025-09-26 10:16:30,646 - lava_callback - ERROR - Error processing callback for node 68d3c4facd36afa834e0dbd0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:33060 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:16:39,114 - lava_callback - INFO - Received callback for node 68d3c501cd36afa834e0dbec INFO: 172.20.0.1:33066 - "POST /node/68d3c501cd36afa834e0dbec HTTP/1.0" 202 Accepted 2025-09-26 10:16:39,121 - lava_callback - INFO - Starting async job submit for node 68d3c501cd36afa834e0dbec 2025-09-26 10:16:39,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:16:39,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c501cd36afa834e0dbec HTTP/1.1" 200 None 2025-09-26 10:16:39,137 - lava_callback - DEBUG - Processing node 68d3c501cd36afa834e0dbec: baseline-arm64-baylibre 2025-09-26 10:16:39,137 - lava_callback - ERROR - Error processing callback for node 68d3c501cd36afa834e0dbec: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:45964 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:16:47,597 - lava_callback - INFO - Received callback for node 68d3c4fdcd36afa834e0dbd9 INFO: 172.20.0.1:45980 - "POST /node/68d3c4fdcd36afa834e0dbd9 HTTP/1.0" 202 Accepted 2025-09-26 10:16:47,603 - lava_callback - INFO - Starting async job submit for node 68d3c4fdcd36afa834e0dbd9 2025-09-26 10:16:47,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:16:47,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c4fdcd36afa834e0dbd9 HTTP/1.1" 200 None 2025-09-26 10:16:47,619 - lava_callback - DEBUG - Processing node 68d3c4fdcd36afa834e0dbd9: ltp-sched 2025-09-26 10:16:47,619 - lava_callback - ERROR - Error processing callback for node 68d3c4fdcd36afa834e0dbd9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:16:48,365 - lava_callback - INFO - Received callback for node 68d3c501cd36afa834e0dbe9 INFO: 172.20.0.1:45992 - "POST /node/68d3c501cd36afa834e0dbe9 HTTP/1.0" 202 Accepted 2025-09-26 10:16:48,374 - lava_callback - INFO - Starting async job submit for node 68d3c501cd36afa834e0dbe9 2025-09-26 10:16:48,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:16:48,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c501cd36afa834e0dbe9 HTTP/1.1" 200 None 2025-09-26 10:16:48,389 - lava_callback - DEBUG - Processing node 68d3c501cd36afa834e0dbe9: ltp-watchqueue 2025-09-26 10:16:48,389 - lava_callback - ERROR - Error processing callback for node 68d3c501cd36afa834e0dbe9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:16:49,127 - lava_callback - INFO - Received callback for node 68d3c505cd36afa834e0dbf5 INFO: 172.20.0.1:45996 - "POST /node/68d3c505cd36afa834e0dbf5 HTTP/1.0" 202 Accepted 2025-09-26 10:16:49,132 - lava_callback - INFO - Starting async job submit for node 68d3c505cd36afa834e0dbf5 2025-09-26 10:16:49,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:16:49,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c505cd36afa834e0dbf5 HTTP/1.1" 200 None 2025-09-26 10:16:49,146 - lava_callback - DEBUG - Processing node 68d3c505cd36afa834e0dbf5: ltp-fsx 2025-09-26 10:16:49,146 - lava_callback - ERROR - Error processing callback for node 68d3c505cd36afa834e0dbf5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:16:49,905 - lava_callback - INFO - Received callback for node 68d3c50dcd36afa834e0dc38 INFO: 172.20.0.1:57754 - "POST /node/68d3c50dcd36afa834e0dc38 HTTP/1.0" 202 Accepted 2025-09-26 10:16:49,911 - lava_callback - INFO - Starting async job submit for node 68d3c50dcd36afa834e0dc38 2025-09-26 10:16:49,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:16:49,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c50dcd36afa834e0dc38 HTTP/1.1" 200 None 2025-09-26 10:16:49,926 - lava_callback - DEBUG - Processing node 68d3c50dcd36afa834e0dc38: ltp-smoketest 2025-09-26 10:16:49,926 - lava_callback - ERROR - Error processing callback for node 68d3c50dcd36afa834e0dc38: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:57760 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:16:59,147 - lava_callback - INFO - Received callback for node 68d3c512cd36afa834e0dc45 INFO: 172.20.0.1:57776 - "POST /node/68d3c512cd36afa834e0dc45 HTTP/1.0" 202 Accepted 2025-09-26 10:16:59,152 - lava_callback - INFO - Starting async job submit for node 68d3c512cd36afa834e0dc45 2025-09-26 10:16:59,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:16:59,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c512cd36afa834e0dc45 HTTP/1.1" 200 None 2025-09-26 10:16:59,188 - lava_callback - DEBUG - Processing node 68d3c512cd36afa834e0dc45: baseline-arm64-baylibre 2025-09-26 10:16:59,188 - lava_callback - ERROR - Error processing callback for node 68d3c512cd36afa834e0dc45: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:34390 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:17:07,913 - lava_callback - INFO - Received callback for node 68d3c512cd36afa834e0dc47 INFO: 172.20.0.1:34402 - "POST /node/68d3c512cd36afa834e0dc47 HTTP/1.0" 202 Accepted 2025-09-26 10:17:07,919 - lava_callback - INFO - Starting async job submit for node 68d3c512cd36afa834e0dc47 2025-09-26 10:17:07,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:17:07,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c512cd36afa834e0dc47 HTTP/1.1" 200 None 2025-09-26 10:17:07,936 - lava_callback - DEBUG - Processing node 68d3c512cd36afa834e0dc47: ltp-watchqueue 2025-09-26 10:17:07,936 - lava_callback - ERROR - Error processing callback for node 68d3c512cd36afa834e0dc47: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:17:08,684 - lava_callback - INFO - Received callback for node 68d3c516cd36afa834e0dc50 INFO: 172.20.0.1:34418 - "POST /node/68d3c516cd36afa834e0dc50 HTTP/1.0" 202 Accepted 2025-09-26 10:17:08,689 - lava_callback - INFO - Starting async job submit for node 68d3c516cd36afa834e0dc50 2025-09-26 10:17:08,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:17:08,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c516cd36afa834e0dc50 HTTP/1.1" 200 None 2025-09-26 10:17:08,703 - lava_callback - DEBUG - Processing node 68d3c516cd36afa834e0dc50: ltp-sched 2025-09-26 10:17:08,703 - lava_callback - ERROR - Error processing callback for node 68d3c516cd36afa834e0dc50: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:34428 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:17:09,451 - lava_callback - INFO - Received callback for node 68d3c523cd36afa834e0dc85 INFO: 172.20.0.1:35974 - "POST /node/68d3c523cd36afa834e0dc85 HTTP/1.0" 202 Accepted 2025-09-26 10:17:09,457 - lava_callback - INFO - Starting async job submit for node 68d3c523cd36afa834e0dc85 2025-09-26 10:17:09,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:17:09,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c523cd36afa834e0dc85 HTTP/1.1" 200 None 2025-09-26 10:17:09,480 - lava_callback - DEBUG - Processing node 68d3c523cd36afa834e0dc85: ltp-smoketest 2025-09-26 10:17:09,480 - lava_callback - ERROR - Error processing callback for node 68d3c523cd36afa834e0dc85: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:17:11,457 - lava_callback - INFO - Received callback for node 68d3c523cd36afa834e0dc88 INFO: 172.20.0.1:35978 - "POST /node/68d3c523cd36afa834e0dc88 HTTP/1.0" 202 Accepted 2025-09-26 10:17:11,462 - lava_callback - INFO - Starting async job submit for node 68d3c523cd36afa834e0dc88 2025-09-26 10:17:11,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:17:11,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c523cd36afa834e0dc88 HTTP/1.1" 200 None 2025-09-26 10:17:11,483 - lava_callback - DEBUG - Processing node 68d3c523cd36afa834e0dc88: baseline-arm64-clabbe 2025-09-26 10:17:11,483 - lava_callback - ERROR - Error processing callback for node 68d3c523cd36afa834e0dc88: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:17:13,265 - lava_callback - INFO - Received callback for node 68d43ec5a5c2c05277bc98ff INFO: 172.20.0.1:35990 - "POST /node/68d43ec5a5c2c05277bc98ff HTTP/1.0" 202 Accepted 2025-09-26 10:17:13,271 - lava_callback - INFO - Starting async job submit for node 68d43ec5a5c2c05277bc98ff 2025-09-26 10:17:13,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:17:13,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d43ec5a5c2c05277bc98ff HTTP/1.1" 200 None 2025-09-26 10:17:13,313 - lava_callback - DEBUG - Processing node 68d43ec5a5c2c05277bc98ff: baseline-arm64-broonie 2025-09-26 10:17:13,625 - lava_callback - ERROR - Error processing callback for node 68d43ec5a5c2c05277bc98ff: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:36006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50422 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:17:27,656 - lava_callback - INFO - Received callback for node 68d3c52ccd36afa834e0dca0 INFO: 172.20.0.1:50430 - "POST /node/68d3c52ccd36afa834e0dca0 HTTP/1.0" 202 Accepted 2025-09-26 10:17:27,662 - lava_callback - INFO - Starting async job submit for node 68d3c52ccd36afa834e0dca0 2025-09-26 10:17:27,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:17:27,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c52ccd36afa834e0dca0 HTTP/1.1" 200 None 2025-09-26 10:17:27,677 - lava_callback - DEBUG - Processing node 68d3c52ccd36afa834e0dca0: ltp-syscalls 2025-09-26 10:17:27,677 - lava_callback - ERROR - Error processing callback for node 68d3c52ccd36afa834e0dca0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:17:31,449 - lava_callback - INFO - Received callback for node 68d3c528cd36afa834e0dc95 INFO: 172.20.0.1:53474 - "POST /node/68d3c528cd36afa834e0dc95 HTTP/1.0" 202 Accepted 2025-09-26 10:17:31,454 - lava_callback - INFO - Starting async job submit for node 68d3c528cd36afa834e0dc95 2025-09-26 10:17:31,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:17:31,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c528cd36afa834e0dc95 HTTP/1.1" 200 None 2025-09-26 10:17:31,474 - lava_callback - DEBUG - Processing node 68d3c528cd36afa834e0dc95: baseline-arm64-clabbe 2025-09-26 10:17:31,474 - lava_callback - ERROR - Error processing callback for node 68d3c528cd36afa834e0dc95: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:17:32,131 - lava_callback - INFO - Received callback for node 68d3c529cd36afa834e0dc98 INFO: 172.20.0.1:53480 - "POST /node/68d3c529cd36afa834e0dc98 HTTP/1.0" 202 Accepted 2025-09-26 10:17:32,137 - lava_callback - INFO - Starting async job submit for node 68d3c529cd36afa834e0dc98 2025-09-26 10:17:32,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:17:32,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c529cd36afa834e0dc98 HTTP/1.1" 200 None 2025-09-26 10:17:32,152 - lava_callback - DEBUG - Processing node 68d3c529cd36afa834e0dc98: baseline-arm64-clabbe 2025-09-26 10:17:32,152 - lava_callback - ERROR - Error processing callback for node 68d3c529cd36afa834e0dc98: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:17:32,794 - lava_callback - INFO - Received callback for node 68d3c52acd36afa834e0dc9b INFO: 172.20.0.1:53492 - "POST /node/68d3c52acd36afa834e0dc9b HTTP/1.0" 202 Accepted 2025-09-26 10:17:32,800 - lava_callback - INFO - Starting async job submit for node 68d3c52acd36afa834e0dc9b 2025-09-26 10:17:32,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:17:32,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c52acd36afa834e0dc9b HTTP/1.1" 200 None 2025-09-26 10:17:32,816 - lava_callback - DEBUG - Processing node 68d3c52acd36afa834e0dc9b: baseline-arm64-clabbe 2025-09-26 10:17:32,816 - lava_callback - ERROR - Error processing callback for node 68d3c52acd36afa834e0dc9b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:17:33,451 - lava_callback - INFO - Received callback for node 68d3c52bcd36afa834e0dc9e INFO: 172.20.0.1:53504 - "POST /node/68d3c52bcd36afa834e0dc9e HTTP/1.0" 202 Accepted 2025-09-26 10:17:33,456 - lava_callback - INFO - Starting async job submit for node 68d3c52bcd36afa834e0dc9e 2025-09-26 10:17:33,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:17:33,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c52bcd36afa834e0dc9e HTTP/1.1" 200 None 2025-09-26 10:17:33,469 - lava_callback - DEBUG - Processing node 68d3c52bcd36afa834e0dc9e: baseline-arm64-clabbe 2025-09-26 10:17:33,469 - lava_callback - ERROR - Error processing callback for node 68d3c52bcd36afa834e0dc9e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:53520 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:17:36,779 - lava_callback - INFO - Received callback for node 68d667b22f83206171a903fc INFO: 172.20.0.1:53534 - "POST /node/68d667b22f83206171a903fc HTTP/1.0" 202 Accepted 2025-09-26 10:17:36,785 - lava_callback - INFO - Starting async job submit for node 68d667b22f83206171a903fc 2025-09-26 10:17:36,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:17:36,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d667b22f83206171a903fc HTTP/1.1" 200 None 2025-09-26 10:17:36,821 - lava_callback - DEBUG - Processing node 68d667b22f83206171a903fc: baseline-arm64-broonie 2025-09-26 10:17:37,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:17:37,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:17:37,536 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d667b22f83206171a903fc/log.txt.gz 2025-09-26 10:17:37,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:17:39,945 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:17:39,946 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d667b22f83206171a903fc/lava_callback.json.gz 2025-09-26 10:17:39,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:17:39,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d667b22f83206171a903fc HTTP/1.1" 200 None 2025-09-26 10:17:39,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:17:39,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:17:39,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:17:40,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d667b22f83206171a903fc HTTP/1.1" 200 None 2025-09-26 10:17:40,022 - lava_callback - INFO - Completed processing callback for node 68d667b22f83206171a903fc 2025-09-26 10:17:41,602 - lava_callback - INFO - Received callback for node 68d667ab2f83206171a903f8 INFO: 172.20.0.1:52532 - "POST /node/68d667ab2f83206171a903f8 HTTP/1.0" 202 Accepted 2025-09-26 10:17:41,608 - lava_callback - INFO - Starting async job submit for node 68d667ab2f83206171a903f8 2025-09-26 10:17:41,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:17:41,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d667ab2f83206171a903f8 HTTP/1.1" 200 None 2025-09-26 10:17:41,675 - lava_callback - DEBUG - Processing node 68d667ab2f83206171a903f8: baseline-arm64-kontron 2025-09-26 10:17:41,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:17:42,307 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:17:42,307 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d667ab2f83206171a903f8/log.txt.gz 2025-09-26 10:17:42,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:17:42,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:17:42,448 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-kontron-68d667ab2f83206171a903f8/lava_callback.json.gz 2025-09-26 10:17:42,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:17:42,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d667ab2f83206171a903f8 HTTP/1.1" 200 None 2025-09-26 10:17:42,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:17:42,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:17:42,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:17:42,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d667ab2f83206171a903f8 HTTP/1.1" 200 None 2025-09-26 10:17:42,568 - lava_callback - INFO - Completed processing callback for node 68d667ab2f83206171a903f8 INFO: 172.20.0.1:52536 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:17:53,940 - lava_callback - INFO - Received callback for node 68d3c549cd36afa834e0dd52 INFO: 172.20.0.1:39114 - "POST /node/68d3c549cd36afa834e0dd52 HTTP/1.0" 202 Accepted 2025-09-26 10:17:53,948 - lava_callback - INFO - Starting async job submit for node 68d3c549cd36afa834e0dd52 2025-09-26 10:17:53,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:17:53,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c549cd36afa834e0dd52 HTTP/1.1" 200 None 2025-09-26 10:17:53,964 - lava_callback - DEBUG - Processing node 68d3c549cd36afa834e0dd52: baseline-arm 2025-09-26 10:17:53,964 - lava_callback - ERROR - Error processing callback for node 68d3c549cd36afa834e0dd52: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:17:54,646 - lava_callback - INFO - Received callback for node 68d3c54acd36afa834e0dd60 INFO: 172.20.0.1:39128 - "POST /node/68d3c54acd36afa834e0dd60 HTTP/1.0" 202 Accepted 2025-09-26 10:17:54,651 - lava_callback - INFO - Starting async job submit for node 68d3c54acd36afa834e0dd60 2025-09-26 10:17:54,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:17:54,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c54acd36afa834e0dd60 HTTP/1.1" 200 None 2025-09-26 10:17:54,666 - lava_callback - DEBUG - Processing node 68d3c54acd36afa834e0dd60: baseline-arm 2025-09-26 10:17:54,666 - lava_callback - ERROR - Error processing callback for node 68d3c54acd36afa834e0dd60: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:39142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49410 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:18:07,653 - lava_callback - INFO - Received callback for node 68d3c550cd36afa834e0dd63 INFO: 172.20.0.1:49414 - "POST /node/68d3c550cd36afa834e0dd63 HTTP/1.0" 202 Accepted 2025-09-26 10:18:07,659 - lava_callback - INFO - Starting async job submit for node 68d3c550cd36afa834e0dd63 2025-09-26 10:18:07,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:18:07,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c550cd36afa834e0dd63 HTTP/1.1" 200 None 2025-09-26 10:18:07,673 - lava_callback - DEBUG - Processing node 68d3c550cd36afa834e0dd63: ltp-input 2025-09-26 10:18:07,673 - lava_callback - ERROR - Error processing callback for node 68d3c550cd36afa834e0dd63: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60220 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:18:13,793 - lava_callback - INFO - Received callback for node 68d3c551cd36afa834e0dd66 INFO: 172.20.0.1:60224 - "POST /node/68d3c551cd36afa834e0dd66 HTTP/1.0" 202 Accepted 2025-09-26 10:18:13,798 - lava_callback - INFO - Starting async job submit for node 68d3c551cd36afa834e0dd66 2025-09-26 10:18:13,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:18:13,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c551cd36afa834e0dd66 HTTP/1.1" 200 None 2025-09-26 10:18:13,818 - lava_callback - DEBUG - Processing node 68d3c551cd36afa834e0dd66: baseline-arm 2025-09-26 10:18:13,818 - lava_callback - ERROR - Error processing callback for node 68d3c551cd36afa834e0dd66: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:18:14,481 - lava_callback - INFO - Received callback for node 68d3c552cd36afa834e0dd69 INFO: 172.20.0.1:60228 - "POST /node/68d3c552cd36afa834e0dd69 HTTP/1.0" 202 Accepted 2025-09-26 10:18:14,487 - lava_callback - INFO - Starting async job submit for node 68d3c552cd36afa834e0dd69 2025-09-26 10:18:14,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:18:14,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c552cd36afa834e0dd69 HTTP/1.1" 200 None 2025-09-26 10:18:14,500 - lava_callback - DEBUG - Processing node 68d3c552cd36afa834e0dd69: baseline-arm 2025-09-26 10:18:14,500 - lava_callback - ERROR - Error processing callback for node 68d3c552cd36afa834e0dd69: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:18:15,158 - lava_callback - INFO - Received callback for node 68d3c55dcd36afa834e0dd78 INFO: 172.20.0.1:60234 - "POST /node/68d3c55dcd36afa834e0dd78 HTTP/1.0" 202 Accepted 2025-09-26 10:18:15,166 - lava_callback - INFO - Starting async job submit for node 68d3c55dcd36afa834e0dd78 2025-09-26 10:18:15,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:60240 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 10:18:15,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c55dcd36afa834e0dd78 HTTP/1.1" 200 None 2025-09-26 10:18:15,182 - lava_callback - DEBUG - Processing node 68d3c55dcd36afa834e0dd78: baseline-arm 2025-09-26 10:18:15,182 - lava_callback - ERROR - Error processing callback for node 68d3c55dcd36afa834e0dd78: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:18:15,861 - lava_callback - INFO - Received callback for node 68d3c55ecd36afa834e0dd7b INFO: 172.20.0.1:60250 - "POST /node/68d3c55ecd36afa834e0dd7b HTTP/1.0" 202 Accepted 2025-09-26 10:18:15,869 - lava_callback - INFO - Starting async job submit for node 68d3c55ecd36afa834e0dd7b 2025-09-26 10:18:15,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:18:15,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c55ecd36afa834e0dd7b HTTP/1.1" 200 None 2025-09-26 10:18:15,883 - lava_callback - DEBUG - Processing node 68d3c55ecd36afa834e0dd7b: baseline-arm 2025-09-26 10:18:15,884 - lava_callback - ERROR - Error processing callback for node 68d3c55ecd36afa834e0dd7b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60256 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:18:16,572 - lava_callback - INFO - Received callback for node 68d3c560cd36afa834e0dd7f INFO: 172.20.0.1:60262 - "POST /node/68d3c560cd36afa834e0dd7f HTTP/1.0" 202 Accepted 2025-09-26 10:18:16,577 - lava_callback - INFO - Starting async job submit for node 68d3c560cd36afa834e0dd7f 2025-09-26 10:18:16,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:18:16,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c560cd36afa834e0dd7f HTTP/1.1" 200 None 2025-09-26 10:18:16,593 - lava_callback - DEBUG - Processing node 68d3c560cd36afa834e0dd7f: baseline-arm 2025-09-26 10:18:16,593 - lava_callback - ERROR - Error processing callback for node 68d3c560cd36afa834e0dd7f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:18:17,267 - lava_callback - INFO - Received callback for node 68d3c561cd36afa834e0dd82 INFO: 172.20.0.1:60276 - "POST /node/68d3c561cd36afa834e0dd82 HTTP/1.0" 202 Accepted 2025-09-26 10:18:17,273 - lava_callback - INFO - Starting async job submit for node 68d3c561cd36afa834e0dd82 2025-09-26 10:18:17,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:18:17,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c561cd36afa834e0dd82 HTTP/1.1" 200 None 2025-09-26 10:18:17,295 - lava_callback - DEBUG - Processing node 68d3c561cd36afa834e0dd82: baseline-arm 2025-09-26 10:18:17,295 - lava_callback - ERROR - Error processing callback for node 68d3c561cd36afa834e0dd82: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39822 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:18:31,910 - lava_callback - INFO - Received callback for node 68d667412f83206171a903ef INFO: 172.20.0.1:55874 - "POST /node/68d667412f83206171a903ef HTTP/1.0" 202 Accepted 2025-09-26 10:18:31,916 - lava_callback - INFO - Starting async job submit for node 68d667412f83206171a903ef 2025-09-26 10:18:31,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:18:31,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d667412f83206171a903ef HTTP/1.1" 200 None 2025-09-26 10:18:31,981 - lava_callback - DEBUG - Processing node 68d667412f83206171a903ef: baseline-arm64-broonie 2025-09-26 10:18:32,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:18:33,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:18:33,248 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d667412f83206171a903ef/log.txt.gz 2025-09-26 10:18:33,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:18:35,551 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:18:35,552 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d667412f83206171a903ef/lava_callback.json.gz 2025-09-26 10:18:35,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:18:35,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d667412f83206171a903ef HTTP/1.1" 200 None 2025-09-26 10:18:35,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:18:35,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:18:35,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:18:35,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d667412f83206171a903ef HTTP/1.1" 200 None 2025-09-26 10:18:35,658 - lava_callback - INFO - Completed processing callback for node 68d667412f83206171a903ef 2025-09-26 10:18:36,222 - lava_callback - INFO - Received callback for node 68d40921cd36afa834e16d78 INFO: 172.20.0.1:55886 - "POST /node/68d40921cd36afa834e16d78 HTTP/1.0" 202 Accepted 2025-09-26 10:18:36,232 - lava_callback - INFO - Starting async job submit for node 68d40921cd36afa834e16d78 2025-09-26 10:18:36,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:18:36,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40921cd36afa834e16d78 HTTP/1.1" 200 None 2025-09-26 10:18:36,305 - lava_callback - DEBUG - Processing node 68d40921cd36afa834e16d78: baseline-arm INFO: 172.20.0.1:55892 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:18:36,589 - lava_callback - ERROR - Error processing callback for node 68d40921cd36afa834e16d78: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:51018 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:18:53,873 - lava_callback - INFO - Received callback for node 68d3c57ccd36afa834e0ddb0 INFO: 172.20.0.1:55396 - "POST /node/68d3c57ccd36afa834e0ddb0 HTTP/1.0" 202 Accepted 2025-09-26 10:18:53,878 - lava_callback - INFO - Starting async job submit for node 68d3c57ccd36afa834e0ddb0 2025-09-26 10:18:53,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:18:53,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c57ccd36afa834e0ddb0 HTTP/1.1" 200 None 2025-09-26 10:18:53,896 - lava_callback - DEBUG - Processing node 68d3c57ccd36afa834e0ddb0: baseline-arm 2025-09-26 10:18:53,896 - lava_callback - ERROR - Error processing callback for node 68d3c57ccd36afa834e0ddb0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:18:54,557 - lava_callback - INFO - Received callback for node 68d3c581cd36afa834e0ddc3 INFO: 172.20.0.1:55404 - "POST /node/68d3c581cd36afa834e0ddc3 HTTP/1.0" 202 Accepted 2025-09-26 10:18:54,563 - lava_callback - INFO - Starting async job submit for node 68d3c581cd36afa834e0ddc3 2025-09-26 10:18:54,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:18:54,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c581cd36afa834e0ddc3 HTTP/1.1" 200 None 2025-09-26 10:18:54,593 - lava_callback - DEBUG - Processing node 68d3c581cd36afa834e0ddc3: baseline-arm 2025-09-26 10:18:54,593 - lava_callback - ERROR - Error processing callback for node 68d3c581cd36afa834e0ddc3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:55410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34200 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:19:07,724 - lava_callback - INFO - Received callback for node 68d3c590cd36afa834e0de09 INFO: 172.20.0.1:34216 - "POST /node/68d3c590cd36afa834e0de09 HTTP/1.0" 202 Accepted 2025-09-26 10:19:07,734 - lava_callback - INFO - Starting async job submit for node 68d3c590cd36afa834e0de09 2025-09-26 10:19:07,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:19:07,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c590cd36afa834e0de09 HTTP/1.1" 200 None 2025-09-26 10:19:07,751 - lava_callback - DEBUG - Processing node 68d3c590cd36afa834e0de09: ltp-fsx 2025-09-26 10:19:07,751 - lava_callback - ERROR - Error processing callback for node 68d3c590cd36afa834e0de09: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:19:08,518 - lava_callback - INFO - Received callback for node 68d3c595cd36afa834e0de1a INFO: 172.20.0.1:34232 - "POST /node/68d3c595cd36afa834e0de1a HTTP/1.0" 202 Accepted 2025-09-26 10:19:08,523 - lava_callback - INFO - Starting async job submit for node 68d3c595cd36afa834e0de1a 2025-09-26 10:19:08,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:19:08,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c595cd36afa834e0de1a HTTP/1.1" 200 None 2025-09-26 10:19:08,539 - lava_callback - DEBUG - Processing node 68d3c595cd36afa834e0de1a: baseline-arm-broonie 2025-09-26 10:19:08,539 - lava_callback - ERROR - Error processing callback for node 68d3c595cd36afa834e0de1a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:19:09,267 - lava_callback - INFO - Received callback for node 68d3c598cd36afa834e0de1f INFO: 172.20.0.1:34244 - "POST /node/68d3c598cd36afa834e0de1f HTTP/1.0" 202 Accepted 2025-09-26 10:19:09,277 - lava_callback - INFO - Starting async job submit for node 68d3c598cd36afa834e0de1f 2025-09-26 10:19:09,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:19:09,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c598cd36afa834e0de1f HTTP/1.1" 200 None 2025-09-26 10:19:09,293 - lava_callback - DEBUG - Processing node 68d3c598cd36afa834e0de1f: ltp-smoketest 2025-09-26 10:19:09,293 - lava_callback - ERROR - Error processing callback for node 68d3c598cd36afa834e0de1f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:49488 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:19:10,059 - lava_callback - INFO - Received callback for node 68d3c59bcd36afa834e0de28 INFO: 172.20.0.1:49492 - "POST /node/68d3c59bcd36afa834e0de28 HTTP/1.0" 202 Accepted 2025-09-26 10:19:10,064 - lava_callback - INFO - Starting async job submit for node 68d3c59bcd36afa834e0de28 2025-09-26 10:19:10,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:19:10,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c59bcd36afa834e0de28 HTTP/1.1" 200 None 2025-09-26 10:19:10,084 - lava_callback - DEBUG - Processing node 68d3c59bcd36afa834e0de28: baseline-arm-broonie 2025-09-26 10:19:10,084 - lava_callback - ERROR - Error processing callback for node 68d3c59bcd36afa834e0de28: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:49504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56030 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:19:31,710 - lava_callback - INFO - Received callback for node 68d3c5a5cd36afa834e0de43 INFO: 172.20.0.1:39810 - "POST /node/68d3c5a5cd36afa834e0de43 HTTP/1.0" 202 Accepted 2025-09-26 10:19:31,716 - lava_callback - INFO - Starting async job submit for node 68d3c5a5cd36afa834e0de43 2025-09-26 10:19:31,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:19:31,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c5a5cd36afa834e0de43 HTTP/1.1" 200 None 2025-09-26 10:19:31,731 - lava_callback - DEBUG - Processing node 68d3c5a5cd36afa834e0de43: baseline-arm-clabbe 2025-09-26 10:19:31,731 - lava_callback - ERROR - Error processing callback for node 68d3c5a5cd36afa834e0de43: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:19:32,356 - lava_callback - INFO - Received callback for node 68d3c5a8cd36afa834e0de4f INFO: 172.20.0.1:39826 - "POST /node/68d3c5a8cd36afa834e0de4f HTTP/1.0" 202 Accepted 2025-09-26 10:19:32,361 - lava_callback - INFO - Starting async job submit for node 68d3c5a8cd36afa834e0de4f 2025-09-26 10:19:32,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:19:32,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c5a8cd36afa834e0de4f HTTP/1.1" 200 None 2025-09-26 10:19:32,376 - lava_callback - DEBUG - Processing node 68d3c5a8cd36afa834e0de4f: baseline-arm-clabbe 2025-09-26 10:19:32,376 - lava_callback - ERROR - Error processing callback for node 68d3c5a8cd36afa834e0de4f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:19:33,015 - lava_callback - INFO - Received callback for node 68d3c5b0cd36afa834e0de68 INFO: 172.20.0.1:39842 - "POST /node/68d3c5b0cd36afa834e0de68 HTTP/1.0" 202 Accepted 2025-09-26 10:19:33,021 - lava_callback - INFO - Starting async job submit for node 68d3c5b0cd36afa834e0de68 2025-09-26 10:19:33,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:19:33,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c5b0cd36afa834e0de68 HTTP/1.1" 200 None 2025-09-26 10:19:33,038 - lava_callback - DEBUG - Processing node 68d3c5b0cd36afa834e0de68: baseline-arm-clabbe 2025-09-26 10:19:33,038 - lava_callback - ERROR - Error processing callback for node 68d3c5b0cd36afa834e0de68: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:19:33,687 - lava_callback - INFO - Received callback for node 68d3c5a9cd36afa834e0de56 INFO: 172.20.0.1:39858 - "POST /node/68d3c5a9cd36afa834e0de56 HTTP/1.0" 202 Accepted 2025-09-26 10:19:33,695 - lava_callback - INFO - Starting async job submit for node 68d3c5a9cd36afa834e0de56 2025-09-26 10:19:33,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:19:33,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c5a9cd36afa834e0de56 HTTP/1.1" 200 None 2025-09-26 10:19:33,711 - lava_callback - DEBUG - Processing node 68d3c5a9cd36afa834e0de56: baseline-arm-clabbe 2025-09-26 10:19:33,711 - lava_callback - ERROR - Error processing callback for node 68d3c5a9cd36afa834e0de56: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:39864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59924 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:19:47,745 - lava_callback - INFO - Received callback for node 68d3c5b1cd36afa834e0de6a INFO: 172.20.0.1:59940 - "POST /node/68d3c5b1cd36afa834e0de6a HTTP/1.0" 202 Accepted 2025-09-26 10:19:47,751 - lava_callback - INFO - Starting async job submit for node 68d3c5b1cd36afa834e0de6a 2025-09-26 10:19:47,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:19:47,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c5b1cd36afa834e0de6a HTTP/1.1" 200 None 2025-09-26 10:19:47,794 - lava_callback - DEBUG - Processing node 68d3c5b1cd36afa834e0de6a: ltp-syscalls 2025-09-26 10:19:47,794 - lava_callback - ERROR - Error processing callback for node 68d3c5b1cd36afa834e0de6a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:19:48,507 - lava_callback - INFO - Received callback for node 68d3c5bacd36afa834e0de89 INFO: 172.20.0.1:59942 - "POST /node/68d3c5bacd36afa834e0de89 HTTP/1.0" 202 Accepted 2025-09-26 10:19:48,513 - lava_callback - INFO - Starting async job submit for node 68d3c5bacd36afa834e0de89 2025-09-26 10:19:48,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:19:48,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c5bacd36afa834e0de89 HTTP/1.1" 200 None 2025-09-26 10:19:48,527 - lava_callback - DEBUG - Processing node 68d3c5bacd36afa834e0de89: ltp-cap-bounds 2025-09-26 10:19:48,527 - lava_callback - ERROR - Error processing callback for node 68d3c5bacd36afa834e0de89: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:19:49,266 - lava_callback - INFO - Received callback for node 68d3c5bbcd36afa834e0de8c INFO: 172.20.0.1:59950 - "POST /node/68d3c5bbcd36afa834e0de8c HTTP/1.0" 202 Accepted 2025-09-26 10:19:49,272 - lava_callback - INFO - Starting async job submit for node 68d3c5bbcd36afa834e0de8c 2025-09-26 10:19:49,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:19:49,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c5bbcd36afa834e0de8c HTTP/1.1" 200 None 2025-09-26 10:19:49,371 - lava_callback - DEBUG - Processing node 68d3c5bbcd36afa834e0de8c: ltp-containers 2025-09-26 10:19:49,371 - lava_callback - ERROR - Error processing callback for node 68d3c5bbcd36afa834e0de8c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:19:50,007 - lava_callback - INFO - Received callback for node 68d3c5bccd36afa834e0de91 INFO: 172.20.0.1:37404 - "POST /node/68d3c5bccd36afa834e0de91 HTTP/1.0" 202 Accepted 2025-09-26 10:19:50,013 - lava_callback - INFO - Starting async job submit for node 68d3c5bccd36afa834e0de91 2025-09-26 10:19:50,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:19:50,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c5bccd36afa834e0de91 HTTP/1.1" 200 None 2025-09-26 10:19:50,049 - lava_callback - DEBUG - Processing node 68d3c5bccd36afa834e0de91: ltp-controllers 2025-09-26 10:19:50,049 - lava_callback - ERROR - Error processing callback for node 68d3c5bccd36afa834e0de91: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:19:50,756 - lava_callback - INFO - Received callback for node 68d3c5becd36afa834e0de98 INFO: 172.20.0.1:37414 - "POST /node/68d3c5becd36afa834e0de98 HTTP/1.0" 202 Accepted 2025-09-26 10:19:50,762 - lava_callback - INFO - Starting async job submit for node 68d3c5becd36afa834e0de98 2025-09-26 10:19:50,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:19:50,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c5becd36afa834e0de98 HTTP/1.1" 200 None 2025-09-26 10:19:50,789 - lava_callback - DEBUG - Processing node 68d3c5becd36afa834e0de98: ltp-cve 2025-09-26 10:19:50,789 - lava_callback - ERROR - Error processing callback for node 68d3c5becd36afa834e0de98: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:19:51,541 - lava_callback - INFO - Received callback for node 68d3c5c0cd36afa834e0dea0 INFO: 172.20.0.1:37426 - "POST /node/68d3c5c0cd36afa834e0dea0 HTTP/1.0" 202 Accepted 2025-09-26 10:19:51,550 - lava_callback - INFO - Starting async job submit for node 68d3c5c0cd36afa834e0dea0 2025-09-26 10:19:51,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:19:51,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c5c0cd36afa834e0dea0 HTTP/1.1" 200 None 2025-09-26 10:19:51,569 - lava_callback - DEBUG - Processing node 68d3c5c0cd36afa834e0dea0: ltp-fs-bind 2025-09-26 10:19:51,570 - lava_callback - ERROR - Error processing callback for node 68d3c5c0cd36afa834e0dea0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:19:52,327 - lava_callback - INFO - Received callback for node 68d3c5c2cd36afa834e0dea6 INFO: 172.20.0.1:37442 - "POST /node/68d3c5c2cd36afa834e0dea6 HTTP/1.0" 202 Accepted 2025-09-26 10:19:52,333 - lava_callback - INFO - Starting async job submit for node 68d3c5c2cd36afa834e0dea6 2025-09-26 10:19:52,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:19:52,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c5c2cd36afa834e0dea6 HTTP/1.1" 200 None 2025-09-26 10:19:52,368 - lava_callback - DEBUG - Processing node 68d3c5c2cd36afa834e0dea6: ltp-fsx 2025-09-26 10:19:52,368 - lava_callback - ERROR - Error processing callback for node 68d3c5c2cd36afa834e0dea6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:19:53,086 - lava_callback - INFO - Received callback for node 68d3c5c3cd36afa834e0deae INFO: 172.20.0.1:37452 - "POST /node/68d3c5c3cd36afa834e0deae HTTP/1.0" 202 Accepted 2025-09-26 10:19:53,092 - lava_callback - INFO - Starting async job submit for node 68d3c5c3cd36afa834e0deae 2025-09-26 10:19:53,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:19:53,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c5c3cd36afa834e0deae HTTP/1.1" 200 None 2025-09-26 10:19:53,108 - lava_callback - DEBUG - Processing node 68d3c5c3cd36afa834e0deae: ltp-input 2025-09-26 10:19:53,109 - lava_callback - ERROR - Error processing callback for node 68d3c5c3cd36afa834e0deae: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:19:53,844 - lava_callback - INFO - Received callback for node 68d3c5c4cd36afa834e0deb1 INFO: 172.20.0.1:37456 - "POST /node/68d3c5c4cd36afa834e0deb1 HTTP/1.0" 202 Accepted 2025-09-26 10:19:53,850 - lava_callback - INFO - Starting async job submit for node 68d3c5c4cd36afa834e0deb1 2025-09-26 10:19:53,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:19:53,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c5c4cd36afa834e0deb1 HTTP/1.1" 200 None 2025-09-26 10:19:53,888 - lava_callback - DEBUG - Processing node 68d3c5c4cd36afa834e0deb1: ltp-ipc 2025-09-26 10:19:53,888 - lava_callback - ERROR - Error processing callback for node 68d3c5c4cd36afa834e0deb1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:19:54,632 - lava_callback - INFO - Received callback for node 68d3c5c6cd36afa834e0deba INFO: 172.20.0.1:37462 - "POST /node/68d3c5c6cd36afa834e0deba HTTP/1.0" 202 Accepted 2025-09-26 10:19:54,638 - lava_callback - INFO - Starting async job submit for node 68d3c5c6cd36afa834e0deba 2025-09-26 10:19:54,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:19:54,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c5c6cd36afa834e0deba HTTP/1.1" 200 None 2025-09-26 10:19:54,651 - lava_callback - DEBUG - Processing node 68d3c5c6cd36afa834e0deba: ltp-pty 2025-09-26 10:19:54,651 - lava_callback - ERROR - Error processing callback for node 68d3c5c6cd36afa834e0deba: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:19:55,400 - lava_callback - INFO - Received callback for node 68d3c5c7cd36afa834e0ded4 INFO: 172.20.0.1:37464 - "POST /node/68d3c5c7cd36afa834e0ded4 HTTP/1.0" 202 Accepted 2025-09-26 10:19:55,406 - lava_callback - INFO - Starting async job submit for node 68d3c5c7cd36afa834e0ded4 2025-09-26 10:19:55,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:19:55,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c5c7cd36afa834e0ded4 HTTP/1.1" 200 None 2025-09-26 10:19:55,423 - lava_callback - DEBUG - Processing node 68d3c5c7cd36afa834e0ded4: ltp-sched 2025-09-26 10:19:55,423 - lava_callback - ERROR - Error processing callback for node 68d3c5c7cd36afa834e0ded4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:19:56,173 - lava_callback - INFO - Received callback for node 68d3c5c9cd36afa834e0dee7 INFO: 172.20.0.1:37470 - "POST /node/68d3c5c9cd36afa834e0dee7 HTTP/1.0" 202 Accepted 2025-09-26 10:19:56,179 - lava_callback - INFO - Starting async job submit for node 68d3c5c9cd36afa834e0dee7 2025-09-26 10:19:56,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:19:56,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c5c9cd36afa834e0dee7 HTTP/1.1" 200 None 2025-09-26 10:19:56,193 - lava_callback - DEBUG - Processing node 68d3c5c9cd36afa834e0dee7: ltp-smoketest 2025-09-26 10:19:56,193 - lava_callback - ERROR - Error processing callback for node 68d3c5c9cd36afa834e0dee7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:37480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36096 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:20:07,762 - lava_callback - INFO - Received callback for node 68d3c5cbcd36afa834e0def1 INFO: 172.20.0.1:36106 - "POST /node/68d3c5cbcd36afa834e0def1 HTTP/1.0" 202 Accepted 2025-09-26 10:20:07,768 - lava_callback - INFO - Starting async job submit for node 68d3c5cbcd36afa834e0def1 2025-09-26 10:20:07,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:20:07,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c5cbcd36afa834e0def1 HTTP/1.1" 200 None 2025-09-26 10:20:07,783 - lava_callback - DEBUG - Processing node 68d3c5cbcd36afa834e0def1: ltp-syscalls 2025-09-26 10:20:07,783 - lava_callback - ERROR - Error processing callback for node 68d3c5cbcd36afa834e0def1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:20:08,513 - lava_callback - INFO - Received callback for node 68d3c5cdcd36afa834e0def4 INFO: 172.20.0.1:36122 - "POST /node/68d3c5cdcd36afa834e0def4 HTTP/1.0" 202 Accepted 2025-09-26 10:20:08,519 - lava_callback - INFO - Starting async job submit for node 68d3c5cdcd36afa834e0def4 2025-09-26 10:20:08,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:20:08,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c5cdcd36afa834e0def4 HTTP/1.1" 200 None 2025-09-26 10:20:08,543 - lava_callback - DEBUG - Processing node 68d3c5cdcd36afa834e0def4: ltp-syscalls-ipc 2025-09-26 10:20:08,543 - lava_callback - ERROR - Error processing callback for node 68d3c5cdcd36afa834e0def4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:20:09,270 - lava_callback - INFO - Received callback for node 68d3c5cecd36afa834e0def7 INFO: 172.20.0.1:36124 - "POST /node/68d3c5cecd36afa834e0def7 HTTP/1.0" 202 Accepted 2025-09-26 10:20:09,279 - lava_callback - INFO - Starting async job submit for node 68d3c5cecd36afa834e0def7 2025-09-26 10:20:09,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:20:09,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c5cecd36afa834e0def7 HTTP/1.1" 200 None 2025-09-26 10:20:09,292 - lava_callback - DEBUG - Processing node 68d3c5cecd36afa834e0def7: ltp-timers 2025-09-26 10:20:09,293 - lava_callback - ERROR - Error processing callback for node 68d3c5cecd36afa834e0def7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60686 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:20:10,160 - lava_callback - INFO - Received callback for node 68d3c5d0cd36afa834e0defd INFO: 172.20.0.1:60702 - "POST /node/68d3c5d0cd36afa834e0defd HTTP/1.0" 202 Accepted 2025-09-26 10:20:10,166 - lava_callback - INFO - Starting async job submit for node 68d3c5d0cd36afa834e0defd 2025-09-26 10:20:10,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:20:10,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c5d0cd36afa834e0defd HTTP/1.1" 200 None 2025-09-26 10:20:10,179 - lava_callback - DEBUG - Processing node 68d3c5d0cd36afa834e0defd: ltp-watchqueue 2025-09-26 10:20:10,179 - lava_callback - ERROR - Error processing callback for node 68d3c5d0cd36afa834e0defd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:20:10,937 - lava_callback - INFO - Received callback for node 68d3c5d7cd36afa834e0df07 INFO: 172.20.0.1:60716 - "POST /node/68d3c5d7cd36afa834e0df07 HTTP/1.0" 202 Accepted 2025-09-26 10:20:10,943 - lava_callback - INFO - Starting async job submit for node 68d3c5d7cd36afa834e0df07 2025-09-26 10:20:10,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:20:10,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c5d7cd36afa834e0df07 HTTP/1.1" 200 None 2025-09-26 10:20:10,959 - lava_callback - DEBUG - Processing node 68d3c5d7cd36afa834e0df07: ltp-input 2025-09-26 10:20:10,959 - lava_callback - ERROR - Error processing callback for node 68d3c5d7cd36afa834e0df07: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34876 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:20:27,782 - lava_callback - INFO - Received callback for node 68d3c5e4cd36afa834e0df18 INFO: 172.20.0.1:34888 - "POST /node/68d3c5e4cd36afa834e0df18 HTTP/1.0" 202 Accepted 2025-09-26 10:20:27,788 - lava_callback - INFO - Starting async job submit for node 68d3c5e4cd36afa834e0df18 2025-09-26 10:20:27,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:20:27,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c5e4cd36afa834e0df18 HTTP/1.1" 200 None 2025-09-26 10:20:27,803 - lava_callback - DEBUG - Processing node 68d3c5e4cd36afa834e0df18: ltp-syscalls-ipc 2025-09-26 10:20:27,803 - lava_callback - ERROR - Error processing callback for node 68d3c5e4cd36afa834e0df18: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:43966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47018 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:20:47,863 - lava_callback - INFO - Received callback for node 68d3c5f0cd36afa834e0df27 INFO: 172.20.0.1:47030 - "POST /node/68d3c5f0cd36afa834e0df27 HTTP/1.0" 202 Accepted 2025-09-26 10:20:47,869 - lava_callback - INFO - Starting async job submit for node 68d3c5f0cd36afa834e0df27 2025-09-26 10:20:47,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:20:47,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c5f0cd36afa834e0df27 HTTP/1.1" 200 None 2025-09-26 10:20:47,884 - lava_callback - DEBUG - Processing node 68d3c5f0cd36afa834e0df27: ltp-ipc 2025-09-26 10:20:47,884 - lava_callback - ERROR - Error processing callback for node 68d3c5f0cd36afa834e0df27: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:53484 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:21:01,150 - lava_callback - INFO - Received callback for node 68d4092acd36afa834e16d81 INFO: 172.20.0.1:54216 - "POST /node/68d4092acd36afa834e16d81 HTTP/1.0" 202 Accepted 2025-09-26 10:21:01,156 - lava_callback - INFO - Starting async job submit for node 68d4092acd36afa834e16d81 2025-09-26 10:21:01,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:21:01,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4092acd36afa834e16d81 HTTP/1.1" 200 None 2025-09-26 10:21:01,191 - lava_callback - DEBUG - Processing node 68d4092acd36afa834e16d81: baseline-arm 2025-09-26 10:21:01,411 - lava_callback - ERROR - Error processing callback for node 68d4092acd36afa834e16d81: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:54218 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:21:07,909 - lava_callback - INFO - Received callback for node 68d3c609cd36afa834e0df6b INFO: 172.20.0.1:54234 - "POST /node/68d3c609cd36afa834e0df6b HTTP/1.0" 202 Accepted 2025-09-26 10:21:07,915 - lava_callback - INFO - Starting async job submit for node 68d3c609cd36afa834e0df6b 2025-09-26 10:21:07,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:21:07,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c609cd36afa834e0df6b HTTP/1.1" 200 None 2025-09-26 10:21:07,929 - lava_callback - DEBUG - Processing node 68d3c609cd36afa834e0df6b: ltp-syscalls 2025-09-26 10:21:07,929 - lava_callback - ERROR - Error processing callback for node 68d3c609cd36afa834e0df6b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:50422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33196 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:21:28,094 - lava_callback - INFO - Received callback for node 68d3c61bcd36afa834e0df95 INFO: 172.20.0.1:33210 - "POST /node/68d3c61bcd36afa834e0df95 HTTP/1.0" 202 Accepted 2025-09-26 10:21:28,100 - lava_callback - INFO - Starting async job submit for node 68d3c61bcd36afa834e0df95 2025-09-26 10:21:28,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:21:28,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c61bcd36afa834e0df95 HTTP/1.1" 200 None 2025-09-26 10:21:28,113 - lava_callback - DEBUG - Processing node 68d3c61bcd36afa834e0df95: ltp-syscalls-ipc 2025-09-26 10:21:28,114 - lava_callback - ERROR - Error processing callback for node 68d3c61bcd36afa834e0df95: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:21:28,903 - lava_callback - INFO - Received callback for node 68d3c61ecd36afa834e0df98 INFO: 172.20.0.1:33220 - "POST /node/68d3c61ecd36afa834e0df98 HTTP/1.0" 202 Accepted 2025-09-26 10:21:28,909 - lava_callback - INFO - Starting async job submit for node 68d3c61ecd36afa834e0df98 2025-09-26 10:21:28,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:21:28,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c61ecd36afa834e0df98 HTTP/1.1" 200 None 2025-09-26 10:21:28,948 - lava_callback - DEBUG - Processing node 68d3c61ecd36afa834e0df98: ltp-timers 2025-09-26 10:21:28,948 - lava_callback - ERROR - Error processing callback for node 68d3c61ecd36afa834e0df98: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:21:29,689 - lava_callback - INFO - Received callback for node 68d3c621cd36afa834e0df9b INFO: 172.20.0.1:60324 - "POST /node/68d3c621cd36afa834e0df9b HTTP/1.0" 202 Accepted 2025-09-26 10:21:29,695 - lava_callback - INFO - Starting async job submit for node 68d3c621cd36afa834e0df9b 2025-09-26 10:21:29,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:21:29,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c621cd36afa834e0df9b HTTP/1.1" 200 None 2025-09-26 10:21:29,711 - lava_callback - DEBUG - Processing node 68d3c621cd36afa834e0df9b: ltp-syscalls-ipc 2025-09-26 10:21:29,711 - lava_callback - ERROR - Error processing callback for node 68d3c621cd36afa834e0df9b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:21:30,438 - lava_callback - INFO - Received callback for node 68d3c624cd36afa834e0df9e INFO: 172.20.0.1:60334 - "POST /node/68d3c624cd36afa834e0df9e HTTP/1.0" 202 Accepted 2025-09-26 10:21:30,444 - lava_callback - INFO - Starting async job submit for node 68d3c624cd36afa834e0df9e 2025-09-26 10:21:30,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:21:30,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c624cd36afa834e0df9e HTTP/1.1" 200 None 2025-09-26 10:21:30,485 - lava_callback - DEBUG - Processing node 68d3c624cd36afa834e0df9e: ltp-timers 2025-09-26 10:21:30,485 - lava_callback - ERROR - Error processing callback for node 68d3c624cd36afa834e0df9e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:21:31,185 - lava_callback - INFO - Received callback for node 68d3c627cd36afa834e0dfa1 INFO: 172.20.0.1:60344 - "POST /node/68d3c627cd36afa834e0dfa1 HTTP/1.0" 202 Accepted 2025-09-26 10:21:31,192 - lava_callback - INFO - Starting async job submit for node 68d3c627cd36afa834e0dfa1 2025-09-26 10:21:31,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:21:31,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c627cd36afa834e0dfa1 HTTP/1.1" 200 None 2025-09-26 10:21:31,206 - lava_callback - DEBUG - Processing node 68d3c627cd36afa834e0dfa1: ltp-watchqueue 2025-09-26 10:21:31,206 - lava_callback - ERROR - Error processing callback for node 68d3c627cd36afa834e0dfa1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:21:31,995 - lava_callback - INFO - Received callback for node 68d3c629cd36afa834e0dfa4 INFO: 172.20.0.1:60354 - "POST /node/68d3c629cd36afa834e0dfa4 HTTP/1.0" 202 Accepted 2025-09-26 10:21:32,002 - lava_callback - INFO - Starting async job submit for node 68d3c629cd36afa834e0dfa4 2025-09-26 10:21:32,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:21:32,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c629cd36afa834e0dfa4 HTTP/1.1" 200 None 2025-09-26 10:21:32,024 - lava_callback - DEBUG - Processing node 68d3c629cd36afa834e0dfa4: ltp-cap-bounds 2025-09-26 10:21:32,024 - lava_callback - ERROR - Error processing callback for node 68d3c629cd36afa834e0dfa4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41096 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:21:47,893 - lava_callback - INFO - Received callback for node 68d3c62ccd36afa834e0dfa7 INFO: 172.20.0.1:41104 - "POST /node/68d3c62ccd36afa834e0dfa7 HTTP/1.0" 202 Accepted 2025-09-26 10:21:47,898 - lava_callback - INFO - Starting async job submit for node 68d3c62ccd36afa834e0dfa7 2025-09-26 10:21:47,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:21:47,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c62ccd36afa834e0dfa7 HTTP/1.1" 200 None 2025-09-26 10:21:47,912 - lava_callback - DEBUG - Processing node 68d3c62ccd36afa834e0dfa7: ltp-containers 2025-09-26 10:21:47,912 - lava_callback - ERROR - Error processing callback for node 68d3c62ccd36afa834e0dfa7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:21:48,651 - lava_callback - INFO - Received callback for node 68d3c631cd36afa834e0dfad INFO: 172.20.0.1:41114 - "POST /node/68d3c631cd36afa834e0dfad HTTP/1.0" 202 Accepted 2025-09-26 10:21:48,660 - lava_callback - INFO - Starting async job submit for node 68d3c631cd36afa834e0dfad 2025-09-26 10:21:48,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:21:48,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c631cd36afa834e0dfad HTTP/1.1" 200 None 2025-09-26 10:21:48,676 - lava_callback - DEBUG - Processing node 68d3c631cd36afa834e0dfad: ltp-controllers 2025-09-26 10:21:48,677 - lava_callback - ERROR - Error processing callback for node 68d3c631cd36afa834e0dfad: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:21:49,481 - lava_callback - INFO - Received callback for node 68d3c634cd36afa834e0dfb0 INFO: 172.20.0.1:43078 - "POST /node/68d3c634cd36afa834e0dfb0 HTTP/1.0" 202 Accepted 2025-09-26 10:21:49,487 - lava_callback - INFO - Starting async job submit for node 68d3c634cd36afa834e0dfb0 2025-09-26 10:21:49,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:21:49,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c634cd36afa834e0dfb0 HTTP/1.1" 200 None 2025-09-26 10:21:49,509 - lava_callback - DEBUG - Processing node 68d3c634cd36afa834e0dfb0: ltp-containers 2025-09-26 10:21:49,509 - lava_callback - ERROR - Error processing callback for node 68d3c634cd36afa834e0dfb0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:21:50,289 - lava_callback - INFO - Received callback for node 68d3c637cd36afa834e0dfb5 INFO: 172.20.0.1:43086 - "POST /node/68d3c637cd36afa834e0dfb5 HTTP/1.0" 202 Accepted 2025-09-26 10:21:50,295 - lava_callback - INFO - Starting async job submit for node 68d3c637cd36afa834e0dfb5 2025-09-26 10:21:50,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:21:50,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c637cd36afa834e0dfb5 HTTP/1.1" 200 None 2025-09-26 10:21:50,323 - lava_callback - DEBUG - Processing node 68d3c637cd36afa834e0dfb5: ltp-controllers 2025-09-26 10:21:50,323 - lava_callback - ERROR - Error processing callback for node 68d3c637cd36afa834e0dfb5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:21:51,049 - lava_callback - INFO - Received callback for node 68d3c63acd36afa834e0dfbc INFO: 172.20.0.1:43094 - "POST /node/68d3c63acd36afa834e0dfbc HTTP/1.0" 202 Accepted 2025-09-26 10:21:51,055 - lava_callback - INFO - Starting async job submit for node 68d3c63acd36afa834e0dfbc 2025-09-26 10:21:51,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:21:51,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c63acd36afa834e0dfbc HTTP/1.1" 200 None 2025-09-26 10:21:51,070 - lava_callback - DEBUG - Processing node 68d3c63acd36afa834e0dfbc: ltp-cve 2025-09-26 10:21:51,070 - lava_callback - ERROR - Error processing callback for node 68d3c63acd36afa834e0dfbc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:21:51,805 - lava_callback - INFO - Received callback for node 68d3c63dcd36afa834e0dfbf INFO: 172.20.0.1:43104 - "POST /node/68d3c63dcd36afa834e0dfbf HTTP/1.0" 202 Accepted 2025-09-26 10:21:51,810 - lava_callback - INFO - Starting async job submit for node 68d3c63dcd36afa834e0dfbf 2025-09-26 10:21:51,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:21:51,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c63dcd36afa834e0dfbf HTTP/1.1" 200 None 2025-09-26 10:21:51,826 - lava_callback - DEBUG - Processing node 68d3c63dcd36afa834e0dfbf: ltp-input 2025-09-26 10:21:51,826 - lava_callback - ERROR - Error processing callback for node 68d3c63dcd36afa834e0dfbf: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:21:52,298 - lava_callback - INFO - Received callback for node 68d664fc2f83206171a90273 INFO: 172.20.0.1:43110 - "POST /node/68d664fc2f83206171a90273 HTTP/1.0" 202 Accepted 2025-09-26 10:21:52,305 - lava_callback - INFO - Starting async job submit for node 68d664fc2f83206171a90273 2025-09-26 10:21:52,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:21:52,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d664fc2f83206171a90273 HTTP/1.1" 200 None 2025-09-26 10:21:52,393 - lava_callback - DEBUG - Processing node 68d664fc2f83206171a90273: ltp-smoketest 2025-09-26 10:21:52,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:21:53,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:21:53,906 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d664fc2f83206171a90273/log.txt.gz 2025-09-26 10:21:53,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:21:56,211 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:21:56,212 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d664fc2f83206171a90273/lava_callback.json.gz 2025-09-26 10:21:56,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:21:56,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d664fc2f83206171a90273 HTTP/1.1" 200 None 2025-09-26 10:21:56,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:21:56,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c942f83206171a8fe61 HTTP/1.1" 200 None 2025-09-26 10:21:56,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:21:56,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d664fc2f83206171a90273 HTTP/1.1" 200 None 2025-09-26 10:21:56,402 - lava_callback - INFO - Completed processing callback for node 68d664fc2f83206171a90273 INFO: 172.20.0.1:43124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50744 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:22:07,872 - lava_callback - INFO - Received callback for node 68d3c63fcd36afa834e0dfc7 INFO: 172.20.0.1:50760 - "POST /node/68d3c63fcd36afa834e0dfc7 HTTP/1.0" 202 Accepted 2025-09-26 10:22:07,878 - lava_callback - INFO - Starting async job submit for node 68d3c63fcd36afa834e0dfc7 2025-09-26 10:22:07,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:22:07,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c63fcd36afa834e0dfc7 HTTP/1.1" 200 None 2025-09-26 10:22:07,892 - lava_callback - DEBUG - Processing node 68d3c63fcd36afa834e0dfc7: ltp-controllers 2025-09-26 10:22:07,892 - lava_callback - ERROR - Error processing callback for node 68d3c63fcd36afa834e0dfc7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:34274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53140 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:22:27,855 - lava_callback - INFO - Received callback for node 68d3c657cd36afa834e0dffd INFO: 172.20.0.1:53142 - "POST /node/68d3c657cd36afa834e0dffd HTTP/1.0" 202 Accepted 2025-09-26 10:22:27,861 - lava_callback - INFO - Starting async job submit for node 68d3c657cd36afa834e0dffd 2025-09-26 10:22:27,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:22:27,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c657cd36afa834e0dffd HTTP/1.1" 200 None 2025-09-26 10:22:27,879 - lava_callback - DEBUG - Processing node 68d3c657cd36afa834e0dffd: ltp-cve 2025-09-26 10:22:27,880 - lava_callback - ERROR - Error processing callback for node 68d3c657cd36afa834e0dffd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:22:28,662 - lava_callback - INFO - Received callback for node 68d3c65fcd36afa834e0e00c INFO: 172.20.0.1:53158 - "POST /node/68d3c65fcd36afa834e0e00c HTTP/1.0" 202 Accepted 2025-09-26 10:22:28,667 - lava_callback - INFO - Starting async job submit for node 68d3c65fcd36afa834e0e00c 2025-09-26 10:22:28,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:22:28,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c65fcd36afa834e0e00c HTTP/1.1" 200 None 2025-09-26 10:22:28,683 - lava_callback - DEBUG - Processing node 68d3c65fcd36afa834e0e00c: ltp-ipc 2025-09-26 10:22:28,683 - lava_callback - ERROR - Error processing callback for node 68d3c65fcd36afa834e0e00c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:22:34,440 - lava_callback - INFO - Received callback for node 68d3c664cd36afa834e0e012 INFO: 172.20.0.1:53528 - "POST /node/68d3c664cd36afa834e0e012 HTTP/1.0" 202 Accepted 2025-09-26 10:22:34,445 - lava_callback - INFO - Starting async job submit for node 68d3c664cd36afa834e0e012 2025-09-26 10:22:34,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:22:34,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c664cd36afa834e0e012 HTTP/1.1" 200 None 2025-09-26 10:22:34,461 - lava_callback - DEBUG - Processing node 68d3c664cd36afa834e0e012: baseline-arm 2025-09-26 10:22:34,461 - lava_callback - ERROR - Error processing callback for node 68d3c664cd36afa834e0e012: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:22:35,198 - lava_callback - INFO - Received callback for node 68d3c664cd36afa834e0e015 INFO: 172.20.0.1:53542 - "POST /node/68d3c664cd36afa834e0e015 HTTP/1.0" 202 Accepted 2025-09-26 10:22:35,204 - lava_callback - INFO - Starting async job submit for node 68d3c664cd36afa834e0e015 2025-09-26 10:22:35,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:22:35,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c664cd36afa834e0e015 HTTP/1.1" 200 None 2025-09-26 10:22:35,239 - lava_callback - DEBUG - Processing node 68d3c664cd36afa834e0e015: baseline-arm 2025-09-26 10:22:35,239 - lava_callback - ERROR - Error processing callback for node 68d3c664cd36afa834e0e015: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:53548 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:22:42,104 - lava_callback - INFO - Received callback for node 68d665162f83206171a9027a INFO: 172.20.0.1:57612 - "POST /node/68d665162f83206171a9027a HTTP/1.0" 202 Accepted 2025-09-26 10:22:42,110 - lava_callback - INFO - Starting async job submit for node 68d665162f83206171a9027a 2025-09-26 10:22:42,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:22:42,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665162f83206171a9027a HTTP/1.1" 200 None 2025-09-26 10:22:42,166 - lava_callback - DEBUG - Processing node 68d665162f83206171a9027a: baseline-arm 2025-09-26 10:22:42,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:22:42,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:22:42,854 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d665162f83206171a9027a/log.txt.gz 2025-09-26 10:22:42,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:22:45,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:22:45,187 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d665162f83206171a9027a/lava_callback.json.gz DEBUG: Setup failed for 68d665162f83206171a9027a. Transitting job node result: incomplete -> fail 2025-09-26 10:22:45,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:22:45,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665162f83206171a9027a HTTP/1.1" 200 None 2025-09-26 10:22:45,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:22:45,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-26 10:22:45,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:22:45,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665162f83206171a9027a HTTP/1.1" 200 None 2025-09-26 10:22:45,328 - lava_callback - INFO - Completed processing callback for node 68d665162f83206171a9027a INFO: 172.20.0.1:57626 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:22:54,662 - lava_callback - INFO - Received callback for node 68d3c668cd36afa834e0e01b INFO: 172.20.0.1:48474 - "POST /node/68d3c668cd36afa834e0e01b HTTP/1.0" 202 Accepted 2025-09-26 10:22:54,667 - lava_callback - INFO - Starting async job submit for node 68d3c668cd36afa834e0e01b 2025-09-26 10:22:54,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:22:54,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c668cd36afa834e0e01b HTTP/1.1" 200 None 2025-09-26 10:22:54,681 - lava_callback - DEBUG - Processing node 68d3c668cd36afa834e0e01b: baseline-arm 2025-09-26 10:22:54,681 - lava_callback - ERROR - Error processing callback for node 68d3c668cd36afa834e0e01b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:22:55,380 - lava_callback - INFO - Received callback for node 68d3c66bcd36afa834e0e01e INFO: 172.20.0.1:48486 - "POST /node/68d3c66bcd36afa834e0e01e HTTP/1.0" 202 Accepted 2025-09-26 10:22:55,386 - lava_callback - INFO - Starting async job submit for node 68d3c66bcd36afa834e0e01e 2025-09-26 10:22:55,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:22:55,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c66bcd36afa834e0e01e HTTP/1.1" 200 None 2025-09-26 10:22:55,401 - lava_callback - DEBUG - Processing node 68d3c66bcd36afa834e0e01e: baseline-arm 2025-09-26 10:22:55,401 - lava_callback - ERROR - Error processing callback for node 68d3c66bcd36afa834e0e01e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:22:56,075 - lava_callback - INFO - Received callback for node 68d3c674cd36afa834e0e02d INFO: 172.20.0.1:48498 - "POST /node/68d3c674cd36afa834e0e02d HTTP/1.0" 202 Accepted 2025-09-26 10:22:56,080 - lava_callback - INFO - Starting async job submit for node 68d3c674cd36afa834e0e02d 2025-09-26 10:22:56,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:22:56,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c674cd36afa834e0e02d HTTP/1.1" 200 None 2025-09-26 10:22:56,096 - lava_callback - DEBUG - Processing node 68d3c674cd36afa834e0e02d: baseline-arm 2025-09-26 10:22:56,097 - lava_callback - ERROR - Error processing callback for node 68d3c674cd36afa834e0e02d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:48512 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:22:56,779 - lava_callback - INFO - Received callback for node 68d3c675cd36afa834e0e030 INFO: 172.20.0.1:48518 - "POST /node/68d3c675cd36afa834e0e030 HTTP/1.0" 202 Accepted 2025-09-26 10:22:56,785 - lava_callback - INFO - Starting async job submit for node 68d3c675cd36afa834e0e030 2025-09-26 10:22:56,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:22:56,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c675cd36afa834e0e030 HTTP/1.1" 200 None 2025-09-26 10:22:56,798 - lava_callback - DEBUG - Processing node 68d3c675cd36afa834e0e030: baseline-arm 2025-09-26 10:22:56,798 - lava_callback - ERROR - Error processing callback for node 68d3c675cd36afa834e0e030: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:22:57,509 - lava_callback - INFO - Received callback for node 68d3c67bcd36afa834e0e036 INFO: 172.20.0.1:48532 - "POST /node/68d3c67bcd36afa834e0e036 HTTP/1.0" 202 Accepted 2025-09-26 10:22:57,515 - lava_callback - INFO - Starting async job submit for node 68d3c67bcd36afa834e0e036 2025-09-26 10:22:57,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:22:57,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c67bcd36afa834e0e036 HTTP/1.1" 200 None 2025-09-26 10:22:57,530 - lava_callback - DEBUG - Processing node 68d3c67bcd36afa834e0e036: baseline-arm 2025-09-26 10:22:57,530 - lava_callback - ERROR - Error processing callback for node 68d3c67bcd36afa834e0e036: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:22:58,218 - lava_callback - INFO - Received callback for node 68d3c67ccd36afa834e0e039 INFO: 172.20.0.1:48540 - "POST /node/68d3c67ccd36afa834e0e039 HTTP/1.0" 202 Accepted 2025-09-26 10:22:58,223 - lava_callback - INFO - Starting async job submit for node 68d3c67ccd36afa834e0e039 2025-09-26 10:22:58,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:22:58,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c67ccd36afa834e0e039 HTTP/1.1" 200 None 2025-09-26 10:22:58,237 - lava_callback - DEBUG - Processing node 68d3c67ccd36afa834e0e039: baseline-arm 2025-09-26 10:22:58,237 - lava_callback - ERROR - Error processing callback for node 68d3c67ccd36afa834e0e039: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:39052 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:23:06,950 - lava_callback - INFO - Received callback for node 68d3c372cd36afa834e0d841 INFO: 172.20.0.1:39068 - "POST /node/68d3c372cd36afa834e0d841 HTTP/1.0" 202 Accepted 2025-09-26 10:23:06,957 - lava_callback - INFO - Starting async job submit for node 68d3c372cd36afa834e0d841 2025-09-26 10:23:07,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:23:07,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c372cd36afa834e0d841 HTTP/1.1" 200 None 2025-09-26 10:23:07,016 - lava_callback - DEBUG - Processing node 68d3c372cd36afa834e0d841: ltp-smoketest 2025-09-26 10:23:07,482 - lava_callback - ERROR - Error processing callback for node 68d3c372cd36afa834e0d841: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:23:07,878 - lava_callback - INFO - Received callback for node 68d3c678cd36afa834e0e033 INFO: 172.20.0.1:39078 - "POST /node/68d3c678cd36afa834e0e033 HTTP/1.0" 202 Accepted 2025-09-26 10:23:07,884 - lava_callback - INFO - Starting async job submit for node 68d3c678cd36afa834e0e033 2025-09-26 10:23:07,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:23:07,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c678cd36afa834e0e033 HTTP/1.1" 200 None 2025-09-26 10:23:07,927 - lava_callback - DEBUG - Processing node 68d3c678cd36afa834e0e033: ltp-timers 2025-09-26 10:23:07,927 - lava_callback - ERROR - Error processing callback for node 68d3c678cd36afa834e0e033: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:23:08,678 - lava_callback - INFO - Received callback for node 68d3c687cd36afa834e0e06b INFO: 172.20.0.1:39088 - "POST /node/68d3c687cd36afa834e0e06b HTTP/1.0" 202 Accepted 2025-09-26 10:23:08,687 - lava_callback - INFO - Starting async job submit for node 68d3c687cd36afa834e0e06b 2025-09-26 10:23:08,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:23:08,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c687cd36afa834e0e06b HTTP/1.1" 200 None 2025-09-26 10:23:08,701 - lava_callback - DEBUG - Processing node 68d3c687cd36afa834e0e06b: ltp-pty 2025-09-26 10:23:08,701 - lava_callback - ERROR - Error processing callback for node 68d3c687cd36afa834e0e06b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:23:09,430 - lava_callback - INFO - Received callback for node 68d3c68bcd36afa834e0e07e INFO: 172.20.0.1:54816 - "POST /node/68d3c68bcd36afa834e0e07e HTTP/1.0" 202 Accepted 2025-09-26 10:23:09,439 - lava_callback - INFO - Starting async job submit for node 68d3c68bcd36afa834e0e07e 2025-09-26 10:23:09,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:23:09,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c68bcd36afa834e0e07e HTTP/1.1" 200 None 2025-09-26 10:23:09,452 - lava_callback - DEBUG - Processing node 68d3c68bcd36afa834e0e07e: ltp-watchqueue 2025-09-26 10:23:09,452 - lava_callback - ERROR - Error processing callback for node 68d3c68bcd36afa834e0e07e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:54824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54844 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:23:22,622 - lava_callback - INFO - Received callback for node 68d4092ccd36afa834e16d84 INFO: 172.20.0.1:51566 - "POST /node/68d4092ccd36afa834e16d84 HTTP/1.0" 202 Accepted 2025-09-26 10:23:22,630 - lava_callback - INFO - Starting async job submit for node 68d4092ccd36afa834e16d84 2025-09-26 10:23:22,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:23:22,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4092ccd36afa834e16d84 HTTP/1.1" 200 None 2025-09-26 10:23:22,669 - lava_callback - DEBUG - Processing node 68d4092ccd36afa834e16d84: baseline-arm 2025-09-26 10:23:22,893 - lava_callback - ERROR - Error processing callback for node 68d4092ccd36afa834e16d84: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:23:23,257 - lava_callback - INFO - Received callback for node 68d665412f83206171a90282 INFO: 172.20.0.1:51574 - "POST /node/68d665412f83206171a90282 HTTP/1.0" 202 Accepted 2025-09-26 10:23:23,267 - lava_callback - INFO - Starting async job submit for node 68d665412f83206171a90282 2025-09-26 10:23:23,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:23:23,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665412f83206171a90282 HTTP/1.1" 200 None 2025-09-26 10:23:23,313 - lava_callback - DEBUG - Processing node 68d665412f83206171a90282: baseline-arm 2025-09-26 10:23:23,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:23:24,464 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:23:24,465 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d665412f83206171a90282/log.txt.gz 2025-09-26 10:23:24,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:51576 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:23:26,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:23:26,760 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d665412f83206171a90282/lava_callback.json.gz DEBUG: Setup failed for 68d665412f83206171a90282. Transitting job node result: incomplete -> fail 2025-09-26 10:23:26,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:23:26,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d665412f83206171a90282 HTTP/1.1" 200 None 2025-09-26 10:23:26,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:23:26,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-26 10:23:26,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:23:26,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d665412f83206171a90282 HTTP/1.1" 200 None 2025-09-26 10:23:26,884 - lava_callback - INFO - Completed processing callback for node 68d665412f83206171a90282 INFO: 172.20.0.1:51302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36834 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:23:47,285 - lava_callback - INFO - Received callback for node 68d3c461cd36afa834e0da37 INFO: 172.20.0.1:36840 - "POST /node/68d3c461cd36afa834e0da37 HTTP/1.0" 202 Accepted 2025-09-26 10:23:47,296 - lava_callback - INFO - Starting async job submit for node 68d3c461cd36afa834e0da37 2025-09-26 10:23:47,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:23:47,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c461cd36afa834e0da37 HTTP/1.1" 200 None 2025-09-26 10:23:47,348 - lava_callback - DEBUG - Processing node 68d3c461cd36afa834e0da37: ltp-pty 2025-09-26 10:23:47,716 - lava_callback - ERROR - Error processing callback for node 68d3c461cd36afa834e0da37: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:23:47,950 - lava_callback - INFO - Received callback for node 68d3c6a6cd36afa834e0e0ab INFO: 172.20.0.1:36850 - "POST /node/68d3c6a6cd36afa834e0e0ab HTTP/1.0" 202 Accepted 2025-09-26 10:23:47,956 - lava_callback - INFO - Starting async job submit for node 68d3c6a6cd36afa834e0e0ab 2025-09-26 10:23:47,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:23:47,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c6a6cd36afa834e0e0ab HTTP/1.1" 200 None 2025-09-26 10:23:47,969 - lava_callback - DEBUG - Processing node 68d3c6a6cd36afa834e0e0ab: ltp-ipc 2025-09-26 10:23:47,969 - lava_callback - ERROR - Error processing callback for node 68d3c6a6cd36afa834e0e0ab: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:23:51,695 - lava_callback - INFO - Received callback for node 68d669502f83206171a9041e INFO: 172.20.0.1:52012 - "POST /node/68d669502f83206171a9041e HTTP/1.0" 202 Accepted 2025-09-26 10:23:51,703 - lava_callback - INFO - Starting async job submit for node 68d669502f83206171a9041e 2025-09-26 10:23:51,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:23:51,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d669502f83206171a9041e HTTP/1.1" 200 None 2025-09-26 10:23:51,767 - lava_callback - DEBUG - Processing node 68d669502f83206171a9041e: baseline-riscv-collabora 2025-09-26 10:23:51,959 - lava_callback - INFO - Received callback for node 68d6687c2f83206171a9040e INFO: 172.20.0.1:52020 - "POST /node/68d6687c2f83206171a9040e HTTP/1.0" 202 Accepted 2025-09-26 10:23:51,969 - lava_callback - INFO - Starting async job submit for node 68d6687c2f83206171a9040e 2025-09-26 10:23:52,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:23:52,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:23:52,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6687c2f83206171a9040e HTTP/1.1" 200 None 2025-09-26 10:23:52,037 - lava_callback - DEBUG - Processing node 68d6687c2f83206171a9040e: baseline-arm64-broonie 2025-09-26 10:23:52,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:23:52,244 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-riscv-collabora-68d669502f83206171a9041e/log.txt.gz 2025-09-26 10:23:52,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:23:52,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:23:52,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:23:52,412 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-riscv-collabora-68d669502f83206171a9041e/lava_callback.json.gz 2025-09-26 10:23:52,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:23:52,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:23:52,447 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6687c2f83206171a9040e/log.txt.gz 2025-09-26 10:23:52,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:23:52,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d669502f83206171a9041e HTTP/1.1" 200 None 2025-09-26 10:23:52,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:23:52,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56824b70fb2a1e20f281b HTTP/1.1" 200 None 2025-09-26 10:23:52,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:23:52,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d669502f83206171a9041e HTTP/1.1" 200 None 2025-09-26 10:23:52,508 - lava_callback - INFO - Completed processing callback for node 68d669502f83206171a9041e 2025-09-26 10:23:54,371 - lava_callback - INFO - Received callback for node 68d3c6b8cd36afa834e0e0ca INFO: 172.20.0.1:52034 - "POST /node/68d3c6b8cd36afa834e0e0ca HTTP/1.0" 202 Accepted 2025-09-26 10:23:54,377 - lava_callback - INFO - Starting async job submit for node 68d3c6b8cd36afa834e0e0ca 2025-09-26 10:23:54,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:23:54,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c6b8cd36afa834e0e0ca HTTP/1.1" 200 None 2025-09-26 10:23:54,392 - lava_callback - DEBUG - Processing node 68d3c6b8cd36afa834e0e0ca: baseline-arm 2025-09-26 10:23:54,392 - lava_callback - ERROR - Error processing callback for node 68d3c6b8cd36afa834e0e0ca: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:23:54,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:23:54,752 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6687c2f83206171a9040e/lava_callback.json.gz 2025-09-26 10:23:54,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:23:54,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6687c2f83206171a9040e HTTP/1.1" 200 None 2025-09-26 10:23:54,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:23:54,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:23:54,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:23:54,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6687c2f83206171a9040e HTTP/1.1" 200 None 2025-09-26 10:23:54,846 - lava_callback - INFO - Completed processing callback for node 68d6687c2f83206171a9040e INFO: 172.20.0.1:52042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60710 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:24:08,184 - lava_callback - INFO - Received callback for node 68d3c6c1cd36afa834e0e0d6 INFO: 172.20.0.1:60714 - "POST /node/68d3c6c1cd36afa834e0e0d6 HTTP/1.0" 202 Accepted 2025-09-26 10:24:08,190 - lava_callback - INFO - Starting async job submit for node 68d3c6c1cd36afa834e0e0d6 2025-09-26 10:24:08,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:24:08,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c6c1cd36afa834e0e0d6 HTTP/1.1" 200 None 2025-09-26 10:24:08,205 - lava_callback - DEBUG - Processing node 68d3c6c1cd36afa834e0e0d6: ltp-pty 2025-09-26 10:24:08,205 - lava_callback - ERROR - Error processing callback for node 68d3c6c1cd36afa834e0e0d6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:52934 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:24:13,214 - lava_callback - INFO - Received callback for node 68d3c365cd36afa834e0d820 INFO: 172.20.0.1:52942 - "POST /node/68d3c365cd36afa834e0d820 HTTP/1.0" 202 Accepted 2025-09-26 10:24:13,221 - lava_callback - INFO - Starting async job submit for node 68d3c365cd36afa834e0d820 2025-09-26 10:24:13,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:24:13,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c365cd36afa834e0d820 HTTP/1.1" 200 None 2025-09-26 10:24:13,273 - lava_callback - DEBUG - Processing node 68d3c365cd36afa834e0d820: ltp-sched 2025-09-26 10:24:13,598 - lava_callback - ERROR - Error processing callback for node 68d3c365cd36afa834e0d820: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:24:14,582 - lava_callback - INFO - Received callback for node 68d3c6b9cd36afa834e0e0cd INFO: 172.20.0.1:52956 - "POST /node/68d3c6b9cd36afa834e0e0cd HTTP/1.0" 202 Accepted 2025-09-26 10:24:14,587 - lava_callback - INFO - Starting async job submit for node 68d3c6b9cd36afa834e0e0cd 2025-09-26 10:24:14,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:24:14,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c6b9cd36afa834e0e0cd HTTP/1.1" 200 None 2025-09-26 10:24:14,614 - lava_callback - DEBUG - Processing node 68d3c6b9cd36afa834e0e0cd: baseline-arm 2025-09-26 10:24:14,614 - lava_callback - ERROR - Error processing callback for node 68d3c6b9cd36afa834e0e0cd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:24:15,099 - lava_callback - INFO - Received callback for node 68d6694e2f83206171a9041b INFO: 172.20.0.1:52958 - "POST /node/68d6694e2f83206171a9041b HTTP/1.0" 202 Accepted 2025-09-26 10:24:15,105 - lava_callback - INFO - Starting async job submit for node 68d6694e2f83206171a9041b 2025-09-26 10:24:15,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:24:15,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6694e2f83206171a9041b HTTP/1.1" 200 None 2025-09-26 10:24:15,155 - lava_callback - DEBUG - Processing node 68d6694e2f83206171a9041b: baseline-riscv-broonie INFO: 172.20.0.1:52962 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 10:24:15,286 - lava_callback - INFO - Received callback for node 68d3c6bdcd36afa834e0e0d0 INFO: 172.20.0.1:52968 - "POST /node/68d3c6bdcd36afa834e0e0d0 HTTP/1.0" 202 Accepted 2025-09-26 10:24:15,296 - lava_callback - INFO - Starting async job submit for node 68d3c6bdcd36afa834e0e0d0 2025-09-26 10:24:15,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:24:15,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:24:15,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c6bdcd36afa834e0e0d0 HTTP/1.1" 200 None 2025-09-26 10:24:15,432 - lava_callback - DEBUG - Processing node 68d3c6bdcd36afa834e0e0d0: baseline-arm 2025-09-26 10:24:15,432 - lava_callback - ERROR - Error processing callback for node 68d3c6bdcd36afa834e0e0d0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:24:16,012 - lava_callback - INFO - Received callback for node 68d3c6becd36afa834e0e0d3 INFO: 172.20.0.1:52978 - "POST /node/68d3c6becd36afa834e0e0d3 HTTP/1.0" 202 Accepted 2025-09-26 10:24:16,018 - lava_callback - INFO - Starting async job submit for node 68d3c6becd36afa834e0e0d3 2025-09-26 10:24:16,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:24:16,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c6becd36afa834e0e0d3 HTTP/1.1" 200 None 2025-09-26 10:24:16,045 - lava_callback - DEBUG - Processing node 68d3c6becd36afa834e0e0d3: baseline-arm 2025-09-26 10:24:16,045 - lava_callback - ERROR - Error processing callback for node 68d3c6becd36afa834e0e0d3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:24:16,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:24:16,116 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-riscv-broonie-68d6694e2f83206171a9041b/log.txt.gz 2025-09-26 10:24:16,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:52980 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:24:16,718 - lava_callback - INFO - Received callback for node 68d3c6c2cd36afa834e0e0d9 INFO: 172.20.0.1:52992 - "POST /node/68d3c6c2cd36afa834e0e0d9 HTTP/1.0" 202 Accepted 2025-09-26 10:24:16,724 - lava_callback - INFO - Starting async job submit for node 68d3c6c2cd36afa834e0e0d9 2025-09-26 10:24:16,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:24:16,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c6c2cd36afa834e0e0d9 HTTP/1.1" 200 None 2025-09-26 10:24:16,738 - lava_callback - DEBUG - Processing node 68d3c6c2cd36afa834e0e0d9: baseline-arm 2025-09-26 10:24:16,738 - lava_callback - ERROR - Error processing callback for node 68d3c6c2cd36afa834e0e0d9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:24:17,427 - lava_callback - INFO - Received callback for node 68d3c6c4cd36afa834e0e0dc INFO: 172.20.0.1:53008 - "POST /node/68d3c6c4cd36afa834e0e0dc HTTP/1.0" 202 Accepted 2025-09-26 10:24:17,432 - lava_callback - INFO - Starting async job submit for node 68d3c6c4cd36afa834e0e0dc 2025-09-26 10:24:17,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:24:17,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c6c4cd36afa834e0e0dc HTTP/1.1" 200 None 2025-09-26 10:24:17,450 - lava_callback - DEBUG - Processing node 68d3c6c4cd36afa834e0e0dc: baseline-arm 2025-09-26 10:24:17,450 - lava_callback - ERROR - Error processing callback for node 68d3c6c4cd36afa834e0e0dc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:24:18,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:24:18,454 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-riscv-broonie-68d6694e2f83206171a9041b/lava_callback.json.gz 2025-09-26 10:24:18,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:24:18,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6694e2f83206171a9041b HTTP/1.1" 200 None 2025-09-26 10:24:18,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:24:18,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56824b70fb2a1e20f281b HTTP/1.1" 200 None 2025-09-26 10:24:18,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:24:18,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6694e2f83206171a9041b HTTP/1.1" 200 None 2025-09-26 10:24:18,542 - lava_callback - INFO - Completed processing callback for node 68d6694e2f83206171a9041b INFO: 172.20.0.1:39278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39282 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:24:34,263 - lava_callback - INFO - Received callback for node 68d3c6cdcd36afa834e0e117 INFO: 172.20.0.1:58782 - "POST /node/68d3c6cdcd36afa834e0e117 HTTP/1.0" 202 Accepted 2025-09-26 10:24:34,268 - lava_callback - INFO - Starting async job submit for node 68d3c6cdcd36afa834e0e117 2025-09-26 10:24:34,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:24:34,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c6cdcd36afa834e0e117 HTTP/1.1" 200 None 2025-09-26 10:24:34,283 - lava_callback - DEBUG - Processing node 68d3c6cdcd36afa834e0e117: baseline-arm 2025-09-26 10:24:34,283 - lava_callback - ERROR - Error processing callback for node 68d3c6cdcd36afa834e0e117: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:24:34,970 - lava_callback - INFO - Received callback for node 68d3c6cecd36afa834e0e11a INFO: 172.20.0.1:58786 - "POST /node/68d3c6cecd36afa834e0e11a HTTP/1.0" 202 Accepted 2025-09-26 10:24:34,975 - lava_callback - INFO - Starting async job submit for node 68d3c6cecd36afa834e0e11a 2025-09-26 10:24:34,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:24:34,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c6cecd36afa834e0e11a HTTP/1.1" 200 None 2025-09-26 10:24:34,991 - lava_callback - DEBUG - Processing node 68d3c6cecd36afa834e0e11a: baseline-arm 2025-09-26 10:24:34,991 - lava_callback - ERROR - Error processing callback for node 68d3c6cecd36afa834e0e11a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:24:35,703 - lava_callback - INFO - Received callback for node 68d3c6d3cd36afa834e0e123 INFO: 172.20.0.1:58794 - "POST /node/68d3c6d3cd36afa834e0e123 HTTP/1.0" 202 Accepted 2025-09-26 10:24:35,708 - lava_callback - INFO - Starting async job submit for node 68d3c6d3cd36afa834e0e123 2025-09-26 10:24:35,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:24:35,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c6d3cd36afa834e0e123 HTTP/1.1" 200 None 2025-09-26 10:24:35,723 - lava_callback - DEBUG - Processing node 68d3c6d3cd36afa834e0e123: baseline-arm 2025-09-26 10:24:35,723 - lava_callback - ERROR - Error processing callback for node 68d3c6d3cd36afa834e0e123: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:24:36,430 - lava_callback - INFO - Received callback for node 68d3c6d5cd36afa834e0e126 INFO: 172.20.0.1:58802 - "POST /node/68d3c6d5cd36afa834e0e126 HTTP/1.0" 202 Accepted 2025-09-26 10:24:36,435 - lava_callback - INFO - Starting async job submit for node 68d3c6d5cd36afa834e0e126 2025-09-26 10:24:36,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:24:36,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c6d5cd36afa834e0e126 HTTP/1.1" 200 None 2025-09-26 10:24:36,452 - lava_callback - DEBUG - Processing node 68d3c6d5cd36afa834e0e126: baseline-arm 2025-09-26 10:24:36,452 - lava_callback - ERROR - Error processing callback for node 68d3c6d5cd36afa834e0e126: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:58808 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:24:37,156 - lava_callback - INFO - Received callback for node 68d3c6d9cd36afa834e0e129 INFO: 172.20.0.1:58818 - "POST /node/68d3c6d9cd36afa834e0e129 HTTP/1.0" 202 Accepted 2025-09-26 10:24:37,161 - lava_callback - INFO - Starting async job submit for node 68d3c6d9cd36afa834e0e129 2025-09-26 10:24:37,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:24:37,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c6d9cd36afa834e0e129 HTTP/1.1" 200 None 2025-09-26 10:24:37,177 - lava_callback - DEBUG - Processing node 68d3c6d9cd36afa834e0e129: baseline-arm 2025-09-26 10:24:37,177 - lava_callback - ERROR - Error processing callback for node 68d3c6d9cd36afa834e0e129: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:24:37,875 - lava_callback - INFO - Received callback for node 68d3c6d9cd36afa834e0e12c INFO: 172.20.0.1:58824 - "POST /node/68d3c6d9cd36afa834e0e12c HTTP/1.0" 202 Accepted 2025-09-26 10:24:37,880 - lava_callback - INFO - Starting async job submit for node 68d3c6d9cd36afa834e0e12c 2025-09-26 10:24:37,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:24:37,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c6d9cd36afa834e0e12c HTTP/1.1" 200 None 2025-09-26 10:24:37,894 - lava_callback - DEBUG - Processing node 68d3c6d9cd36afa834e0e12c: baseline-arm 2025-09-26 10:24:37,894 - lava_callback - ERROR - Error processing callback for node 68d3c6d9cd36afa834e0e12c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:24:38,600 - lava_callback - INFO - Received callback for node 68d3c6dbcd36afa834e0e12f INFO: 172.20.0.1:58838 - "POST /node/68d3c6dbcd36afa834e0e12f HTTP/1.0" 202 Accepted 2025-09-26 10:24:38,606 - lava_callback - INFO - Starting async job submit for node 68d3c6dbcd36afa834e0e12f 2025-09-26 10:24:38,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:24:38,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c6dbcd36afa834e0e12f HTTP/1.1" 200 None 2025-09-26 10:24:38,631 - lava_callback - DEBUG - Processing node 68d3c6dbcd36afa834e0e12f: baseline-arm 2025-09-26 10:24:38,631 - lava_callback - ERROR - Error processing callback for node 68d3c6dbcd36afa834e0e12f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:24:39,329 - lava_callback - INFO - Received callback for node 68d3c6ddcd36afa834e0e132 INFO: 172.20.0.1:33422 - "POST /node/68d3c6ddcd36afa834e0e132 HTTP/1.0" 202 Accepted 2025-09-26 10:24:39,335 - lava_callback - INFO - Starting async job submit for node 68d3c6ddcd36afa834e0e132 2025-09-26 10:24:39,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:24:39,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c6ddcd36afa834e0e132 HTTP/1.1" 200 None 2025-09-26 10:24:39,349 - lava_callback - DEBUG - Processing node 68d3c6ddcd36afa834e0e132: baseline-arm 2025-09-26 10:24:39,350 - lava_callback - ERROR - Error processing callback for node 68d3c6ddcd36afa834e0e132: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:24:40,038 - lava_callback - INFO - Received callback for node 68d3c6dfcd36afa834e0e138 INFO: 172.20.0.1:33424 - "POST /node/68d3c6dfcd36afa834e0e138 HTTP/1.0" 202 Accepted 2025-09-26 10:24:40,046 - lava_callback - INFO - Starting async job submit for node 68d3c6dfcd36afa834e0e138 2025-09-26 10:24:40,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:24:40,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c6dfcd36afa834e0e138 HTTP/1.1" 200 None 2025-09-26 10:24:40,062 - lava_callback - DEBUG - Processing node 68d3c6dfcd36afa834e0e138: baseline-arm 2025-09-26 10:24:40,063 - lava_callback - ERROR - Error processing callback for node 68d3c6dfcd36afa834e0e138: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:24:40,740 - lava_callback - INFO - Received callback for node 68d3c6dfcd36afa834e0e13b INFO: 172.20.0.1:33436 - "POST /node/68d3c6dfcd36afa834e0e13b HTTP/1.0" 202 Accepted 2025-09-26 10:24:40,748 - lava_callback - INFO - Starting async job submit for node 68d3c6dfcd36afa834e0e13b 2025-09-26 10:24:40,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:24:40,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c6dfcd36afa834e0e13b HTTP/1.1" 200 None 2025-09-26 10:24:40,786 - lava_callback - DEBUG - Processing node 68d3c6dfcd36afa834e0e13b: baseline-arm 2025-09-26 10:24:40,786 - lava_callback - ERROR - Error processing callback for node 68d3c6dfcd36afa834e0e13b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:33450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41420 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:25:07,992 - lava_callback - INFO - Received callback for node 68d3c6ffcd36afa834e0e16c INFO: 172.20.0.1:41430 - "POST /node/68d3c6ffcd36afa834e0e16c HTTP/1.0" 202 Accepted 2025-09-26 10:25:07,998 - lava_callback - INFO - Starting async job submit for node 68d3c6ffcd36afa834e0e16c 2025-09-26 10:25:07,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:25:08,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c6ffcd36afa834e0e16c HTTP/1.1" 200 None 2025-09-26 10:25:08,013 - lava_callback - DEBUG - Processing node 68d3c6ffcd36afa834e0e16c: ltp-cap-bounds 2025-09-26 10:25:08,013 - lava_callback - ERROR - Error processing callback for node 68d3c6ffcd36afa834e0e16c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:51328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54936 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:25:28,020 - lava_callback - INFO - Received callback for node 68d3c70ccd36afa834e0e1a8 INFO: 172.20.0.1:54938 - "POST /node/68d3c70ccd36afa834e0e1a8 HTTP/1.0" 202 Accepted 2025-09-26 10:25:28,026 - lava_callback - INFO - Starting async job submit for node 68d3c70ccd36afa834e0e1a8 2025-09-26 10:25:28,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:25:28,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c70ccd36afa834e0e1a8 HTTP/1.1" 200 None 2025-09-26 10:25:28,040 - lava_callback - DEBUG - Processing node 68d3c70ccd36afa834e0e1a8: ltp-containers 2025-09-26 10:25:28,040 - lava_callback - ERROR - Error processing callback for node 68d3c70ccd36afa834e0e1a8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60638 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:25:40,033 - lava_callback - INFO - Received callback for node 68d40a19cd36afa834e16edc INFO: 172.20.0.1:52604 - "POST /node/68d40a19cd36afa834e16edc HTTP/1.0" 202 Accepted 2025-09-26 10:25:40,039 - lava_callback - INFO - Starting async job submit for node 68d40a19cd36afa834e16edc 2025-09-26 10:25:40,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:25:40,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a19cd36afa834e16edc HTTP/1.1" 200 None 2025-09-26 10:25:40,083 - lava_callback - DEBUG - Processing node 68d40a19cd36afa834e16edc: baseline-arm 2025-09-26 10:25:40,320 - lava_callback - ERROR - Error processing callback for node 68d40a19cd36afa834e16edc: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:52616 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:25:48,013 - lava_callback - INFO - Received callback for node 68d3c726cd36afa834e0e1c0 INFO: 172.20.0.1:52626 - "POST /node/68d3c726cd36afa834e0e1c0 HTTP/1.0" 202 Accepted 2025-09-26 10:25:48,019 - lava_callback - INFO - Starting async job submit for node 68d3c726cd36afa834e0e1c0 2025-09-26 10:25:48,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:25:48,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c726cd36afa834e0e1c0 HTTP/1.1" 200 None 2025-09-26 10:25:48,033 - lava_callback - DEBUG - Processing node 68d3c726cd36afa834e0e1c0: ltp-sched 2025-09-26 10:25:48,033 - lava_callback - ERROR - Error processing callback for node 68d3c726cd36afa834e0e1c0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:25:52,030 - lava_callback - INFO - Received callback for node 68d669bb2f83206171a90432 INFO: 172.20.0.1:50004 - "POST /node/68d669bb2f83206171a90432 HTTP/1.0" 202 Accepted 2025-09-26 10:25:52,036 - lava_callback - INFO - Starting async job submit for node 68d669bb2f83206171a90432 2025-09-26 10:25:52,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:25:52,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d669bb2f83206171a90432 HTTP/1.1" 200 None 2025-09-26 10:25:52,094 - lava_callback - DEBUG - Processing node 68d669bb2f83206171a90432: baseline-arm64-broonie 2025-09-26 10:25:52,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:25:53,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:25:53,550 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d669bb2f83206171a90432/log.txt.gz 2025-09-26 10:25:53,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:25:54,658 - lava_callback - INFO - Received callback for node 68d3c730cd36afa834e0e1cc INFO: 172.20.0.1:50020 - "POST /node/68d3c730cd36afa834e0e1cc HTTP/1.0" 202 Accepted 2025-09-26 10:25:54,665 - lava_callback - INFO - Starting async job submit for node 68d3c730cd36afa834e0e1cc 2025-09-26 10:25:54,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:25:54,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c730cd36afa834e0e1cc HTTP/1.1" 200 None 2025-09-26 10:25:54,682 - lava_callback - DEBUG - Processing node 68d3c730cd36afa834e0e1cc: baseline-arm 2025-09-26 10:25:54,682 - lava_callback - ERROR - Error processing callback for node 68d3c730cd36afa834e0e1cc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:25:55,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:25:55,857 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d669bb2f83206171a90432/lava_callback.json.gz 2025-09-26 10:25:55,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:25:55,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d669bb2f83206171a90432 HTTP/1.1" 200 None 2025-09-26 10:25:55,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:25:55,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c9e2f83206171a8fe79 HTTP/1.1" 200 None 2025-09-26 10:25:55,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:25:55,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d669bb2f83206171a90432 HTTP/1.1" 200 None 2025-09-26 10:25:55,935 - lava_callback - INFO - Completed processing callback for node 68d669bb2f83206171a90432 INFO: 172.20.0.1:50028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57246 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:26:08,132 - lava_callback - INFO - Received callback for node 68d3c72ccd36afa834e0e1c9 INFO: 172.20.0.1:57252 - "POST /node/68d3c72ccd36afa834e0e1c9 HTTP/1.0" 202 Accepted 2025-09-26 10:26:08,139 - lava_callback - INFO - Starting async job submit for node 68d3c72ccd36afa834e0e1c9 2025-09-26 10:26:08,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:26:08,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c72ccd36afa834e0e1c9 HTTP/1.1" 200 None 2025-09-26 10:26:08,158 - lava_callback - DEBUG - Processing node 68d3c72ccd36afa834e0e1c9: ltp-pty 2025-09-26 10:26:08,158 - lava_callback - ERROR - Error processing callback for node 68d3c72ccd36afa834e0e1c9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:26:08,909 - lava_callback - INFO - Received callback for node 68d3c739cd36afa834e0e1d8 INFO: 172.20.0.1:57258 - "POST /node/68d3c739cd36afa834e0e1d8 HTTP/1.0" 202 Accepted 2025-09-26 10:26:08,918 - lava_callback - INFO - Starting async job submit for node 68d3c739cd36afa834e0e1d8 2025-09-26 10:26:08,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:26:08,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c739cd36afa834e0e1d8 HTTP/1.1" 200 None 2025-09-26 10:26:08,936 - lava_callback - DEBUG - Processing node 68d3c739cd36afa834e0e1d8: ltp-sched 2025-09-26 10:26:08,936 - lava_callback - ERROR - Error processing callback for node 68d3c739cd36afa834e0e1d8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:57168 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:26:14,794 - lava_callback - INFO - Received callback for node 68d3c731cd36afa834e0e1cf INFO: 172.20.0.1:57172 - "POST /node/68d3c731cd36afa834e0e1cf HTTP/1.0" 202 Accepted 2025-09-26 10:26:14,799 - lava_callback - INFO - Starting async job submit for node 68d3c731cd36afa834e0e1cf 2025-09-26 10:26:14,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:26:14,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c731cd36afa834e0e1cf HTTP/1.1" 200 None 2025-09-26 10:26:14,813 - lava_callback - DEBUG - Processing node 68d3c731cd36afa834e0e1cf: baseline-arm 2025-09-26 10:26:14,813 - lava_callback - ERROR - Error processing callback for node 68d3c731cd36afa834e0e1cf: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:57180 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 10:26:15,509 - lava_callback - INFO - Received callback for node 68d3c734cd36afa834e0e1d2 INFO: 172.20.0.1:57184 - "POST /node/68d3c734cd36afa834e0e1d2 HTTP/1.0" 202 Accepted 2025-09-26 10:26:15,514 - lava_callback - INFO - Starting async job submit for node 68d3c734cd36afa834e0e1d2 2025-09-26 10:26:15,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:26:15,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c734cd36afa834e0e1d2 HTTP/1.1" 200 None 2025-09-26 10:26:15,529 - lava_callback - DEBUG - Processing node 68d3c734cd36afa834e0e1d2: baseline-arm 2025-09-26 10:26:15,530 - lava_callback - ERROR - Error processing callback for node 68d3c734cd36afa834e0e1d2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:26:16,235 - lava_callback - INFO - Received callback for node 68d3c735cd36afa834e0e1d5 INFO: 172.20.0.1:57192 - "POST /node/68d3c735cd36afa834e0e1d5 HTTP/1.0" 202 Accepted 2025-09-26 10:26:16,244 - lava_callback - INFO - Starting async job submit for node 68d3c735cd36afa834e0e1d5 2025-09-26 10:26:16,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:26:16,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c735cd36afa834e0e1d5 HTTP/1.1" 200 None 2025-09-26 10:26:16,258 - lava_callback - DEBUG - Processing node 68d3c735cd36afa834e0e1d5: baseline-arm 2025-09-26 10:26:16,258 - lava_callback - ERROR - Error processing callback for node 68d3c735cd36afa834e0e1d5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:57208 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:26:16,946 - lava_callback - INFO - Received callback for node 68d3c73bcd36afa834e0e1db INFO: 172.20.0.1:57214 - "POST /node/68d3c73bcd36afa834e0e1db HTTP/1.0" 202 Accepted 2025-09-26 10:26:16,952 - lava_callback - INFO - Starting async job submit for node 68d3c73bcd36afa834e0e1db 2025-09-26 10:26:16,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:26:16,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c73bcd36afa834e0e1db HTTP/1.1" 200 None 2025-09-26 10:26:16,969 - lava_callback - DEBUG - Processing node 68d3c73bcd36afa834e0e1db: baseline-arm 2025-09-26 10:26:16,970 - lava_callback - ERROR - Error processing callback for node 68d3c73bcd36afa834e0e1db: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:26:17,674 - lava_callback - INFO - Received callback for node 68d3c73ccd36afa834e0e1de INFO: 172.20.0.1:57226 - "POST /node/68d3c73ccd36afa834e0e1de HTTP/1.0" 202 Accepted 2025-09-26 10:26:17,680 - lava_callback - INFO - Starting async job submit for node 68d3c73ccd36afa834e0e1de 2025-09-26 10:26:17,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:26:17,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c73ccd36afa834e0e1de HTTP/1.1" 200 None 2025-09-26 10:26:17,696 - lava_callback - DEBUG - Processing node 68d3c73ccd36afa834e0e1de: baseline-arm 2025-09-26 10:26:17,696 - lava_callback - ERROR - Error processing callback for node 68d3c73ccd36afa834e0e1de: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:26:18,389 - lava_callback - INFO - Received callback for node 68d3c742cd36afa834e0e1e7 INFO: 172.20.0.1:57238 - "POST /node/68d3c742cd36afa834e0e1e7 HTTP/1.0" 202 Accepted 2025-09-26 10:26:18,394 - lava_callback - INFO - Starting async job submit for node 68d3c742cd36afa834e0e1e7 2025-09-26 10:26:18,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:26:18,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c742cd36afa834e0e1e7 HTTP/1.1" 200 None 2025-09-26 10:26:18,416 - lava_callback - DEBUG - Processing node 68d3c742cd36afa834e0e1e7: baseline-arm 2025-09-26 10:26:18,416 - lava_callback - ERROR - Error processing callback for node 68d3c742cd36afa834e0e1e7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:26:19,100 - lava_callback - INFO - Received callback for node 68d3c743cd36afa834e0e1ea INFO: 172.20.0.1:57250 - "POST /node/68d3c743cd36afa834e0e1ea HTTP/1.0" 202 Accepted 2025-09-26 10:26:19,106 - lava_callback - INFO - Starting async job submit for node 68d3c743cd36afa834e0e1ea 2025-09-26 10:26:19,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:26:19,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c743cd36afa834e0e1ea HTTP/1.1" 200 None 2025-09-26 10:26:19,122 - lava_callback - DEBUG - Processing node 68d3c743cd36afa834e0e1ea: baseline-arm 2025-09-26 10:26:19,122 - lava_callback - ERROR - Error processing callback for node 68d3c743cd36afa834e0e1ea: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:34322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34334 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:26:28,108 - lava_callback - INFO - Received callback for node 68d3c740cd36afa834e0e1e1 INFO: 172.20.0.1:34346 - "POST /node/68d3c740cd36afa834e0e1e1 HTTP/1.0" 202 Accepted 2025-09-26 10:26:28,114 - lava_callback - INFO - Starting async job submit for node 68d3c740cd36afa834e0e1e1 2025-09-26 10:26:28,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:26:28,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c740cd36afa834e0e1e1 HTTP/1.1" 200 None 2025-09-26 10:26:28,128 - lava_callback - DEBUG - Processing node 68d3c740cd36afa834e0e1e1: ltp-smoketest 2025-09-26 10:26:28,128 - lava_callback - ERROR - Error processing callback for node 68d3c740cd36afa834e0e1e1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:26:28,987 - lava_callback - INFO - Received callback for node 68d3c74bcd36afa834e0e21b INFO: 172.20.0.1:34350 - "POST /node/68d3c74bcd36afa834e0e21b HTTP/1.0" 202 Accepted 2025-09-26 10:26:28,993 - lava_callback - INFO - Starting async job submit for node 68d3c74bcd36afa834e0e21b 2025-09-26 10:26:28,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:26:29,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c74bcd36afa834e0e21b HTTP/1.1" 200 None 2025-09-26 10:26:29,022 - lava_callback - DEBUG - Processing node 68d3c74bcd36afa834e0e21b: ltp-sched 2025-09-26 10:26:29,022 - lava_callback - ERROR - Error processing callback for node 68d3c74bcd36afa834e0e21b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:42946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52824 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:26:48,139 - lava_callback - INFO - Received callback for node 68d3c757cd36afa834e0e27e INFO: 172.20.0.1:52828 - "POST /node/68d3c757cd36afa834e0e27e HTTP/1.0" 202 Accepted 2025-09-26 10:26:48,145 - lava_callback - INFO - Starting async job submit for node 68d3c757cd36afa834e0e27e 2025-09-26 10:26:48,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:26:48,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c757cd36afa834e0e27e HTTP/1.1" 200 None 2025-09-26 10:26:48,162 - lava_callback - DEBUG - Processing node 68d3c757cd36afa834e0e27e: ltp-smoketest 2025-09-26 10:26:48,162 - lava_callback - ERROR - Error processing callback for node 68d3c757cd36afa834e0e27e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:26:48,892 - lava_callback - INFO - Received callback for node 68d3c762cd36afa834e0e28d INFO: 172.20.0.1:52844 - "POST /node/68d3c762cd36afa834e0e28d HTTP/1.0" 202 Accepted 2025-09-26 10:26:48,898 - lava_callback - INFO - Starting async job submit for node 68d3c762cd36afa834e0e28d 2025-09-26 10:26:48,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:26:48,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c762cd36afa834e0e28d HTTP/1.1" 200 None 2025-09-26 10:26:48,914 - lava_callback - DEBUG - Processing node 68d3c762cd36afa834e0e28d: ltp-syscalls 2025-09-26 10:26:48,914 - lava_callback - ERROR - Error processing callback for node 68d3c762cd36afa834e0e28d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:51344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39540 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:27:14,849 - lava_callback - INFO - Received callback for node 68d3c774cd36afa834e0e2a8 INFO: 172.20.0.1:39544 - "POST /node/68d3c774cd36afa834e0e2a8 HTTP/1.0" 202 Accepted 2025-09-26 10:27:14,854 - lava_callback - INFO - Starting async job submit for node 68d3c774cd36afa834e0e2a8 2025-09-26 10:27:14,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:27:14,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c774cd36afa834e0e2a8 HTTP/1.1" 200 None 2025-09-26 10:27:14,868 - lava_callback - DEBUG - Processing node 68d3c774cd36afa834e0e2a8: baseline-arm 2025-09-26 10:27:14,868 - lava_callback - ERROR - Error processing callback for node 68d3c774cd36afa834e0e2a8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:39548 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 10:27:15,541 - lava_callback - INFO - Received callback for node 68d3c776cd36afa834e0e2ab INFO: 172.20.0.1:39554 - "POST /node/68d3c776cd36afa834e0e2ab HTTP/1.0" 202 Accepted 2025-09-26 10:27:15,547 - lava_callback - INFO - Starting async job submit for node 68d3c776cd36afa834e0e2ab 2025-09-26 10:27:15,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:27:15,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c776cd36afa834e0e2ab HTTP/1.1" 200 None 2025-09-26 10:27:15,582 - lava_callback - DEBUG - Processing node 68d3c776cd36afa834e0e2ab: baseline-arm 2025-09-26 10:27:15,582 - lava_callback - ERROR - Error processing callback for node 68d3c776cd36afa834e0e2ab: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:27:16,244 - lava_callback - INFO - Received callback for node 68d3c77dcd36afa834e0e2b4 INFO: 172.20.0.1:39568 - "POST /node/68d3c77dcd36afa834e0e2b4 HTTP/1.0" 202 Accepted 2025-09-26 10:27:16,249 - lava_callback - INFO - Starting async job submit for node 68d3c77dcd36afa834e0e2b4 2025-09-26 10:27:16,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:27:16,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c77dcd36afa834e0e2b4 HTTP/1.1" 200 None 2025-09-26 10:27:16,264 - lava_callback - DEBUG - Processing node 68d3c77dcd36afa834e0e2b4: baseline-arm 2025-09-26 10:27:16,264 - lava_callback - ERROR - Error processing callback for node 68d3c77dcd36afa834e0e2b4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:39578 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:27:16,955 - lava_callback - INFO - Received callback for node 68d3c77ecd36afa834e0e2b8 INFO: 172.20.0.1:39590 - "POST /node/68d3c77ecd36afa834e0e2b8 HTTP/1.0" 202 Accepted 2025-09-26 10:27:16,960 - lava_callback - INFO - Starting async job submit for node 68d3c77ecd36afa834e0e2b8 2025-09-26 10:27:16,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:27:16,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c77ecd36afa834e0e2b8 HTTP/1.1" 200 None 2025-09-26 10:27:16,974 - lava_callback - DEBUG - Processing node 68d3c77ecd36afa834e0e2b8: baseline-arm 2025-09-26 10:27:16,974 - lava_callback - ERROR - Error processing callback for node 68d3c77ecd36afa834e0e2b8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:27:18,452 - lava_callback - INFO - Received callback for node 68d3c423cd36afa834e0d9db INFO: 172.20.0.1:39604 - "POST /node/68d3c423cd36afa834e0d9db HTTP/1.0" 202 Accepted 2025-09-26 10:27:18,458 - lava_callback - INFO - Starting async job submit for node 68d3c423cd36afa834e0d9db 2025-09-26 10:27:18,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:27:18,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c423cd36afa834e0d9db HTTP/1.1" 200 None 2025-09-26 10:27:18,500 - lava_callback - DEBUG - Processing node 68d3c423cd36afa834e0d9db: baseline-arm 2025-09-26 10:27:18,784 - lava_callback - ERROR - Error processing callback for node 68d3c423cd36afa834e0d9db: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:46968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46974 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:27:34,894 - lava_callback - INFO - Received callback for node 68d3c786cd36afa834e0e2c4 INFO: 172.20.0.1:39934 - "POST /node/68d3c786cd36afa834e0e2c4 HTTP/1.0" 202 Accepted 2025-09-26 10:27:34,899 - lava_callback - INFO - Starting async job submit for node 68d3c786cd36afa834e0e2c4 2025-09-26 10:27:34,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:27:34,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c786cd36afa834e0e2c4 HTTP/1.1" 200 None 2025-09-26 10:27:34,930 - lava_callback - DEBUG - Processing node 68d3c786cd36afa834e0e2c4: baseline-arm 2025-09-26 10:27:34,930 - lava_callback - ERROR - Error processing callback for node 68d3c786cd36afa834e0e2c4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:27:35,605 - lava_callback - INFO - Received callback for node 68d3c78dcd36afa834e0e2f6 INFO: 172.20.0.1:39942 - "POST /node/68d3c78dcd36afa834e0e2f6 HTTP/1.0" 202 Accepted 2025-09-26 10:27:35,610 - lava_callback - INFO - Starting async job submit for node 68d3c78dcd36afa834e0e2f6 2025-09-26 10:27:35,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:27:35,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c78dcd36afa834e0e2f6 HTTP/1.1" 200 None 2025-09-26 10:27:35,626 - lava_callback - DEBUG - Processing node 68d3c78dcd36afa834e0e2f6: baseline-arm 2025-09-26 10:27:35,626 - lava_callback - ERROR - Error processing callback for node 68d3c78dcd36afa834e0e2f6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:27:36,306 - lava_callback - INFO - Received callback for node 68d3c78fcd36afa834e0e2f9 INFO: 172.20.0.1:39952 - "POST /node/68d3c78fcd36afa834e0e2f9 HTTP/1.0" 202 Accepted 2025-09-26 10:27:36,314 - lava_callback - INFO - Starting async job submit for node 68d3c78fcd36afa834e0e2f9 2025-09-26 10:27:36,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:27:36,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c78fcd36afa834e0e2f9 HTTP/1.1" 200 None 2025-09-26 10:27:36,330 - lava_callback - DEBUG - Processing node 68d3c78fcd36afa834e0e2f9: baseline-arm 2025-09-26 10:27:36,330 - lava_callback - ERROR - Error processing callback for node 68d3c78fcd36afa834e0e2f9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:39958 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:27:37,027 - lava_callback - INFO - Received callback for node 68d3c794cd36afa834e0e2fe INFO: 172.20.0.1:39962 - "POST /node/68d3c794cd36afa834e0e2fe HTTP/1.0" 202 Accepted 2025-09-26 10:27:37,035 - lava_callback - INFO - Starting async job submit for node 68d3c794cd36afa834e0e2fe 2025-09-26 10:27:37,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:27:37,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c794cd36afa834e0e2fe HTTP/1.1" 200 None 2025-09-26 10:27:37,048 - lava_callback - DEBUG - Processing node 68d3c794cd36afa834e0e2fe: baseline-arm 2025-09-26 10:27:37,048 - lava_callback - ERROR - Error processing callback for node 68d3c794cd36afa834e0e2fe: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:27:37,746 - lava_callback - INFO - Received callback for node 68d3c795cd36afa834e0e301 INFO: 172.20.0.1:39964 - "POST /node/68d3c795cd36afa834e0e301 HTTP/1.0" 202 Accepted 2025-09-26 10:27:37,751 - lava_callback - INFO - Starting async job submit for node 68d3c795cd36afa834e0e301 2025-09-26 10:27:37,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:27:37,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c795cd36afa834e0e301 HTTP/1.1" 200 None 2025-09-26 10:27:37,765 - lava_callback - DEBUG - Processing node 68d3c795cd36afa834e0e301: baseline-arm 2025-09-26 10:27:37,765 - lava_callback - ERROR - Error processing callback for node 68d3c795cd36afa834e0e301: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:58546 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:27:54,746 - lava_callback - INFO - Received callback for node 68d3c797cd36afa834e0e304 INFO: 172.20.0.1:60704 - "POST /node/68d3c797cd36afa834e0e304 HTTP/1.0" 202 Accepted 2025-09-26 10:27:54,754 - lava_callback - INFO - Starting async job submit for node 68d3c797cd36afa834e0e304 2025-09-26 10:27:54,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:27:54,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c797cd36afa834e0e304 HTTP/1.1" 200 None 2025-09-26 10:27:54,773 - lava_callback - DEBUG - Processing node 68d3c797cd36afa834e0e304: baseline-arm 2025-09-26 10:27:54,773 - lava_callback - ERROR - Error processing callback for node 68d3c797cd36afa834e0e304: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:27:55,473 - lava_callback - INFO - Received callback for node 68d3c79acd36afa834e0e307 INFO: 172.20.0.1:60720 - "POST /node/68d3c79acd36afa834e0e307 HTTP/1.0" 202 Accepted 2025-09-26 10:27:55,478 - lava_callback - INFO - Starting async job submit for node 68d3c79acd36afa834e0e307 2025-09-26 10:27:55,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:27:55,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c79acd36afa834e0e307 HTTP/1.1" 200 None 2025-09-26 10:27:55,492 - lava_callback - DEBUG - Processing node 68d3c79acd36afa834e0e307: baseline-arm 2025-09-26 10:27:55,492 - lava_callback - ERROR - Error processing callback for node 68d3c79acd36afa834e0e307: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:27:56,188 - lava_callback - INFO - Received callback for node 68d3c7a4cd36afa834e0e316 INFO: 172.20.0.1:60734 - "POST /node/68d3c7a4cd36afa834e0e316 HTTP/1.0" 202 Accepted 2025-09-26 10:27:56,193 - lava_callback - INFO - Starting async job submit for node 68d3c7a4cd36afa834e0e316 2025-09-26 10:27:56,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:27:56,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c7a4cd36afa834e0e316 HTTP/1.1" 200 None 2025-09-26 10:27:56,207 - lava_callback - DEBUG - Processing node 68d3c7a4cd36afa834e0e316: baseline-arm 2025-09-26 10:27:56,208 - lava_callback - ERROR - Error processing callback for node 68d3c7a4cd36afa834e0e316: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60740 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:27:56,918 - lava_callback - INFO - Received callback for node 68d3c7a4cd36afa834e0e319 INFO: 172.20.0.1:60756 - "POST /node/68d3c7a4cd36afa834e0e319 HTTP/1.0" 202 Accepted 2025-09-26 10:27:56,924 - lava_callback - INFO - Starting async job submit for node 68d3c7a4cd36afa834e0e319 2025-09-26 10:27:56,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:27:56,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c7a4cd36afa834e0e319 HTTP/1.1" 200 None 2025-09-26 10:27:56,939 - lava_callback - DEBUG - Processing node 68d3c7a4cd36afa834e0e319: baseline-arm 2025-09-26 10:27:56,939 - lava_callback - ERROR - Error processing callback for node 68d3c7a4cd36afa834e0e319: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:27:57,629 - lava_callback - INFO - Received callback for node 68d3c7a6cd36afa834e0e31c INFO: 172.20.0.1:60758 - "POST /node/68d3c7a6cd36afa834e0e31c HTTP/1.0" 202 Accepted 2025-09-26 10:27:57,634 - lava_callback - INFO - Starting async job submit for node 68d3c7a6cd36afa834e0e31c 2025-09-26 10:27:57,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:27:57,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c7a6cd36afa834e0e31c HTTP/1.1" 200 None 2025-09-26 10:27:57,647 - lava_callback - DEBUG - Processing node 68d3c7a6cd36afa834e0e31c: baseline-arm 2025-09-26 10:27:57,647 - lava_callback - ERROR - Error processing callback for node 68d3c7a6cd36afa834e0e31c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:28:00,021 - lava_callback - INFO - Received callback for node 68d40a1acd36afa834e16edf INFO: 172.20.0.1:46676 - "POST /node/68d40a1acd36afa834e16edf HTTP/1.0" 202 Accepted 2025-09-26 10:28:00,030 - lava_callback - INFO - Starting async job submit for node 68d40a1acd36afa834e16edf 2025-09-26 10:28:00,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:28:00,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a1acd36afa834e16edf HTTP/1.1" 200 None 2025-09-26 10:28:00,066 - lava_callback - DEBUG - Processing node 68d40a1acd36afa834e16edf: baseline-arm 2025-09-26 10:28:00,288 - lava_callback - ERROR - Error processing callback for node 68d40a1acd36afa834e16edf: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52496 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:28:14,654 - lava_callback - INFO - Received callback for node 68d3c7a9cd36afa834e0e31f INFO: 172.20.0.1:52512 - "POST /node/68d3c7a9cd36afa834e0e31f HTTP/1.0" 202 Accepted 2025-09-26 10:28:14,659 - lava_callback - INFO - Starting async job submit for node 68d3c7a9cd36afa834e0e31f 2025-09-26 10:28:14,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:28:14,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c7a9cd36afa834e0e31f HTTP/1.1" 200 None 2025-09-26 10:28:14,676 - lava_callback - DEBUG - Processing node 68d3c7a9cd36afa834e0e31f: baseline-arm 2025-09-26 10:28:14,676 - lava_callback - ERROR - Error processing callback for node 68d3c7a9cd36afa834e0e31f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:52528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34840 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:28:27,233 - lava_callback - INFO - Received callback for node 68d3c6b4cd36afa834e0e0c4 INFO: 172.20.0.1:34848 - "POST /node/68d3c6b4cd36afa834e0e0c4 HTTP/1.0" 202 Accepted 2025-09-26 10:28:27,239 - lava_callback - INFO - Starting async job submit for node 68d3c6b4cd36afa834e0e0c4 2025-09-26 10:28:27,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:28:27,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c6b4cd36afa834e0e0c4 HTTP/1.1" 200 None 2025-09-26 10:28:27,294 - lava_callback - DEBUG - Processing node 68d3c6b4cd36afa834e0e0c4: ltp-watchqueue 2025-09-26 10:28:27,670 - lava_callback - ERROR - Error processing callback for node 68d3c6b4cd36afa834e0e0c4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:28:32,854 - lava_callback - INFO - Received callback for node 68d3c6ebcd36afa834e0e14a INFO: 172.20.0.1:39596 - "POST /node/68d3c6ebcd36afa834e0e14a HTTP/1.0" 202 Accepted 2025-09-26 10:28:32,861 - lava_callback - INFO - Starting async job submit for node 68d3c6ebcd36afa834e0e14a 2025-09-26 10:28:32,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:28:32,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c6ebcd36afa834e0e14a HTTP/1.1" 200 None 2025-09-26 10:28:32,916 - lava_callback - DEBUG - Processing node 68d3c6ebcd36afa834e0e14a: ltp-cap-bounds 2025-09-26 10:28:33,280 - lava_callback - ERROR - Error processing callback for node 68d3c6ebcd36afa834e0e14a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:39604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39390 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:29:01,601 - lava_callback - INFO - Received callback for node 68d3cb2bcd36afa834e0f1c9 INFO: 172.20.0.1:44084 - "POST /node/68d3cb2bcd36afa834e0f1c9 HTTP/1.0" 202 Accepted 2025-09-26 10:29:01,608 - lava_callback - INFO - Starting async job submit for node 68d3cb2bcd36afa834e0f1c9 2025-09-26 10:29:01,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:29:01,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cb2bcd36afa834e0f1c9 HTTP/1.1" 200 None 2025-09-26 10:29:01,685 - lava_callback - DEBUG - Processing node 68d3cb2bcd36afa834e0f1c9: baseline-arm64 2025-09-26 10:29:02,587 - lava_callback - ERROR - Error processing callback for node 68d3cb2bcd36afa834e0f1c9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:44096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43730 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:29:24,028 - lava_callback - INFO - Received callback for node 68d3cb2ccd36afa834e0f1cc INFO: 172.20.0.1:43742 - "POST /node/68d3cb2ccd36afa834e0f1cc HTTP/1.0" 202 Accepted 2025-09-26 10:29:24,036 - lava_callback - INFO - Starting async job submit for node 68d3cb2ccd36afa834e0f1cc 2025-09-26 10:29:24,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:29:24,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cb2ccd36afa834e0f1cc HTTP/1.1" 200 None 2025-09-26 10:29:24,092 - lava_callback - DEBUG - Processing node 68d3cb2ccd36afa834e0f1cc: baseline-arm64 2025-09-26 10:29:24,903 - lava_callback - ERROR - Error processing callback for node 68d3cb2ccd36afa834e0f1cc: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:43754 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:29:28,211 - lava_callback - INFO - Received callback for node 68d3c7facd36afa834e0e3cb INFO: 172.20.0.1:43768 - "POST /node/68d3c7facd36afa834e0e3cb HTTP/1.0" 202 Accepted 2025-09-26 10:29:28,217 - lava_callback - INFO - Starting async job submit for node 68d3c7facd36afa834e0e3cb 2025-09-26 10:29:28,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:29:28,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c7facd36afa834e0e3cb HTTP/1.1" 200 None 2025-09-26 10:29:28,231 - lava_callback - DEBUG - Processing node 68d3c7facd36afa834e0e3cb: ltp-syscalls 2025-09-26 10:29:28,231 - lava_callback - ERROR - Error processing callback for node 68d3c7facd36afa834e0e3cb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:44126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48332 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:30:08,318 - lava_callback - INFO - Received callback for node 68d3c81bcd36afa834e0e41b INFO: 172.20.0.1:48336 - "POST /node/68d3c81bcd36afa834e0e41b HTTP/1.0" 202 Accepted 2025-09-26 10:30:08,324 - lava_callback - INFO - Starting async job submit for node 68d3c81bcd36afa834e0e41b 2025-09-26 10:30:08,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:30:08,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c81bcd36afa834e0e41b HTTP/1.1" 200 None 2025-09-26 10:30:08,338 - lava_callback - DEBUG - Processing node 68d3c81bcd36afa834e0e41b: ltp-syscalls-ipc 2025-09-26 10:30:08,339 - lava_callback - ERROR - Error processing callback for node 68d3c81bcd36afa834e0e41b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60806 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:30:19,177 - lava_callback - INFO - Received callback for node 68d40a1ecd36afa834e16ee2 INFO: 172.20.0.1:60816 - "POST /node/68d40a1ecd36afa834e16ee2 HTTP/1.0" 202 Accepted 2025-09-26 10:30:19,183 - lava_callback - INFO - Starting async job submit for node 68d40a1ecd36afa834e16ee2 2025-09-26 10:30:19,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:30:19,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a1ecd36afa834e16ee2 HTTP/1.1" 200 None 2025-09-26 10:30:19,235 - lava_callback - DEBUG - Processing node 68d40a1ecd36afa834e16ee2: baseline-arm INFO: 172.20.0.1:56248 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:30:19,464 - lava_callback - ERROR - Error processing callback for node 68d40a1ecd36afa834e16ee2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:56260 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:30:28,395 - lava_callback - INFO - Received callback for node 68d3c832cd36afa834e0e440 INFO: 172.20.0.1:56264 - "POST /node/68d3c832cd36afa834e0e440 HTTP/1.0" 202 Accepted 2025-09-26 10:30:28,404 - lava_callback - INFO - Starting async job submit for node 68d3c832cd36afa834e0e440 2025-09-26 10:30:28,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:30:28,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c832cd36afa834e0e440 HTTP/1.1" 200 None 2025-09-26 10:30:28,423 - lava_callback - DEBUG - Processing node 68d3c832cd36afa834e0e440: ltp-syscalls 2025-09-26 10:30:28,423 - lava_callback - ERROR - Error processing callback for node 68d3c832cd36afa834e0e440: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:42128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56670 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:30:48,277 - lava_callback - INFO - Received callback for node 68d3c84fcd36afa834e0e47d INFO: 172.20.0.1:56676 - "POST /node/68d3c84fcd36afa834e0e47d HTTP/1.0" 202 Accepted 2025-09-26 10:30:48,287 - lava_callback - INFO - Starting async job submit for node 68d3c84fcd36afa834e0e47d 2025-09-26 10:30:48,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:30:48,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c84fcd36afa834e0e47d HTTP/1.1" 200 None 2025-09-26 10:30:48,302 - lava_callback - DEBUG - Processing node 68d3c84fcd36afa834e0e47d: ltp-syscalls-ipc 2025-09-26 10:30:48,302 - lava_callback - ERROR - Error processing callback for node 68d3c84fcd36afa834e0e47d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:30:49,093 - lava_callback - INFO - Received callback for node 68d3c854cd36afa834e0e48a INFO: 172.20.0.1:56686 - "POST /node/68d3c854cd36afa834e0e48a HTTP/1.0" 202 Accepted 2025-09-26 10:30:49,103 - lava_callback - INFO - Starting async job submit for node 68d3c854cd36afa834e0e48a 2025-09-26 10:30:49,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:30:49,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c854cd36afa834e0e48a HTTP/1.1" 200 None 2025-09-26 10:30:49,139 - lava_callback - DEBUG - Processing node 68d3c854cd36afa834e0e48a: ltp-timers 2025-09-26 10:30:49,139 - lava_callback - ERROR - Error processing callback for node 68d3c854cd36afa834e0e48a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:44356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56700 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:31:08,438 - lava_callback - INFO - Received callback for node 68d3c85bcd36afa834e0e493 INFO: 172.20.0.1:56712 - "POST /node/68d3c85bcd36afa834e0e493 HTTP/1.0" 202 Accepted 2025-09-26 10:31:08,447 - lava_callback - INFO - Starting async job submit for node 68d3c85bcd36afa834e0e493 2025-09-26 10:31:08,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:31:08,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c85bcd36afa834e0e493 HTTP/1.1" 200 None 2025-09-26 10:31:08,463 - lava_callback - DEBUG - Processing node 68d3c85bcd36afa834e0e493: ltp-syscalls-ipc 2025-09-26 10:31:08,463 - lava_callback - ERROR - Error processing callback for node 68d3c85bcd36afa834e0e493: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:31:09,263 - lava_callback - INFO - Received callback for node 68d3c85dcd36afa834e0e496 INFO: 172.20.0.1:56722 - "POST /node/68d3c85dcd36afa834e0e496 HTTP/1.0" 202 Accepted 2025-09-26 10:31:09,269 - lava_callback - INFO - Starting async job submit for node 68d3c85dcd36afa834e0e496 2025-09-26 10:31:09,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:31:09,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c85dcd36afa834e0e496 HTTP/1.1" 200 None 2025-09-26 10:31:09,306 - lava_callback - DEBUG - Processing node 68d3c85dcd36afa834e0e496: ltp-fs-bind 2025-09-26 10:31:09,306 - lava_callback - ERROR - Error processing callback for node 68d3c85dcd36afa834e0e496: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:31:10,215 - lava_callback - INFO - Received callback for node 68d3c860cd36afa834e0e499 INFO: 172.20.0.1:58278 - "POST /node/68d3c860cd36afa834e0e499 HTTP/1.0" 202 Accepted 2025-09-26 10:31:10,221 - lava_callback - INFO - Starting async job submit for node 68d3c860cd36afa834e0e499 2025-09-26 10:31:10,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:31:10,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c860cd36afa834e0e499 HTTP/1.1" 200 None 2025-09-26 10:31:10,237 - lava_callback - DEBUG - Processing node 68d3c860cd36afa834e0e499: ltp-timers 2025-09-26 10:31:10,237 - lava_callback - ERROR - Error processing callback for node 68d3c860cd36afa834e0e499: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:58280 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:31:14,823 - lava_callback - INFO - Received callback for node 68d3c862cd36afa834e0e49c INFO: 172.20.0.1:58294 - "POST /node/68d3c862cd36afa834e0e49c HTTP/1.0" 202 Accepted 2025-09-26 10:31:14,828 - lava_callback - INFO - Starting async job submit for node 68d3c862cd36afa834e0e49c 2025-09-26 10:31:14,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:31:14,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c862cd36afa834e0e49c HTTP/1.1" 200 None 2025-09-26 10:31:14,841 - lava_callback - DEBUG - Processing node 68d3c862cd36afa834e0e49c: baseline-arm 2025-09-26 10:31:14,841 - lava_callback - ERROR - Error processing callback for node 68d3c862cd36afa834e0e49c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:58308 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 10:31:15,539 - lava_callback - INFO - Received callback for node 68d3c862cd36afa834e0e49f INFO: 172.20.0.1:58320 - "POST /node/68d3c862cd36afa834e0e49f HTTP/1.0" 202 Accepted 2025-09-26 10:31:15,545 - lava_callback - INFO - Starting async job submit for node 68d3c862cd36afa834e0e49f 2025-09-26 10:31:15,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:31:15,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c862cd36afa834e0e49f HTTP/1.1" 200 None 2025-09-26 10:31:15,561 - lava_callback - DEBUG - Processing node 68d3c862cd36afa834e0e49f: baseline-arm 2025-09-26 10:31:15,561 - lava_callback - ERROR - Error processing callback for node 68d3c862cd36afa834e0e49f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:58330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42440 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:31:28,285 - lava_callback - INFO - Received callback for node 68d3c876cd36afa834e0e4b9 INFO: 172.20.0.1:42452 - "POST /node/68d3c876cd36afa834e0e4b9 HTTP/1.0" 202 Accepted 2025-09-26 10:31:28,291 - lava_callback - INFO - Starting async job submit for node 68d3c876cd36afa834e0e4b9 2025-09-26 10:31:28,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:31:28,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c876cd36afa834e0e4b9 HTTP/1.1" 200 None 2025-09-26 10:31:28,307 - lava_callback - DEBUG - Processing node 68d3c876cd36afa834e0e4b9: ltp-watchqueue 2025-09-26 10:31:28,307 - lava_callback - ERROR - Error processing callback for node 68d3c876cd36afa834e0e4b9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:31:33,099 - lava_callback - INFO - Received callback for node 68d3cd0dcd36afa834e0f5cd INFO: 172.20.0.1:49470 - "POST /node/68d3cd0dcd36afa834e0f5cd HTTP/1.0" 202 Accepted 2025-09-26 10:31:33,106 - lava_callback - INFO - Starting async job submit for node 68d3cd0dcd36afa834e0f5cd 2025-09-26 10:31:33,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:31:33,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cd0dcd36afa834e0f5cd HTTP/1.1" 200 None 2025-09-26 10:31:33,161 - lava_callback - DEBUG - Processing node 68d3cd0dcd36afa834e0f5cd: baseline-arm64 2025-09-26 10:31:34,039 - lava_callback - ERROR - Error processing callback for node 68d3cd0dcd36afa834e0f5cd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:31:34,840 - lava_callback - INFO - Received callback for node 68d3c872cd36afa834e0e4b3 INFO: 172.20.0.1:49486 - "POST /node/68d3c872cd36afa834e0e4b3 HTTP/1.0" 202 Accepted 2025-09-26 10:31:34,845 - lava_callback - INFO - Starting async job submit for node 68d3c872cd36afa834e0e4b3 2025-09-26 10:31:34,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:31:34,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c872cd36afa834e0e4b3 HTTP/1.1" 200 None 2025-09-26 10:31:34,859 - lava_callback - DEBUG - Processing node 68d3c872cd36afa834e0e4b3: baseline-arm 2025-09-26 10:31:34,859 - lava_callback - ERROR - Error processing callback for node 68d3c872cd36afa834e0e4b3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:31:35,517 - lava_callback - INFO - Received callback for node 68d3c872cd36afa834e0e4b6 INFO: 172.20.0.1:49500 - "POST /node/68d3c872cd36afa834e0e4b6 HTTP/1.0" 202 Accepted 2025-09-26 10:31:35,522 - lava_callback - INFO - Starting async job submit for node 68d3c872cd36afa834e0e4b6 2025-09-26 10:31:35,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:31:35,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c872cd36afa834e0e4b6 HTTP/1.1" 200 None 2025-09-26 10:31:35,571 - lava_callback - DEBUG - Processing node 68d3c872cd36afa834e0e4b6: baseline-arm 2025-09-26 10:31:35,571 - lava_callback - ERROR - Error processing callback for node 68d3c872cd36afa834e0e4b6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:31:36,214 - lava_callback - INFO - Received callback for node 68d3c879cd36afa834e0e4bc INFO: 172.20.0.1:49506 - "POST /node/68d3c879cd36afa834e0e4bc HTTP/1.0" 202 Accepted 2025-09-26 10:31:36,220 - lava_callback - INFO - Starting async job submit for node 68d3c879cd36afa834e0e4bc 2025-09-26 10:31:36,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:31:36,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c879cd36afa834e0e4bc HTTP/1.1" 200 None 2025-09-26 10:31:36,236 - lava_callback - DEBUG - Processing node 68d3c879cd36afa834e0e4bc: baseline-arm 2025-09-26 10:31:36,236 - lava_callback - ERROR - Error processing callback for node 68d3c879cd36afa834e0e4bc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:49520 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:31:36,915 - lava_callback - INFO - Received callback for node 68d3c87acd36afa834e0e4bf INFO: 172.20.0.1:49526 - "POST /node/68d3c87acd36afa834e0e4bf HTTP/1.0" 202 Accepted 2025-09-26 10:31:36,924 - lava_callback - INFO - Starting async job submit for node 68d3c87acd36afa834e0e4bf 2025-09-26 10:31:36,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:31:36,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c87acd36afa834e0e4bf HTTP/1.1" 200 None 2025-09-26 10:31:36,939 - lava_callback - DEBUG - Processing node 68d3c87acd36afa834e0e4bf: baseline-arm 2025-09-26 10:31:36,939 - lava_callback - ERROR - Error processing callback for node 68d3c87acd36afa834e0e4bf: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:31:37,616 - lava_callback - INFO - Received callback for node 68d3c87dcd36afa834e0e4c6 INFO: 172.20.0.1:49536 - "POST /node/68d3c87dcd36afa834e0e4c6 HTTP/1.0" 202 Accepted 2025-09-26 10:31:37,623 - lava_callback - INFO - Starting async job submit for node 68d3c87dcd36afa834e0e4c6 2025-09-26 10:31:37,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:31:37,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c87dcd36afa834e0e4c6 HTTP/1.1" 200 None 2025-09-26 10:31:37,642 - lava_callback - DEBUG - Processing node 68d3c87dcd36afa834e0e4c6: baseline-arm 2025-09-26 10:31:37,642 - lava_callback - ERROR - Error processing callback for node 68d3c87dcd36afa834e0e4c6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:31:38,311 - lava_callback - INFO - Received callback for node 68d3c87fcd36afa834e0e4c9 INFO: 172.20.0.1:49542 - "POST /node/68d3c87fcd36afa834e0e4c9 HTTP/1.0" 202 Accepted 2025-09-26 10:31:38,316 - lava_callback - INFO - Starting async job submit for node 68d3c87fcd36afa834e0e4c9 2025-09-26 10:31:38,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:31:38,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c87fcd36afa834e0e4c9 HTTP/1.1" 200 None 2025-09-26 10:31:38,330 - lava_callback - DEBUG - Processing node 68d3c87fcd36afa834e0e4c9: baseline-arm 2025-09-26 10:31:38,330 - lava_callback - ERROR - Error processing callback for node 68d3c87fcd36afa834e0e4c9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:31:45,604 - lava_callback - INFO - Received callback for node 68d3cd0ecd36afa834e0f5d0 INFO: 172.20.0.1:40210 - "POST /node/68d3cd0ecd36afa834e0f5d0 HTTP/1.0" 202 Accepted 2025-09-26 10:31:45,611 - lava_callback - INFO - Starting async job submit for node 68d3cd0ecd36afa834e0f5d0 2025-09-26 10:31:45,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:31:45,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cd0ecd36afa834e0f5d0 HTTP/1.1" 200 None 2025-09-26 10:31:45,683 - lava_callback - DEBUG - Processing node 68d3cd0ecd36afa834e0f5d0: baseline-arm64 INFO: 172.20.0.1:40218 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:31:46,576 - lava_callback - ERROR - Error processing callback for node 68d3cd0ecd36afa834e0f5d0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:31:48,339 - lava_callback - INFO - Received callback for node 68d3c883cd36afa834e0e4cc INFO: 172.20.0.1:40228 - "POST /node/68d3c883cd36afa834e0e4cc HTTP/1.0" 202 Accepted 2025-09-26 10:31:48,347 - lava_callback - INFO - Starting async job submit for node 68d3c883cd36afa834e0e4cc 2025-09-26 10:31:48,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:31:48,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c883cd36afa834e0e4cc HTTP/1.1" 200 None 2025-09-26 10:31:48,364 - lava_callback - DEBUG - Processing node 68d3c883cd36afa834e0e4cc: ltp-cap-bounds 2025-09-26 10:31:48,364 - lava_callback - ERROR - Error processing callback for node 68d3c883cd36afa834e0e4cc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:31:49,113 - lava_callback - INFO - Received callback for node 68d3c886cd36afa834e0e4cf INFO: 172.20.0.1:40234 - "POST /node/68d3c886cd36afa834e0e4cf HTTP/1.0" 202 Accepted 2025-09-26 10:31:49,119 - lava_callback - INFO - Starting async job submit for node 68d3c886cd36afa834e0e4cf 2025-09-26 10:31:49,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:31:49,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c886cd36afa834e0e4cf HTTP/1.1" 200 None 2025-09-26 10:31:49,134 - lava_callback - DEBUG - Processing node 68d3c886cd36afa834e0e4cf: ltp-fsx 2025-09-26 10:31:49,134 - lava_callback - ERROR - Error processing callback for node 68d3c886cd36afa834e0e4cf: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:31:49,866 - lava_callback - INFO - Received callback for node 68d3c88ecd36afa834e0e94d INFO: 172.20.0.1:37154 - "POST /node/68d3c88ecd36afa834e0e94d HTTP/1.0" 202 Accepted 2025-09-26 10:31:49,872 - lava_callback - INFO - Starting async job submit for node 68d3c88ecd36afa834e0e94d 2025-09-26 10:31:49,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:31:49,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c88ecd36afa834e0e94d HTTP/1.1" 200 None 2025-09-26 10:31:49,894 - lava_callback - DEBUG - Processing node 68d3c88ecd36afa834e0e94d: ltp-containers 2025-09-26 10:31:49,894 - lava_callback - ERROR - Error processing callback for node 68d3c88ecd36afa834e0e94d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:37166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46654 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:32:08,320 - lava_callback - INFO - Received callback for node 68d3c89bcd36afa834e0ea6f INFO: 172.20.0.1:46666 - "POST /node/68d3c89bcd36afa834e0ea6f HTTP/1.0" 202 Accepted 2025-09-26 10:32:08,329 - lava_callback - INFO - Starting async job submit for node 68d3c89bcd36afa834e0ea6f 2025-09-26 10:32:08,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:32:08,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c89bcd36afa834e0ea6f HTTP/1.1" 200 None 2025-09-26 10:32:08,343 - lava_callback - DEBUG - Processing node 68d3c89bcd36afa834e0ea6f: ltp-controllers 2025-09-26 10:32:08,343 - lava_callback - ERROR - Error processing callback for node 68d3c89bcd36afa834e0ea6f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:35906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33630 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:32:28,969 - lava_callback - INFO - Received callback for node 68d3c8abcd36afa834e0ea84 INFO: 172.20.0.1:33646 - "POST /node/68d3c8abcd36afa834e0ea84 HTTP/1.0" 202 Accepted 2025-09-26 10:32:28,983 - lava_callback - INFO - Starting async job submit for node 68d3c8abcd36afa834e0ea84 2025-09-26 10:32:28,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:32:29,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c8abcd36afa834e0ea84 HTTP/1.1" 200 None 2025-09-26 10:32:29,017 - lava_callback - DEBUG - Processing node 68d3c8abcd36afa834e0ea84: ltp-containers 2025-09-26 10:32:29,017 - lava_callback - ERROR - Error processing callback for node 68d3c8abcd36afa834e0ea84: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:32:29,731 - lava_callback - INFO - Received callback for node 68d3c8afcd36afa834e0ea87 INFO: 172.20.0.1:60766 - "POST /node/68d3c8afcd36afa834e0ea87 HTTP/1.0" 202 Accepted 2025-09-26 10:32:29,741 - lava_callback - INFO - Starting async job submit for node 68d3c8afcd36afa834e0ea87 2025-09-26 10:32:29,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:32:29,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c8afcd36afa834e0ea87 HTTP/1.1" 200 None 2025-09-26 10:32:29,758 - lava_callback - DEBUG - Processing node 68d3c8afcd36afa834e0ea87: ltp-controllers 2025-09-26 10:32:29,759 - lava_callback - ERROR - Error processing callback for node 68d3c8afcd36afa834e0ea87: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:32:32,327 - lava_callback - INFO - Received callback for node 68d3c8b3cd36afa834e0ea8a INFO: 172.20.0.1:60776 - "POST /node/68d3c8b3cd36afa834e0ea8a HTTP/1.0" 202 Accepted 2025-09-26 10:32:32,336 - lava_callback - INFO - Starting async job submit for node 68d3c8b3cd36afa834e0ea8a 2025-09-26 10:32:32,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:32:32,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c8b3cd36afa834e0ea8a HTTP/1.1" 200 None 2025-09-26 10:32:32,358 - lava_callback - DEBUG - Processing node 68d3c8b3cd36afa834e0ea8a: ltp-fs-bind 2025-09-26 10:32:32,358 - lava_callback - ERROR - Error processing callback for node 68d3c8b3cd36afa834e0ea8a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:32:35,063 - lava_callback - INFO - Received callback for node 68d3c8b5cd36afa834e0ea8d INFO: 172.20.0.1:60786 - "POST /node/68d3c8b5cd36afa834e0ea8d HTTP/1.0" 202 Accepted 2025-09-26 10:32:35,068 - lava_callback - INFO - Starting async job submit for node 68d3c8b5cd36afa834e0ea8d 2025-09-26 10:32:35,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:32:35,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c8b5cd36afa834e0ea8d HTTP/1.1" 200 None 2025-09-26 10:32:35,082 - lava_callback - DEBUG - Processing node 68d3c8b5cd36afa834e0ea8d: baseline-arm 2025-09-26 10:32:35,082 - lava_callback - ERROR - Error processing callback for node 68d3c8b5cd36afa834e0ea8d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:32:35,639 - lava_callback - INFO - Received callback for node 68d40a20cd36afa834e16ee5 INFO: 172.20.0.1:60802 - "POST /node/68d40a20cd36afa834e16ee5 HTTP/1.0" 202 Accepted 2025-09-26 10:32:35,645 - lava_callback - INFO - Starting async job submit for node 68d40a20cd36afa834e16ee5 2025-09-26 10:32:35,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:32:35,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a20cd36afa834e16ee5 HTTP/1.1" 200 None 2025-09-26 10:32:35,680 - lava_callback - DEBUG - Processing node 68d40a20cd36afa834e16ee5: baseline-arm 2025-09-26 10:32:35,753 - lava_callback - INFO - Received callback for node 68d3c8b7cd36afa834e0ea90 INFO: 172.20.0.1:60818 - "POST /node/68d3c8b7cd36afa834e0ea90 HTTP/1.0" 202 Accepted 2025-09-26 10:32:35,768 - lava_callback - INFO - Starting async job submit for node 68d3c8b7cd36afa834e0ea90 2025-09-26 10:32:35,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:32:35,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c8b7cd36afa834e0ea90 HTTP/1.1" 200 None 2025-09-26 10:32:35,835 - lava_callback - DEBUG - Processing node 68d3c8b7cd36afa834e0ea90: baseline-arm 2025-09-26 10:32:35,835 - lava_callback - ERROR - Error processing callback for node 68d3c8b7cd36afa834e0ea90: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:32:35,915 - lava_callback - ERROR - Error processing callback for node 68d40a20cd36afa834e16ee5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:32:36,476 - lava_callback - INFO - Received callback for node 68d3c8bacd36afa834e0ea97 INFO: 172.20.0.1:60832 - "POST /node/68d3c8bacd36afa834e0ea97 HTTP/1.0" 202 Accepted 2025-09-26 10:32:36,484 - lava_callback - INFO - Starting async job submit for node 68d3c8bacd36afa834e0ea97 2025-09-26 10:32:36,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:32:36,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c8bacd36afa834e0ea97 HTTP/1.1" 200 None 2025-09-26 10:32:36,503 - lava_callback - DEBUG - Processing node 68d3c8bacd36afa834e0ea97: baseline-arm 2025-09-26 10:32:36,503 - lava_callback - ERROR - Error processing callback for node 68d3c8bacd36afa834e0ea97: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60840 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:32:37,154 - lava_callback - INFO - Received callback for node 68d3c8bccd36afa834e0ea9a INFO: 172.20.0.1:60850 - "POST /node/68d3c8bccd36afa834e0ea9a HTTP/1.0" 202 Accepted 2025-09-26 10:32:37,163 - lava_callback - INFO - Starting async job submit for node 68d3c8bccd36afa834e0ea9a 2025-09-26 10:32:37,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:32:37,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c8bccd36afa834e0ea9a HTTP/1.1" 200 None 2025-09-26 10:32:37,177 - lava_callback - DEBUG - Processing node 68d3c8bccd36afa834e0ea9a: baseline-arm 2025-09-26 10:32:37,177 - lava_callback - ERROR - Error processing callback for node 68d3c8bccd36afa834e0ea9a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:32:39,257 - lava_callback - INFO - Received callback for node 68d3c8c4cd36afa834e0eaa4 INFO: 172.20.0.1:60866 - "POST /node/68d3c8c4cd36afa834e0eaa4 HTTP/1.0" 202 Accepted 2025-09-26 10:32:39,263 - lava_callback - INFO - Starting async job submit for node 68d3c8c4cd36afa834e0eaa4 2025-09-26 10:32:39,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:32:39,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c8c4cd36afa834e0eaa4 HTTP/1.1" 200 None 2025-09-26 10:32:39,281 - lava_callback - DEBUG - Processing node 68d3c8c4cd36afa834e0eaa4: ltp-cve 2025-09-26 10:32:39,281 - lava_callback - ERROR - Error processing callback for node 68d3c8c4cd36afa834e0eaa4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:56300 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:32:54,847 - lava_callback - INFO - Received callback for node 68d3c8c7cd36afa834e0eaaf INFO: 172.20.0.1:36864 - "POST /node/68d3c8c7cd36afa834e0eaaf HTTP/1.0" 202 Accepted 2025-09-26 10:32:54,855 - lava_callback - INFO - Starting async job submit for node 68d3c8c7cd36afa834e0eaaf 2025-09-26 10:32:54,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:32:54,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c8c7cd36afa834e0eaaf HTTP/1.1" 200 None 2025-09-26 10:32:54,871 - lava_callback - DEBUG - Processing node 68d3c8c7cd36afa834e0eaaf: baseline-arm 2025-09-26 10:32:54,871 - lava_callback - ERROR - Error processing callback for node 68d3c8c7cd36afa834e0eaaf: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:32:56,149 - lava_callback - INFO - Received callback for node 68d3c8cacd36afa834e0eacd INFO: 172.20.0.1:36878 - "POST /node/68d3c8cacd36afa834e0eacd HTTP/1.0" 202 Accepted 2025-09-26 10:32:56,154 - lava_callback - INFO - Starting async job submit for node 68d3c8cacd36afa834e0eacd 2025-09-26 10:32:56,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:32:56,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c8cacd36afa834e0eacd HTTP/1.1" 200 None 2025-09-26 10:32:56,194 - lava_callback - DEBUG - Processing node 68d3c8cacd36afa834e0eacd: baseline-arm 2025-09-26 10:32:56,194 - lava_callback - ERROR - Error processing callback for node 68d3c8cacd36afa834e0eacd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:36894 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:32:56,840 - lava_callback - INFO - Received callback for node 68d3c8d4cd36afa834e0eadd INFO: 172.20.0.1:36910 - "POST /node/68d3c8d4cd36afa834e0eadd HTTP/1.0" 202 Accepted 2025-09-26 10:32:56,846 - lava_callback - INFO - Starting async job submit for node 68d3c8d4cd36afa834e0eadd 2025-09-26 10:32:56,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:32:56,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c8d4cd36afa834e0eadd HTTP/1.1" 200 None 2025-09-26 10:32:56,860 - lava_callback - DEBUG - Processing node 68d3c8d4cd36afa834e0eadd: baseline-arm 2025-09-26 10:32:56,860 - lava_callback - ERROR - Error processing callback for node 68d3c8d4cd36afa834e0eadd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:43292 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:33:09,831 - lava_callback - INFO - Received callback for node 68d3c8d2cd36afa834e0eada INFO: 172.20.0.1:47420 - "POST /node/68d3c8d2cd36afa834e0eada HTTP/1.0" 202 Accepted 2025-09-26 10:33:09,841 - lava_callback - INFO - Starting async job submit for node 68d3c8d2cd36afa834e0eada 2025-09-26 10:33:09,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:09,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c8d2cd36afa834e0eada HTTP/1.1" 200 None 2025-09-26 10:33:09,872 - lava_callback - DEBUG - Processing node 68d3c8d2cd36afa834e0eada: ltp-controllers 2025-09-26 10:33:09,872 - lava_callback - ERROR - Error processing callback for node 68d3c8d2cd36afa834e0eada: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:47430 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:33:14,624 - lava_callback - INFO - Received callback for node 68d3c8d6cd36afa834e0eae0 INFO: 172.20.0.1:47438 - "POST /node/68d3c8d6cd36afa834e0eae0 HTTP/1.0" 202 Accepted 2025-09-26 10:33:14,633 - lava_callback - INFO - Starting async job submit for node 68d3c8d6cd36afa834e0eae0 2025-09-26 10:33:14,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:14,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c8d6cd36afa834e0eae0 HTTP/1.1" 200 None 2025-09-26 10:33:14,647 - lava_callback - DEBUG - Processing node 68d3c8d6cd36afa834e0eae0: baseline-arm 2025-09-26 10:33:14,647 - lava_callback - ERROR - Error processing callback for node 68d3c8d6cd36afa834e0eae0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:47454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60974 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:33:19,989 - lava_callback - INFO - Received callback for node 68d3c8e5cd36afa834e0eb51 INFO: 172.20.0.1:60988 - "POST /node/68d3c8e5cd36afa834e0eb51 HTTP/1.0" 202 Accepted 2025-09-26 10:33:19,995 - lava_callback - INFO - Starting async job submit for node 68d3c8e5cd36afa834e0eb51 2025-09-26 10:33:19,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:20,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c8e5cd36afa834e0eb51 HTTP/1.1" 200 None 2025-09-26 10:33:20,012 - lava_callback - DEBUG - Processing node 68d3c8e5cd36afa834e0eb51: ltp-fsx 2025-09-26 10:33:20,012 - lava_callback - ERROR - Error processing callback for node 68d3c8e5cd36afa834e0eb51: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:33:20,753 - lava_callback - INFO - Received callback for node 68d3c8e7cd36afa834e0eb54 INFO: 172.20.0.1:32768 - "POST /node/68d3c8e7cd36afa834e0eb54 HTTP/1.0" 202 Accepted 2025-09-26 10:33:20,759 - lava_callback - INFO - Starting async job submit for node 68d3c8e7cd36afa834e0eb54 2025-09-26 10:33:20,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:20,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c8e7cd36afa834e0eb54 HTTP/1.1" 200 None 2025-09-26 10:33:20,772 - lava_callback - DEBUG - Processing node 68d3c8e7cd36afa834e0eb54: ltp-cve 2025-09-26 10:33:20,772 - lava_callback - ERROR - Error processing callback for node 68d3c8e7cd36afa834e0eb54: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:32770 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:33:28,444 - lava_callback - INFO - Received callback for node 68d3c8f3cd36afa834e0eb63 INFO: 172.20.0.1:32774 - "POST /node/68d3c8f3cd36afa834e0eb63 HTTP/1.0" 202 Accepted 2025-09-26 10:33:28,452 - lava_callback - INFO - Starting async job submit for node 68d3c8f3cd36afa834e0eb63 2025-09-26 10:33:28,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:28,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c8f3cd36afa834e0eb63 HTTP/1.1" 200 None 2025-09-26 10:33:28,467 - lava_callback - DEBUG - Processing node 68d3c8f3cd36afa834e0eb63: ltp-input 2025-09-26 10:33:28,468 - lava_callback - ERROR - Error processing callback for node 68d3c8f3cd36afa834e0eb63: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:33:30,796 - lava_callback - INFO - Received callback for node 68d66baa2f83206171a90448 INFO: 172.20.0.1:44096 - "POST /node/68d66baa2f83206171a90448 HTTP/1.0" 202 Accepted 2025-09-26 10:33:30,804 - lava_callback - INFO - Starting async job submit for node 68d66baa2f83206171a90448 2025-09-26 10:33:30,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:30,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66baa2f83206171a90448 HTTP/1.1" 200 None 2025-09-26 10:33:30,835 - lava_callback - DEBUG - Processing node 68d66baa2f83206171a90448: baseline-x86 2025-09-26 10:33:31,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:33:32,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:33:32,113 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d66baa2f83206171a90448/log.txt.gz 2025-09-26 10:33:32,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:33:34,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:33:34,637 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d66baa2f83206171a90448/lava_callback.json.gz 2025-09-26 10:33:34,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:34,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66baa2f83206171a90448 HTTP/1.1" 200 None 2025-09-26 10:33:34,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:34,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56829b70fb2a1e20f281e HTTP/1.1" 200 None 2025-09-26 10:33:34,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:34,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66baa2f83206171a90448 HTTP/1.1" 200 None 2025-09-26 10:33:34,730 - lava_callback - INFO - Completed processing callback for node 68d66baa2f83206171a90448 INFO: 172.20.0.1:44106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55376 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:33:54,785 - lava_callback - INFO - Received callback for node 68d66bb22f83206171a90454 INFO: 172.20.0.1:60844 - "POST /node/68d66bb22f83206171a90454 HTTP/1.0" 202 Accepted 2025-09-26 10:33:54,795 - lava_callback - INFO - Starting async job submit for node 68d66bb22f83206171a90454 2025-09-26 10:33:54,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:54,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66bb22f83206171a90454 HTTP/1.1" 200 None 2025-09-26 10:33:54,845 - lava_callback - DEBUG - Processing node 68d66bb22f83206171a90454: baseline-arm 2025-09-26 10:33:55,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:60846 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:33:56,944 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:33:56,944 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66bb22f83206171a90454/log.txt.gz 2025-09-26 10:33:56,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:33:57,309 - lava_callback - INFO - Received callback for node 68d66bb82f83206171a9045d INFO: 172.20.0.1:60848 - "POST /node/68d66bb82f83206171a9045d HTTP/1.0" 202 Accepted 2025-09-26 10:33:57,318 - lava_callback - INFO - Starting async job submit for node 68d66bb82f83206171a9045d 2025-09-26 10:33:57,335 - lava_callback - INFO - Received callback for node 68d66bb62f83206171a9045a 2025-09-26 10:33:57,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:60852 - "POST /node/68d66bb62f83206171a9045a HTTP/1.0" 202 Accepted 2025-09-26 10:33:57,348 - lava_callback - INFO - Starting async job submit for node 68d66bb62f83206171a9045a 2025-09-26 10:33:57,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:57,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66bb82f83206171a9045d HTTP/1.1" 200 None 2025-09-26 10:33:57,389 - lava_callback - DEBUG - Processing node 68d66bb82f83206171a9045d: baseline-arm 2025-09-26 10:33:57,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66bb62f83206171a9045a HTTP/1.1" 200 None 2025-09-26 10:33:57,471 - lava_callback - DEBUG - Processing node 68d66bb62f83206171a9045a: baseline-arm 2025-09-26 10:33:57,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:33:57,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:33:58,524 - lava_callback - INFO - Received callback for node 68d66bbb2f83206171a90460 INFO: 172.20.0.1:60860 - "POST /node/68d66bbb2f83206171a90460 HTTP/1.0" 202 Accepted 2025-09-26 10:33:58,530 - lava_callback - INFO - Starting async job submit for node 68d66bbb2f83206171a90460 2025-09-26 10:33:58,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:58,563 - lava_callback - INFO - Received callback for node 68d66bb02f83206171a9044e 2025-09-26 10:33:58,569 - lava_callback - INFO - Starting async job submit for node 68d66bb02f83206171a9044e INFO: 172.20.0.1:60870 - "POST /node/68d66bb02f83206171a9044e HTTP/1.0" 202 Accepted 2025-09-26 10:33:58,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:58,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66bbb2f83206171a90460 HTTP/1.1" 200 None 2025-09-26 10:33:58,618 - lava_callback - DEBUG - Processing node 68d66bbb2f83206171a90460: baseline-arm 2025-09-26 10:33:58,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66bb02f83206171a9044e HTTP/1.1" 200 None 2025-09-26 10:33:58,639 - lava_callback - DEBUG - Processing node 68d66bb02f83206171a9044e: baseline-arm 2025-09-26 10:33:59,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:33:59,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:33:59,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:33:59,483 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66bbb2f83206171a90460/log.txt.gz 2025-09-26 10:33:59,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:33:59,516 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:33:59,517 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66bb82f83206171a9045d/log.txt.gz 2025-09-26 10:33:59,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:33:59,556 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:33:59,557 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66bb02f83206171a9044e/log.txt.gz 2025-09-26 10:33:59,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:33:59,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:33:59,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:33:59,603 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66bb22f83206171a90454/lava_callback.json.gz 2025-09-26 10:33:59,608 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66bb62f83206171a9045a/log.txt.gz 2025-09-26 10:33:59,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:33:59,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:59,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66bb22f83206171a90454 HTTP/1.1" 200 None 2025-09-26 10:33:59,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:59,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:33:59,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:59,710 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:33:59,711 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66bbb2f83206171a90460/lava_callback.json.gz 2025-09-26 10:33:59,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:33:59,744 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66bb82f83206171a9045d/lava_callback.json.gz 2025-09-26 10:33:59,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66bb22f83206171a90454 HTTP/1.1" 200 None 2025-09-26 10:33:59,756 - lava_callback - INFO - Completed processing callback for node 68d66bb22f83206171a90454 2025-09-26 10:33:59,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:59,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:59,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66bb82f83206171a9045d HTTP/1.1" 200 None 2025-09-26 10:33:59,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:59,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66bbb2f83206171a90460 HTTP/1.1" 200 None 2025-09-26 10:33:59,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:59,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:33:59,867 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66bb02f83206171a9044e/lava_callback.json.gz 2025-09-26 10:33:59,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:59,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:33:59,913 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66bb62f83206171a9045a/lava_callback.json.gz 2025-09-26 10:33:59,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:33:59,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:59,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:33:59,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:59,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:59,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66bb02f83206171a9044e HTTP/1.1" 200 None 2025-09-26 10:33:59,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:59,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66bb62f83206171a9045a HTTP/1.1" 200 None 2025-09-26 10:33:59,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:33:59,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:33:59,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:00,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66bbb2f83206171a90460 HTTP/1.1" 200 None 2025-09-26 10:34:00,007 - lava_callback - INFO - Completed processing callback for node 68d66bbb2f83206171a90460 2025-09-26 10:34:00,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:34:00,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:00,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66bb82f83206171a9045d HTTP/1.1" 200 None 2025-09-26 10:34:00,040 - lava_callback - INFO - Completed processing callback for node 68d66bb82f83206171a9045d 2025-09-26 10:34:00,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66bb02f83206171a9044e HTTP/1.1" 200 None 2025-09-26 10:34:00,107 - lava_callback - INFO - Completed processing callback for node 68d66bb02f83206171a9044e 2025-09-26 10:34:00,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66bb62f83206171a9045a HTTP/1.1" 200 None 2025-09-26 10:34:00,120 - lava_callback - INFO - Completed processing callback for node 68d66bb62f83206171a9045a 2025-09-26 10:34:00,999 - lava_callback - INFO - Received callback for node 68d66bb02f83206171a90451 INFO: 172.20.0.1:48566 - "POST /node/68d66bb02f83206171a90451 HTTP/1.0" 202 Accepted 2025-09-26 10:34:01,005 - lava_callback - INFO - Starting async job submit for node 68d66bb02f83206171a90451 2025-09-26 10:34:01,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:01,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66bb02f83206171a90451 HTTP/1.1" 200 None 2025-09-26 10:34:01,047 - lava_callback - DEBUG - Processing node 68d66bb02f83206171a90451: baseline-arm 2025-09-26 10:34:01,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:34:01,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:34:01,445 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66bb02f83206171a90451/log.txt.gz 2025-09-26 10:34:01,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:34:01,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:34:01,631 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66bb02f83206171a90451/lava_callback.json.gz 2025-09-26 10:34:01,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:01,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66bb02f83206171a90451 HTTP/1.1" 200 None 2025-09-26 10:34:01,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:01,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:34:01,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:01,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66bb02f83206171a90451 HTTP/1.1" 200 None 2025-09-26 10:34:01,747 - lava_callback - INFO - Completed processing callback for node 68d66bb02f83206171a90451 2025-09-26 10:34:02,268 - lava_callback - INFO - Received callback for node 68d66bb22f83206171a90457 INFO: 172.20.0.1:48568 - "POST /node/68d66bb22f83206171a90457 HTTP/1.0" 202 Accepted 2025-09-26 10:34:02,274 - lava_callback - INFO - Starting async job submit for node 68d66bb22f83206171a90457 2025-09-26 10:34:02,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:02,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66bb22f83206171a90457 HTTP/1.1" 200 None 2025-09-26 10:34:02,308 - lava_callback - DEBUG - Processing node 68d66bb22f83206171a90457: baseline-arm 2025-09-26 10:34:02,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:34:02,702 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:34:02,703 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66bb22f83206171a90457/log.txt.gz 2025-09-26 10:34:02,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:34:05,262 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:34:05,263 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66bb22f83206171a90457/lava_callback.json.gz 2025-09-26 10:34:05,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:05,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66bb22f83206171a90457 HTTP/1.1" 200 None 2025-09-26 10:34:05,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:05,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:34:05,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:05,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66bb22f83206171a90457 HTTP/1.1" 200 None 2025-09-26 10:34:05,351 - lava_callback - INFO - Completed processing callback for node 68d66bb22f83206171a90457 INFO: 172.20.0.1:48576 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:34:08,407 - lava_callback - INFO - Received callback for node 68d3c90ecd36afa834e0eb9c INFO: 172.20.0.1:48582 - "POST /node/68d3c90ecd36afa834e0eb9c HTTP/1.0" 202 Accepted 2025-09-26 10:34:08,417 - lava_callback - INFO - Starting async job submit for node 68d3c90ecd36afa834e0eb9c 2025-09-26 10:34:08,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:08,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c90ecd36afa834e0eb9c HTTP/1.1" 200 None 2025-09-26 10:34:08,443 - lava_callback - DEBUG - Processing node 68d3c90ecd36afa834e0eb9c: ltp-timers 2025-09-26 10:34:08,443 - lava_callback - ERROR - Error processing callback for node 68d3c90ecd36afa834e0eb9c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:34:09,178 - lava_callback - INFO - Received callback for node 68d3c91fcd36afa834e0ebb4 INFO: 172.20.0.1:48596 - "POST /node/68d3c91fcd36afa834e0ebb4 HTTP/1.0" 202 Accepted 2025-09-26 10:34:09,185 - lava_callback - INFO - Starting async job submit for node 68d3c91fcd36afa834e0ebb4 2025-09-26 10:34:09,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:09,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c91fcd36afa834e0ebb4 HTTP/1.1" 200 None 2025-09-26 10:34:09,200 - lava_callback - DEBUG - Processing node 68d3c91fcd36afa834e0ebb4: ltp-watchqueue 2025-09-26 10:34:09,200 - lava_callback - ERROR - Error processing callback for node 68d3c91fcd36afa834e0ebb4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:40198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52570 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:34:28,444 - lava_callback - INFO - Received callback for node 68d3c922cd36afa834e0ebb7 INFO: 172.20.0.1:52574 - "POST /node/68d3c922cd36afa834e0ebb7 HTTP/1.0" 202 Accepted 2025-09-26 10:34:28,453 - lava_callback - INFO - Starting async job submit for node 68d3c922cd36afa834e0ebb7 2025-09-26 10:34:28,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:28,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c922cd36afa834e0ebb7 HTTP/1.1" 200 None 2025-09-26 10:34:28,471 - lava_callback - DEBUG - Processing node 68d3c922cd36afa834e0ebb7: ltp-cve 2025-09-26 10:34:28,471 - lava_callback - ERROR - Error processing callback for node 68d3c922cd36afa834e0ebb7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:52382 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:34:42,699 - lava_callback - INFO - Received callback for node 68d66c0b2f83206171a904c0 INFO: 172.20.0.1:59300 - "POST /node/68d66c0b2f83206171a904c0 HTTP/1.0" 202 Accepted 2025-09-26 10:34:42,707 - lava_callback - INFO - Starting async job submit for node 68d66c0b2f83206171a904c0 2025-09-26 10:34:42,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:42,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c0b2f83206171a904c0 HTTP/1.1" 200 None 2025-09-26 10:34:42,743 - lava_callback - DEBUG - Processing node 68d66c0b2f83206171a904c0: baseline-arm 2025-09-26 10:34:43,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:34:44,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:34:44,566 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c0b2f83206171a904c0/log.txt.gz 2025-09-26 10:34:44,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:34:44,851 - lava_callback - INFO - Received callback for node 68d66c092f83206171a904bd INFO: 172.20.0.1:59308 - "POST /node/68d66c092f83206171a904bd HTTP/1.0" 202 Accepted 2025-09-26 10:34:44,860 - lava_callback - INFO - Starting async job submit for node 68d66c092f83206171a904bd 2025-09-26 10:34:44,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:44,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c092f83206171a904bd HTTP/1.1" 200 None 2025-09-26 10:34:44,947 - lava_callback - DEBUG - Processing node 68d66c092f83206171a904bd: baseline-arm 2025-09-26 10:34:45,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:59316 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:34:46,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:34:46,966 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c0b2f83206171a904c0/lava_callback.json.gz 2025-09-26 10:34:46,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:46,994 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:34:46,995 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c092f83206171a904bd/log.txt.gz 2025-09-26 10:34:47,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:34:47,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c0b2f83206171a904c0 HTTP/1.1" 200 None 2025-09-26 10:34:47,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:47,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:34:47,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:47,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c0b2f83206171a904c0 HTTP/1.1" 200 None 2025-09-26 10:34:47,077 - lava_callback - INFO - Completed processing callback for node 68d66c0b2f83206171a904c0 2025-09-26 10:34:47,239 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:34:47,240 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c092f83206171a904bd/lava_callback.json.gz 2025-09-26 10:34:47,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:47,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c092f83206171a904bd HTTP/1.1" 200 None 2025-09-26 10:34:47,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:47,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:34:47,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:47,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c092f83206171a904bd HTTP/1.1" 200 None 2025-09-26 10:34:47,363 - lava_callback - INFO - Completed processing callback for node 68d66c092f83206171a904bd 2025-09-26 10:34:48,474 - lava_callback - INFO - Received callback for node 68d3c93bcd36afa834e0ebf4 INFO: 172.20.0.1:59322 - "POST /node/68d3c93bcd36afa834e0ebf4 HTTP/1.0" 202 Accepted 2025-09-26 10:34:48,482 - lava_callback - INFO - Starting async job submit for node 68d3c93bcd36afa834e0ebf4 2025-09-26 10:34:48,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:48,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c93bcd36afa834e0ebf4 HTTP/1.1" 200 None 2025-09-26 10:34:48,495 - lava_callback - DEBUG - Processing node 68d3c93bcd36afa834e0ebf4: ltp-watchqueue 2025-09-26 10:34:48,495 - lava_callback - ERROR - Error processing callback for node 68d3c93bcd36afa834e0ebf4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:34:55,319 - lava_callback - INFO - Received callback for node 68d3c93ccd36afa834e0ebfe INFO: 172.20.0.1:55424 - "POST /node/68d3c93ccd36afa834e0ebfe HTTP/1.0" 202 Accepted 2025-09-26 10:34:55,326 - lava_callback - INFO - Starting async job submit for node 68d3c93ccd36afa834e0ebfe 2025-09-26 10:34:55,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:55,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c93ccd36afa834e0ebfe HTTP/1.1" 200 None 2025-09-26 10:34:55,342 - lava_callback - DEBUG - Processing node 68d3c93ccd36afa834e0ebfe: baseline-arm 2025-09-26 10:34:55,342 - lava_callback - ERROR - Error processing callback for node 68d3c93ccd36afa834e0ebfe: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:34:56,024 - lava_callback - INFO - Received callback for node 68d3c93dcd36afa834e0ec04 INFO: 172.20.0.1:55428 - "POST /node/68d3c93dcd36afa834e0ec04 HTTP/1.0" 202 Accepted 2025-09-26 10:34:56,031 - lava_callback - INFO - Starting async job submit for node 68d3c93dcd36afa834e0ec04 2025-09-26 10:34:56,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:56,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c93dcd36afa834e0ec04 HTTP/1.1" 200 None 2025-09-26 10:34:56,046 - lava_callback - DEBUG - Processing node 68d3c93dcd36afa834e0ec04: baseline-arm 2025-09-26 10:34:56,046 - lava_callback - ERROR - Error processing callback for node 68d3c93dcd36afa834e0ec04: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:55444 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:34:56,749 - lava_callback - INFO - Received callback for node 68d3c940cd36afa834e0ec0e INFO: 172.20.0.1:55450 - "POST /node/68d3c940cd36afa834e0ec0e HTTP/1.0" 202 Accepted 2025-09-26 10:34:56,757 - lava_callback - INFO - Starting async job submit for node 68d3c940cd36afa834e0ec0e 2025-09-26 10:34:56,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:56,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c940cd36afa834e0ec0e HTTP/1.1" 200 None 2025-09-26 10:34:56,773 - lava_callback - DEBUG - Processing node 68d3c940cd36afa834e0ec0e: baseline-arm 2025-09-26 10:34:56,773 - lava_callback - ERROR - Error processing callback for node 68d3c940cd36afa834e0ec0e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:34:57,444 - lava_callback - INFO - Received callback for node 68d3c942cd36afa834e0ec16 INFO: 172.20.0.1:55462 - "POST /node/68d3c942cd36afa834e0ec16 HTTP/1.0" 202 Accepted 2025-09-26 10:34:57,452 - lava_callback - INFO - Starting async job submit for node 68d3c942cd36afa834e0ec16 2025-09-26 10:34:57,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:34:57,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c942cd36afa834e0ec16 HTTP/1.1" 200 None 2025-09-26 10:34:57,483 - lava_callback - DEBUG - Processing node 68d3c942cd36afa834e0ec16: baseline-arm 2025-09-26 10:34:57,483 - lava_callback - ERROR - Error processing callback for node 68d3c942cd36afa834e0ec16: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:35:00,159 - lava_callback - INFO - Received callback for node 68d3c944cd36afa834e0ec1d INFO: 172.20.0.1:44368 - "POST /node/68d3c944cd36afa834e0ec1d HTTP/1.0" 202 Accepted 2025-09-26 10:35:00,166 - lava_callback - INFO - Starting async job submit for node 68d3c944cd36afa834e0ec1d 2025-09-26 10:35:00,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:00,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c944cd36afa834e0ec1d HTTP/1.1" 200 None 2025-09-26 10:35:00,189 - lava_callback - DEBUG - Processing node 68d3c944cd36afa834e0ec1d: baseline-arm64-baylibre 2025-09-26 10:35:00,189 - lava_callback - ERROR - Error processing callback for node 68d3c944cd36afa834e0ec1d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:35:02,889 - lava_callback - INFO - Received callback for node 68d40a23cd36afa834e16ee8 INFO: 172.20.0.1:44370 - "POST /node/68d40a23cd36afa834e16ee8 HTTP/1.0" 202 Accepted 2025-09-26 10:35:02,898 - lava_callback - INFO - Starting async job submit for node 68d40a23cd36afa834e16ee8 2025-09-26 10:35:02,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:02,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a23cd36afa834e16ee8 HTTP/1.1" 200 None 2025-09-26 10:35:02,946 - lava_callback - DEBUG - Processing node 68d40a23cd36afa834e16ee8: baseline-arm 2025-09-26 10:35:03,347 - lava_callback - ERROR - Error processing callback for node 68d40a23cd36afa834e16ee8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:44378 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:35:08,541 - lava_callback - INFO - Received callback for node 68d3c959cd36afa834e0ec7e INFO: 172.20.0.1:44380 - "POST /node/68d3c959cd36afa834e0ec7e HTTP/1.0" 202 Accepted 2025-09-26 10:35:08,547 - lava_callback - INFO - Starting async job submit for node 68d3c959cd36afa834e0ec7e 2025-09-26 10:35:08,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:08,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c959cd36afa834e0ec7e HTTP/1.1" 200 None 2025-09-26 10:35:08,571 - lava_callback - DEBUG - Processing node 68d3c959cd36afa834e0ec7e: ltp-fsx 2025-09-26 10:35:08,571 - lava_callback - ERROR - Error processing callback for node 68d3c959cd36afa834e0ec7e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51040 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 10:35:15,413 - lava_callback - INFO - Received callback for node 68d3c95fcd36afa834e0ec9b INFO: 172.20.0.1:51050 - "POST /node/68d3c95fcd36afa834e0ec9b HTTP/1.0" 202 Accepted 2025-09-26 10:35:15,420 - lava_callback - INFO - Starting async job submit for node 68d3c95fcd36afa834e0ec9b 2025-09-26 10:35:15,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:15,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c95fcd36afa834e0ec9b HTTP/1.1" 200 None 2025-09-26 10:35:15,436 - lava_callback - DEBUG - Processing node 68d3c95fcd36afa834e0ec9b: baseline-arm 2025-09-26 10:35:15,436 - lava_callback - ERROR - Error processing callback for node 68d3c95fcd36afa834e0ec9b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:35:16,124 - lava_callback - INFO - Received callback for node 68d3c960cd36afa834e0eca1 INFO: 172.20.0.1:51064 - "POST /node/68d3c960cd36afa834e0eca1 HTTP/1.0" 202 Accepted 2025-09-26 10:35:16,133 - lava_callback - INFO - Starting async job submit for node 68d3c960cd36afa834e0eca1 2025-09-26 10:35:16,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:16,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c960cd36afa834e0eca1 HTTP/1.1" 200 None 2025-09-26 10:35:16,156 - lava_callback - DEBUG - Processing node 68d3c960cd36afa834e0eca1: baseline-arm 2025-09-26 10:35:16,157 - lava_callback - ERROR - Error processing callback for node 68d3c960cd36afa834e0eca1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:51076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50964 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:35:20,176 - lava_callback - INFO - Received callback for node 68d3c954cd36afa834e0ec72 INFO: 172.20.0.1:50970 - "POST /node/68d3c954cd36afa834e0ec72 HTTP/1.0" 202 Accepted 2025-09-26 10:35:20,186 - lava_callback - INFO - Starting async job submit for node 68d3c954cd36afa834e0ec72 2025-09-26 10:35:20,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:20,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c954cd36afa834e0ec72 HTTP/1.1" 200 None 2025-09-26 10:35:20,221 - lava_callback - DEBUG - Processing node 68d3c954cd36afa834e0ec72: baseline-arm64-baylibre 2025-09-26 10:35:20,221 - lava_callback - ERROR - Error processing callback for node 68d3c954cd36afa834e0ec72: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:50972 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:35:32,307 - lava_callback - INFO - Received callback for node 68d3c966cd36afa834e0ecba INFO: 172.20.0.1:37242 - "POST /node/68d3c966cd36afa834e0ecba HTTP/1.0" 202 Accepted 2025-09-26 10:35:32,315 - lava_callback - INFO - Starting async job submit for node 68d3c966cd36afa834e0ecba 2025-09-26 10:35:32,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:32,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c966cd36afa834e0ecba HTTP/1.1" 200 None 2025-09-26 10:35:32,331 - lava_callback - DEBUG - Processing node 68d3c966cd36afa834e0ecba: baseline-arm64-clabbe 2025-09-26 10:35:32,331 - lava_callback - ERROR - Error processing callback for node 68d3c966cd36afa834e0ecba: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:35:32,985 - lava_callback - INFO - Received callback for node 68d3c963cd36afa834e0ecab INFO: 172.20.0.1:37254 - "POST /node/68d3c963cd36afa834e0ecab HTTP/1.0" 202 Accepted 2025-09-26 10:35:32,992 - lava_callback - INFO - Starting async job submit for node 68d3c963cd36afa834e0ecab 2025-09-26 10:35:32,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:33,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c963cd36afa834e0ecab HTTP/1.1" 200 None 2025-09-26 10:35:33,006 - lava_callback - DEBUG - Processing node 68d3c963cd36afa834e0ecab: baseline-arm64-clabbe 2025-09-26 10:35:33,006 - lava_callback - ERROR - Error processing callback for node 68d3c963cd36afa834e0ecab: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:35:33,643 - lava_callback - INFO - Received callback for node 68d3c96acd36afa834e0ecc0 INFO: 172.20.0.1:37264 - "POST /node/68d3c96acd36afa834e0ecc0 HTTP/1.0" 202 Accepted 2025-09-26 10:35:33,651 - lava_callback - INFO - Starting async job submit for node 68d3c96acd36afa834e0ecc0 2025-09-26 10:35:33,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:33,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c96acd36afa834e0ecc0 HTTP/1.1" 200 None 2025-09-26 10:35:33,670 - lava_callback - DEBUG - Processing node 68d3c96acd36afa834e0ecc0: baseline-arm64-clabbe 2025-09-26 10:35:33,670 - lava_callback - ERROR - Error processing callback for node 68d3c96acd36afa834e0ecc0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:35:33,843 - lava_callback - INFO - Received callback for node 68d66c212f83206171a90500 INFO: 172.20.0.1:37278 - "POST /node/68d66c212f83206171a90500 HTTP/1.0" 202 Accepted 2025-09-26 10:35:33,852 - lava_callback - INFO - Starting async job submit for node 68d66c212f83206171a90500 2025-09-26 10:35:33,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:33,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c212f83206171a90500 HTTP/1.1" 200 None 2025-09-26 10:35:33,913 - lava_callback - DEBUG - Processing node 68d66c212f83206171a90500: baseline-arm 2025-09-26 10:35:34,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:35:34,305 - lava_callback - INFO - Received callback for node 68d3c96bcd36afa834e0ecc6 INFO: 172.20.0.1:37282 - "POST /node/68d3c96bcd36afa834e0ecc6 HTTP/1.0" 202 Accepted 2025-09-26 10:35:34,316 - lava_callback - INFO - Starting async job submit for node 68d3c96bcd36afa834e0ecc6 2025-09-26 10:35:34,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:34,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c96bcd36afa834e0ecc6 HTTP/1.1" 200 None 2025-09-26 10:35:34,362 - lava_callback - DEBUG - Processing node 68d3c96bcd36afa834e0ecc6: baseline-arm64-clabbe 2025-09-26 10:35:34,363 - lava_callback - ERROR - Error processing callback for node 68d3c96bcd36afa834e0ecc6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:35:34,693 - lava_callback - INFO - Received callback for node 68d3c963cd36afa834e0ecad INFO: 172.20.0.1:37294 - "POST /node/68d3c963cd36afa834e0ecad HTTP/1.0" 202 Accepted 2025-09-26 10:35:34,702 - lava_callback - INFO - Starting async job submit for node 68d3c963cd36afa834e0ecad 2025-09-26 10:35:34,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:34,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c963cd36afa834e0ecad HTTP/1.1" 200 None 2025-09-26 10:35:34,716 - lava_callback - DEBUG - Processing node 68d3c963cd36afa834e0ecad: baseline-arm 2025-09-26 10:35:34,716 - lava_callback - ERROR - Error processing callback for node 68d3c963cd36afa834e0ecad: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:35:34,979 - lava_callback - INFO - Received callback for node 68d3c96ccd36afa834e0ecc9 INFO: 172.20.0.1:37308 - "POST /node/68d3c96ccd36afa834e0ecc9 HTTP/1.0" 202 Accepted 2025-09-26 10:35:34,988 - lava_callback - INFO - Starting async job submit for node 68d3c96ccd36afa834e0ecc9 2025-09-26 10:35:34,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:35,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c96ccd36afa834e0ecc9 HTTP/1.1" 200 None 2025-09-26 10:35:35,004 - lava_callback - DEBUG - Processing node 68d3c96ccd36afa834e0ecc9: baseline-arm64-clabbe 2025-09-26 10:35:35,004 - lava_callback - ERROR - Error processing callback for node 68d3c96ccd36afa834e0ecc9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:35:35,202 - lava_callback - INFO - Received callback for node 68d66c1f2f83206171a904f7 INFO: 172.20.0.1:37316 - "POST /node/68d66c1f2f83206171a904f7 HTTP/1.0" 202 Accepted 2025-09-26 10:35:35,211 - lava_callback - INFO - Starting async job submit for node 68d66c1f2f83206171a904f7 2025-09-26 10:35:35,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:35,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c1f2f83206171a904f7 HTTP/1.1" 200 None 2025-09-26 10:35:35,275 - lava_callback - DEBUG - Processing node 68d66c1f2f83206171a904f7: baseline-arm 2025-09-26 10:35:35,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:35:35,385 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c212f83206171a90500/log.txt.gz 2025-09-26 10:35:35,413 - lava_callback - INFO - Received callback for node 68d3c964cd36afa834e0ecb0 INFO: 172.20.0.1:37328 - "POST /node/68d3c964cd36afa834e0ecb0 HTTP/1.0" 202 Accepted 2025-09-26 10:35:35,429 - lava_callback - INFO - Starting async job submit for node 68d3c964cd36afa834e0ecb0 2025-09-26 10:35:35,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:35,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:35:35,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c964cd36afa834e0ecb0 HTTP/1.1" 200 None 2025-09-26 10:35:35,539 - lava_callback - DEBUG - Processing node 68d3c964cd36afa834e0ecb0: baseline-arm 2025-09-26 10:35:35,544 - lava_callback - ERROR - Error processing callback for node 68d3c964cd36afa834e0ecb0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:35:35,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:35:35,744 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:35:35,745 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c212f83206171a90500/lava_callback.json.gz 2025-09-26 10:35:35,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:35,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c212f83206171a90500 HTTP/1.1" 200 None 2025-09-26 10:35:35,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:35,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:35:35,798 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c1f2f83206171a904f7/log.txt.gz 2025-09-26 10:35:35,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:35:35,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:35:35,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:35,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c212f83206171a90500 HTTP/1.1" 200 None 2025-09-26 10:35:35,889 - lava_callback - INFO - Completed processing callback for node 68d66c212f83206171a90500 2025-09-26 10:35:36,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:35:36,055 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c1f2f83206171a904f7/lava_callback.json.gz 2025-09-26 10:35:36,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:36,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c1f2f83206171a904f7 HTTP/1.1" 200 None 2025-09-26 10:35:36,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:36,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:35:36,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:36,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c1f2f83206171a904f7 HTTP/1.1" 200 None 2025-09-26 10:35:36,189 - lava_callback - INFO - Completed processing callback for node 68d66c1f2f83206171a904f7 2025-09-26 10:35:36,441 - lava_callback - INFO - Received callback for node 68d66c1d2f83206171a904f4 INFO: 172.20.0.1:37342 - "POST /node/68d66c1d2f83206171a904f4 HTTP/1.0" 202 Accepted 2025-09-26 10:35:36,448 - lava_callback - INFO - Starting async job submit for node 68d66c1d2f83206171a904f4 2025-09-26 10:35:36,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:36,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c1d2f83206171a904f4 HTTP/1.1" 200 None 2025-09-26 10:35:36,492 - lava_callback - DEBUG - Processing node 68d66c1d2f83206171a904f4: baseline-arm INFO: 172.20.0.1:37358 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:35:36,705 - lava_callback - INFO - Received callback for node 68d66c1b2f83206171a904ed INFO: 172.20.0.1:37370 - "POST /node/68d66c1b2f83206171a904ed HTTP/1.0" 202 Accepted 2025-09-26 10:35:36,714 - lava_callback - INFO - Starting async job submit for node 68d66c1b2f83206171a904ed 2025-09-26 10:35:36,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:36,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c1b2f83206171a904ed HTTP/1.1" 200 None 2025-09-26 10:35:36,838 - lava_callback - DEBUG - Processing node 68d66c1b2f83206171a904ed: baseline-arm 2025-09-26 10:35:36,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:35:37,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:35:37,219 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c1d2f83206171a904f4/log.txt.gz 2025-09-26 10:35:37,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:35:37,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:35:37,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:35:37,385 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c1d2f83206171a904f4/lava_callback.json.gz 2025-09-26 10:35:37,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:35:37,397 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c1b2f83206171a904ed/log.txt.gz 2025-09-26 10:35:37,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:35:37,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:37,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c1d2f83206171a904f4 HTTP/1.1" 200 None 2025-09-26 10:35:37,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:37,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:35:37,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:37,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c1d2f83206171a904f4 HTTP/1.1" 200 None 2025-09-26 10:35:37,531 - lava_callback - INFO - Completed processing callback for node 68d66c1d2f83206171a904f4 2025-09-26 10:35:37,647 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:35:37,648 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c1b2f83206171a904ed/lava_callback.json.gz 2025-09-26 10:35:37,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:37,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c1b2f83206171a904ed HTTP/1.1" 200 None 2025-09-26 10:35:37,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:37,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:35:37,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:37,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c1b2f83206171a904ed HTTP/1.1" 200 None 2025-09-26 10:35:37,740 - lava_callback - INFO - Completed processing callback for node 68d66c1b2f83206171a904ed 2025-09-26 10:35:39,058 - lava_callback - INFO - Received callback for node 68d66c1f2f83206171a904fa INFO: 172.20.0.1:37372 - "POST /node/68d66c1f2f83206171a904fa HTTP/1.0" 202 Accepted 2025-09-26 10:35:39,066 - lava_callback - INFO - Starting async job submit for node 68d66c1f2f83206171a904fa 2025-09-26 10:35:39,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:39,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c1f2f83206171a904fa HTTP/1.1" 200 None 2025-09-26 10:35:39,198 - lava_callback - DEBUG - Processing node 68d66c1f2f83206171a904fa: baseline-arm 2025-09-26 10:35:39,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:35:40,298 - lava_callback - INFO - Received callback for node 68d66bbc2f83206171a90463 INFO: 172.20.0.1:56634 - "POST /node/68d66bbc2f83206171a90463 HTTP/1.0" 202 Accepted 2025-09-26 10:35:40,304 - lava_callback - INFO - Starting async job submit for node 68d66bbc2f83206171a90463 2025-09-26 10:35:40,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:40,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66bbc2f83206171a90463 HTTP/1.1" 200 None 2025-09-26 10:35:40,351 - lava_callback - DEBUG - Processing node 68d66bbc2f83206171a90463: baseline-arm 2025-09-26 10:35:40,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:35:41,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:35:41,136 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66bbc2f83206171a90463/log.txt.gz 2025-09-26 10:35:41,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:35:41,186 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:35:41,187 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c1f2f83206171a904fa/log.txt.gz 2025-09-26 10:35:41,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:35:41,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:35:41,337 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66bbc2f83206171a90463/lava_callback.json.gz 2025-09-26 10:35:41,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:41,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:35:41,374 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c1f2f83206171a904fa/lava_callback.json.gz 2025-09-26 10:35:41,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:41,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66bbc2f83206171a90463 HTTP/1.1" 200 None 2025-09-26 10:35:41,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:41,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c1f2f83206171a904fa HTTP/1.1" 200 None 2025-09-26 10:35:41,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:41,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:35:41,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:41,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:35:41,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:41,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66bbc2f83206171a90463 HTTP/1.1" 200 None 2025-09-26 10:35:41,490 - lava_callback - INFO - Completed processing callback for node 68d66bbc2f83206171a90463 2025-09-26 10:35:41,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c1f2f83206171a904fa HTTP/1.1" 200 None 2025-09-26 10:35:41,531 - lava_callback - INFO - Completed processing callback for node 68d66c1f2f83206171a904fa 2025-09-26 10:35:41,642 - lava_callback - INFO - Received callback for node 68d66c222f83206171a9050c INFO: 172.20.0.1:56648 - "POST /node/68d66c222f83206171a9050c HTTP/1.0" 202 Accepted 2025-09-26 10:35:41,650 - lava_callback - INFO - Starting async job submit for node 68d66c222f83206171a9050c 2025-09-26 10:35:41,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:41,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c222f83206171a9050c HTTP/1.1" 200 None 2025-09-26 10:35:41,707 - lava_callback - DEBUG - Processing node 68d66c222f83206171a9050c: baseline-arm 2025-09-26 10:35:42,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:35:42,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:35:42,212 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c222f83206171a9050c/log.txt.gz 2025-09-26 10:35:42,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:35:42,351 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:35:42,352 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c222f83206171a9050c/lava_callback.json.gz 2025-09-26 10:35:42,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:42,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c222f83206171a9050c HTTP/1.1" 200 None 2025-09-26 10:35:42,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:42,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:35:42,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:42,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c222f83206171a9050c HTTP/1.1" 200 None 2025-09-26 10:35:42,454 - lava_callback - INFO - Completed processing callback for node 68d66c222f83206171a9050c 2025-09-26 10:35:43,756 - lava_callback - INFO - Received callback for node 68d66c102f83206171a904c6 INFO: 172.20.0.1:56652 - "POST /node/68d66c102f83206171a904c6 HTTP/1.0" 202 Accepted 2025-09-26 10:35:43,766 - lava_callback - INFO - Starting async job submit for node 68d66c102f83206171a904c6 2025-09-26 10:35:43,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:43,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c102f83206171a904c6 HTTP/1.1" 200 None 2025-09-26 10:35:43,807 - lava_callback - DEBUG - Processing node 68d66c102f83206171a904c6: baseline-arm 2025-09-26 10:35:44,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:35:44,282 - lava_callback - INFO - Received callback for node 68d66c0f2f83206171a904c3 INFO: 172.20.0.1:56664 - "POST /node/68d66c0f2f83206171a904c3 HTTP/1.0" 202 Accepted 2025-09-26 10:35:44,292 - lava_callback - INFO - Starting async job submit for node 68d66c0f2f83206171a904c3 2025-09-26 10:35:44,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:44,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c0f2f83206171a904c3 HTTP/1.1" 200 None 2025-09-26 10:35:44,338 - lava_callback - DEBUG - Processing node 68d66c0f2f83206171a904c3: baseline-arm 2025-09-26 10:35:44,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:56666 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:35:46,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:35:46,641 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c102f83206171a904c6/log.txt.gz 2025-09-26 10:35:46,646 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:35:46,646 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c0f2f83206171a904c3/log.txt.gz 2025-09-26 10:35:46,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:35:46,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:35:47,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:35:47,174 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c0f2f83206171a904c3/lava_callback.json.gz 2025-09-26 10:35:47,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:47,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c0f2f83206171a904c3 HTTP/1.1" 200 None 2025-09-26 10:35:47,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:47,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:35:47,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:47,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:35:47,282 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c102f83206171a904c6/lava_callback.json.gz 2025-09-26 10:35:47,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:47,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c102f83206171a904c6 HTTP/1.1" 200 None 2025-09-26 10:35:47,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:47,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c0f2f83206171a904c3 HTTP/1.1" 200 None 2025-09-26 10:35:47,384 - lava_callback - INFO - Completed processing callback for node 68d66c0f2f83206171a904c3 2025-09-26 10:35:47,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:35:47,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:47,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c102f83206171a904c6 HTTP/1.1" 200 None 2025-09-26 10:35:47,446 - lava_callback - INFO - Completed processing callback for node 68d66c102f83206171a904c6 2025-09-26 10:35:48,475 - lava_callback - INFO - Received callback for node 68d3c96fcd36afa834e0ecd1 INFO: 172.20.0.1:56678 - "POST /node/68d3c96fcd36afa834e0ecd1 HTTP/1.0" 202 Accepted 2025-09-26 10:35:48,484 - lava_callback - INFO - Starting async job submit for node 68d3c96fcd36afa834e0ecd1 2025-09-26 10:35:48,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:48,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c96fcd36afa834e0ecd1 HTTP/1.1" 200 None 2025-09-26 10:35:48,512 - lava_callback - DEBUG - Processing node 68d3c96fcd36afa834e0ecd1: ltp-input 2025-09-26 10:35:48,512 - lava_callback - ERROR - Error processing callback for node 68d3c96fcd36afa834e0ecd1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:35:49,252 - lava_callback - INFO - Received callback for node 68d3c977cd36afa834e0eced INFO: 172.20.0.1:56688 - "POST /node/68d3c977cd36afa834e0eced HTTP/1.0" 202 Accepted 2025-09-26 10:35:49,268 - lava_callback - INFO - Starting async job submit for node 68d3c977cd36afa834e0eced 2025-09-26 10:35:49,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:49,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c977cd36afa834e0eced HTTP/1.1" 200 None 2025-09-26 10:35:49,282 - lava_callback - DEBUG - Processing node 68d3c977cd36afa834e0eced: ltp-ipc 2025-09-26 10:35:49,282 - lava_callback - ERROR - Error processing callback for node 68d3c977cd36afa834e0eced: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:35:50,112 - lava_callback - INFO - Received callback for node 68d3c984cd36afa834e0ecfc INFO: 172.20.0.1:56496 - "POST /node/68d3c984cd36afa834e0ecfc HTTP/1.0" 202 Accepted 2025-09-26 10:35:50,119 - lava_callback - INFO - Starting async job submit for node 68d3c984cd36afa834e0ecfc 2025-09-26 10:35:50,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:50,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c984cd36afa834e0ecfc HTTP/1.1" 200 None 2025-09-26 10:35:50,148 - lava_callback - DEBUG - Processing node 68d3c984cd36afa834e0ecfc: ltp-input 2025-09-26 10:35:50,149 - lava_callback - ERROR - Error processing callback for node 68d3c984cd36afa834e0ecfc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:35:54,754 - lava_callback - INFO - Received callback for node 68d3c803cd36afa834e0e3da INFO: 172.20.0.1:56510 - "POST /node/68d3c803cd36afa834e0e3da HTTP/1.0" 202 Accepted 2025-09-26 10:35:54,768 - lava_callback - INFO - Starting async job submit for node 68d3c803cd36afa834e0e3da 2025-09-26 10:35:54,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:35:55,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c803cd36afa834e0e3da HTTP/1.1" 200 None 2025-09-26 10:35:55,018 - lava_callback - DEBUG - Processing node 68d3c803cd36afa834e0e3da: ltp-fs-bind 2025-09-26 10:35:55,886 - lava_callback - ERROR - Error processing callback for node 68d3c803cd36afa834e0e3da: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:56512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42400 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:36:08,825 - lava_callback - INFO - Received callback for node 68d66c692f83206171a90583 INFO: 172.20.0.1:42414 - "POST /node/68d66c692f83206171a90583 HTTP/1.0" 202 Accepted 2025-09-26 10:36:08,879 - lava_callback - INFO - Starting async job submit for node 68d66c692f83206171a90583 2025-09-26 10:36:08,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:08,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c692f83206171a90583 HTTP/1.1" 200 None 2025-09-26 10:36:08,959 - lava_callback - DEBUG - Processing node 68d66c692f83206171a90583: baseline-arm-pengutronix 2025-09-26 10:36:09,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:36:09,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:36:09,229 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d66c692f83206171a90583/log.txt.gz 2025-09-26 10:36:09,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:36:09,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:36:09,353 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d66c692f83206171a90583/lava_callback.json.gz 2025-09-26 10:36:09,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:09,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c692f83206171a90583 HTTP/1.1" 200 None 2025-09-26 10:36:09,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:09,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:36:09,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:09,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c692f83206171a90583 HTTP/1.1" 200 None 2025-09-26 10:36:09,447 - lava_callback - INFO - Completed processing callback for node 68d66c692f83206171a90583 INFO: 172.20.0.1:46540 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:36:14,783 - lava_callback - INFO - Received callback for node 68d66c672f83206171a90580 INFO: 172.20.0.1:46542 - "POST /node/68d66c672f83206171a90580 HTTP/1.0" 202 Accepted 2025-09-26 10:36:14,792 - lava_callback - INFO - Starting async job submit for node 68d66c672f83206171a90580 2025-09-26 10:36:14,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:14,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c672f83206171a90580 HTTP/1.1" 200 None 2025-09-26 10:36:14,826 - lava_callback - DEBUG - Processing node 68d66c672f83206171a90580: baseline-arm-pengutronix 2025-09-26 10:36:15,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:46554 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 10:36:15,854 - lava_callback - INFO - Received callback for node 68d66c642f83206171a9057d INFO: 172.20.0.1:46560 - "POST /node/68d66c642f83206171a9057d HTTP/1.0" 202 Accepted 2025-09-26 10:36:15,859 - lava_callback - INFO - Starting async job submit for node 68d66c642f83206171a9057d 2025-09-26 10:36:15,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:15,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c642f83206171a9057d HTTP/1.1" 200 None 2025-09-26 10:36:15,903 - lava_callback - DEBUG - Processing node 68d66c642f83206171a9057d: baseline-arm-pengutronix 2025-09-26 10:36:16,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:46566 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:36:17,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:36:17,141 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d66c642f83206171a9057d/log.txt.gz 2025-09-26 10:36:17,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:36:17,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:36:17,221 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d66c672f83206171a90580/log.txt.gz 2025-09-26 10:36:17,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:51912 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:36:19,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:36:19,673 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d66c672f83206171a90580/lava_callback.json.gz 2025-09-26 10:36:19,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:19,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c672f83206171a90580 HTTP/1.1" 200 None 2025-09-26 10:36:19,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:19,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:36:19,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:19,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c672f83206171a90580 HTTP/1.1" 200 None 2025-09-26 10:36:19,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:36:19,825 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d66c642f83206171a9057d/lava_callback.json.gz 2025-09-26 10:36:19,843 - lava_callback - INFO - Completed processing callback for node 68d66c672f83206171a90580 2025-09-26 10:36:19,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:19,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c642f83206171a9057d HTTP/1.1" 200 None 2025-09-26 10:36:19,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:19,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:36:19,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:19,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c642f83206171a9057d HTTP/1.1" 200 None 2025-09-26 10:36:19,934 - lava_callback - INFO - Completed processing callback for node 68d66c642f83206171a9057d 2025-09-26 10:36:21,983 - lava_callback - INFO - Received callback for node 68d66c5a2f83206171a90571 INFO: 172.20.0.1:51926 - "POST /node/68d66c5a2f83206171a90571 HTTP/1.0" 202 Accepted 2025-09-26 10:36:21,992 - lava_callback - INFO - Starting async job submit for node 68d66c5a2f83206171a90571 2025-09-26 10:36:22,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:22,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c5a2f83206171a90571 HTTP/1.1" 200 None 2025-09-26 10:36:22,056 - lava_callback - DEBUG - Processing node 68d66c5a2f83206171a90571: baseline-arm-broonie 2025-09-26 10:36:22,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:36:22,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:36:22,655 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d66c5a2f83206171a90571/log.txt.gz 2025-09-26 10:36:22,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:36:22,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:36:22,805 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d66c5a2f83206171a90571/lava_callback.json.gz 2025-09-26 10:36:22,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:22,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c5a2f83206171a90571 HTTP/1.1" 200 None 2025-09-26 10:36:22,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:22,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:36:22,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:22,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c5a2f83206171a90571 HTTP/1.1" 200 None 2025-09-26 10:36:22,892 - lava_callback - INFO - Completed processing callback for node 68d66c5a2f83206171a90571 INFO: 172.20.0.1:51942 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:36:28,477 - lava_callback - INFO - Received callback for node 68d3c9a0cd36afa834e0ed52 INFO: 172.20.0.1:51948 - "POST /node/68d3c9a0cd36afa834e0ed52 HTTP/1.0" 202 Accepted 2025-09-26 10:36:28,483 - lava_callback - INFO - Starting async job submit for node 68d3c9a0cd36afa834e0ed52 2025-09-26 10:36:28,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:28,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c9a0cd36afa834e0ed52 HTTP/1.1" 200 None 2025-09-26 10:36:28,497 - lava_callback - DEBUG - Processing node 68d3c9a0cd36afa834e0ed52: ltp-pty 2025-09-26 10:36:28,497 - lava_callback - ERROR - Error processing callback for node 68d3c9a0cd36afa834e0ed52: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:36:29,249 - lava_callback - INFO - Received callback for node 68d3c9aacd36afa834e0ed61 INFO: 172.20.0.1:51960 - "POST /node/68d3c9aacd36afa834e0ed61 HTTP/1.0" 202 Accepted 2025-09-26 10:36:29,256 - lava_callback - INFO - Starting async job submit for node 68d3c9aacd36afa834e0ed61 2025-09-26 10:36:29,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:29,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c9aacd36afa834e0ed61 HTTP/1.1" 200 None 2025-09-26 10:36:29,269 - lava_callback - DEBUG - Processing node 68d3c9aacd36afa834e0ed61: ltp-ipc 2025-09-26 10:36:29,269 - lava_callback - ERROR - Error processing callback for node 68d3c9aacd36afa834e0ed61: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:36:35,187 - lava_callback - INFO - Received callback for node 68d3c9abcd36afa834e0ed64 INFO: 172.20.0.1:36122 - "POST /node/68d3c9abcd36afa834e0ed64 HTTP/1.0" 202 Accepted 2025-09-26 10:36:35,195 - lava_callback - INFO - Starting async job submit for node 68d3c9abcd36afa834e0ed64 2025-09-26 10:36:35,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:35,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c9abcd36afa834e0ed64 HTTP/1.1" 200 None 2025-09-26 10:36:35,218 - lava_callback - DEBUG - Processing node 68d3c9abcd36afa834e0ed64: baseline-arm 2025-09-26 10:36:35,218 - lava_callback - ERROR - Error processing callback for node 68d3c9abcd36afa834e0ed64: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:36:35,896 - lava_callback - INFO - Received callback for node 68d3c9accd36afa834e0ed67 INFO: 172.20.0.1:36130 - "POST /node/68d3c9accd36afa834e0ed67 HTTP/1.0" 202 Accepted 2025-09-26 10:36:35,905 - lava_callback - INFO - Starting async job submit for node 68d3c9accd36afa834e0ed67 2025-09-26 10:36:35,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:35,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c9accd36afa834e0ed67 HTTP/1.1" 200 None 2025-09-26 10:36:35,932 - lava_callback - DEBUG - Processing node 68d3c9accd36afa834e0ed67: baseline-arm 2025-09-26 10:36:35,932 - lava_callback - ERROR - Error processing callback for node 68d3c9accd36afa834e0ed67: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:36132 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:36:36,626 - lava_callback - INFO - Received callback for node 68d3c9aecd36afa834e0ed6a INFO: 172.20.0.1:36136 - "POST /node/68d3c9aecd36afa834e0ed6a HTTP/1.0" 202 Accepted 2025-09-26 10:36:36,632 - lava_callback - INFO - Starting async job submit for node 68d3c9aecd36afa834e0ed6a 2025-09-26 10:36:36,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:36,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c9aecd36afa834e0ed6a HTTP/1.1" 200 None 2025-09-26 10:36:36,647 - lava_callback - DEBUG - Processing node 68d3c9aecd36afa834e0ed6a: baseline-arm 2025-09-26 10:36:36,647 - lava_callback - ERROR - Error processing callback for node 68d3c9aecd36afa834e0ed6a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:36:40,110 - lava_callback - INFO - Received callback for node 68d66c152f83206171a904cc INFO: 172.20.0.1:54684 - "POST /node/68d66c152f83206171a904cc HTTP/1.0" 202 Accepted 2025-09-26 10:36:40,120 - lava_callback - INFO - Starting async job submit for node 68d66c152f83206171a904cc 2025-09-26 10:36:40,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:40,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c152f83206171a904cc HTTP/1.1" 200 None 2025-09-26 10:36:40,175 - lava_callback - DEBUG - Processing node 68d66c152f83206171a904cc: baseline-arm 2025-09-26 10:36:40,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:36:43,045 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:36:43,046 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c152f83206171a904cc/log.txt.gz 2025-09-26 10:36:43,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:36:44,971 - lava_callback - INFO - Received callback for node 68d66c132f83206171a904c9 INFO: 172.20.0.1:54690 - "POST /node/68d66c132f83206171a904c9 HTTP/1.0" 202 Accepted 2025-09-26 10:36:44,977 - lava_callback - INFO - Starting async job submit for node 68d66c132f83206171a904c9 2025-09-26 10:36:45,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:45,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c132f83206171a904c9 HTTP/1.1" 200 None 2025-09-26 10:36:45,055 - lava_callback - DEBUG - Processing node 68d66c132f83206171a904c9: baseline-arm 2025-09-26 10:36:45,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:36:45,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:36:45,604 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c152f83206171a904cc/lava_callback.json.gz 2025-09-26 10:36:45,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:45,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c152f83206171a904cc HTTP/1.1" 200 None 2025-09-26 10:36:45,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:45,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:36:45,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:45,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c152f83206171a904cc HTTP/1.1" 200 None 2025-09-26 10:36:45,699 - lava_callback - INFO - Completed processing callback for node 68d66c152f83206171a904cc INFO: 172.20.0.1:54692 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:36:47,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:36:47,971 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c132f83206171a904c9/log.txt.gz 2025-09-26 10:36:47,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:36:48,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:36:48,335 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c132f83206171a904c9/lava_callback.json.gz 2025-09-26 10:36:48,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:48,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c132f83206171a904c9 HTTP/1.1" 200 None 2025-09-26 10:36:48,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:48,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:36:48,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:48,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c132f83206171a904c9 HTTP/1.1" 200 None 2025-09-26 10:36:48,417 - lava_callback - INFO - Completed processing callback for node 68d66c132f83206171a904c9 2025-09-26 10:36:48,584 - lava_callback - INFO - Received callback for node 68d3c9b6cd36afa834e0ed76 INFO: 172.20.0.1:54708 - "POST /node/68d3c9b6cd36afa834e0ed76 HTTP/1.0" 202 Accepted 2025-09-26 10:36:48,590 - lava_callback - INFO - Starting async job submit for node 68d3c9b6cd36afa834e0ed76 2025-09-26 10:36:48,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:48,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c9b6cd36afa834e0ed76 HTTP/1.1" 200 None 2025-09-26 10:36:48,609 - lava_callback - DEBUG - Processing node 68d3c9b6cd36afa834e0ed76: ltp-pty 2025-09-26 10:36:48,609 - lava_callback - ERROR - Error processing callback for node 68d3c9b6cd36afa834e0ed76: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:36:55,022 - lava_callback - INFO - Received callback for node 68d3c9b1cd36afa834e0ed6d INFO: 172.20.0.1:59810 - "POST /node/68d3c9b1cd36afa834e0ed6d HTTP/1.0" 202 Accepted 2025-09-26 10:36:55,031 - lava_callback - INFO - Starting async job submit for node 68d3c9b1cd36afa834e0ed6d 2025-09-26 10:36:55,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:55,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c9b1cd36afa834e0ed6d HTTP/1.1" 200 None 2025-09-26 10:36:55,046 - lava_callback - DEBUG - Processing node 68d3c9b1cd36afa834e0ed6d: baseline-arm 2025-09-26 10:36:55,046 - lava_callback - ERROR - Error processing callback for node 68d3c9b1cd36afa834e0ed6d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:36:55,753 - lava_callback - INFO - Received callback for node 68d3c9c4cd36afa834e0ed85 INFO: 172.20.0.1:59818 - "POST /node/68d3c9c4cd36afa834e0ed85 HTTP/1.0" 202 Accepted 2025-09-26 10:36:55,758 - lava_callback - INFO - Starting async job submit for node 68d3c9c4cd36afa834e0ed85 2025-09-26 10:36:55,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:36:55,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c9c4cd36afa834e0ed85 HTTP/1.1" 200 None 2025-09-26 10:36:55,801 - lava_callback - DEBUG - Processing node 68d3c9c4cd36afa834e0ed85: baseline-arm 2025-09-26 10:36:55,801 - lava_callback - ERROR - Error processing callback for node 68d3c9c4cd36afa834e0ed85: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:59834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52992 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:37:12,911 - lava_callback - INFO - Received callback for node 68d66c582f83206171a9056e INFO: 172.20.0.1:55256 - "POST /node/68d66c582f83206171a9056e HTTP/1.0" 202 Accepted 2025-09-26 10:37:12,917 - lava_callback - INFO - Starting async job submit for node 68d66c582f83206171a9056e 2025-09-26 10:37:12,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:12,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c582f83206171a9056e HTTP/1.1" 200 None 2025-09-26 10:37:12,958 - lava_callback - DEBUG - Processing node 68d66c582f83206171a9056e: baseline-arm-broonie 2025-09-26 10:37:13,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:37:13,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:37:13,805 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d66c582f83206171a9056e/log.txt.gz 2025-09-26 10:37:13,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:37:13,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:37:13,987 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d66c582f83206171a9056e/lava_callback.json.gz 2025-09-26 10:37:14,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:14,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c582f83206171a9056e HTTP/1.1" 200 None 2025-09-26 10:37:14,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:14,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:37:14,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:14,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c582f83206171a9056e HTTP/1.1" 200 None 2025-09-26 10:37:14,099 - lava_callback - INFO - Completed processing callback for node 68d66c582f83206171a9056e INFO: 172.20.0.1:55272 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:37:14,717 - lava_callback - INFO - Received callback for node 68d66c242f83206171a90515 INFO: 172.20.0.1:55274 - "POST /node/68d66c242f83206171a90515 HTTP/1.0" 202 Accepted 2025-09-26 10:37:14,732 - lava_callback - INFO - Starting async job submit for node 68d66c242f83206171a90515 2025-09-26 10:37:14,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:14,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c242f83206171a90515 HTTP/1.1" 200 None 2025-09-26 10:37:14,798 - lava_callback - DEBUG - Processing node 68d66c242f83206171a90515: baseline-arm 2025-09-26 10:37:15,159 - lava_callback - INFO - Received callback for node 68d3c9c6cd36afa834e0ed88 2025-09-26 10:37:15,173 - lava_callback - INFO - Starting async job submit for node 68d3c9c6cd36afa834e0ed88 INFO: 172.20.0.1:55288 - "POST /node/68d3c9c6cd36afa834e0ed88 HTTP/1.0" 202 Accepted 2025-09-26 10:37:15,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:55292 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 10:37:15,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:37:15,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c9c6cd36afa834e0ed88 HTTP/1.1" 200 None 2025-09-26 10:37:15,202 - lava_callback - DEBUG - Processing node 68d3c9c6cd36afa834e0ed88: baseline-arm 2025-09-26 10:37:15,202 - lava_callback - ERROR - Error processing callback for node 68d3c9c6cd36afa834e0ed88: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:37:15,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:37:15,317 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c242f83206171a90515/log.txt.gz 2025-09-26 10:37:15,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:37:15,464 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:37:15,464 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c242f83206171a90515/lava_callback.json.gz 2025-09-26 10:37:15,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:15,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c242f83206171a90515 HTTP/1.1" 200 None 2025-09-26 10:37:15,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:15,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:37:15,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:15,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c242f83206171a90515 HTTP/1.1" 200 None 2025-09-26 10:37:15,603 - lava_callback - INFO - Completed processing callback for node 68d66c242f83206171a90515 2025-09-26 10:37:15,882 - lava_callback - INFO - Received callback for node 68d3c9cdcd36afa834e0edbc INFO: 172.20.0.1:55300 - "POST /node/68d3c9cdcd36afa834e0edbc HTTP/1.0" 202 Accepted 2025-09-26 10:37:15,892 - lava_callback - INFO - Starting async job submit for node 68d3c9cdcd36afa834e0edbc 2025-09-26 10:37:15,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:15,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c9cdcd36afa834e0edbc HTTP/1.1" 200 None 2025-09-26 10:37:15,929 - lava_callback - DEBUG - Processing node 68d3c9cdcd36afa834e0edbc: baseline-arm 2025-09-26 10:37:15,929 - lava_callback - ERROR - Error processing callback for node 68d3c9cdcd36afa834e0edbc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:55314 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:37:16,590 - lava_callback - INFO - Received callback for node 68d3c9cecd36afa834e0edbf INFO: 172.20.0.1:55322 - "POST /node/68d3c9cecd36afa834e0edbf HTTP/1.0" 202 Accepted 2025-09-26 10:37:16,598 - lava_callback - INFO - Starting async job submit for node 68d3c9cecd36afa834e0edbf 2025-09-26 10:37:16,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:16,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c9cecd36afa834e0edbf HTTP/1.1" 200 None 2025-09-26 10:37:16,615 - lava_callback - DEBUG - Processing node 68d3c9cecd36afa834e0edbf: baseline-arm 2025-09-26 10:37:16,615 - lava_callback - ERROR - Error processing callback for node 68d3c9cecd36afa834e0edbf: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:37:17,326 - lava_callback - INFO - Received callback for node 68d3c9d9cd36afa834e0edce INFO: 172.20.0.1:55328 - "POST /node/68d3c9d9cd36afa834e0edce HTTP/1.0" 202 Accepted 2025-09-26 10:37:17,334 - lava_callback - INFO - Starting async job submit for node 68d3c9d9cd36afa834e0edce 2025-09-26 10:37:17,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:17,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c9d9cd36afa834e0edce HTTP/1.1" 200 None 2025-09-26 10:37:17,351 - lava_callback - DEBUG - Processing node 68d3c9d9cd36afa834e0edce: baseline-arm 2025-09-26 10:37:17,351 - lava_callback - ERROR - Error processing callback for node 68d3c9d9cd36afa834e0edce: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:37:18,019 - lava_callback - INFO - Received callback for node 68d3c9d9cd36afa834e0edd1 INFO: 172.20.0.1:55336 - "POST /node/68d3c9d9cd36afa834e0edd1 HTTP/1.0" 202 Accepted 2025-09-26 10:37:18,025 - lava_callback - INFO - Starting async job submit for node 68d3c9d9cd36afa834e0edd1 2025-09-26 10:37:18,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:18,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c9d9cd36afa834e0edd1 HTTP/1.1" 200 None 2025-09-26 10:37:18,042 - lava_callback - DEBUG - Processing node 68d3c9d9cd36afa834e0edd1: baseline-arm 2025-09-26 10:37:18,042 - lava_callback - ERROR - Error processing callback for node 68d3c9d9cd36afa834e0edd1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:37:19,242 - lava_callback - INFO - Received callback for node 68d66c262f83206171a90518 INFO: 172.20.0.1:55352 - "POST /node/68d66c262f83206171a90518 HTTP/1.0" 202 Accepted 2025-09-26 10:37:19,248 - lava_callback - INFO - Starting async job submit for node 68d66c262f83206171a90518 2025-09-26 10:37:19,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:19,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c262f83206171a90518 HTTP/1.1" 200 None 2025-09-26 10:37:19,284 - lava_callback - DEBUG - Processing node 68d66c262f83206171a90518: baseline-arm 2025-09-26 10:37:19,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:44618 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:37:19,962 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:37:19,963 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c262f83206171a90518/log.txt.gz 2025-09-26 10:37:19,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:37:20,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:37:20,180 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c262f83206171a90518/lava_callback.json.gz 2025-09-26 10:37:20,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:20,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c262f83206171a90518 HTTP/1.1" 200 None 2025-09-26 10:37:20,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:20,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:37:20,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:20,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c262f83206171a90518 HTTP/1.1" 200 None 2025-09-26 10:37:20,355 - lava_callback - INFO - Completed processing callback for node 68d66c262f83206171a90518 2025-09-26 10:37:22,042 - lava_callback - INFO - Received callback for node 68d40a25cd36afa834e16eeb INFO: 172.20.0.1:44626 - "POST /node/68d40a25cd36afa834e16eeb HTTP/1.0" 202 Accepted 2025-09-26 10:37:22,051 - lava_callback - INFO - Starting async job submit for node 68d40a25cd36afa834e16eeb 2025-09-26 10:37:22,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:22,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a25cd36afa834e16eeb HTTP/1.1" 200 None 2025-09-26 10:37:22,105 - lava_callback - DEBUG - Processing node 68d40a25cd36afa834e16eeb: baseline-arm 2025-09-26 10:37:22,497 - lava_callback - ERROR - Error processing callback for node 68d40a25cd36afa834e16eeb: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:44636 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:37:35,194 - lava_callback - INFO - Received callback for node 68d3c9dbcd36afa834e0edd4 INFO: 172.20.0.1:54320 - "POST /node/68d3c9dbcd36afa834e0edd4 HTTP/1.0" 202 Accepted 2025-09-26 10:37:35,200 - lava_callback - INFO - Starting async job submit for node 68d3c9dbcd36afa834e0edd4 2025-09-26 10:37:35,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:35,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c9dbcd36afa834e0edd4 HTTP/1.1" 200 None 2025-09-26 10:37:35,220 - lava_callback - DEBUG - Processing node 68d3c9dbcd36afa834e0edd4: baseline-arm 2025-09-26 10:37:35,220 - lava_callback - ERROR - Error processing callback for node 68d3c9dbcd36afa834e0edd4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:37:35,899 - lava_callback - INFO - Received callback for node 68d3c9dccd36afa834e0edd7 INFO: 172.20.0.1:54326 - "POST /node/68d3c9dccd36afa834e0edd7 HTTP/1.0" 202 Accepted 2025-09-26 10:37:35,905 - lava_callback - INFO - Starting async job submit for node 68d3c9dccd36afa834e0edd7 2025-09-26 10:37:35,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:35,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c9dccd36afa834e0edd7 HTTP/1.1" 200 None 2025-09-26 10:37:35,918 - lava_callback - DEBUG - Processing node 68d3c9dccd36afa834e0edd7: baseline-arm 2025-09-26 10:37:35,918 - lava_callback - ERROR - Error processing callback for node 68d3c9dccd36afa834e0edd7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:54338 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:37:36,633 - lava_callback - INFO - Received callback for node 68d3c9decd36afa834e0edda INFO: 172.20.0.1:54352 - "POST /node/68d3c9decd36afa834e0edda HTTP/1.0" 202 Accepted 2025-09-26 10:37:36,641 - lava_callback - INFO - Starting async job submit for node 68d3c9decd36afa834e0edda 2025-09-26 10:37:36,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:36,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c9decd36afa834e0edda HTTP/1.1" 200 None 2025-09-26 10:37:36,661 - lava_callback - DEBUG - Processing node 68d3c9decd36afa834e0edda: baseline-arm 2025-09-26 10:37:36,661 - lava_callback - ERROR - Error processing callback for node 68d3c9decd36afa834e0edda: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:37:37,332 - lava_callback - INFO - Received callback for node 68d3c9decd36afa834e0eddd INFO: 172.20.0.1:54364 - "POST /node/68d3c9decd36afa834e0eddd HTTP/1.0" 202 Accepted 2025-09-26 10:37:37,337 - lava_callback - INFO - Starting async job submit for node 68d3c9decd36afa834e0eddd 2025-09-26 10:37:37,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:37,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c9decd36afa834e0eddd HTTP/1.1" 200 None 2025-09-26 10:37:37,364 - lava_callback - DEBUG - Processing node 68d3c9decd36afa834e0eddd: baseline-arm 2025-09-26 10:37:37,364 - lava_callback - ERROR - Error processing callback for node 68d3c9decd36afa834e0eddd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:37:38,047 - lava_callback - INFO - Received callback for node 68d3c9e0cd36afa834e0ede0 INFO: 172.20.0.1:54378 - "POST /node/68d3c9e0cd36afa834e0ede0 HTTP/1.0" 202 Accepted 2025-09-26 10:37:38,052 - lava_callback - INFO - Starting async job submit for node 68d3c9e0cd36afa834e0ede0 2025-09-26 10:37:38,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:38,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c9e0cd36afa834e0ede0 HTTP/1.1" 200 None 2025-09-26 10:37:38,075 - lava_callback - DEBUG - Processing node 68d3c9e0cd36afa834e0ede0: baseline-arm 2025-09-26 10:37:38,075 - lava_callback - ERROR - Error processing callback for node 68d3c9e0cd36afa834e0ede0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:37:38,736 - lava_callback - INFO - Received callback for node 68d3c9e0cd36afa834e0ede3 INFO: 172.20.0.1:54380 - "POST /node/68d3c9e0cd36afa834e0ede3 HTTP/1.0" 202 Accepted 2025-09-26 10:37:38,742 - lava_callback - INFO - Starting async job submit for node 68d3c9e0cd36afa834e0ede3 2025-09-26 10:37:38,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:38,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c9e0cd36afa834e0ede3 HTTP/1.1" 200 None 2025-09-26 10:37:38,759 - lava_callback - DEBUG - Processing node 68d3c9e0cd36afa834e0ede3: baseline-arm 2025-09-26 10:37:38,759 - lava_callback - ERROR - Error processing callback for node 68d3c9e0cd36afa834e0ede3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:37:43,508 - lava_callback - INFO - Received callback for node 68d66c192f83206171a904e3 INFO: 172.20.0.1:33464 - "POST /node/68d66c192f83206171a904e3 HTTP/1.0" 202 Accepted 2025-09-26 10:37:43,514 - lava_callback - INFO - Starting async job submit for node 68d66c192f83206171a904e3 2025-09-26 10:37:43,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:43,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c192f83206171a904e3 HTTP/1.1" 200 None 2025-09-26 10:37:43,551 - lava_callback - DEBUG - Processing node 68d66c192f83206171a904e3: baseline-arm 2025-09-26 10:37:43,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:37:44,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:37:44,073 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c192f83206171a904e3/log.txt.gz 2025-09-26 10:37:44,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:37:44,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:37:44,223 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c192f83206171a904e3/lava_callback.json.gz 2025-09-26 10:37:44,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:44,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c192f83206171a904e3 HTTP/1.1" 200 None 2025-09-26 10:37:44,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:44,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:37:44,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:44,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c192f83206171a904e3 HTTP/1.1" 200 None 2025-09-26 10:37:44,325 - lava_callback - INFO - Completed processing callback for node 68d66c192f83206171a904e3 2025-09-26 10:37:45,488 - lava_callback - INFO - Received callback for node 68d66c1a2f83206171a904ea INFO: 172.20.0.1:33472 - "POST /node/68d66c1a2f83206171a904ea HTTP/1.0" 202 Accepted 2025-09-26 10:37:45,494 - lava_callback - INFO - Starting async job submit for node 68d66c1a2f83206171a904ea 2025-09-26 10:37:45,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:45,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c1a2f83206171a904ea HTTP/1.1" 200 None 2025-09-26 10:37:45,538 - lava_callback - DEBUG - Processing node 68d66c1a2f83206171a904ea: baseline-arm 2025-09-26 10:37:45,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:33482 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:37:47,463 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:37:47,464 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c1a2f83206171a904ea/log.txt.gz 2025-09-26 10:37:47,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:37:50,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:37:50,103 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c1a2f83206171a904ea/lava_callback.json.gz 2025-09-26 10:37:50,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:50,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c1a2f83206171a904ea HTTP/1.1" 200 None 2025-09-26 10:37:50,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:50,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:37:50,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:50,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c1a2f83206171a904ea HTTP/1.1" 200 None 2025-09-26 10:37:50,189 - lava_callback - INFO - Completed processing callback for node 68d66c1a2f83206171a904ea 2025-09-26 10:37:52,487 - lava_callback - INFO - Received callback for node 68d3beb75180aefab120c5d8 INFO: 172.20.0.1:35920 - "POST /node/68d3beb75180aefab120c5d8 HTTP/1.0" 202 Accepted 2025-09-26 10:37:52,532 - lava_callback - INFO - Starting async job submit for node 68d3beb75180aefab120c5d8 2025-09-26 10:37:54,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:37:54,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3beb75180aefab120c5d8 HTTP/1.1" 200 None 2025-09-26 10:37:54,465 - lava_callback - DEBUG - Processing node 68d3beb75180aefab120c5d8: ltp-syscalls INFO: 172.20.0.1:35932 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:38:02,077 - lava_callback - ERROR - Error processing callback for node 68d3beb75180aefab120c5d8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:37698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39238 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:38:14,726 - lava_callback - INFO - Received callback for node 68d3ca0ecd36afa834e0ee4e INFO: 172.20.0.1:39242 - "POST /node/68d3ca0ecd36afa834e0ee4e HTTP/1.0" 202 Accepted 2025-09-26 10:38:14,735 - lava_callback - INFO - Starting async job submit for node 68d3ca0ecd36afa834e0ee4e 2025-09-26 10:38:14,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:38:14,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ca0ecd36afa834e0ee4e HTTP/1.1" 200 None 2025-09-26 10:38:14,752 - lava_callback - DEBUG - Processing node 68d3ca0ecd36afa834e0ee4e: baseline-arm 2025-09-26 10:38:14,752 - lava_callback - ERROR - Error processing callback for node 68d3ca0ecd36afa834e0ee4e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:39246 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 10:38:15,445 - lava_callback - INFO - Received callback for node 68d3ca0fcd36afa834e0ee51 INFO: 172.20.0.1:39254 - "POST /node/68d3ca0fcd36afa834e0ee51 HTTP/1.0" 202 Accepted 2025-09-26 10:38:15,456 - lava_callback - INFO - Starting async job submit for node 68d3ca0fcd36afa834e0ee51 2025-09-26 10:38:15,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:38:15,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ca0fcd36afa834e0ee51 HTTP/1.1" 200 None 2025-09-26 10:38:15,475 - lava_callback - DEBUG - Processing node 68d3ca0fcd36afa834e0ee51: baseline-arm 2025-09-26 10:38:15,475 - lava_callback - ERROR - Error processing callback for node 68d3ca0fcd36afa834e0ee51: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:39256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51144 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:38:27,807 - lava_callback - INFO - Received callback for node 68d3c7decd36afa834e0e39b INFO: 172.20.0.1:51152 - "POST /node/68d3c7decd36afa834e0e39b HTTP/1.0" 202 Accepted 2025-09-26 10:38:27,814 - lava_callback - INFO - Starting async job submit for node 68d3c7decd36afa834e0e39b 2025-09-26 10:38:27,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:38:27,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c7decd36afa834e0e39b HTTP/1.1" 200 None 2025-09-26 10:38:27,898 - lava_callback - DEBUG - Processing node 68d3c7decd36afa834e0e39b: ltp-smoketest 2025-09-26 10:38:28,383 - lava_callback - ERROR - Error processing callback for node 68d3c7decd36afa834e0e39b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:47190 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:38:39,943 - lava_callback - INFO - Received callback for node 68d66c762f83206171a90592 INFO: 172.20.0.1:34998 - "POST /node/68d66c762f83206171a90592 HTTP/1.0" 202 Accepted 2025-09-26 10:38:39,954 - lava_callback - INFO - Starting async job submit for node 68d66c762f83206171a90592 2025-09-26 10:38:40,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:38:40,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c762f83206171a90592 HTTP/1.1" 200 None 2025-09-26 10:38:40,036 - lava_callback - DEBUG - Processing node 68d66c762f83206171a90592: ltp-dio 2025-09-26 10:38:40,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:38:40,966 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:38:40,967 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-68d66c762f83206171a90592/log.txt.gz 2025-09-26 10:38:40,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:38:41,149 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:38:41,150 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-68d66c762f83206171a90592/lava_callback.json.gz 2025-09-26 10:38:41,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:38:41,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c762f83206171a90592 HTTP/1.1" 200 None 2025-09-26 10:38:41,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:38:41,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:38:41,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:38:41,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c762f83206171a90592 HTTP/1.1" 200 None 2025-09-26 10:38:41,327 - lava_callback - INFO - Completed processing callback for node 68d66c762f83206171a90592 2025-09-26 10:38:43,769 - lava_callback - INFO - Received callback for node 68d66c432f83206171a9054b INFO: 172.20.0.1:35006 - "POST /node/68d66c432f83206171a9054b HTTP/1.0" 202 Accepted 2025-09-26 10:38:43,775 - lava_callback - INFO - Starting async job submit for node 68d66c432f83206171a9054b 2025-09-26 10:38:43,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:38:43,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c432f83206171a9054b HTTP/1.1" 200 None 2025-09-26 10:38:43,820 - lava_callback - DEBUG - Processing node 68d66c432f83206171a9054b: baseline-arm 2025-09-26 10:38:44,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:38:45,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:38:45,111 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c432f83206171a9054b/log.txt.gz 2025-09-26 10:38:45,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:38:45,311 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:38:45,312 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c432f83206171a9054b/lava_callback.json.gz 2025-09-26 10:38:45,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:38:45,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c432f83206171a9054b HTTP/1.1" 200 None 2025-09-26 10:38:45,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:38:45,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:38:45,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:38:45,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c432f83206171a9054b HTTP/1.1" 200 None 2025-09-26 10:38:45,434 - lava_callback - INFO - Completed processing callback for node 68d66c432f83206171a9054b INFO: 172.20.0.1:35018 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:38:46,525 - lava_callback - INFO - Received callback for node 68d66c442f83206171a9054e INFO: 172.20.0.1:35034 - "POST /node/68d66c442f83206171a9054e HTTP/1.0" 202 Accepted 2025-09-26 10:38:46,533 - lava_callback - INFO - Starting async job submit for node 68d66c442f83206171a9054e 2025-09-26 10:38:46,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:38:46,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c442f83206171a9054e HTTP/1.1" 200 None 2025-09-26 10:38:46,572 - lava_callback - DEBUG - Processing node 68d66c442f83206171a9054e: baseline-arm 2025-09-26 10:38:47,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:38:47,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:38:47,492 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c442f83206171a9054e/log.txt.gz 2025-09-26 10:38:47,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:38:47,658 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:38:47,659 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c442f83206171a9054e/lava_callback.json.gz 2025-09-26 10:38:47,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:38:47,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c442f83206171a9054e HTTP/1.1" 200 None 2025-09-26 10:38:47,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:38:47,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:38:47,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:38:47,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c442f83206171a9054e HTTP/1.1" 200 None 2025-09-26 10:38:47,768 - lava_callback - INFO - Completed processing callback for node 68d66c442f83206171a9054e 2025-09-26 10:38:55,120 - lava_callback - INFO - Received callback for node 68d3ca2dcd36afa834e0efcd INFO: 172.20.0.1:33110 - "POST /node/68d3ca2dcd36afa834e0efcd HTTP/1.0" 202 Accepted 2025-09-26 10:38:55,125 - lava_callback - INFO - Starting async job submit for node 68d3ca2dcd36afa834e0efcd 2025-09-26 10:38:55,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:38:55,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ca2dcd36afa834e0efcd HTTP/1.1" 200 None 2025-09-26 10:38:55,143 - lava_callback - DEBUG - Processing node 68d3ca2dcd36afa834e0efcd: baseline-arm 2025-09-26 10:38:55,143 - lava_callback - ERROR - Error processing callback for node 68d3ca2dcd36afa834e0efcd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:38:55,823 - lava_callback - INFO - Received callback for node 68d3ca2fcd36afa834e0efd0 INFO: 172.20.0.1:33118 - "POST /node/68d3ca2fcd36afa834e0efd0 HTTP/1.0" 202 Accepted 2025-09-26 10:38:55,832 - lava_callback - INFO - Starting async job submit for node 68d3ca2fcd36afa834e0efd0 2025-09-26 10:38:55,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:38:55,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ca2fcd36afa834e0efd0 HTTP/1.1" 200 None 2025-09-26 10:38:55,852 - lava_callback - DEBUG - Processing node 68d3ca2fcd36afa834e0efd0: baseline-arm 2025-09-26 10:38:55,852 - lava_callback - ERROR - Error processing callback for node 68d3ca2fcd36afa834e0efd0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:33132 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:38:56,537 - lava_callback - INFO - Received callback for node 68d3ca33cd36afa834e0efd3 INFO: 172.20.0.1:33134 - "POST /node/68d3ca33cd36afa834e0efd3 HTTP/1.0" 202 Accepted 2025-09-26 10:38:56,545 - lava_callback - INFO - Starting async job submit for node 68d3ca33cd36afa834e0efd3 2025-09-26 10:38:56,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:38:56,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ca33cd36afa834e0efd3 HTTP/1.1" 200 None 2025-09-26 10:38:56,567 - lava_callback - DEBUG - Processing node 68d3ca33cd36afa834e0efd3: baseline-arm 2025-09-26 10:38:56,567 - lava_callback - ERROR - Error processing callback for node 68d3ca33cd36afa834e0efd3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:38:57,271 - lava_callback - INFO - Received callback for node 68d3ca34cd36afa834e0efd6 INFO: 172.20.0.1:33150 - "POST /node/68d3ca34cd36afa834e0efd6 HTTP/1.0" 202 Accepted 2025-09-26 10:38:57,279 - lava_callback - INFO - Starting async job submit for node 68d3ca34cd36afa834e0efd6 2025-09-26 10:38:57,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:38:57,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ca34cd36afa834e0efd6 HTTP/1.1" 200 None 2025-09-26 10:38:57,297 - lava_callback - DEBUG - Processing node 68d3ca34cd36afa834e0efd6: baseline-arm 2025-09-26 10:38:57,297 - lava_callback - ERROR - Error processing callback for node 68d3ca34cd36afa834e0efd6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:38:58,003 - lava_callback - INFO - Received callback for node 68d3ca38cd36afa834e0efdc INFO: 172.20.0.1:33154 - "POST /node/68d3ca38cd36afa834e0efdc HTTP/1.0" 202 Accepted 2025-09-26 10:38:58,009 - lava_callback - INFO - Starting async job submit for node 68d3ca38cd36afa834e0efdc 2025-09-26 10:38:58,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:38:58,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ca38cd36afa834e0efdc HTTP/1.1" 200 None 2025-09-26 10:38:58,024 - lava_callback - DEBUG - Processing node 68d3ca38cd36afa834e0efdc: baseline-arm 2025-09-26 10:38:58,024 - lava_callback - ERROR - Error processing callback for node 68d3ca38cd36afa834e0efdc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:38:58,731 - lava_callback - INFO - Received callback for node 68d3ca39cd36afa834e0efdf INFO: 172.20.0.1:33158 - "POST /node/68d3ca39cd36afa834e0efdf HTTP/1.0" 202 Accepted 2025-09-26 10:38:58,739 - lava_callback - INFO - Starting async job submit for node 68d3ca39cd36afa834e0efdf 2025-09-26 10:38:58,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:38:58,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ca39cd36afa834e0efdf HTTP/1.1" 200 None 2025-09-26 10:38:58,755 - lava_callback - DEBUG - Processing node 68d3ca39cd36afa834e0efdf: baseline-arm 2025-09-26 10:38:58,755 - lava_callback - ERROR - Error processing callback for node 68d3ca39cd36afa834e0efdf: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:38:58,951 - lava_callback - INFO - Received callback for node 68d66cd72f83206171a905f1 INFO: 172.20.0.1:33170 - "POST /node/68d66cd72f83206171a905f1 HTTP/1.0" 202 Accepted 2025-09-26 10:38:58,958 - lava_callback - INFO - Starting async job submit for node 68d66cd72f83206171a905f1 2025-09-26 10:38:58,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:38:59,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66cd72f83206171a905f1 HTTP/1.1" 200 None 2025-09-26 10:38:59,043 - lava_callback - DEBUG - Processing node 68d66cd72f83206171a905f1: baseline-arm64 2025-09-26 10:38:59,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:01,255 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:01,256 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66cd72f83206171a905f1/log.txt.gz 2025-09-26 10:39:01,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:01,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:01,374 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66cd72f83206171a905f1/lava_callback.json.gz 2025-09-26 10:39:01,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:01,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66cd72f83206171a905f1 HTTP/1.1" 200 None 2025-09-26 10:39:01,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:01,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:39:01,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:01,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66cd72f83206171a905f1 HTTP/1.1" 200 None 2025-09-26 10:39:01,519 - lava_callback - INFO - Completed processing callback for node 68d66cd72f83206171a905f1 INFO: 172.20.0.1:44578 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:39:08,583 - lava_callback - INFO - Received callback for node 68d66cdd2f83206171a90601 INFO: 172.20.0.1:44586 - "POST /node/68d66cdd2f83206171a90601 HTTP/1.0" 202 Accepted 2025-09-26 10:39:08,595 - lava_callback - INFO - Starting async job submit for node 68d66cdd2f83206171a90601 2025-09-26 10:39:08,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:08,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66cdd2f83206171a90601 HTTP/1.1" 200 None 2025-09-26 10:39:08,664 - lava_callback - DEBUG - Processing node 68d66cdd2f83206171a90601: baseline-arm64 2025-09-26 10:39:09,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:09,222 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:09,223 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66cdd2f83206171a90601/log.txt.gz 2025-09-26 10:39:09,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:09,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:09,404 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66cdd2f83206171a90601/lava_callback.json.gz 2025-09-26 10:39:09,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:09,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66cdd2f83206171a90601 HTTP/1.1" 200 None 2025-09-26 10:39:09,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:09,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:39:09,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:09,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66cdd2f83206171a90601 HTTP/1.1" 200 None 2025-09-26 10:39:09,559 - lava_callback - INFO - Completed processing callback for node 68d66cdd2f83206171a90601 2025-09-26 10:39:10,490 - lava_callback - INFO - Received callback for node 68d66ce02f83206171a90604 INFO: 172.20.0.1:59794 - "POST /node/68d66ce02f83206171a90604 HTTP/1.0" 202 Accepted 2025-09-26 10:39:10,498 - lava_callback - INFO - Starting async job submit for node 68d66ce02f83206171a90604 2025-09-26 10:39:10,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:10,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ce02f83206171a90604 HTTP/1.1" 200 None 2025-09-26 10:39:10,542 - lava_callback - DEBUG - Processing node 68d66ce02f83206171a90604: baseline-arm64 2025-09-26 10:39:10,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:11,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:11,202 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66ce02f83206171a90604/log.txt.gz 2025-09-26 10:39:11,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:14,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:14,334 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66ce02f83206171a90604/lava_callback.json.gz 2025-09-26 10:39:14,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:14,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ce02f83206171a90604 HTTP/1.1" 200 None 2025-09-26 10:39:14,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:14,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:39:14,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:14,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66ce02f83206171a90604 HTTP/1.1" 200 None 2025-09-26 10:39:14,617 - lava_callback - INFO - Completed processing callback for node 68d66ce02f83206171a90604 INFO: 172.20.0.1:59796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47574 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:39:20,507 - lava_callback - INFO - Received callback for node 68d66cda2f83206171a905fa INFO: 172.20.0.1:47586 - "POST /node/68d66cda2f83206171a905fa HTTP/1.0" 202 Accepted 2025-09-26 10:39:20,517 - lava_callback - INFO - Starting async job submit for node 68d66cda2f83206171a905fa 2025-09-26 10:39:20,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:20,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66cda2f83206171a905fa HTTP/1.1" 200 None 2025-09-26 10:39:20,606 - lava_callback - DEBUG - Processing node 68d66cda2f83206171a905fa: baseline-arm64 2025-09-26 10:39:21,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:21,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:21,417 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66cda2f83206171a905fa/log.txt.gz 2025-09-26 10:39:21,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:21,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:21,631 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66cda2f83206171a905fa/lava_callback.json.gz 2025-09-26 10:39:21,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:21,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66cda2f83206171a905fa HTTP/1.1" 200 None 2025-09-26 10:39:21,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:21,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:39:21,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:21,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66cda2f83206171a905fa HTTP/1.1" 200 None 2025-09-26 10:39:21,776 - lava_callback - INFO - Completed processing callback for node 68d66cda2f83206171a905fa INFO: 172.20.0.1:47592 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:39:35,022 - lava_callback - INFO - Received callback for node 68d40a27cd36afa834e16eee INFO: 172.20.0.1:52956 - "POST /node/68d40a27cd36afa834e16eee HTTP/1.0" 202 Accepted 2025-09-26 10:39:35,033 - lava_callback - INFO - Starting async job submit for node 68d40a27cd36afa834e16eee 2025-09-26 10:39:35,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:35,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a27cd36afa834e16eee HTTP/1.1" 200 None 2025-09-26 10:39:35,112 - lava_callback - DEBUG - Processing node 68d40a27cd36afa834e16eee: baseline-arm 2025-09-26 10:39:35,576 - lava_callback - ERROR - Error processing callback for node 68d40a27cd36afa834e16eee: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:52958 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:39:41,864 - lava_callback - INFO - Received callback for node 68d66c482f83206171a90559 INFO: 172.20.0.1:52486 - "POST /node/68d66c482f83206171a90559 HTTP/1.0" 202 Accepted 2025-09-26 10:39:41,871 - lava_callback - INFO - Starting async job submit for node 68d66c482f83206171a90559 2025-09-26 10:39:41,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:41,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c482f83206171a90559 HTTP/1.1" 200 None 2025-09-26 10:39:41,917 - lava_callback - DEBUG - Processing node 68d66c482f83206171a90559: baseline-arm 2025-09-26 10:39:42,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:44,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:44,322 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c482f83206171a90559/log.txt.gz 2025-09-26 10:39:44,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:44,463 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:44,464 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c482f83206171a90559/lava_callback.json.gz 2025-09-26 10:39:44,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:44,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c482f83206171a90559 HTTP/1.1" 200 None 2025-09-26 10:39:44,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:44,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:39:44,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:44,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c482f83206171a90559 HTTP/1.1" 200 None 2025-09-26 10:39:44,546 - lava_callback - INFO - Completed processing callback for node 68d66c482f83206171a90559 INFO: 172.20.0.1:52490 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:39:47,047 - lava_callback - INFO - Received callback for node 68d66c492f83206171a9055c INFO: 172.20.0.1:52504 - "POST /node/68d66c492f83206171a9055c HTTP/1.0" 202 Accepted 2025-09-26 10:39:47,054 - lava_callback - INFO - Starting async job submit for node 68d66c492f83206171a9055c 2025-09-26 10:39:47,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:47,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c492f83206171a9055c HTTP/1.1" 200 None 2025-09-26 10:39:47,092 - lava_callback - DEBUG - Processing node 68d66c492f83206171a9055c: baseline-arm 2025-09-26 10:39:47,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:49,321 - lava_callback - INFO - Received callback for node 68d66d1b2f83206171a90643 INFO: 172.20.0.1:59738 - "POST /node/68d66d1b2f83206171a90643 HTTP/1.0" 202 Accepted 2025-09-26 10:39:49,327 - lava_callback - INFO - Starting async job submit for node 68d66d1b2f83206171a90643 2025-09-26 10:39:49,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:49,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d1b2f83206171a90643 HTTP/1.1" 200 None 2025-09-26 10:39:49,380 - lava_callback - DEBUG - Processing node 68d66d1b2f83206171a90643: baseline-arm64 2025-09-26 10:39:49,515 - lava_callback - INFO - Received callback for node 68d66d1a2f83206171a90640 INFO: 172.20.0.1:59742 - "POST /node/68d66d1a2f83206171a90640 HTTP/1.0" 202 Accepted 2025-09-26 10:39:49,545 - lava_callback - INFO - Starting async job submit for node 68d66d1a2f83206171a90640 2025-09-26 10:39:49,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:49,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:49,582 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c492f83206171a9055c/log.txt.gz 2025-09-26 10:39:49,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:49,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d1a2f83206171a90640 HTTP/1.1" 200 None 2025-09-26 10:39:49,722 - lava_callback - DEBUG - Processing node 68d66d1a2f83206171a90640: baseline-arm64 2025-09-26 10:39:49,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:49,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:49,990 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c492f83206171a9055c/lava_callback.json.gz 2025-09-26 10:39:50,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:50,044 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d1b2f83206171a90643/log.txt.gz 2025-09-26 10:39:50,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:50,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:50,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c492f83206171a9055c HTTP/1.1" 200 None 2025-09-26 10:39:50,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:50,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:39:50,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:50,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c492f83206171a9055c HTTP/1.1" 200 None 2025-09-26 10:39:50,216 - lava_callback - INFO - Completed processing callback for node 68d66c492f83206171a9055c 2025-09-26 10:39:50,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:50,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:50,366 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d1b2f83206171a90643/lava_callback.json.gz 2025-09-26 10:39:50,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:50,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d1b2f83206171a90643 HTTP/1.1" 200 None 2025-09-26 10:39:50,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:50,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:39:50,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:50,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d1b2f83206171a90643 HTTP/1.1" 200 None 2025-09-26 10:39:50,481 - lava_callback - INFO - Completed processing callback for node 68d66d1b2f83206171a90643 2025-09-26 10:39:50,544 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:50,545 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d1a2f83206171a90640/log.txt.gz 2025-09-26 10:39:50,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:50,755 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:50,756 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d1a2f83206171a90640/lava_callback.json.gz 2025-09-26 10:39:50,774 - lava_callback - INFO - Received callback for node 68d66d232f83206171a9064c INFO: 172.20.0.1:59746 - "POST /node/68d66d232f83206171a9064c HTTP/1.0" 202 Accepted 2025-09-26 10:39:50,797 - lava_callback - INFO - Starting async job submit for node 68d66d232f83206171a9064c 2025-09-26 10:39:50,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:50,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:50,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d1a2f83206171a90640 HTTP/1.1" 200 None 2025-09-26 10:39:50,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:50,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d232f83206171a9064c HTTP/1.1" 200 None 2025-09-26 10:39:50,865 - lava_callback - DEBUG - Processing node 68d66d232f83206171a9064c: baseline-arm64 2025-09-26 10:39:50,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:39:50,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:51,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d1a2f83206171a90640 HTTP/1.1" 200 None 2025-09-26 10:39:51,030 - lava_callback - INFO - Completed processing callback for node 68d66d1a2f83206171a90640 2025-09-26 10:39:51,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:51,458 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:51,459 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d232f83206171a9064c/log.txt.gz 2025-09-26 10:39:51,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:51,594 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:51,595 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d232f83206171a9064c/lava_callback.json.gz 2025-09-26 10:39:51,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:51,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d232f83206171a9064c HTTP/1.1" 200 None 2025-09-26 10:39:51,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:51,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:39:51,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:51,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d232f83206171a9064c HTTP/1.1" 200 None 2025-09-26 10:39:51,693 - lava_callback - INFO - Completed processing callback for node 68d66d232f83206171a9064c 2025-09-26 10:39:53,509 - lava_callback - INFO - Received callback for node 68d66d172f83206171a9063d INFO: 172.20.0.1:59762 - "POST /node/68d66d172f83206171a9063d HTTP/1.0" 202 Accepted 2025-09-26 10:39:53,515 - lava_callback - INFO - Starting async job submit for node 68d66d172f83206171a9063d 2025-09-26 10:39:53,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:53,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d172f83206171a9063d HTTP/1.1" 200 None 2025-09-26 10:39:53,550 - lava_callback - DEBUG - Processing node 68d66d172f83206171a9063d: baseline-arm64 2025-09-26 10:39:53,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:54,510 - lava_callback - INFO - Received callback for node 68d66d132f83206171a90623 INFO: 172.20.0.1:59770 - "POST /node/68d66d132f83206171a90623 HTTP/1.0" 202 Accepted 2025-09-26 10:39:54,517 - lava_callback - INFO - Starting async job submit for node 68d66d132f83206171a90623 2025-09-26 10:39:54,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:54,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d132f83206171a90623 HTTP/1.1" 200 None 2025-09-26 10:39:54,558 - lava_callback - DEBUG - Processing node 68d66d132f83206171a90623: baseline-arm64 2025-09-26 10:39:54,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:55,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:55,231 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d172f83206171a9063d/log.txt.gz 2025-09-26 10:39:55,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:55,303 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:55,304 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d132f83206171a90623/log.txt.gz 2025-09-26 10:39:55,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:55,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:55,433 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d172f83206171a9063d/lava_callback.json.gz 2025-09-26 10:39:55,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:55,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d172f83206171a9063d HTTP/1.1" 200 None 2025-09-26 10:39:55,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:55,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:55,484 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d132f83206171a90623/lava_callback.json.gz 2025-09-26 10:39:55,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:39:55,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:55,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:55,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d132f83206171a90623 HTTP/1.1" 200 None 2025-09-26 10:39:55,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:55,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:39:55,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d172f83206171a9063d HTTP/1.1" 200 None 2025-09-26 10:39:55,585 - lava_callback - INFO - Completed processing callback for node 68d66d172f83206171a9063d 2025-09-26 10:39:55,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:55,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d132f83206171a90623 HTTP/1.1" 200 None 2025-09-26 10:39:55,660 - lava_callback - INFO - Completed processing callback for node 68d66d132f83206171a90623 INFO: 172.20.0.1:59780 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:39:56,596 - lava_callback - INFO - Received callback for node 68d66d202f83206171a90649 INFO: 172.20.0.1:59788 - "POST /node/68d66d202f83206171a90649 HTTP/1.0" 202 Accepted 2025-09-26 10:39:56,605 - lava_callback - INFO - Starting async job submit for node 68d66d202f83206171a90649 2025-09-26 10:39:56,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:56,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d202f83206171a90649 HTTP/1.1" 200 None 2025-09-26 10:39:56,652 - lava_callback - DEBUG - Processing node 68d66d202f83206171a90649: baseline-arm64 2025-09-26 10:39:57,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:57,141 - lava_callback - INFO - Received callback for node 68d66d1e2f83206171a90646 INFO: 172.20.0.1:59796 - "POST /node/68d66d1e2f83206171a90646 HTTP/1.0" 202 Accepted 2025-09-26 10:39:57,150 - lava_callback - INFO - Starting async job submit for node 68d66d1e2f83206171a90646 2025-09-26 10:39:57,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:57,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:57,181 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d202f83206171a90649/log.txt.gz 2025-09-26 10:39:57,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:57,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d1e2f83206171a90646 HTTP/1.1" 200 None 2025-09-26 10:39:57,198 - lava_callback - DEBUG - Processing node 68d66d1e2f83206171a90646: baseline-arm64 2025-09-26 10:39:57,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:57,549 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d202f83206171a90649/lava_callback.json.gz 2025-09-26 10:39:57,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:57,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d202f83206171a90649 HTTP/1.1" 200 None 2025-09-26 10:39:57,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:57,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:57,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:39:57,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:57,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d202f83206171a90649 HTTP/1.1" 200 None 2025-09-26 10:39:57,737 - lava_callback - INFO - Completed processing callback for node 68d66d202f83206171a90649 2025-09-26 10:39:57,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:57,872 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d1e2f83206171a90646/log.txt.gz 2025-09-26 10:39:57,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:39:58,047 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:39:58,048 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d1e2f83206171a90646/lava_callback.json.gz 2025-09-26 10:39:58,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:58,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d1e2f83206171a90646 HTTP/1.1" 200 None 2025-09-26 10:39:58,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:58,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:39:58,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:58,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d1e2f83206171a90646 HTTP/1.1" 200 None 2025-09-26 10:39:58,155 - lava_callback - INFO - Completed processing callback for node 68d66d1e2f83206171a90646 2025-09-26 10:39:58,436 - lava_callback - INFO - Received callback for node 68d669442f83206171a90416 INFO: 172.20.0.1:59804 - "POST /node/68d669442f83206171a90416 HTTP/1.0" 202 Accepted 2025-09-26 10:39:58,447 - lava_callback - INFO - Starting async job submit for node 68d669442f83206171a90416 2025-09-26 10:39:58,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:39:58,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d669442f83206171a90416 HTTP/1.1" 200 None 2025-09-26 10:39:58,541 - lava_callback - DEBUG - Processing node 68d669442f83206171a90416: ltp-smoketest 2025-09-26 10:39:59,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:40:00,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:40:00,838 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d669442f83206171a90416/log.txt.gz 2025-09-26 10:40:00,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:40:01,003 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:40:01,004 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d669442f83206171a90416/lava_callback.json.gz 2025-09-26 10:40:01,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:01,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d669442f83206171a90416 HTTP/1.1" 200 None 2025-09-26 10:40:01,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:01,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c942f83206171a8fe61 HTTP/1.1" 200 None 2025-09-26 10:40:01,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:01,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d669442f83206171a90416 HTTP/1.1" 200 None 2025-09-26 10:40:01,269 - lava_callback - INFO - Completed processing callback for node 68d669442f83206171a90416 2025-09-26 10:40:04,831 - lava_callback - INFO - Received callback for node 68d66d322f83206171a9066a INFO: 172.20.0.1:37422 - "POST /node/68d66d322f83206171a9066a HTTP/1.0" 202 Accepted 2025-09-26 10:40:04,837 - lava_callback - INFO - Starting async job submit for node 68d66d322f83206171a9066a 2025-09-26 10:40:04,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:04,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d322f83206171a9066a HTTP/1.1" 200 None 2025-09-26 10:40:04,884 - lava_callback - DEBUG - Processing node 68d66d322f83206171a9066a: baseline-arm64 2025-09-26 10:40:05,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:40:06,255 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:40:06,256 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d322f83206171a9066a/log.txt.gz 2025-09-26 10:40:06,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:40:06,380 - lava_callback - INFO - Received callback for node 68d66d382f83206171a90675 INFO: 172.20.0.1:37426 - "POST /node/68d66d382f83206171a90675 HTTP/1.0" 202 Accepted 2025-09-26 10:40:06,388 - lava_callback - INFO - Starting async job submit for node 68d66d382f83206171a90675 2025-09-26 10:40:06,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:06,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:40:06,428 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d322f83206171a9066a/lava_callback.json.gz 2025-09-26 10:40:06,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:06,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d382f83206171a90675 HTTP/1.1" 200 None 2025-09-26 10:40:06,455 - lava_callback - DEBUG - Processing node 68d66d382f83206171a90675: baseline-arm64 INFO: 172.20.0.1:37432 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:40:06,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d322f83206171a9066a HTTP/1.1" 200 None 2025-09-26 10:40:06,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:06,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:40:06,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:06,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d322f83206171a9066a HTTP/1.1" 200 None 2025-09-26 10:40:06,691 - lava_callback - INFO - Completed processing callback for node 68d66d322f83206171a9066a 2025-09-26 10:40:07,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:40:07,168 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:40:07,169 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d382f83206171a90675/log.txt.gz 2025-09-26 10:40:07,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:40:07,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:40:07,342 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d382f83206171a90675/lava_callback.json.gz 2025-09-26 10:40:07,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:07,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d382f83206171a90675 HTTP/1.1" 200 None 2025-09-26 10:40:07,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:07,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:40:07,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:07,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d382f83206171a90675 HTTP/1.1" 200 None 2025-09-26 10:40:07,448 - lava_callback - INFO - Completed processing callback for node 68d66d382f83206171a90675 2025-09-26 10:40:13,512 - lava_callback - INFO - Received callback for node 68d3c997cd36afa834e0ed43 INFO: 172.20.0.1:57812 - "POST /node/68d3c997cd36afa834e0ed43 HTTP/1.0" 202 Accepted 2025-09-26 10:40:13,520 - lava_callback - INFO - Starting async job submit for node 68d3c997cd36afa834e0ed43 2025-09-26 10:40:13,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:13,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c997cd36afa834e0ed43 HTTP/1.1" 200 None 2025-09-26 10:40:13,567 - lava_callback - DEBUG - Processing node 68d3c997cd36afa834e0ed43: ltp-ipc 2025-09-26 10:40:14,019 - lava_callback - ERROR - Error processing callback for node 68d3c997cd36afa834e0ed43: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:57816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36544 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:40:21,117 - lava_callback - INFO - Received callback for node 68d66d2c2f83206171a90655 INFO: 172.20.0.1:36548 - "POST /node/68d66d2c2f83206171a90655 HTTP/1.0" 202 Accepted 2025-09-26 10:40:21,126 - lava_callback - INFO - Starting async job submit for node 68d66d2c2f83206171a90655 2025-09-26 10:40:21,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:21,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d2c2f83206171a90655 HTTP/1.1" 200 None 2025-09-26 10:40:21,181 - lava_callback - DEBUG - Processing node 68d66d2c2f83206171a90655: baseline-arm64 2025-09-26 10:40:21,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:40:21,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:40:21,841 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d2c2f83206171a90655/log.txt.gz 2025-09-26 10:40:21,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:40:21,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:40:21,986 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d2c2f83206171a90655/lava_callback.json.gz 2025-09-26 10:40:22,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:22,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d2c2f83206171a90655 HTTP/1.1" 200 None 2025-09-26 10:40:22,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:22,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:40:22,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:22,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d2c2f83206171a90655 HTTP/1.1" 200 None 2025-09-26 10:40:22,078 - lava_callback - INFO - Completed processing callback for node 68d66d2c2f83206171a90655 2025-09-26 10:40:22,648 - lava_callback - INFO - Received callback for node 68d66d312f83206171a90667 INFO: 172.20.0.1:36564 - "POST /node/68d66d312f83206171a90667 HTTP/1.0" 202 Accepted 2025-09-26 10:40:22,657 - lava_callback - INFO - Starting async job submit for node 68d66d312f83206171a90667 2025-09-26 10:40:22,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:22,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d312f83206171a90667 HTTP/1.1" 200 None 2025-09-26 10:40:22,695 - lava_callback - DEBUG - Processing node 68d66d312f83206171a90667: baseline-arm64 2025-09-26 10:40:23,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:40:24,013 - lava_callback - INFO - Received callback for node 68d66d292f83206171a90652 INFO: 172.20.0.1:36566 - "POST /node/68d66d292f83206171a90652 HTTP/1.0" 202 Accepted 2025-09-26 10:40:24,020 - lava_callback - INFO - Starting async job submit for node 68d66d292f83206171a90652 2025-09-26 10:40:24,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:24,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d292f83206171a90652 HTTP/1.1" 200 None 2025-09-26 10:40:24,060 - lava_callback - DEBUG - Processing node 68d66d292f83206171a90652: baseline-arm64 2025-09-26 10:40:24,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:40:25,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:40:25,143 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d292f83206171a90652/log.txt.gz 2025-09-26 10:40:25,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:40:25,162 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:40:25,163 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d312f83206171a90667/log.txt.gz 2025-09-26 10:40:25,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:40:25,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:40:25,295 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d292f83206171a90652/lava_callback.json.gz 2025-09-26 10:40:25,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:25,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d292f83206171a90652 HTTP/1.1" 200 None 2025-09-26 10:40:25,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:25,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:40:25,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:25,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d292f83206171a90652 HTTP/1.1" 200 None 2025-09-26 10:40:25,408 - lava_callback - INFO - Completed processing callback for node 68d66d292f83206171a90652 2025-09-26 10:40:26,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:40:26,344 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d312f83206171a90667/lava_callback.json.gz 2025-09-26 10:40:26,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:26,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d312f83206171a90667 HTTP/1.1" 200 None 2025-09-26 10:40:26,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:26,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:40:26,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:26,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d312f83206171a90667 HTTP/1.1" 200 None 2025-09-26 10:40:26,428 - lava_callback - INFO - Completed processing callback for node 68d66d312f83206171a90667 INFO: 172.20.0.1:36570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39736 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:40:43,422 - lava_callback - INFO - Received callback for node 68d66ce92f83206171a90611 INFO: 172.20.0.1:40326 - "POST /node/68d66ce92f83206171a90611 HTTP/1.0" 202 Accepted 2025-09-26 10:40:43,428 - lava_callback - INFO - Starting async job submit for node 68d66ce92f83206171a90611 2025-09-26 10:40:43,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:43,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ce92f83206171a90611 HTTP/1.1" 200 None 2025-09-26 10:40:43,478 - lava_callback - DEBUG - Processing node 68d66ce92f83206171a90611: baseline-arm64 2025-09-26 10:40:43,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:40:44,091 - lava_callback - INFO - Received callback for node 68d66c4c2f83206171a90562 INFO: 172.20.0.1:40334 - "POST /node/68d66c4c2f83206171a90562 HTTP/1.0" 202 Accepted 2025-09-26 10:40:44,101 - lava_callback - INFO - Starting async job submit for node 68d66c4c2f83206171a90562 2025-09-26 10:40:44,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:44,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c4c2f83206171a90562 HTTP/1.1" 200 None 2025-09-26 10:40:44,135 - lava_callback - DEBUG - Processing node 68d66c4c2f83206171a90562: baseline-arm 2025-09-26 10:40:44,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:40:44,655 - lava_callback - INFO - Received callback for node 68d66ce32f83206171a9060b INFO: 172.20.0.1:40336 - "POST /node/68d66ce32f83206171a9060b HTTP/1.0" 202 Accepted 2025-09-26 10:40:44,661 - lava_callback - INFO - Starting async job submit for node 68d66ce32f83206171a9060b 2025-09-26 10:40:44,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:44,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ce32f83206171a9060b HTTP/1.1" 200 None 2025-09-26 10:40:44,712 - lava_callback - DEBUG - Processing node 68d66ce32f83206171a9060b: baseline-arm64 2025-09-26 10:40:44,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:40:45,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:40:45,180 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66ce32f83206171a9060b/log.txt.gz 2025-09-26 10:40:45,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:40:45,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:40:45,212 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66ce92f83206171a90611/log.txt.gz 2025-09-26 10:40:45,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:40:45,222 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:40:45,223 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c4c2f83206171a90562/log.txt.gz 2025-09-26 10:40:45,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:40:45,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:40:45,340 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66ce32f83206171a9060b/lava_callback.json.gz 2025-09-26 10:40:45,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:45,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ce32f83206171a9060b HTTP/1.1" 200 None 2025-09-26 10:40:45,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:45,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:40:45,425 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c4c2f83206171a90562/lava_callback.json.gz 2025-09-26 10:40:45,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:40:45,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:45,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:40:45,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:45,462 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66ce92f83206171a90611/lava_callback.json.gz 2025-09-26 10:40:45,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:45,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c4c2f83206171a90562 HTTP/1.1" 200 None 2025-09-26 10:40:45,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:45,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66ce32f83206171a9060b HTTP/1.1" 200 None 2025-09-26 10:40:45,534 - lava_callback - INFO - Completed processing callback for node 68d66ce32f83206171a9060b 2025-09-26 10:40:45,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ce92f83206171a90611 HTTP/1.1" 200 None 2025-09-26 10:40:45,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:45,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:40:45,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:45,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:40:45,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:45,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c4c2f83206171a90562 HTTP/1.1" 200 None 2025-09-26 10:40:45,632 - lava_callback - INFO - Completed processing callback for node 68d66c4c2f83206171a90562 2025-09-26 10:40:45,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66ce92f83206171a90611 HTTP/1.1" 200 None 2025-09-26 10:40:45,658 - lava_callback - INFO - Completed processing callback for node 68d66ce92f83206171a90611 INFO: 172.20.0.1:40350 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:40:49,562 - lava_callback - INFO - Received callback for node 68d66c4a2f83206171a9055f INFO: 172.20.0.1:36348 - "POST /node/68d66c4a2f83206171a9055f HTTP/1.0" 202 Accepted 2025-09-26 10:40:49,568 - lava_callback - INFO - Starting async job submit for node 68d66c4a2f83206171a9055f 2025-09-26 10:40:49,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:49,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c4a2f83206171a9055f HTTP/1.1" 200 None 2025-09-26 10:40:49,612 - lava_callback - DEBUG - Processing node 68d66c4a2f83206171a9055f: baseline-arm 2025-09-26 10:40:49,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:40:50,369 - lava_callback - INFO - Received callback for node 68d66d5f2f83206171a906d3 INFO: 172.20.0.1:36354 - "POST /node/68d66d5f2f83206171a906d3 HTTP/1.0" 202 Accepted 2025-09-26 10:40:50,379 - lava_callback - INFO - Starting async job submit for node 68d66d5f2f83206171a906d3 2025-09-26 10:40:50,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:50,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d5f2f83206171a906d3 HTTP/1.1" 200 None 2025-09-26 10:40:50,460 - lava_callback - DEBUG - Processing node 68d66d5f2f83206171a906d3: baseline-arm64 2025-09-26 10:40:50,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:40:50,559 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c4a2f83206171a9055f/log.txt.gz 2025-09-26 10:40:50,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:40:50,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:40:50,946 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c4a2f83206171a9055f/lava_callback.json.gz 2025-09-26 10:40:51,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:51,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c4a2f83206171a9055f HTTP/1.1" 200 None 2025-09-26 10:40:51,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:51,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:40:51,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:51,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:40:51,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c4a2f83206171a9055f HTTP/1.1" 200 None 2025-09-26 10:40:51,230 - lava_callback - INFO - Completed processing callback for node 68d66c4a2f83206171a9055f 2025-09-26 10:40:51,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:40:51,369 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d5f2f83206171a906d3/log.txt.gz 2025-09-26 10:40:51,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:40:51,542 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:40:51,543 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d5f2f83206171a906d3/lava_callback.json.gz 2025-09-26 10:40:51,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:51,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d5f2f83206171a906d3 HTTP/1.1" 200 None 2025-09-26 10:40:51,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:51,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:40:51,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:51,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d5f2f83206171a906d3 HTTP/1.1" 200 None 2025-09-26 10:40:51,636 - lava_callback - INFO - Completed processing callback for node 68d66d5f2f83206171a906d3 INFO: 172.20.0.1:36366 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:40:57,531 - lava_callback - INFO - Received callback for node 68d66ce62f83206171a9060e INFO: 172.20.0.1:36382 - "POST /node/68d66ce62f83206171a9060e HTTP/1.0" 202 Accepted 2025-09-26 10:40:57,548 - lava_callback - INFO - Starting async job submit for node 68d66ce62f83206171a9060e 2025-09-26 10:40:57,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:57,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ce62f83206171a9060e HTTP/1.1" 200 None 2025-09-26 10:40:57,922 - lava_callback - DEBUG - Processing node 68d66ce62f83206171a9060e: baseline-arm64 2025-09-26 10:40:58,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:40:58,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:40:58,426 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66ce62f83206171a9060e/log.txt.gz 2025-09-26 10:40:58,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:40:58,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:40:58,579 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66ce62f83206171a9060e/lava_callback.json.gz 2025-09-26 10:40:58,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:58,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ce62f83206171a9060e HTTP/1.1" 200 None 2025-09-26 10:40:58,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:58,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:40:58,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:58,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66ce62f83206171a9060e HTTP/1.1" 200 None 2025-09-26 10:40:58,679 - lava_callback - INFO - Completed processing callback for node 68d66ce62f83206171a9060e 2025-09-26 10:40:59,347 - lava_callback - INFO - Received callback for node 68d66d652f83206171a906d9 INFO: 172.20.0.1:57030 - "POST /node/68d66d652f83206171a906d9 HTTP/1.0" 202 Accepted 2025-09-26 10:40:59,354 - lava_callback - INFO - Starting async job submit for node 68d66d652f83206171a906d9 2025-09-26 10:40:59,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:40:59,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d652f83206171a906d9 HTTP/1.1" 200 None 2025-09-26 10:40:59,395 - lava_callback - DEBUG - Processing node 68d66d652f83206171a906d9: baseline-arm64 2025-09-26 10:40:59,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:01,412 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:01,412 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d652f83206171a906d9/log.txt.gz 2025-09-26 10:41:01,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:01,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:01,584 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d652f83206171a906d9/lava_callback.json.gz 2025-09-26 10:41:01,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:01,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d652f83206171a906d9 HTTP/1.1" 200 None 2025-09-26 10:41:01,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:01,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:41:01,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:01,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d652f83206171a906d9 HTTP/1.1" 200 None 2025-09-26 10:41:01,715 - lava_callback - INFO - Completed processing callback for node 68d66d652f83206171a906d9 INFO: 172.20.0.1:57034 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:41:06,825 - lava_callback - INFO - Received callback for node 68d66d5d2f83206171a906d0 INFO: 172.20.0.1:57040 - "POST /node/68d66d5d2f83206171a906d0 HTTP/1.0" 202 Accepted 2025-09-26 10:41:06,864 - lava_callback - INFO - Starting async job submit for node 68d66d5d2f83206171a906d0 2025-09-26 10:41:06,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:06,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d5d2f83206171a906d0 HTTP/1.1" 200 None 2025-09-26 10:41:06,934 - lava_callback - DEBUG - Processing node 68d66d5d2f83206171a906d0: baseline-arm64 2025-09-26 10:41:07,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:07,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:07,798 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d5d2f83206171a906d0/log.txt.gz 2025-09-26 10:41:07,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:08,022 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:08,023 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d5d2f83206171a906d0/lava_callback.json.gz 2025-09-26 10:41:08,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:08,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d5d2f83206171a906d0 HTTP/1.1" 200 None 2025-09-26 10:41:08,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:08,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:41:08,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:08,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d5d2f83206171a906d0 HTTP/1.1" 200 None 2025-09-26 10:41:08,126 - lava_callback - INFO - Completed processing callback for node 68d66d5d2f83206171a906d0 2025-09-26 10:41:14,427 - lava_callback - INFO - Received callback for node 68d66d262f83206171a9064f INFO: 172.20.0.1:42882 - "POST /node/68d66d262f83206171a9064f HTTP/1.0" 202 Accepted 2025-09-26 10:41:14,433 - lava_callback - INFO - Starting async job submit for node 68d66d262f83206171a9064f 2025-09-26 10:41:14,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:14,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d262f83206171a9064f HTTP/1.1" 200 None 2025-09-26 10:41:14,466 - lava_callback - DEBUG - Processing node 68d66d262f83206171a9064f: baseline-arm64 2025-09-26 10:41:14,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:42896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42910 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:41:16,163 - lava_callback - INFO - Received callback for node 68d66ceb2f83206171a90614 INFO: 172.20.0.1:42924 - "POST /node/68d66ceb2f83206171a90614 HTTP/1.0" 202 Accepted 2025-09-26 10:41:16,174 - lava_callback - INFO - Starting async job submit for node 68d66ceb2f83206171a90614 2025-09-26 10:41:16,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:16,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ceb2f83206171a90614 HTTP/1.1" 200 None 2025-09-26 10:41:16,216 - lava_callback - DEBUG - Processing node 68d66ceb2f83206171a90614: baseline-arm64 2025-09-26 10:41:16,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:42928 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:41:17,055 - lava_callback - INFO - Received callback for node 68d66d762f83206171a906f1 INFO: 172.20.0.1:42942 - "POST /node/68d66d762f83206171a906f1 HTTP/1.0" 202 Accepted 2025-09-26 10:41:17,062 - lava_callback - INFO - Starting async job submit for node 68d66d762f83206171a906f1 2025-09-26 10:41:17,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:17,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d762f83206171a906f1 HTTP/1.1" 200 None 2025-09-26 10:41:17,104 - lava_callback - DEBUG - Processing node 68d66d762f83206171a906f1: baseline-arm64 2025-09-26 10:41:17,266 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:17,297 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d262f83206171a9064f/log.txt.gz 2025-09-26 10:41:17,345 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:17,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:17,410 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66ceb2f83206171a90614/log.txt.gz 2025-09-26 10:41:17,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:17,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:51888 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:41:19,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:19,698 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d262f83206171a9064f/lava_callback.json.gz 2025-09-26 10:41:19,714 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:19,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:19,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:19,723 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66ceb2f83206171a90614/lava_callback.json.gz 2025-09-26 10:41:19,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:19,746 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d762f83206171a906f1/log.txt.gz 2025-09-26 10:41:19,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:19,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d262f83206171a9064f HTTP/1.1" 200 None 2025-09-26 10:41:19,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:19,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ceb2f83206171a90614 HTTP/1.1" 200 None 2025-09-26 10:41:19,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:19,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:41:19,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:41:19,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:19,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:19,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66ceb2f83206171a90614 HTTP/1.1" 200 None 2025-09-26 10:41:19,848 - lava_callback - INFO - Completed processing callback for node 68d66ceb2f83206171a90614 2025-09-26 10:41:19,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d262f83206171a9064f HTTP/1.1" 200 None 2025-09-26 10:41:19,850 - lava_callback - INFO - Completed processing callback for node 68d66d262f83206171a9064f 2025-09-26 10:41:19,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:19,965 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d762f83206171a906f1/lava_callback.json.gz 2025-09-26 10:41:20,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:20,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d762f83206171a906f1 HTTP/1.1" 200 None 2025-09-26 10:41:20,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:20,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:41:20,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:20,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d762f83206171a906f1 HTTP/1.1" 200 None 2025-09-26 10:41:20,159 - lava_callback - INFO - Completed processing callback for node 68d66d762f83206171a906f1 2025-09-26 10:41:20,375 - lava_callback - INFO - Received callback for node 68d669752f83206171a90424 INFO: 172.20.0.1:51904 - "POST /node/68d669752f83206171a90424 HTTP/1.0" 202 Accepted 2025-09-26 10:41:20,385 - lava_callback - INFO - Starting async job submit for node 68d669752f83206171a90424 2025-09-26 10:41:20,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:20,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d669752f83206171a90424 HTTP/1.1" 200 None 2025-09-26 10:41:20,460 - lava_callback - DEBUG - Processing node 68d669752f83206171a90424: baseline-arm 2025-09-26 10:41:20,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:21,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:21,018 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d669752f83206171a90424/log.txt.gz 2025-09-26 10:41:21,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:21,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:21,195 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d669752f83206171a90424/lava_callback.json.gz DEBUG: Setup failed for 68d669752f83206171a90424. Transitting job node result: incomplete -> fail 2025-09-26 10:41:21,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:21,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d669752f83206171a90424 HTTP/1.1" 200 None 2025-09-26 10:41:21,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:21,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-26 10:41:21,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:21,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d669752f83206171a90424 HTTP/1.1" 200 None 2025-09-26 10:41:21,369 - lava_callback - INFO - Completed processing callback for node 68d669752f83206171a90424 2025-09-26 10:41:22,951 - lava_callback - INFO - Received callback for node 68d66d3c2f83206171a9067b INFO: 172.20.0.1:51906 - "POST /node/68d66d3c2f83206171a9067b HTTP/1.0" 202 Accepted 2025-09-26 10:41:22,959 - lava_callback - INFO - Starting async job submit for node 68d66d3c2f83206171a9067b 2025-09-26 10:41:22,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:22,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d3c2f83206171a9067b HTTP/1.1" 200 None 2025-09-26 10:41:23,000 - lava_callback - DEBUG - Processing node 68d66d3c2f83206171a9067b: baseline-arm64 2025-09-26 10:41:23,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:24,343 - lava_callback - INFO - Received callback for node 68d66d392f83206171a90678 INFO: 172.20.0.1:51910 - "POST /node/68d66d392f83206171a90678 HTTP/1.0" 202 Accepted 2025-09-26 10:41:24,349 - lava_callback - INFO - Starting async job submit for node 68d66d392f83206171a90678 2025-09-26 10:41:24,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:24,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d392f83206171a90678 HTTP/1.1" 200 None 2025-09-26 10:41:24,396 - lava_callback - DEBUG - Processing node 68d66d392f83206171a90678: baseline-arm64 2025-09-26 10:41:24,525 - lava_callback - INFO - Received callback for node 68d66d732f83206171a906ee INFO: 172.20.0.1:51926 - "POST /node/68d66d732f83206171a906ee HTTP/1.0" 202 Accepted 2025-09-26 10:41:24,541 - lava_callback - INFO - Starting async job submit for node 68d66d732f83206171a906ee 2025-09-26 10:41:24,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:24,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d732f83206171a906ee HTTP/1.1" 200 None 2025-09-26 10:41:24,675 - lava_callback - DEBUG - Processing node 68d66d732f83206171a906ee: baseline-arm64 2025-09-26 10:41:25,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:25,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:25,351 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:25,352 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d392f83206171a90678/log.txt.gz 2025-09-26 10:41:25,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:25,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:25,374 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d3c2f83206171a9067b/log.txt.gz 2025-09-26 10:41:25,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:25,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:25,538 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d732f83206171a906ee/log.txt.gz 2025-09-26 10:41:25,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:25,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:25,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:25,598 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d392f83206171a90678/lava_callback.json.gz 2025-09-26 10:41:25,604 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d3c2f83206171a9067b/lava_callback.json.gz 2025-09-26 10:41:25,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:25,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:25,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d3c2f83206171a9067b HTTP/1.1" 200 None 2025-09-26 10:41:25,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:25,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d392f83206171a90678 HTTP/1.1" 200 None 2025-09-26 10:41:25,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:25,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:41:25,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:25,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:41:25,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:25,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:25,774 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d732f83206171a906ee/lava_callback.json.gz 2025-09-26 10:41:25,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d3c2f83206171a9067b HTTP/1.1" 200 None 2025-09-26 10:41:25,824 - lava_callback - INFO - Completed processing callback for node 68d66d3c2f83206171a9067b 2025-09-26 10:41:25,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:25,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d392f83206171a90678 HTTP/1.1" 200 None 2025-09-26 10:41:25,842 - lava_callback - INFO - Completed processing callback for node 68d66d392f83206171a90678 2025-09-26 10:41:25,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d732f83206171a906ee HTTP/1.1" 200 None 2025-09-26 10:41:25,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:25,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:41:25,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:26,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d732f83206171a906ee HTTP/1.1" 200 None 2025-09-26 10:41:26,012 - lava_callback - INFO - Completed processing callback for node 68d66d732f83206171a906ee INFO: 172.20.0.1:51938 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:41:34,817 - lava_callback - INFO - Received callback for node 68d66d892f83206171a90732 INFO: 172.20.0.1:53436 - "POST /node/68d66d892f83206171a90732 HTTP/1.0" 202 Accepted 2025-09-26 10:41:34,825 - lava_callback - INFO - Starting async job submit for node 68d66d892f83206171a90732 2025-09-26 10:41:34,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:34,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d892f83206171a90732 HTTP/1.1" 200 None 2025-09-26 10:41:34,872 - lava_callback - DEBUG - Processing node 68d66d892f83206171a90732: baseline-arm64 2025-09-26 10:41:35,146 - lava_callback - INFO - Received callback for node 68d3cacecd36afa834e0f123 INFO: 172.20.0.1:53446 - "POST /node/68d3cacecd36afa834e0f123 HTTP/1.0" 202 Accepted 2025-09-26 10:41:35,152 - lava_callback - INFO - Starting async job submit for node 68d3cacecd36afa834e0f123 2025-09-26 10:41:35,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:35,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:35,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cacecd36afa834e0f123 HTTP/1.1" 200 None 2025-09-26 10:41:35,169 - lava_callback - DEBUG - Processing node 68d3cacecd36afa834e0f123: baseline-arm 2025-09-26 10:41:35,169 - lava_callback - ERROR - Error processing callback for node 68d3cacecd36afa834e0f123: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:41:35,882 - lava_callback - INFO - Received callback for node 68d3cacecd36afa834e0f126 INFO: 172.20.0.1:53462 - "POST /node/68d3cacecd36afa834e0f126 HTTP/1.0" 202 Accepted 2025-09-26 10:41:35,892 - lava_callback - INFO - Starting async job submit for node 68d3cacecd36afa834e0f126 2025-09-26 10:41:35,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:35,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:35,895 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d892f83206171a90732/log.txt.gz 2025-09-26 10:41:35,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:35,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cacecd36afa834e0f126 HTTP/1.1" 200 None 2025-09-26 10:41:35,917 - lava_callback - DEBUG - Processing node 68d3cacecd36afa834e0f126: baseline-arm 2025-09-26 10:41:35,918 - lava_callback - ERROR - Error processing callback for node 68d3cacecd36afa834e0f126: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:41:36,071 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:36,072 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d892f83206171a90732/lava_callback.json.gz 2025-09-26 10:41:36,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:36,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d892f83206171a90732 HTTP/1.1" 200 None 2025-09-26 10:41:36,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:36,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:41:36,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:36,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d892f83206171a90732 HTTP/1.1" 200 None 2025-09-26 10:41:36,219 - lava_callback - INFO - Completed processing callback for node 68d66d892f83206171a90732 INFO: 172.20.0.1:53474 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:41:36,622 - lava_callback - INFO - Received callback for node 68d3cad0cd36afa834e0f129 INFO: 172.20.0.1:53478 - "POST /node/68d3cad0cd36afa834e0f129 HTTP/1.0" 202 Accepted 2025-09-26 10:41:36,628 - lava_callback - INFO - Starting async job submit for node 68d3cad0cd36afa834e0f129 2025-09-26 10:41:36,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:36,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cad0cd36afa834e0f129 HTTP/1.1" 200 None 2025-09-26 10:41:36,643 - lava_callback - DEBUG - Processing node 68d3cad0cd36afa834e0f129: baseline-arm 2025-09-26 10:41:36,643 - lava_callback - ERROR - Error processing callback for node 68d3cad0cd36afa834e0f129: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:41:37,328 - lava_callback - INFO - Received callback for node 68d3cad1cd36afa834e0f12c INFO: 172.20.0.1:53490 - "POST /node/68d3cad1cd36afa834e0f12c HTTP/1.0" 202 Accepted 2025-09-26 10:41:37,338 - lava_callback - INFO - Starting async job submit for node 68d3cad1cd36afa834e0f12c 2025-09-26 10:41:37,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:37,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cad1cd36afa834e0f12c HTTP/1.1" 200 None 2025-09-26 10:41:37,353 - lava_callback - DEBUG - Processing node 68d3cad1cd36afa834e0f12c: baseline-arm 2025-09-26 10:41:37,353 - lava_callback - ERROR - Error processing callback for node 68d3cad1cd36afa834e0f12c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:41:38,050 - lava_callback - INFO - Received callback for node 68d3cad5cd36afa834e0f12f INFO: 172.20.0.1:53492 - "POST /node/68d3cad5cd36afa834e0f12f HTTP/1.0" 202 Accepted 2025-09-26 10:41:38,058 - lava_callback - INFO - Starting async job submit for node 68d3cad5cd36afa834e0f12f 2025-09-26 10:41:38,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:38,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cad5cd36afa834e0f12f HTTP/1.1" 200 None 2025-09-26 10:41:38,072 - lava_callback - DEBUG - Processing node 68d3cad5cd36afa834e0f12f: baseline-arm 2025-09-26 10:41:38,072 - lava_callback - ERROR - Error processing callback for node 68d3cad5cd36afa834e0f12f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:41:38,767 - lava_callback - INFO - Received callback for node 68d3cad6cd36afa834e0f134 INFO: 172.20.0.1:53508 - "POST /node/68d3cad6cd36afa834e0f134 HTTP/1.0" 202 Accepted 2025-09-26 10:41:38,775 - lava_callback - INFO - Starting async job submit for node 68d3cad6cd36afa834e0f134 2025-09-26 10:41:38,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:38,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cad6cd36afa834e0f134 HTTP/1.1" 200 None 2025-09-26 10:41:38,792 - lava_callback - DEBUG - Processing node 68d3cad6cd36afa834e0f134: baseline-arm 2025-09-26 10:41:38,792 - lava_callback - ERROR - Error processing callback for node 68d3cad6cd36afa834e0f134: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:41:39,449 - lava_callback - INFO - Received callback for node 68d3cad8cd36afa834e0f137 INFO: 172.20.0.1:40986 - "POST /node/68d3cad8cd36afa834e0f137 HTTP/1.0" 202 Accepted 2025-09-26 10:41:39,457 - lava_callback - INFO - Starting async job submit for node 68d3cad8cd36afa834e0f137 2025-09-26 10:41:39,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:39,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cad8cd36afa834e0f137 HTTP/1.1" 200 None 2025-09-26 10:41:39,477 - lava_callback - DEBUG - Processing node 68d3cad8cd36afa834e0f137: baseline-arm 2025-09-26 10:41:39,478 - lava_callback - ERROR - Error processing callback for node 68d3cad8cd36afa834e0f137: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:41:40,118 - lava_callback - INFO - Received callback for node 68d3cadbcd36afa834e0f13a INFO: 172.20.0.1:40992 - "POST /node/68d3cadbcd36afa834e0f13a HTTP/1.0" 202 Accepted 2025-09-26 10:41:40,123 - lava_callback - INFO - Starting async job submit for node 68d3cadbcd36afa834e0f13a 2025-09-26 10:41:40,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:40,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cadbcd36afa834e0f13a HTTP/1.1" 200 None 2025-09-26 10:41:40,137 - lava_callback - DEBUG - Processing node 68d3cadbcd36afa834e0f13a: baseline-arm 2025-09-26 10:41:40,137 - lava_callback - ERROR - Error processing callback for node 68d3cadbcd36afa834e0f13a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:41:41,204 - lava_callback - INFO - Received callback for node 68d66c502f83206171a90565 INFO: 172.20.0.1:41004 - "POST /node/68d66c502f83206171a90565 HTTP/1.0" 202 Accepted 2025-09-26 10:41:41,214 - lava_callback - INFO - Starting async job submit for node 68d66c502f83206171a90565 2025-09-26 10:41:41,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:41,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c502f83206171a90565 HTTP/1.1" 200 None 2025-09-26 10:41:41,257 - lava_callback - DEBUG - Processing node 68d66c502f83206171a90565: baseline-arm 2025-09-26 10:41:41,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:41,952 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:41,953 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c502f83206171a90565/log.txt.gz 2025-09-26 10:41:41,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:42,114 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:42,115 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c502f83206171a90565/lava_callback.json.gz 2025-09-26 10:41:42,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:42,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c502f83206171a90565 HTTP/1.1" 200 None 2025-09-26 10:41:42,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:42,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:41:42,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:42,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c502f83206171a90565 HTTP/1.1" 200 None 2025-09-26 10:41:42,278 - lava_callback - INFO - Completed processing callback for node 68d66c502f83206171a90565 2025-09-26 10:41:43,297 - lava_callback - INFO - Received callback for node 68d66d7b2f83206171a9070f INFO: 172.20.0.1:41006 - "POST /node/68d66d7b2f83206171a9070f HTTP/1.0" 202 Accepted 2025-09-26 10:41:43,306 - lava_callback - INFO - Starting async job submit for node 68d66d7b2f83206171a9070f 2025-09-26 10:41:43,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:43,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d7b2f83206171a9070f HTTP/1.1" 200 None 2025-09-26 10:41:43,372 - lava_callback - DEBUG - Processing node 68d66d7b2f83206171a9070f: baseline-arm64 2025-09-26 10:41:43,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:43,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:43,977 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d7b2f83206171a9070f/log.txt.gz 2025-09-26 10:41:43,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:44,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:44,104 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d7b2f83206171a9070f/lava_callback.json.gz 2025-09-26 10:41:44,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:44,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d7b2f83206171a9070f HTTP/1.1" 200 None 2025-09-26 10:41:44,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:44,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:41:44,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:44,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d7b2f83206171a9070f HTTP/1.1" 200 None 2025-09-26 10:41:44,216 - lava_callback - INFO - Completed processing callback for node 68d66d7b2f83206171a9070f 2025-09-26 10:41:45,726 - lava_callback - INFO - Received callback for node 68d66c512f83206171a90568 INFO: 172.20.0.1:41012 - "POST /node/68d66c512f83206171a90568 HTTP/1.0" 202 Accepted 2025-09-26 10:41:45,733 - lava_callback - INFO - Starting async job submit for node 68d66c512f83206171a90568 2025-09-26 10:41:45,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:45,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c512f83206171a90568 HTTP/1.1" 200 None 2025-09-26 10:41:45,778 - lava_callback - DEBUG - Processing node 68d66c512f83206171a90568: baseline-arm 2025-09-26 10:41:46,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:41018 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:41:46,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:46,661 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c512f83206171a90568/log.txt.gz 2025-09-26 10:41:46,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:46,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:46,811 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66c512f83206171a90568/lava_callback.json.gz 2025-09-26 10:41:46,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:46,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66c512f83206171a90568 HTTP/1.1" 200 None 2025-09-26 10:41:46,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:46,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56805b70fb2a1e20f2806 HTTP/1.1" 200 None 2025-09-26 10:41:46,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:46,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66c512f83206171a90568 HTTP/1.1" 200 None 2025-09-26 10:41:46,950 - lava_callback - INFO - Completed processing callback for node 68d66c512f83206171a90568 2025-09-26 10:41:48,779 - lava_callback - INFO - Received callback for node 68d66d792f83206171a90704 INFO: 172.20.0.1:41034 - "POST /node/68d66d792f83206171a90704 HTTP/1.0" 202 Accepted 2025-09-26 10:41:48,788 - lava_callback - INFO - Starting async job submit for node 68d66d792f83206171a90704 2025-09-26 10:41:48,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:48,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d792f83206171a90704 HTTP/1.1" 200 None 2025-09-26 10:41:48,840 - lava_callback - DEBUG - Processing node 68d66d792f83206171a90704: baseline-arm64 2025-09-26 10:41:48,913 - lava_callback - INFO - Received callback for node 68d3cadecd36afa834e0f13d INFO: 172.20.0.1:41042 - "POST /node/68d3cadecd36afa834e0f13d HTTP/1.0" 202 Accepted 2025-09-26 10:41:48,943 - lava_callback - INFO - Starting async job submit for node 68d3cadecd36afa834e0f13d 2025-09-26 10:41:48,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:49,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cadecd36afa834e0f13d HTTP/1.1" 200 None 2025-09-26 10:41:49,055 - lava_callback - DEBUG - Processing node 68d3cadecd36afa834e0f13d: ltp-fsx 2025-09-26 10:41:49,055 - lava_callback - ERROR - Error processing callback for node 68d3cadecd36afa834e0f13d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:41:49,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:49,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:49,522 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d792f83206171a90704/log.txt.gz 2025-09-26 10:41:49,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:49,729 - lava_callback - INFO - Received callback for node 68d3cae9cd36afa834e0f14c INFO: 172.20.0.1:53822 - "POST /node/68d3cae9cd36afa834e0f14c HTTP/1.0" 202 Accepted 2025-09-26 10:41:49,736 - lava_callback - INFO - Starting async job submit for node 68d3cae9cd36afa834e0f14c 2025-09-26 10:41:49,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:49,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cae9cd36afa834e0f14c HTTP/1.1" 200 None 2025-09-26 10:41:49,760 - lava_callback - DEBUG - Processing node 68d3cae9cd36afa834e0f14c: ltp-sched 2025-09-26 10:41:49,760 - lava_callback - ERROR - Error processing callback for node 68d3cae9cd36afa834e0f14c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:41:51,255 - lava_callback - INFO - Received callback for node 68d66d8b2f83206171a90735 INFO: 172.20.0.1:53830 - "POST /node/68d66d8b2f83206171a90735 HTTP/1.0" 202 Accepted 2025-09-26 10:41:51,261 - lava_callback - INFO - Starting async job submit for node 68d66d8b2f83206171a90735 2025-09-26 10:41:51,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:51,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d8b2f83206171a90735 HTTP/1.1" 200 None 2025-09-26 10:41:51,296 - lava_callback - DEBUG - Processing node 68d66d8b2f83206171a90735: baseline-arm64 2025-09-26 10:41:51,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:51,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:51,944 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d792f83206171a90704/lava_callback.json.gz 2025-09-26 10:41:51,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:51,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:51,966 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d8b2f83206171a90735/log.txt.gz 2025-09-26 10:41:51,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:51,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d792f83206171a90704 HTTP/1.1" 200 None 2025-09-26 10:41:51,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:52,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:41:52,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:52,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d792f83206171a90704 HTTP/1.1" 200 None 2025-09-26 10:41:52,056 - lava_callback - INFO - Completed processing callback for node 68d66d792f83206171a90704 2025-09-26 10:41:52,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:52,200 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d8b2f83206171a90735/lava_callback.json.gz 2025-09-26 10:41:52,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:52,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d8b2f83206171a90735 HTTP/1.1" 200 None 2025-09-26 10:41:52,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:52,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:41:52,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:52,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d8b2f83206171a90735 HTTP/1.1" 200 None 2025-09-26 10:41:52,327 - lava_callback - INFO - Completed processing callback for node 68d66d8b2f83206171a90735 2025-09-26 10:41:52,572 - lava_callback - INFO - Received callback for node 68d40a27cd36afa834e16ef1 INFO: 172.20.0.1:53842 - "POST /node/68d40a27cd36afa834e16ef1 HTTP/1.0" 202 Accepted 2025-09-26 10:41:52,581 - lava_callback - INFO - Starting async job submit for node 68d40a27cd36afa834e16ef1 2025-09-26 10:41:52,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:52,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a27cd36afa834e16ef1 HTTP/1.1" 200 None 2025-09-26 10:41:52,642 - lava_callback - DEBUG - Processing node 68d40a27cd36afa834e16ef1: baseline-arm 2025-09-26 10:41:52,993 - lava_callback - ERROR - Error processing callback for node 68d40a27cd36afa834e16ef1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:53848 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:41:58,107 - lava_callback - INFO - Received callback for node 68d66d3f2f83206171a9067e INFO: 172.20.0.1:53850 - "POST /node/68d66d3f2f83206171a9067e HTTP/1.0" 202 Accepted 2025-09-26 10:41:58,113 - lava_callback - INFO - Starting async job submit for node 68d66d3f2f83206171a9067e 2025-09-26 10:41:58,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:58,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d3f2f83206171a9067e HTTP/1.1" 200 None 2025-09-26 10:41:58,147 - lava_callback - DEBUG - Processing node 68d66d3f2f83206171a9067e: baseline-arm64 2025-09-26 10:41:58,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:59,265 - lava_callback - INFO - Received callback for node 68d66d8f2f83206171a90738 INFO: 172.20.0.1:53862 - "POST /node/68d66d8f2f83206171a90738 HTTP/1.0" 202 Accepted 2025-09-26 10:41:59,272 - lava_callback - INFO - Starting async job submit for node 68d66d8f2f83206171a90738 2025-09-26 10:41:59,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:41:59,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d8f2f83206171a90738 HTTP/1.1" 200 None 2025-09-26 10:41:59,305 - lava_callback - DEBUG - Processing node 68d66d8f2f83206171a90738: baseline-arm64 2025-09-26 10:41:59,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:59,825 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:59,826 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d3f2f83206171a9067e/log.txt.gz 2025-09-26 10:41:59,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:41:59,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:41:59,845 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d8f2f83206171a90738/log.txt.gz 2025-09-26 10:41:59,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:42:01,952 - lava_callback - INFO - Received callback for node 68d6699f2f83206171a9042a INFO: 172.20.0.1:54220 - "POST /node/68d6699f2f83206171a9042a HTTP/1.0" 202 Accepted 2025-09-26 10:42:01,960 - lava_callback - INFO - Starting async job submit for node 68d6699f2f83206171a9042a 2025-09-26 10:42:01,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:02,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6699f2f83206171a9042a HTTP/1.1" 200 None 2025-09-26 10:42:02,011 - lava_callback - DEBUG - Processing node 68d6699f2f83206171a9042a: baseline-arm 2025-09-26 10:42:02,509 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:02,515 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d8f2f83206171a90738/lava_callback.json.gz 2025-09-26 10:42:02,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:02,541 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d3f2f83206171a9067e/lava_callback.json.gz 2025-09-26 10:42:02,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:42:02,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:02,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:02,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d3f2f83206171a9067e HTTP/1.1" 200 None 2025-09-26 10:42:02,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:02,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d8f2f83206171a90738 HTTP/1.1" 200 None 2025-09-26 10:42:02,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:02,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:42:02,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:02,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:42:02,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:02,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d8f2f83206171a90738 HTTP/1.1" 200 None 2025-09-26 10:42:02,703 - lava_callback - INFO - Completed processing callback for node 68d66d8f2f83206171a90738 2025-09-26 10:42:02,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d3f2f83206171a9067e HTTP/1.1" 200 None 2025-09-26 10:42:02,758 - lava_callback - INFO - Completed processing callback for node 68d66d3f2f83206171a9067e 2025-09-26 10:42:02,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:02,939 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d6699f2f83206171a9042a/log.txt.gz 2025-09-26 10:42:02,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:42:03,254 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:03,255 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d6699f2f83206171a9042a/lava_callback.json.gz DEBUG: Setup failed for 68d6699f2f83206171a9042a. Transitting job node result: incomplete -> fail 2025-09-26 10:42:03,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:03,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6699f2f83206171a9042a HTTP/1.1" 200 None 2025-09-26 10:42:03,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:03,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651cdcca86fb17472aa0c HTTP/1.1" 200 None 2025-09-26 10:42:03,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:03,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6699f2f83206171a9042a HTTP/1.1" 200 None 2025-09-26 10:42:03,450 - lava_callback - INFO - Completed processing callback for node 68d6699f2f83206171a9042a 2025-09-26 10:42:03,592 - lava_callback - INFO - Received callback for node 68d66daa2f83206171a9076f INFO: 172.20.0.1:54228 - "POST /node/68d66daa2f83206171a9076f HTTP/1.0" 202 Accepted 2025-09-26 10:42:03,602 - lava_callback - INFO - Starting async job submit for node 68d66daa2f83206171a9076f 2025-09-26 10:42:03,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:03,630 - lava_callback - INFO - Received callback for node 68d66d682f83206171a906dc INFO: 172.20.0.1:54240 - "POST /node/68d66d682f83206171a906dc HTTP/1.0" 202 Accepted 2025-09-26 10:42:03,639 - lava_callback - INFO - Starting async job submit for node 68d66d682f83206171a906dc 2025-09-26 10:42:03,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:03,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66daa2f83206171a9076f HTTP/1.1" 200 None 2025-09-26 10:42:03,680 - lava_callback - DEBUG - Processing node 68d66daa2f83206171a9076f: baseline-arm64 2025-09-26 10:42:03,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d682f83206171a906dc HTTP/1.1" 200 None 2025-09-26 10:42:03,718 - lava_callback - DEBUG - Processing node 68d66d682f83206171a906dc: baseline-arm64 2025-09-26 10:42:04,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:42:04,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:42:04,874 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:04,875 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66daa2f83206171a9076f/log.txt.gz 2025-09-26 10:42:04,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:42:05,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:05,032 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d682f83206171a906dc/log.txt.gz 2025-09-26 10:42:05,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:42:05,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:05,060 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66daa2f83206171a9076f/lava_callback.json.gz 2025-09-26 10:42:05,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:05,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66daa2f83206171a9076f HTTP/1.1" 200 None 2025-09-26 10:42:05,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:05,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:42:05,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:05,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66daa2f83206171a9076f HTTP/1.1" 200 None 2025-09-26 10:42:05,166 - lava_callback - INFO - Completed processing callback for node 68d66daa2f83206171a9076f 2025-09-26 10:42:05,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:05,253 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d682f83206171a906dc/lava_callback.json.gz 2025-09-26 10:42:05,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:05,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d682f83206171a906dc HTTP/1.1" 200 None 2025-09-26 10:42:05,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:05,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:42:05,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:05,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d682f83206171a906dc HTTP/1.1" 200 None 2025-09-26 10:42:05,351 - lava_callback - INFO - Completed processing callback for node 68d66d682f83206171a906dc 2025-09-26 10:42:05,628 - lava_callback - INFO - Received callback for node 68d66da62f83206171a9076c INFO: 172.20.0.1:54250 - "POST /node/68d66da62f83206171a9076c HTTP/1.0" 202 Accepted 2025-09-26 10:42:05,636 - lava_callback - INFO - Starting async job submit for node 68d66da62f83206171a9076c 2025-09-26 10:42:05,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:05,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66da62f83206171a9076c HTTP/1.1" 200 None 2025-09-26 10:42:05,677 - lava_callback - DEBUG - Processing node 68d66da62f83206171a9076c: baseline-arm64 2025-09-26 10:42:06,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:54252 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:42:08,312 - lava_callback - INFO - Received callback for node 68d66dad2f83206171a9077e INFO: 172.20.0.1:54264 - "POST /node/68d66dad2f83206171a9077e HTTP/1.0" 202 Accepted 2025-09-26 10:42:08,321 - lava_callback - INFO - Starting async job submit for node 68d66dad2f83206171a9077e 2025-09-26 10:42:08,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:08,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dad2f83206171a9077e HTTP/1.1" 200 None 2025-09-26 10:42:08,377 - lava_callback - DEBUG - Processing node 68d66dad2f83206171a9077e: baseline-arm64 2025-09-26 10:42:08,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:08,673 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66da62f83206171a9076c/log.txt.gz 2025-09-26 10:42:08,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:42:08,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:42:08,919 - lava_callback - INFO - Received callback for node 68d3caf3cd36afa834e0f15b INFO: 172.20.0.1:54280 - "POST /node/68d3caf3cd36afa834e0f15b HTTP/1.0" 202 Accepted 2025-09-26 10:42:08,928 - lava_callback - INFO - Starting async job submit for node 68d3caf3cd36afa834e0f15b 2025-09-26 10:42:08,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:08,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3caf3cd36afa834e0f15b HTTP/1.1" 200 None 2025-09-26 10:42:08,947 - lava_callback - DEBUG - Processing node 68d3caf3cd36afa834e0f15b: ltp-pty 2025-09-26 10:42:08,947 - lava_callback - ERROR - Error processing callback for node 68d3caf3cd36afa834e0f15b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:42:09,056 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:09,057 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66da62f83206171a9076c/lava_callback.json.gz 2025-09-26 10:42:09,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:09,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66da62f83206171a9076c HTTP/1.1" 200 None 2025-09-26 10:42:09,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:09,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:09,159 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dad2f83206171a9077e/log.txt.gz 2025-09-26 10:42:09,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:42:09,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:42:09,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:09,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66da62f83206171a9076c HTTP/1.1" 200 None 2025-09-26 10:42:09,247 - lava_callback - INFO - Completed processing callback for node 68d66da62f83206171a9076c 2025-09-26 10:42:09,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:09,424 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dad2f83206171a9077e/lava_callback.json.gz 2025-09-26 10:42:09,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:09,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dad2f83206171a9077e HTTP/1.1" 200 None 2025-09-26 10:42:09,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:09,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:42:09,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:09,478 - lava_callback - INFO - Received callback for node 68d66db22f83206171a90784 INFO: 172.20.0.1:42998 - "POST /node/68d66db22f83206171a90784 HTTP/1.0" 202 Accepted 2025-09-26 10:42:09,484 - lava_callback - INFO - Starting async job submit for node 68d66db22f83206171a90784 2025-09-26 10:42:09,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:09,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66dad2f83206171a9077e HTTP/1.1" 200 None 2025-09-26 10:42:09,526 - lava_callback - INFO - Completed processing callback for node 68d66dad2f83206171a9077e 2025-09-26 10:42:09,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66db22f83206171a90784 HTTP/1.1" 200 None 2025-09-26 10:42:09,531 - lava_callback - DEBUG - Processing node 68d66db22f83206171a90784: baseline-arm64 2025-09-26 10:42:09,749 - lava_callback - INFO - Received callback for node 68d3caf6cd36afa834e0f15e INFO: 172.20.0.1:43004 - "POST /node/68d3caf6cd36afa834e0f15e HTTP/1.0" 202 Accepted 2025-09-26 10:42:09,764 - lava_callback - INFO - Starting async job submit for node 68d3caf6cd36afa834e0f15e 2025-09-26 10:42:09,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:09,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3caf6cd36afa834e0f15e HTTP/1.1" 200 None 2025-09-26 10:42:09,842 - lava_callback - DEBUG - Processing node 68d3caf6cd36afa834e0f15e: ltp-fs-bind 2025-09-26 10:42:09,842 - lava_callback - ERROR - Error processing callback for node 68d3caf6cd36afa834e0f15e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:42:10,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:42:10,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:10,230 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66db22f83206171a90784/log.txt.gz 2025-09-26 10:42:10,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:42:10,406 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:10,407 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66db22f83206171a90784/lava_callback.json.gz 2025-09-26 10:42:10,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:10,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66db22f83206171a90784 HTTP/1.1" 200 None 2025-09-26 10:42:10,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:10,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:42:10,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:10,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66db22f83206171a90784 HTTP/1.1" 200 None 2025-09-26 10:42:10,523 - lava_callback - INFO - Completed processing callback for node 68d66db22f83206171a90784 2025-09-26 10:42:10,554 - lava_callback - INFO - Received callback for node 68d3caf9cd36afa834e0f161 INFO: 172.20.0.1:43008 - "POST /node/68d3caf9cd36afa834e0f161 HTTP/1.0" 202 Accepted 2025-09-26 10:42:10,565 - lava_callback - INFO - Starting async job submit for node 68d3caf9cd36afa834e0f161 2025-09-26 10:42:10,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:10,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3caf9cd36afa834e0f161 HTTP/1.1" 200 None 2025-09-26 10:42:10,597 - lava_callback - DEBUG - Processing node 68d3caf9cd36afa834e0f161: ltp-sched 2025-09-26 10:42:10,597 - lava_callback - ERROR - Error processing callback for node 68d3caf9cd36afa834e0f161: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:43016 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 10:42:15,182 - lava_callback - INFO - Received callback for node 68d3cafbcd36afa834e0f164 INFO: 172.20.0.1:43030 - "POST /node/68d3cafbcd36afa834e0f164 HTTP/1.0" 202 Accepted 2025-09-26 10:42:15,188 - lava_callback - INFO - Starting async job submit for node 68d3cafbcd36afa834e0f164 2025-09-26 10:42:15,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:15,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cafbcd36afa834e0f164 HTTP/1.1" 200 None 2025-09-26 10:42:15,203 - lava_callback - DEBUG - Processing node 68d3cafbcd36afa834e0f164: baseline-arm 2025-09-26 10:42:15,204 - lava_callback - ERROR - Error processing callback for node 68d3cafbcd36afa834e0f164: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:42:15,434 - lava_callback - INFO - Received callback for node 68d66dbd2f83206171a907a1 INFO: 172.20.0.1:43038 - "POST /node/68d66dbd2f83206171a907a1 HTTP/1.0" 202 Accepted 2025-09-26 10:42:15,440 - lava_callback - INFO - Starting async job submit for node 68d66dbd2f83206171a907a1 2025-09-26 10:42:15,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:15,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dbd2f83206171a907a1 HTTP/1.1" 200 None 2025-09-26 10:42:15,483 - lava_callback - DEBUG - Processing node 68d66dbd2f83206171a907a1: baseline-arm64 INFO: 172.20.0.1:43042 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:42:15,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:42:15,822 - lava_callback - INFO - Received callback for node 68d3cafccd36afa834e0f167 INFO: 172.20.0.1:43048 - "POST /node/68d3cafccd36afa834e0f167 HTTP/1.0" 202 Accepted 2025-09-26 10:42:15,830 - lava_callback - INFO - Starting async job submit for node 68d3cafccd36afa834e0f167 2025-09-26 10:42:15,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:15,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cafccd36afa834e0f167 HTTP/1.1" 200 None 2025-09-26 10:42:15,846 - lava_callback - DEBUG - Processing node 68d3cafccd36afa834e0f167: baseline-arm 2025-09-26 10:42:15,846 - lava_callback - ERROR - Error processing callback for node 68d3cafccd36afa834e0f167: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:42:16,466 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:16,467 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dbd2f83206171a907a1/log.txt.gz 2025-09-26 10:42:16,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:43064 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:42:16,533 - lava_callback - INFO - Received callback for node 68d3cafecd36afa834e0f16a INFO: 172.20.0.1:43068 - "POST /node/68d3cafecd36afa834e0f16a HTTP/1.0" 202 Accepted 2025-09-26 10:42:16,541 - lava_callback - INFO - Starting async job submit for node 68d3cafecd36afa834e0f16a 2025-09-26 10:42:16,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:16,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cafecd36afa834e0f16a HTTP/1.1" 200 None 2025-09-26 10:42:16,558 - lava_callback - DEBUG - Processing node 68d3cafecd36afa834e0f16a: baseline-arm 2025-09-26 10:42:16,558 - lava_callback - ERROR - Error processing callback for node 68d3cafecd36afa834e0f16a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:42:16,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:16,656 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dbd2f83206171a907a1/lava_callback.json.gz 2025-09-26 10:42:16,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:16,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dbd2f83206171a907a1 HTTP/1.1" 200 None 2025-09-26 10:42:16,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:16,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:42:16,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:16,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66dbd2f83206171a907a1 HTTP/1.1" 200 None 2025-09-26 10:42:16,801 - lava_callback - INFO - Completed processing callback for node 68d66dbd2f83206171a907a1 2025-09-26 10:42:17,072 - lava_callback - INFO - Received callback for node 68d66da32f83206171a90769 INFO: 172.20.0.1:43084 - "POST /node/68d66da32f83206171a90769 HTTP/1.0" 202 Accepted 2025-09-26 10:42:17,082 - lava_callback - INFO - Starting async job submit for node 68d66da32f83206171a90769 2025-09-26 10:42:17,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:17,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66da32f83206171a90769 HTTP/1.1" 200 None 2025-09-26 10:42:17,137 - lava_callback - DEBUG - Processing node 68d66da32f83206171a90769: baseline-arm64 2025-09-26 10:42:17,230 - lava_callback - INFO - Received callback for node 68d3caffcd36afa834e0f16d INFO: 172.20.0.1:43088 - "POST /node/68d3caffcd36afa834e0f16d HTTP/1.0" 202 Accepted 2025-09-26 10:42:17,256 - lava_callback - INFO - Starting async job submit for node 68d3caffcd36afa834e0f16d 2025-09-26 10:42:17,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:17,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3caffcd36afa834e0f16d HTTP/1.1" 200 None 2025-09-26 10:42:17,332 - lava_callback - DEBUG - Processing node 68d3caffcd36afa834e0f16d: baseline-arm 2025-09-26 10:42:17,332 - lava_callback - ERROR - Error processing callback for node 68d3caffcd36afa834e0f16d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:42:17,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:42:17,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:17,838 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66da32f83206171a90769/log.txt.gz 2025-09-26 10:42:17,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:42:18,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:18,010 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66da32f83206171a90769/lava_callback.json.gz 2025-09-26 10:42:18,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:18,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66da32f83206171a90769 HTTP/1.1" 200 None 2025-09-26 10:42:18,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:18,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:42:18,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:18,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66da32f83206171a90769 HTTP/1.1" 200 None 2025-09-26 10:42:18,121 - lava_callback - INFO - Completed processing callback for node 68d66da32f83206171a90769 2025-09-26 10:42:18,924 - lava_callback - INFO - Received callback for node 68d66dbb2f83206171a9079a INFO: 172.20.0.1:43094 - "POST /node/68d66dbb2f83206171a9079a HTTP/1.0" 202 Accepted 2025-09-26 10:42:18,934 - lava_callback - INFO - Starting async job submit for node 68d66dbb2f83206171a9079a 2025-09-26 10:42:18,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:19,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dbb2f83206171a9079a HTTP/1.1" 200 None 2025-09-26 10:42:19,020 - lava_callback - DEBUG - Processing node 68d66dbb2f83206171a9079a: baseline-arm64 2025-09-26 10:42:19,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:42:19,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:19,682 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dbb2f83206171a9079a/log.txt.gz 2025-09-26 10:42:19,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:47280 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:42:19,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:19,839 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dbb2f83206171a9079a/lava_callback.json.gz 2025-09-26 10:42:19,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:19,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dbb2f83206171a9079a HTTP/1.1" 200 None 2025-09-26 10:42:19,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:19,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:42:19,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:19,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66dbb2f83206171a9079a HTTP/1.1" 200 None 2025-09-26 10:42:19,954 - lava_callback - INFO - Completed processing callback for node 68d66dbb2f83206171a9079a INFO: 172.20.0.1:47284 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:42:27,741 - lava_callback - INFO - Received callback for node 68d66db82f83206171a90793 INFO: 172.20.0.1:47288 - "POST /node/68d66db82f83206171a90793 HTTP/1.0" 202 Accepted 2025-09-26 10:42:27,749 - lava_callback - INFO - Starting async job submit for node 68d66db82f83206171a90793 2025-09-26 10:42:27,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:27,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66db82f83206171a90793 HTTP/1.1" 200 None 2025-09-26 10:42:27,795 - lava_callback - DEBUG - Processing node 68d66db82f83206171a90793: baseline-arm64 2025-09-26 10:42:28,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:42:28,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:28,419 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66db82f83206171a90793/log.txt.gz 2025-09-26 10:42:28,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:42:28,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:28,560 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66db82f83206171a90793/lava_callback.json.gz 2025-09-26 10:42:28,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:28,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66db82f83206171a90793 HTTP/1.1" 200 None 2025-09-26 10:42:28,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:28,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:42:28,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:28,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66db82f83206171a90793 HTTP/1.1" 200 None 2025-09-26 10:42:28,667 - lava_callback - INFO - Completed processing callback for node 68d66db82f83206171a90793 2025-09-26 10:42:29,048 - lava_callback - INFO - Received callback for node 68d3cb03cd36afa834e0f170 INFO: 172.20.0.1:47290 - "POST /node/68d3cb03cd36afa834e0f170 HTTP/1.0" 202 Accepted 2025-09-26 10:42:29,058 - lava_callback - INFO - Starting async job submit for node 68d3cb03cd36afa834e0f170 2025-09-26 10:42:29,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:29,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cb03cd36afa834e0f170 HTTP/1.1" 200 None 2025-09-26 10:42:29,078 - lava_callback - DEBUG - Processing node 68d3cb03cd36afa834e0f170: ltp-smoketest 2025-09-26 10:42:29,078 - lava_callback - ERROR - Error processing callback for node 68d3cb03cd36afa834e0f170: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:42:29,824 - lava_callback - INFO - Received callback for node 68d3cb05cd36afa834e0f173 INFO: 172.20.0.1:33700 - "POST /node/68d3cb05cd36afa834e0f173 HTTP/1.0" 202 Accepted 2025-09-26 10:42:29,832 - lava_callback - INFO - Starting async job submit for node 68d3cb05cd36afa834e0f173 2025-09-26 10:42:29,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:29,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cb05cd36afa834e0f173 HTTP/1.1" 200 None 2025-09-26 10:42:29,853 - lava_callback - DEBUG - Processing node 68d3cb05cd36afa834e0f173: ltp-sched 2025-09-26 10:42:29,853 - lava_callback - ERROR - Error processing callback for node 68d3cb05cd36afa834e0f173: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:42:30,649 - lava_callback - INFO - Received callback for node 68d3cb14cd36afa834e0f1a7 INFO: 172.20.0.1:33702 - "POST /node/68d3cb14cd36afa834e0f1a7 HTTP/1.0" 202 Accepted 2025-09-26 10:42:30,658 - lava_callback - INFO - Starting async job submit for node 68d3cb14cd36afa834e0f1a7 2025-09-26 10:42:30,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:30,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cb14cd36afa834e0f1a7 HTTP/1.1" 200 None 2025-09-26 10:42:30,673 - lava_callback - DEBUG - Processing node 68d3cb14cd36afa834e0f1a7: ltp-smoketest 2025-09-26 10:42:30,673 - lava_callback - ERROR - Error processing callback for node 68d3cb14cd36afa834e0f1a7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:42:35,196 - lava_callback - INFO - Received callback for node 68d3cb06cd36afa834e0f176 INFO: 172.20.0.1:33710 - "POST /node/68d3cb06cd36afa834e0f176 HTTP/1.0" 202 Accepted 2025-09-26 10:42:35,205 - lava_callback - INFO - Starting async job submit for node 68d3cb06cd36afa834e0f176 2025-09-26 10:42:35,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:35,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cb06cd36afa834e0f176 HTTP/1.1" 200 None 2025-09-26 10:42:35,221 - lava_callback - DEBUG - Processing node 68d3cb06cd36afa834e0f176: baseline-arm 2025-09-26 10:42:35,221 - lava_callback - ERROR - Error processing callback for node 68d3cb06cd36afa834e0f176: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:42:35,895 - lava_callback - INFO - Received callback for node 68d3cb0bcd36afa834e0f19c INFO: 172.20.0.1:33718 - "POST /node/68d3cb0bcd36afa834e0f19c HTTP/1.0" 202 Accepted 2025-09-26 10:42:35,903 - lava_callback - INFO - Starting async job submit for node 68d3cb0bcd36afa834e0f19c 2025-09-26 10:42:35,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:35,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cb0bcd36afa834e0f19c HTTP/1.1" 200 None 2025-09-26 10:42:35,922 - lava_callback - DEBUG - Processing node 68d3cb0bcd36afa834e0f19c: baseline-arm 2025-09-26 10:42:35,923 - lava_callback - ERROR - Error processing callback for node 68d3cb0bcd36afa834e0f19c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:33726 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:42:36,577 - lava_callback - INFO - Received callback for node 68d3cb0dcd36afa834e0f1a1 INFO: 172.20.0.1:33742 - "POST /node/68d3cb0dcd36afa834e0f1a1 HTTP/1.0" 202 Accepted 2025-09-26 10:42:36,583 - lava_callback - INFO - Starting async job submit for node 68d3cb0dcd36afa834e0f1a1 2025-09-26 10:42:36,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:36,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cb0dcd36afa834e0f1a1 HTTP/1.1" 200 None 2025-09-26 10:42:36,598 - lava_callback - DEBUG - Processing node 68d3cb0dcd36afa834e0f1a1: baseline-arm 2025-09-26 10:42:36,598 - lava_callback - ERROR - Error processing callback for node 68d3cb0dcd36afa834e0f1a1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:42:37,293 - lava_callback - INFO - Received callback for node 68d3cb0ecd36afa834e0f1a4 INFO: 172.20.0.1:33754 - "POST /node/68d3cb0ecd36afa834e0f1a4 HTTP/1.0" 202 Accepted 2025-09-26 10:42:37,298 - lava_callback - INFO - Starting async job submit for node 68d3cb0ecd36afa834e0f1a4 2025-09-26 10:42:37,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:37,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cb0ecd36afa834e0f1a4 HTTP/1.1" 200 None 2025-09-26 10:42:37,313 - lava_callback - DEBUG - Processing node 68d3cb0ecd36afa834e0f1a4: baseline-arm 2025-09-26 10:42:37,313 - lava_callback - ERROR - Error processing callback for node 68d3cb0ecd36afa834e0f1a4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:42:37,612 - lava_callback - INFO - Received callback for node 68d66db62f83206171a9078f INFO: 172.20.0.1:33758 - "POST /node/68d66db62f83206171a9078f HTTP/1.0" 202 Accepted 2025-09-26 10:42:37,619 - lava_callback - INFO - Starting async job submit for node 68d66db62f83206171a9078f 2025-09-26 10:42:37,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:37,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66db62f83206171a9078f HTTP/1.1" 200 None 2025-09-26 10:42:37,665 - lava_callback - DEBUG - Processing node 68d66db62f83206171a9078f: baseline-arm64 2025-09-26 10:42:38,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:42:40,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:40,337 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66db62f83206171a9078f/log.txt.gz 2025-09-26 10:42:40,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:42:40,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:40,511 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66db62f83206171a9078f/lava_callback.json.gz 2025-09-26 10:42:40,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:40,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66db62f83206171a9078f HTTP/1.1" 200 None 2025-09-26 10:42:40,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:40,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:42:40,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:40,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66db62f83206171a9078f HTTP/1.1" 200 None 2025-09-26 10:42:40,648 - lava_callback - INFO - Completed processing callback for node 68d66db62f83206171a9078f 2025-09-26 10:42:45,739 - lava_callback - INFO - Received callback for node 68d66db02f83206171a90781 INFO: 172.20.0.1:47070 - "POST /node/68d66db02f83206171a90781 HTTP/1.0" 202 Accepted 2025-09-26 10:42:45,748 - lava_callback - INFO - Starting async job submit for node 68d66db02f83206171a90781 2025-09-26 10:42:45,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:45,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66db02f83206171a90781 HTTP/1.1" 200 None 2025-09-26 10:42:45,798 - lava_callback - DEBUG - Processing node 68d66db02f83206171a90781: baseline-arm64 2025-09-26 10:42:46,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:47086 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:42:47,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:47,966 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66db02f83206171a90781/log.txt.gz 2025-09-26 10:42:47,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:42:48,090 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:48,091 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66db02f83206171a90781/lava_callback.json.gz 2025-09-26 10:42:48,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:48,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66db02f83206171a90781 HTTP/1.1" 200 None 2025-09-26 10:42:48,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:48,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:42:48,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:48,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66db02f83206171a90781 HTTP/1.1" 200 None 2025-09-26 10:42:48,195 - lava_callback - INFO - Completed processing callback for node 68d66db02f83206171a90781 2025-09-26 10:42:48,865 - lava_callback - INFO - Received callback for node 68d3cb1acd36afa834e0f1b1 INFO: 172.20.0.1:47098 - "POST /node/68d3cb1acd36afa834e0f1b1 HTTP/1.0" 202 Accepted 2025-09-26 10:42:48,873 - lava_callback - INFO - Starting async job submit for node 68d3cb1acd36afa834e0f1b1 2025-09-26 10:42:48,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:48,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cb1acd36afa834e0f1b1 HTTP/1.1" 200 None 2025-09-26 10:42:48,895 - lava_callback - DEBUG - Processing node 68d3cb1acd36afa834e0f1b1: ltp-fsx 2025-09-26 10:42:48,895 - lava_callback - ERROR - Error processing callback for node 68d3cb1acd36afa834e0f1b1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:42:49,664 - lava_callback - INFO - Received callback for node 68d3cb1dcd36afa834e0f1b6 INFO: 172.20.0.1:46764 - "POST /node/68d3cb1dcd36afa834e0f1b6 HTTP/1.0" 202 Accepted 2025-09-26 10:42:49,671 - lava_callback - INFO - Starting async job submit for node 68d3cb1dcd36afa834e0f1b6 2025-09-26 10:42:49,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:49,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cb1dcd36afa834e0f1b6 HTTP/1.1" 200 None 2025-09-26 10:42:49,685 - lava_callback - DEBUG - Processing node 68d3cb1dcd36afa834e0f1b6: ltp-smoketest 2025-09-26 10:42:49,685 - lava_callback - ERROR - Error processing callback for node 68d3cb1dcd36afa834e0f1b6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:42:50,437 - lava_callback - INFO - Received callback for node 68d3cb20cd36afa834e0f1b9 INFO: 172.20.0.1:46766 - "POST /node/68d3cb20cd36afa834e0f1b9 HTTP/1.0" 202 Accepted 2025-09-26 10:42:50,447 - lava_callback - INFO - Starting async job submit for node 68d3cb20cd36afa834e0f1b9 2025-09-26 10:42:50,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:50,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cb20cd36afa834e0f1b9 HTTP/1.1" 200 None 2025-09-26 10:42:50,471 - lava_callback - DEBUG - Processing node 68d3cb20cd36afa834e0f1b9: ltp-syscalls 2025-09-26 10:42:50,471 - lava_callback - ERROR - Error processing callback for node 68d3cb20cd36afa834e0f1b9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:42:51,192 - lava_callback - INFO - Received callback for node 68d3cb23cd36afa834e0f1bc INFO: 172.20.0.1:46782 - "POST /node/68d3cb23cd36afa834e0f1bc HTTP/1.0" 202 Accepted 2025-09-26 10:42:51,198 - lava_callback - INFO - Starting async job submit for node 68d3cb23cd36afa834e0f1bc 2025-09-26 10:42:51,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:51,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cb23cd36afa834e0f1bc HTTP/1.1" 200 None 2025-09-26 10:42:51,212 - lava_callback - DEBUG - Processing node 68d3cb23cd36afa834e0f1bc: ltp-input 2025-09-26 10:42:51,212 - lava_callback - ERROR - Error processing callback for node 68d3cb23cd36afa834e0f1bc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:42:51,971 - lava_callback - INFO - Received callback for node 68d3cb28cd36afa834e0f1c2 INFO: 172.20.0.1:46794 - "POST /node/68d3cb28cd36afa834e0f1c2 HTTP/1.0" 202 Accepted 2025-09-26 10:42:51,977 - lava_callback - INFO - Starting async job submit for node 68d3cb28cd36afa834e0f1c2 2025-09-26 10:42:51,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:51,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cb28cd36afa834e0f1c2 HTTP/1.1" 200 None 2025-09-26 10:42:51,991 - lava_callback - DEBUG - Processing node 68d3cb28cd36afa834e0f1c2: ltp-syscalls-ipc 2025-09-26 10:42:51,991 - lava_callback - ERROR - Error processing callback for node 68d3cb28cd36afa834e0f1c2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:42:56,191 - lava_callback - INFO - Received callback for node 68d66d7f2f83206171a9071a INFO: 172.20.0.1:46798 - "POST /node/68d66d7f2f83206171a9071a HTTP/1.0" 202 Accepted 2025-09-26 10:42:56,201 - lava_callback - INFO - Starting async job submit for node 68d66d7f2f83206171a9071a 2025-09-26 10:42:56,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:56,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d7f2f83206171a9071a HTTP/1.1" 200 None 2025-09-26 10:42:56,269 - lava_callback - DEBUG - Processing node 68d66d7f2f83206171a9071a: baseline-arm64 INFO: 172.20.0.1:46800 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:42:56,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:42:57,106 - lava_callback - INFO - Received callback for node 68d66d812f83206171a90721 INFO: 172.20.0.1:46806 - "POST /node/68d66d812f83206171a90721 HTTP/1.0" 202 Accepted 2025-09-26 10:42:57,112 - lava_callback - INFO - Starting async job submit for node 68d66d812f83206171a90721 2025-09-26 10:42:57,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:57,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d812f83206171a90721 HTTP/1.1" 200 None 2025-09-26 10:42:57,147 - lava_callback - DEBUG - Processing node 68d66d812f83206171a90721: baseline-arm64 2025-09-26 10:42:57,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:42:58,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:58,253 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d7f2f83206171a9071a/log.txt.gz 2025-09-26 10:42:58,257 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:58,258 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d812f83206171a90721/log.txt.gz 2025-09-26 10:42:58,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:42:58,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:42:58,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:58,453 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d812f83206171a90721/lava_callback.json.gz 2025-09-26 10:42:58,474 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:42:58,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:58,475 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d7f2f83206171a9071a/lava_callback.json.gz 2025-09-26 10:42:58,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:58,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d812f83206171a90721 HTTP/1.1" 200 None 2025-09-26 10:42:58,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:58,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d7f2f83206171a9071a HTTP/1.1" 200 None 2025-09-26 10:42:58,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:58,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:42:58,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:58,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:42:58,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:42:58,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d7f2f83206171a9071a HTTP/1.1" 200 None 2025-09-26 10:42:58,575 - lava_callback - INFO - Completed processing callback for node 68d66d7f2f83206171a9071a 2025-09-26 10:42:58,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d812f83206171a90721 HTTP/1.1" 200 None 2025-09-26 10:42:58,577 - lava_callback - INFO - Completed processing callback for node 68d66d812f83206171a90721 2025-09-26 10:43:04,454 - lava_callback - INFO - Received callback for node 68d66ddb2f83206171a907de INFO: 172.20.0.1:44822 - "POST /node/68d66ddb2f83206171a907de HTTP/1.0" 202 Accepted 2025-09-26 10:43:04,459 - lava_callback - INFO - Starting async job submit for node 68d66ddb2f83206171a907de 2025-09-26 10:43:04,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:04,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ddb2f83206171a907de HTTP/1.1" 200 None 2025-09-26 10:43:04,505 - lava_callback - DEBUG - Processing node 68d66ddb2f83206171a907de: baseline-arm64 2025-09-26 10:43:04,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:05,881 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:05,882 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66ddb2f83206171a907de/log.txt.gz 2025-09-26 10:43:05,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:44828 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:43:06,778 - lava_callback - INFO - Received callback for node 68d66de82f83206171a907f9 INFO: 172.20.0.1:44834 - "POST /node/68d66de82f83206171a907f9 HTTP/1.0" 202 Accepted 2025-09-26 10:43:06,788 - lava_callback - INFO - Starting async job submit for node 68d66de82f83206171a907f9 2025-09-26 10:43:06,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:06,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66de82f83206171a907f9 HTTP/1.1" 200 None 2025-09-26 10:43:06,822 - lava_callback - DEBUG - Processing node 68d66de82f83206171a907f9: baseline-arm64 2025-09-26 10:43:07,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:08,317 - lava_callback - INFO - Received callback for node 68d66deb2f83206171a90800 INFO: 172.20.0.1:44840 - "POST /node/68d66deb2f83206171a90800 HTTP/1.0" 202 Accepted 2025-09-26 10:43:08,326 - lava_callback - INFO - Starting async job submit for node 68d66deb2f83206171a90800 2025-09-26 10:43:08,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:08,356 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:08,357 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66ddb2f83206171a907de/lava_callback.json.gz 2025-09-26 10:43:08,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:08,369 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66de82f83206171a907f9/log.txt.gz 2025-09-26 10:43:08,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:08,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:08,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66deb2f83206171a90800 HTTP/1.1" 200 None 2025-09-26 10:43:08,400 - lava_callback - DEBUG - Processing node 68d66deb2f83206171a90800: baseline-arm64 2025-09-26 10:43:08,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ddb2f83206171a907de HTTP/1.1" 200 None 2025-09-26 10:43:08,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:08,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:43:08,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:08,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66ddb2f83206171a907de HTTP/1.1" 200 None 2025-09-26 10:43:08,619 - lava_callback - INFO - Completed processing callback for node 68d66ddb2f83206171a907de 2025-09-26 10:43:08,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:09,567 - lava_callback - INFO - Received callback for node 68d66dd32f83206171a907c9 INFO: 172.20.0.1:32942 - "POST /node/68d66dd32f83206171a907c9 HTTP/1.0" 202 Accepted 2025-09-26 10:43:09,576 - lava_callback - INFO - Starting async job submit for node 68d66dd32f83206171a907c9 2025-09-26 10:43:09,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:09,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dd32f83206171a907c9 HTTP/1.1" 200 None 2025-09-26 10:43:09,628 - lava_callback - DEBUG - Processing node 68d66dd32f83206171a907c9: baseline-arm64 2025-09-26 10:43:09,667 - lava_callback - INFO - Received callback for node 68d66dee2f83206171a90803 INFO: 172.20.0.1:32950 - "POST /node/68d66dee2f83206171a90803 HTTP/1.0" 202 Accepted 2025-09-26 10:43:09,679 - lava_callback - INFO - Starting async job submit for node 68d66dee2f83206171a90803 2025-09-26 10:43:09,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:09,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dee2f83206171a90803 HTTP/1.1" 200 None 2025-09-26 10:43:09,833 - lava_callback - DEBUG - Processing node 68d66dee2f83206171a90803: baseline-arm64 2025-09-26 10:43:10,166 - lava_callback - INFO - Received callback for node 68d66dd82f83206171a907db INFO: 172.20.0.1:32960 - "POST /node/68d66dd82f83206171a907db HTTP/1.0" 202 Accepted 2025-09-26 10:43:10,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:10,207 - lava_callback - INFO - Starting async job submit for node 68d66dd82f83206171a907db 2025-09-26 10:43:10,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:10,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:10,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dd82f83206171a907db HTTP/1.1" 200 None 2025-09-26 10:43:10,316 - lava_callback - DEBUG - Processing node 68d66dd82f83206171a907db: baseline-arm64 2025-09-26 10:43:10,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:11,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:11,053 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dd82f83206171a907db/log.txt.gz 2025-09-26 10:43:11,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:11,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:11,145 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dee2f83206171a90803/log.txt.gz 2025-09-26 10:43:11,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:11,151 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66deb2f83206171a90800/log.txt.gz 2025-09-26 10:43:11,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:11,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:11,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:11,195 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dd32f83206171a907c9/log.txt.gz 2025-09-26 10:43:11,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:11,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:11,209 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66de82f83206171a907f9/lava_callback.json.gz 2025-09-26 10:43:11,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:11,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66de82f83206171a907f9 HTTP/1.1" 200 None 2025-09-26 10:43:11,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:11,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:43:11,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:11,307 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:11,307 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dd82f83206171a907db/lava_callback.json.gz 2025-09-26 10:43:11,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66de82f83206171a907f9 HTTP/1.1" 200 None 2025-09-26 10:43:11,376 - lava_callback - INFO - Completed processing callback for node 68d66de82f83206171a907f9 2025-09-26 10:43:11,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:11,409 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:11,410 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dee2f83206171a90803/lava_callback.json.gz 2025-09-26 10:43:11,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dd82f83206171a907db HTTP/1.1" 200 None 2025-09-26 10:43:11,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:11,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:11,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dee2f83206171a90803 HTTP/1.1" 200 None 2025-09-26 10:43:11,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:11,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:11,497 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dd32f83206171a907c9/lava_callback.json.gz 2025-09-26 10:43:11,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:43:11,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:11,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:11,513 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66deb2f83206171a90800/lava_callback.json.gz 2025-09-26 10:43:11,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:43:11,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:11,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:11,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:11,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dd32f83206171a907c9 HTTP/1.1" 200 None 2025-09-26 10:43:11,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:11,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66deb2f83206171a90800 HTTP/1.1" 200 None 2025-09-26 10:43:11,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:11,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66dd82f83206171a907db HTTP/1.1" 200 None 2025-09-26 10:43:11,643 - lava_callback - INFO - Completed processing callback for node 68d66dd82f83206171a907db 2025-09-26 10:43:11,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:43:11,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:11,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:43:11,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:11,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66dee2f83206171a90803 HTTP/1.1" 200 None 2025-09-26 10:43:11,676 - lava_callback - INFO - Completed processing callback for node 68d66dee2f83206171a90803 2025-09-26 10:43:11,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66deb2f83206171a90800 HTTP/1.1" 200 None 2025-09-26 10:43:11,718 - lava_callback - INFO - Completed processing callback for node 68d66deb2f83206171a90800 2025-09-26 10:43:11,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66dd32f83206171a907c9 HTTP/1.1" 200 None 2025-09-26 10:43:11,765 - lava_callback - INFO - Completed processing callback for node 68d66dd32f83206171a907c9 2025-09-26 10:43:14,480 - lava_callback - INFO - Received callback for node 68d66df02f83206171a9080e INFO: 172.20.0.1:32964 - "POST /node/68d66df02f83206171a9080e HTTP/1.0" 202 Accepted 2025-09-26 10:43:14,487 - lava_callback - INFO - Starting async job submit for node 68d66df02f83206171a9080e 2025-09-26 10:43:14,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:14,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66df02f83206171a9080e HTTP/1.1" 200 None 2025-09-26 10:43:14,525 - lava_callback - DEBUG - Processing node 68d66df02f83206171a9080e: baseline-arm64 2025-09-26 10:43:14,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:32980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32990 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:43:16,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:16,513 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66df02f83206171a9080e/log.txt.gz 2025-09-26 10:43:16,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:33000 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:43:16,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:16,670 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66df02f83206171a9080e/lava_callback.json.gz 2025-09-26 10:43:16,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:16,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66df02f83206171a9080e HTTP/1.1" 200 None 2025-09-26 10:43:16,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:16,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:43:16,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:16,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66df02f83206171a9080e HTTP/1.1" 200 None 2025-09-26 10:43:16,801 - lava_callback - INFO - Completed processing callback for node 68d66df02f83206171a9080e 2025-09-26 10:43:17,653 - lava_callback - INFO - Received callback for node 68d66dd52f83206171a907d4 INFO: 172.20.0.1:33004 - "POST /node/68d66dd52f83206171a907d4 HTTP/1.0" 202 Accepted 2025-09-26 10:43:17,662 - lava_callback - INFO - Starting async job submit for node 68d66dd52f83206171a907d4 2025-09-26 10:43:17,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:17,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dd52f83206171a907d4 HTTP/1.1" 200 None 2025-09-26 10:43:17,703 - lava_callback - DEBUG - Processing node 68d66dd52f83206171a907d4: baseline-arm64 2025-09-26 10:43:18,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:18,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:18,280 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dd52f83206171a907d4/log.txt.gz 2025-09-26 10:43:18,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:18,428 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:18,429 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dd52f83206171a907d4/lava_callback.json.gz 2025-09-26 10:43:18,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:18,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dd52f83206171a907d4 HTTP/1.1" 200 None 2025-09-26 10:43:18,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:18,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:43:18,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:18,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66dd52f83206171a907d4 HTTP/1.1" 200 None 2025-09-26 10:43:18,520 - lava_callback - INFO - Completed processing callback for node 68d66dd52f83206171a907d4 INFO: 172.20.0.1:58822 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:43:20,780 - lava_callback - INFO - Received callback for node 68d66d912f83206171a9073b INFO: 172.20.0.1:58838 - "POST /node/68d66d912f83206171a9073b HTTP/1.0" 202 Accepted 2025-09-26 10:43:20,786 - lava_callback - INFO - Starting async job submit for node 68d66d912f83206171a9073b 2025-09-26 10:43:20,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:20,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d912f83206171a9073b HTTP/1.1" 200 None 2025-09-26 10:43:20,835 - lava_callback - DEBUG - Processing node 68d66d912f83206171a9073b: baseline-arm64 2025-09-26 10:43:21,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:21,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:21,889 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d912f83206171a9073b/log.txt.gz 2025-09-26 10:43:21,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:22,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:22,051 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d912f83206171a9073b/lava_callback.json.gz 2025-09-26 10:43:22,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:22,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d912f83206171a9073b HTTP/1.1" 200 None 2025-09-26 10:43:22,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:22,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:43:22,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:22,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d912f83206171a9073b HTTP/1.1" 200 None 2025-09-26 10:43:22,192 - lava_callback - INFO - Completed processing callback for node 68d66d912f83206171a9073b 2025-09-26 10:43:23,313 - lava_callback - INFO - Received callback for node 68d66d862f83206171a9072b INFO: 172.20.0.1:58842 - "POST /node/68d66d862f83206171a9072b HTTP/1.0" 202 Accepted 2025-09-26 10:43:23,323 - lava_callback - INFO - Starting async job submit for node 68d66d862f83206171a9072b 2025-09-26 10:43:23,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:23,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d862f83206171a9072b HTTP/1.1" 200 None 2025-09-26 10:43:23,387 - lava_callback - DEBUG - Processing node 68d66d862f83206171a9072b: baseline-arm64 2025-09-26 10:43:23,532 - lava_callback - INFO - Received callback for node 68d66e012f83206171a90833 INFO: 172.20.0.1:58848 - "POST /node/68d66e012f83206171a90833 HTTP/1.0" 202 Accepted 2025-09-26 10:43:23,554 - lava_callback - INFO - Starting async job submit for node 68d66e012f83206171a90833 2025-09-26 10:43:23,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:23,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e012f83206171a90833 HTTP/1.1" 200 None 2025-09-26 10:43:23,729 - lava_callback - DEBUG - Processing node 68d66e012f83206171a90833: baseline-arm64 2025-09-26 10:43:24,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:24,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:24,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:24,569 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d862f83206171a9072b/log.txt.gz 2025-09-26 10:43:24,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:24,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:24,677 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e012f83206171a90833/log.txt.gz 2025-09-26 10:43:24,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:24,744 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:24,745 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d862f83206171a9072b/lava_callback.json.gz 2025-09-26 10:43:24,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:24,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d862f83206171a9072b HTTP/1.1" 200 None 2025-09-26 10:43:24,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:24,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:43:24,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:24,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d862f83206171a9072b HTTP/1.1" 200 None 2025-09-26 10:43:24,839 - lava_callback - INFO - Completed processing callback for node 68d66d862f83206171a9072b 2025-09-26 10:43:24,877 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:24,878 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e012f83206171a90833/lava_callback.json.gz 2025-09-26 10:43:24,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:24,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e012f83206171a90833 HTTP/1.1" 200 None 2025-09-26 10:43:24,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:24,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:43:24,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:25,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e012f83206171a90833 HTTP/1.1" 200 None 2025-09-26 10:43:25,019 - lava_callback - INFO - Completed processing callback for node 68d66e012f83206171a90833 2025-09-26 10:43:25,567 - lava_callback - INFO - Received callback for node 68d66d842f83206171a90724 INFO: 172.20.0.1:58856 - "POST /node/68d66d842f83206171a90724 HTTP/1.0" 202 Accepted 2025-09-26 10:43:25,579 - lava_callback - INFO - Starting async job submit for node 68d66d842f83206171a90724 2025-09-26 10:43:25,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:25,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d842f83206171a90724 HTTP/1.1" 200 None 2025-09-26 10:43:25,619 - lava_callback - DEBUG - Processing node 68d66d842f83206171a90724: baseline-arm64 2025-09-26 10:43:25,808 - lava_callback - INFO - Received callback for node 68d66d962f83206171a90755 INFO: 172.20.0.1:58866 - "POST /node/68d66d962f83206171a90755 HTTP/1.0" 202 Accepted 2025-09-26 10:43:25,838 - lava_callback - INFO - Starting async job submit for node 68d66d962f83206171a90755 2025-09-26 10:43:25,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:25,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d962f83206171a90755 HTTP/1.1" 200 None 2025-09-26 10:43:25,990 - lava_callback - DEBUG - Processing node 68d66d962f83206171a90755: baseline-arm64 2025-09-26 10:43:26,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:26,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:58874 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:43:26,701 - lava_callback - INFO - Received callback for node 68d66d702f83206171a906eb INFO: 172.20.0.1:58878 - "POST /node/68d66d702f83206171a906eb HTTP/1.0" 202 Accepted 2025-09-26 10:43:26,708 - lava_callback - INFO - Starting async job submit for node 68d66d702f83206171a906eb 2025-09-26 10:43:26,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:26,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d702f83206171a906eb HTTP/1.1" 200 None 2025-09-26 10:43:26,742 - lava_callback - DEBUG - Processing node 68d66d702f83206171a906eb: baseline-arm64 2025-09-26 10:43:27,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:27,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:27,534 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d842f83206171a90724/log.txt.gz 2025-09-26 10:43:27,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:27,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:27,621 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d702f83206171a906eb/log.txt.gz 2025-09-26 10:43:27,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:27,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:27,646 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d962f83206171a90755/log.txt.gz 2025-09-26 10:43:27,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:27,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:27,754 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d842f83206171a90724/lava_callback.json.gz 2025-09-26 10:43:27,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:27,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d842f83206171a90724 HTTP/1.1" 200 None 2025-09-26 10:43:27,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:27,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:43:27,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:27,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:27,864 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d962f83206171a90755/lava_callback.json.gz 2025-09-26 10:43:27,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:27,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:27,896 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d702f83206171a906eb/lava_callback.json.gz 2025-09-26 10:43:27,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:27,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d842f83206171a90724 HTTP/1.1" 200 None 2025-09-26 10:43:27,955 - lava_callback - INFO - Completed processing callback for node 68d66d842f83206171a90724 2025-09-26 10:43:27,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d702f83206171a906eb HTTP/1.1" 200 None 2025-09-26 10:43:27,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:27,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d962f83206171a90755 HTTP/1.1" 200 None 2025-09-26 10:43:27,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:28,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:43:28,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:28,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:43:28,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:28,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d702f83206171a906eb HTTP/1.1" 200 None 2025-09-26 10:43:28,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d962f83206171a90755 HTTP/1.1" 200 None 2025-09-26 10:43:28,080 - lava_callback - INFO - Completed processing callback for node 68d66d702f83206171a906eb 2025-09-26 10:43:28,081 - lava_callback - INFO - Completed processing callback for node 68d66d962f83206171a90755 2025-09-26 10:43:35,737 - lava_callback - INFO - Received callback for node 68d66df32f83206171a90811 INFO: 172.20.0.1:34398 - "POST /node/68d66df32f83206171a90811 HTTP/1.0" 202 Accepted 2025-09-26 10:43:35,744 - lava_callback - INFO - Starting async job submit for node 68d66df32f83206171a90811 2025-09-26 10:43:35,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:35,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66df32f83206171a90811 HTTP/1.1" 200 None 2025-09-26 10:43:35,795 - lava_callback - DEBUG - Processing node 68d66df32f83206171a90811: baseline-arm64 2025-09-26 10:43:36,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:36,267 - lava_callback - INFO - Received callback for node 68d66dc02f83206171a907a4 INFO: 172.20.0.1:34400 - "POST /node/68d66dc02f83206171a907a4 HTTP/1.0" 202 Accepted 2025-09-26 10:43:36,277 - lava_callback - INFO - Starting async job submit for node 68d66dc02f83206171a907a4 2025-09-26 10:43:36,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:36,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dc02f83206171a907a4 HTTP/1.1" 200 None 2025-09-26 10:43:36,368 - lava_callback - DEBUG - Processing node 68d66dc02f83206171a907a4: baseline-arm64 INFO: 172.20.0.1:34408 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:43:36,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:38,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:38,100 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dc02f83206171a907a4/log.txt.gz 2025-09-26 10:43:38,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:38,106 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66df32f83206171a90811/log.txt.gz 2025-09-26 10:43:38,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:38,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:38,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:38,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:38,282 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dc02f83206171a907a4/lava_callback.json.gz 2025-09-26 10:43:38,288 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66df32f83206171a90811/lava_callback.json.gz 2025-09-26 10:43:38,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:38,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:38,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66df32f83206171a90811 HTTP/1.1" 200 None 2025-09-26 10:43:38,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:38,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dc02f83206171a907a4 HTTP/1.1" 200 None 2025-09-26 10:43:38,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:38,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:43:38,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:38,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:43:38,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:38,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66df32f83206171a90811 HTTP/1.1" 200 None 2025-09-26 10:43:38,452 - lava_callback - INFO - Completed processing callback for node 68d66df32f83206171a90811 2025-09-26 10:43:38,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66dc02f83206171a907a4 HTTP/1.1" 200 None 2025-09-26 10:43:38,485 - lava_callback - INFO - Completed processing callback for node 68d66dc02f83206171a907a4 2025-09-26 10:43:38,714 - lava_callback - INFO - Received callback for node 68d66df52f83206171a90814 INFO: 172.20.0.1:34416 - "POST /node/68d66df52f83206171a90814 HTTP/1.0" 202 Accepted 2025-09-26 10:43:38,723 - lava_callback - INFO - Starting async job submit for node 68d66df52f83206171a90814 2025-09-26 10:43:38,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:38,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66df52f83206171a90814 HTTP/1.1" 200 None 2025-09-26 10:43:38,771 - lava_callback - DEBUG - Processing node 68d66df52f83206171a90814: baseline-arm64 2025-09-26 10:43:39,102 - lava_callback - INFO - Received callback for node 68d66e042f83206171a90842 INFO: 172.20.0.1:34426 - "POST /node/68d66e042f83206171a90842 HTTP/1.0" 202 Accepted 2025-09-26 10:43:39,139 - lava_callback - INFO - Starting async job submit for node 68d66e042f83206171a90842 2025-09-26 10:43:39,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:39,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:39,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e042f83206171a90842 HTTP/1.1" 200 None 2025-09-26 10:43:39,189 - lava_callback - DEBUG - Processing node 68d66e042f83206171a90842: baseline-arm64 2025-09-26 10:43:39,356 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:39,395 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66df52f83206171a90814/log.txt.gz 2025-09-26 10:43:39,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:39,701 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:39,702 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66df52f83206171a90814/lava_callback.json.gz 2025-09-26 10:43:39,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:39,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:39,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66df52f83206171a90814 HTTP/1.1" 200 None 2025-09-26 10:43:39,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:39,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:43:39,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:39,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66df52f83206171a90814 HTTP/1.1" 200 None 2025-09-26 10:43:39,916 - lava_callback - INFO - Completed processing callback for node 68d66df52f83206171a90814 2025-09-26 10:43:40,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:40,068 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e042f83206171a90842/log.txt.gz 2025-09-26 10:43:40,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:40,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:40,241 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e042f83206171a90842/lava_callback.json.gz 2025-09-26 10:43:40,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:40,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e042f83206171a90842 HTTP/1.1" 200 None 2025-09-26 10:43:40,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:40,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:43:40,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:40,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e042f83206171a90842 HTTP/1.1" 200 None 2025-09-26 10:43:40,332 - lava_callback - INFO - Completed processing callback for node 68d66e042f83206171a90842 2025-09-26 10:43:40,497 - lava_callback - INFO - Received callback for node 68d66dc32f83206171a907a7 INFO: 172.20.0.1:51724 - "POST /node/68d66dc32f83206171a907a7 HTTP/1.0" 202 Accepted 2025-09-26 10:43:40,507 - lava_callback - INFO - Starting async job submit for node 68d66dc32f83206171a907a7 2025-09-26 10:43:40,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:40,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dc32f83206171a907a7 HTTP/1.1" 200 None 2025-09-26 10:43:40,566 - lava_callback - DEBUG - Processing node 68d66dc32f83206171a907a7: baseline-arm64 2025-09-26 10:43:40,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:41,079 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:41,080 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dc32f83206171a907a7/log.txt.gz 2025-09-26 10:43:41,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:41,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:41,257 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dc32f83206171a907a7/lava_callback.json.gz 2025-09-26 10:43:41,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:41,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dc32f83206171a907a7 HTTP/1.1" 200 None 2025-09-26 10:43:41,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:41,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:43:41,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:41,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66dc32f83206171a907a7 HTTP/1.1" 200 None 2025-09-26 10:43:41,348 - lava_callback - INFO - Completed processing callback for node 68d66dc32f83206171a907a7 2025-09-26 10:43:41,817 - lava_callback - INFO - Received callback for node 68d66dfe2f83206171a90830 INFO: 172.20.0.1:51730 - "POST /node/68d66dfe2f83206171a90830 HTTP/1.0" 202 Accepted 2025-09-26 10:43:41,825 - lava_callback - INFO - Starting async job submit for node 68d66dfe2f83206171a90830 2025-09-26 10:43:41,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:41,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dfe2f83206171a90830 HTTP/1.1" 200 None 2025-09-26 10:43:41,863 - lava_callback - DEBUG - Processing node 68d66dfe2f83206171a90830: baseline-arm64 2025-09-26 10:43:42,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:42,808 - lava_callback - INFO - Received callback for node 68d66e062f83206171a90845 INFO: 172.20.0.1:51740 - "POST /node/68d66e062f83206171a90845 HTTP/1.0" 202 Accepted 2025-09-26 10:43:42,814 - lava_callback - INFO - Starting async job submit for node 68d66e062f83206171a90845 2025-09-26 10:43:42,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:42,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e062f83206171a90845 HTTP/1.1" 200 None 2025-09-26 10:43:42,852 - lava_callback - DEBUG - Processing node 68d66e062f83206171a90845: baseline-arm64 2025-09-26 10:43:42,930 - lava_callback - INFO - Received callback for node 68d66d992f83206171a9075c INFO: 172.20.0.1:51752 - "POST /node/68d66d992f83206171a9075c HTTP/1.0" 202 Accepted 2025-09-26 10:43:42,942 - lava_callback - INFO - Starting async job submit for node 68d66d992f83206171a9075c 2025-09-26 10:43:43,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:43,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d992f83206171a9075c HTTP/1.1" 200 None 2025-09-26 10:43:43,087 - lava_callback - DEBUG - Processing node 68d66d992f83206171a9075c: baseline-arm64 2025-09-26 10:43:43,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:43,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:44,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:44,050 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dfe2f83206171a90830/log.txt.gz 2025-09-26 10:43:44,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:44,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:44,105 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e062f83206171a90845/log.txt.gz 2025-09-26 10:43:44,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:44,128 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:44,129 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d992f83206171a9075c/log.txt.gz 2025-09-26 10:43:44,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:43:44,291 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:44,292 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dfe2f83206171a90830/lava_callback.json.gz 2025-09-26 10:43:44,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:44,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dfe2f83206171a90830 HTTP/1.1" 200 None 2025-09-26 10:43:44,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:44,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:44,347 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:43:44,348 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e062f83206171a90845/lava_callback.json.gz 2025-09-26 10:43:44,353 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d992f83206171a9075c/lava_callback.json.gz 2025-09-26 10:43:44,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:43:44,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:44,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:44,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:44,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d992f83206171a9075c HTTP/1.1" 200 None 2025-09-26 10:43:44,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:44,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e062f83206171a90845 HTTP/1.1" 200 None 2025-09-26 10:43:44,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:44,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:43:44,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:44,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66dfe2f83206171a90830 HTTP/1.1" 200 None 2025-09-26 10:43:44,459 - lava_callback - INFO - Completed processing callback for node 68d66dfe2f83206171a90830 2025-09-26 10:43:44,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:43:44,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:44,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d992f83206171a9075c HTTP/1.1" 200 None 2025-09-26 10:43:44,551 - lava_callback - INFO - Completed processing callback for node 68d66d992f83206171a9075c 2025-09-26 10:43:44,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e062f83206171a90845 HTTP/1.1" 200 None 2025-09-26 10:43:44,565 - lava_callback - INFO - Completed processing callback for node 68d66e062f83206171a90845 INFO: 172.20.0.1:51762 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:43:48,957 - lava_callback - INFO - Received callback for node 68d3cb5fcd36afa834e0f21a INFO: 172.20.0.1:51772 - "POST /node/68d3cb5fcd36afa834e0f21a HTTP/1.0" 202 Accepted 2025-09-26 10:43:48,963 - lava_callback - INFO - Starting async job submit for node 68d3cb5fcd36afa834e0f21a 2025-09-26 10:43:48,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:43:48,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cb5fcd36afa834e0f21a HTTP/1.1" 200 None 2025-09-26 10:43:48,983 - lava_callback - DEBUG - Processing node 68d3cb5fcd36afa834e0f21a: ltp-syscalls 2025-09-26 10:43:48,983 - lava_callback - ERROR - Error processing callback for node 68d3cb5fcd36afa834e0f21a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:34880 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:44:00,443 - lava_callback - INFO - Received callback for node 68d66e0b2f83206171a90855 INFO: 172.20.0.1:58980 - "POST /node/68d66e0b2f83206171a90855 HTTP/1.0" 202 Accepted 2025-09-26 10:44:00,453 - lava_callback - INFO - Starting async job submit for node 68d66e0b2f83206171a90855 2025-09-26 10:44:00,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:00,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e0b2f83206171a90855 HTTP/1.1" 200 None 2025-09-26 10:44:00,504 - lava_callback - DEBUG - Processing node 68d66e0b2f83206171a90855: baseline-arm64 2025-09-26 10:44:00,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:44:01,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:44:01,138 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e0b2f83206171a90855/log.txt.gz 2025-09-26 10:44:01,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:44:01,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:44:01,356 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e0b2f83206171a90855/lava_callback.json.gz 2025-09-26 10:44:01,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:01,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e0b2f83206171a90855 HTTP/1.1" 200 None 2025-09-26 10:44:01,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:01,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:44:01,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:01,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e0b2f83206171a90855 HTTP/1.1" 200 None 2025-09-26 10:44:01,502 - lava_callback - INFO - Completed processing callback for node 68d66e0b2f83206171a90855 2025-09-26 10:44:02,512 - lava_callback - INFO - Received callback for node 68d40a2ccd36afa834e16ef4 INFO: 172.20.0.1:58986 - "POST /node/68d40a2ccd36afa834e16ef4 HTTP/1.0" 202 Accepted 2025-09-26 10:44:02,520 - lava_callback - INFO - Starting async job submit for node 68d40a2ccd36afa834e16ef4 2025-09-26 10:44:02,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:02,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a2ccd36afa834e16ef4 HTTP/1.1" 200 None 2025-09-26 10:44:02,557 - lava_callback - DEBUG - Processing node 68d40a2ccd36afa834e16ef4: baseline-arm 2025-09-26 10:44:02,921 - lava_callback - ERROR - Error processing callback for node 68d40a2ccd36afa834e16ef4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:58998 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:44:09,095 - lava_callback - INFO - Received callback for node 68d3cb6acd36afa834e0f229 INFO: 172.20.0.1:59002 - "POST /node/68d3cb6acd36afa834e0f229 HTTP/1.0" 202 Accepted 2025-09-26 10:44:09,101 - lava_callback - INFO - Starting async job submit for node 68d3cb6acd36afa834e0f229 2025-09-26 10:44:09,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:09,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cb6acd36afa834e0f229 HTTP/1.1" 200 None 2025-09-26 10:44:09,116 - lava_callback - DEBUG - Processing node 68d3cb6acd36afa834e0f229: ltp-syscalls-ipc 2025-09-26 10:44:09,116 - lava_callback - ERROR - Error processing callback for node 68d3cb6acd36afa834e0f229: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:44:09,867 - lava_callback - INFO - Received callback for node 68d3cb75cd36afa834e0f238 INFO: 172.20.0.1:58138 - "POST /node/68d3cb75cd36afa834e0f238 HTTP/1.0" 202 Accepted 2025-09-26 10:44:09,873 - lava_callback - INFO - Starting async job submit for node 68d3cb75cd36afa834e0f238 2025-09-26 10:44:09,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:09,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cb75cd36afa834e0f238 HTTP/1.1" 200 None 2025-09-26 10:44:09,895 - lava_callback - DEBUG - Processing node 68d3cb75cd36afa834e0f238: ltp-timers 2025-09-26 10:44:09,895 - lava_callback - ERROR - Error processing callback for node 68d3cb75cd36afa834e0f238: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:58150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47744 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:44:34,449 - lava_callback - INFO - Received callback for node 68d66dfb2f83206171a90822 INFO: 172.20.0.1:44522 - "POST /node/68d66dfb2f83206171a90822 HTTP/1.0" 202 Accepted 2025-09-26 10:44:34,455 - lava_callback - INFO - Starting async job submit for node 68d66dfb2f83206171a90822 2025-09-26 10:44:34,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:34,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dfb2f83206171a90822 HTTP/1.1" 200 None 2025-09-26 10:44:34,497 - lava_callback - DEBUG - Processing node 68d66dfb2f83206171a90822: baseline-arm64 2025-09-26 10:44:34,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:44:35,555 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:44:35,556 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dfb2f83206171a90822/log.txt.gz 2025-09-26 10:44:35,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:44536 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:44:38,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:44:38,167 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dfb2f83206171a90822/lava_callback.json.gz 2025-09-26 10:44:38,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:38,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dfb2f83206171a90822 HTTP/1.1" 200 None 2025-09-26 10:44:38,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:38,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:44:38,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:38,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66dfb2f83206171a90822 HTTP/1.1" 200 None 2025-09-26 10:44:38,251 - lava_callback - INFO - Completed processing callback for node 68d66dfb2f83206171a90822 2025-09-26 10:44:42,601 - lava_callback - INFO - Received callback for node 68d66e0e2f83206171a90858 INFO: 172.20.0.1:46634 - "POST /node/68d66e0e2f83206171a90858 HTTP/1.0" 202 Accepted 2025-09-26 10:44:42,611 - lava_callback - INFO - Starting async job submit for node 68d66e0e2f83206171a90858 2025-09-26 10:44:42,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:42,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e0e2f83206171a90858 HTTP/1.1" 200 None 2025-09-26 10:44:42,648 - lava_callback - DEBUG - Processing node 68d66e0e2f83206171a90858: baseline-arm64 2025-09-26 10:44:43,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:44:43,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:44:43,232 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e0e2f83206171a90858/log.txt.gz 2025-09-26 10:44:43,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:44:43,965 - lava_callback - INFO - Received callback for node 68d66e322f83206171a90885 INFO: 172.20.0.1:46644 - "POST /node/68d66e322f83206171a90885 HTTP/1.0" 202 Accepted 2025-09-26 10:44:43,976 - lava_callback - INFO - Starting async job submit for node 68d66e322f83206171a90885 2025-09-26 10:44:44,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:44,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e322f83206171a90885 HTTP/1.1" 200 None 2025-09-26 10:44:44,027 - lava_callback - DEBUG - Processing node 68d66e322f83206171a90885: baseline-arm64 2025-09-26 10:44:44,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:44:45,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:44:45,938 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e322f83206171a90885/log.txt.gz 2025-09-26 10:44:45,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:44:45,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:44:45,971 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e0e2f83206171a90858/lava_callback.json.gz 2025-09-26 10:44:46,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:46,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e0e2f83206171a90858 HTTP/1.1" 200 None 2025-09-26 10:44:46,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:46,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:44:46,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:46,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e0e2f83206171a90858 HTTP/1.1" 200 None 2025-09-26 10:44:46,073 - lava_callback - INFO - Completed processing callback for node 68d66e0e2f83206171a90858 2025-09-26 10:44:46,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:44:46,121 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e322f83206171a90885/lava_callback.json.gz 2025-09-26 10:44:46,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:46,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e322f83206171a90885 HTTP/1.1" 200 None 2025-09-26 10:44:46,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:46,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:44:46,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:46,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e322f83206171a90885 HTTP/1.1" 200 None 2025-09-26 10:44:46,274 - lava_callback - INFO - Completed processing callback for node 68d66e322f83206171a90885 INFO: 172.20.0.1:46654 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:44:48,121 - lava_callback - INFO - Received callback for node 68d66dde2f83206171a907e1 INFO: 172.20.0.1:46656 - "POST /node/68d66dde2f83206171a907e1 HTTP/1.0" 202 Accepted 2025-09-26 10:44:48,130 - lava_callback - INFO - Starting async job submit for node 68d66dde2f83206171a907e1 2025-09-26 10:44:48,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:48,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dde2f83206171a907e1 HTTP/1.1" 200 None 2025-09-26 10:44:48,181 - lava_callback - DEBUG - Processing node 68d66dde2f83206171a907e1: baseline-arm64 2025-09-26 10:44:48,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:44:48,643 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:44:48,644 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dde2f83206171a907e1/log.txt.gz 2025-09-26 10:44:48,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:44:48,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:44:48,775 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dde2f83206171a907e1/lava_callback.json.gz 2025-09-26 10:44:48,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:48,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dde2f83206171a907e1 HTTP/1.1" 200 None 2025-09-26 10:44:48,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:48,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:44:48,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:48,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66dde2f83206171a907e1 HTTP/1.1" 200 None 2025-09-26 10:44:48,869 - lava_callback - INFO - Completed processing callback for node 68d66dde2f83206171a907e1 2025-09-26 10:44:49,129 - lava_callback - INFO - Received callback for node 68d3cb8ecd36afa834e0f2d4 INFO: 172.20.0.1:46670 - "POST /node/68d3cb8ecd36afa834e0f2d4 HTTP/1.0" 202 Accepted 2025-09-26 10:44:49,135 - lava_callback - INFO - Starting async job submit for node 68d3cb8ecd36afa834e0f2d4 2025-09-26 10:44:49,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:49,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cb8ecd36afa834e0f2d4 HTTP/1.1" 200 None 2025-09-26 10:44:49,151 - lava_callback - DEBUG - Processing node 68d3cb8ecd36afa834e0f2d4: ltp-fsx 2025-09-26 10:44:49,151 - lava_callback - ERROR - Error processing callback for node 68d3cb8ecd36afa834e0f2d4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:44:49,984 - lava_callback - INFO - Received callback for node 68d3cb9bcd36afa834e0f2e4 INFO: 172.20.0.1:47528 - "POST /node/68d3cb9bcd36afa834e0f2e4 HTTP/1.0" 202 Accepted 2025-09-26 10:44:49,993 - lava_callback - INFO - Starting async job submit for node 68d3cb9bcd36afa834e0f2e4 2025-09-26 10:44:49,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:50,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cb9bcd36afa834e0f2e4 HTTP/1.1" 200 None 2025-09-26 10:44:50,012 - lava_callback - DEBUG - Processing node 68d3cb9bcd36afa834e0f2e4: ltp-syscalls-ipc 2025-09-26 10:44:50,012 - lava_callback - ERROR - Error processing callback for node 68d3cb9bcd36afa834e0f2e4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:44:50,793 - lava_callback - INFO - Received callback for node 68d3cb9ecd36afa834e0f2e7 INFO: 172.20.0.1:47538 - "POST /node/68d3cb9ecd36afa834e0f2e7 HTTP/1.0" 202 Accepted 2025-09-26 10:44:50,799 - lava_callback - INFO - Starting async job submit for node 68d3cb9ecd36afa834e0f2e7 2025-09-26 10:44:50,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:50,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cb9ecd36afa834e0f2e7 HTTP/1.1" 200 None 2025-09-26 10:44:50,836 - lava_callback - DEBUG - Processing node 68d3cb9ecd36afa834e0f2e7: ltp-input 2025-09-26 10:44:50,836 - lava_callback - ERROR - Error processing callback for node 68d3cb9ecd36afa834e0f2e7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:44:53,017 - lava_callback - INFO - Received callback for node 68d66e502f83206171a908e6 INFO: 172.20.0.1:47550 - "POST /node/68d66e502f83206171a908e6 HTTP/1.0" 202 Accepted 2025-09-26 10:44:53,026 - lava_callback - INFO - Starting async job submit for node 68d66e502f83206171a908e6 2025-09-26 10:44:53,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:53,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e502f83206171a908e6 HTTP/1.1" 200 None 2025-09-26 10:44:53,071 - lava_callback - DEBUG - Processing node 68d66e502f83206171a908e6: baseline-arm64 2025-09-26 10:44:53,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:44:53,709 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:44:53,710 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e502f83206171a908e6/log.txt.gz 2025-09-26 10:44:53,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:44:53,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:44:53,873 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e502f83206171a908e6/lava_callback.json.gz 2025-09-26 10:44:53,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:53,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e502f83206171a908e6 HTTP/1.1" 200 None 2025-09-26 10:44:53,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:53,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:44:53,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:53,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e502f83206171a908e6 HTTP/1.1" 200 None 2025-09-26 10:44:53,972 - lava_callback - INFO - Completed processing callback for node 68d66e502f83206171a908e6 2025-09-26 10:44:55,023 - lava_callback - INFO - Received callback for node 68d3cba0cd36afa834e0f2ea INFO: 172.20.0.1:47554 - "POST /node/68d3cba0cd36afa834e0f2ea HTTP/1.0" 202 Accepted 2025-09-26 10:44:55,028 - lava_callback - INFO - Starting async job submit for node 68d3cba0cd36afa834e0f2ea 2025-09-26 10:44:55,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:55,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cba0cd36afa834e0f2ea HTTP/1.1" 200 None 2025-09-26 10:44:55,042 - lava_callback - DEBUG - Processing node 68d3cba0cd36afa834e0f2ea: baseline-arm 2025-09-26 10:44:55,042 - lava_callback - ERROR - Error processing callback for node 68d3cba0cd36afa834e0f2ea: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:44:55,744 - lava_callback - INFO - Received callback for node 68d3cba1cd36afa834e0f2ed INFO: 172.20.0.1:47568 - "POST /node/68d3cba1cd36afa834e0f2ed HTTP/1.0" 202 Accepted 2025-09-26 10:44:55,749 - lava_callback - INFO - Starting async job submit for node 68d3cba1cd36afa834e0f2ed 2025-09-26 10:44:55,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:55,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cba1cd36afa834e0f2ed HTTP/1.1" 200 None 2025-09-26 10:44:55,763 - lava_callback - DEBUG - Processing node 68d3cba1cd36afa834e0f2ed: baseline-arm 2025-09-26 10:44:55,763 - lava_callback - ERROR - Error processing callback for node 68d3cba1cd36afa834e0f2ed: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:47584 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:44:57,364 - lava_callback - INFO - Received callback for node 68d66de32f83206171a907eb INFO: 172.20.0.1:47596 - "POST /node/68d66de32f83206171a907eb HTTP/1.0" 202 Accepted 2025-09-26 10:44:57,372 - lava_callback - INFO - Starting async job submit for node 68d66de32f83206171a907eb 2025-09-26 10:44:57,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:57,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66de32f83206171a907eb HTTP/1.1" 200 None 2025-09-26 10:44:57,429 - lava_callback - DEBUG - Processing node 68d66de32f83206171a907eb: baseline-arm64 2025-09-26 10:44:57,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:44:57,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:44:57,989 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66de32f83206171a907eb/log.txt.gz 2025-09-26 10:44:57,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:44:58,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:44:58,188 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66de32f83206171a907eb/lava_callback.json.gz 2025-09-26 10:44:58,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:58,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66de32f83206171a907eb HTTP/1.1" 200 None 2025-09-26 10:44:58,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:58,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:44:58,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:58,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66de32f83206171a907eb HTTP/1.1" 200 None 2025-09-26 10:44:58,292 - lava_callback - INFO - Completed processing callback for node 68d66de32f83206171a907eb 2025-09-26 10:44:58,694 - lava_callback - INFO - Received callback for node 68d66dc82f83206171a907b1 INFO: 172.20.0.1:47602 - "POST /node/68d66dc82f83206171a907b1 HTTP/1.0" 202 Accepted 2025-09-26 10:44:58,700 - lava_callback - INFO - Starting async job submit for node 68d66dc82f83206171a907b1 2025-09-26 10:44:58,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:58,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dc82f83206171a907b1 HTTP/1.1" 200 None 2025-09-26 10:44:58,744 - lava_callback - DEBUG - Processing node 68d66dc82f83206171a907b1: baseline-arm64 2025-09-26 10:44:59,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:44:59,191 - lava_callback - INFO - Received callback for node 68d66d9c2f83206171a90763 INFO: 172.20.0.1:47614 - "POST /node/68d66d9c2f83206171a90763 HTTP/1.0" 202 Accepted 2025-09-26 10:44:59,201 - lava_callback - INFO - Starting async job submit for node 68d66d9c2f83206171a90763 2025-09-26 10:44:59,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:44:59,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d9c2f83206171a90763 HTTP/1.1" 200 None 2025-09-26 10:44:59,250 - lava_callback - DEBUG - Processing node 68d66d9c2f83206171a90763: baseline-arm64 2025-09-26 10:44:59,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:44:59,349 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dc82f83206171a907b1/log.txt.gz 2025-09-26 10:44:59,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:44:59,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:00,834 - lava_callback - INFO - Received callback for node 68d66dc62f83206171a907ae INFO: 172.20.0.1:45480 - "POST /node/68d66dc62f83206171a907ae HTTP/1.0" 202 Accepted 2025-09-26 10:45:00,842 - lava_callback - INFO - Starting async job submit for node 68d66dc62f83206171a907ae 2025-09-26 10:45:00,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:00,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dc62f83206171a907ae HTTP/1.1" 200 None 2025-09-26 10:45:00,892 - lava_callback - DEBUG - Processing node 68d66dc62f83206171a907ae: baseline-arm64 2025-09-26 10:45:01,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:02,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:02,105 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d9c2f83206171a90763/log.txt.gz 2025-09-26 10:45:02,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:02,163 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:02,164 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dc62f83206171a907ae/log.txt.gz 2025-09-26 10:45:02,171 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:02,171 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dc82f83206171a907b1/lava_callback.json.gz 2025-09-26 10:45:02,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:02,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:02,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dc82f83206171a907b1 HTTP/1.1" 200 None 2025-09-26 10:45:02,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:02,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:45:02,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:02,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66dc82f83206171a907b1 HTTP/1.1" 200 None 2025-09-26 10:45:02,297 - lava_callback - INFO - Completed processing callback for node 68d66dc82f83206171a907b1 2025-09-26 10:45:02,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:02,337 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d9c2f83206171a90763/lava_callback.json.gz 2025-09-26 10:45:02,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:02,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d9c2f83206171a90763 HTTP/1.1" 200 None 2025-09-26 10:45:02,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:02,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:45:02,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:02,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:02,446 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dc62f83206171a907ae/lava_callback.json.gz 2025-09-26 10:45:02,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:02,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d9c2f83206171a90763 HTTP/1.1" 200 None 2025-09-26 10:45:02,512 - lava_callback - INFO - Completed processing callback for node 68d66d9c2f83206171a90763 2025-09-26 10:45:02,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dc62f83206171a907ae HTTP/1.1" 200 None 2025-09-26 10:45:02,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:02,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:45:02,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:02,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66dc62f83206171a907ae HTTP/1.1" 200 None 2025-09-26 10:45:02,641 - lava_callback - INFO - Completed processing callback for node 68d66dc62f83206171a907ae 2025-09-26 10:45:02,728 - lava_callback - INFO - Received callback for node 68d66e4a2f83206171a908cc INFO: 172.20.0.1:45494 - "POST /node/68d66e4a2f83206171a908cc HTTP/1.0" 202 Accepted 2025-09-26 10:45:02,741 - lava_callback - INFO - Starting async job submit for node 68d66e4a2f83206171a908cc 2025-09-26 10:45:02,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:02,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e4a2f83206171a908cc HTTP/1.1" 200 None 2025-09-26 10:45:02,792 - lava_callback - DEBUG - Processing node 68d66e4a2f83206171a908cc: baseline-arm64 2025-09-26 10:45:02,799 - lava_callback - INFO - Received callback for node 68d66e132f83206171a9085e INFO: 172.20.0.1:45504 - "POST /node/68d66e132f83206171a9085e HTTP/1.0" 202 Accepted 2025-09-26 10:45:02,816 - lava_callback - INFO - Starting async job submit for node 68d66e132f83206171a9085e 2025-09-26 10:45:02,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:02,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e132f83206171a9085e HTTP/1.1" 200 None 2025-09-26 10:45:02,946 - lava_callback - DEBUG - Processing node 68d66e132f83206171a9085e: baseline-arm64 2025-09-26 10:45:03,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:03,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:04,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:04,029 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e4a2f83206171a908cc/log.txt.gz 2025-09-26 10:45:04,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:04,060 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:04,060 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e132f83206171a9085e/log.txt.gz 2025-09-26 10:45:04,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:04,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:04,232 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e4a2f83206171a908cc/lava_callback.json.gz 2025-09-26 10:45:04,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:04,290 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:04,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e4a2f83206171a908cc HTTP/1.1" 200 None 2025-09-26 10:45:04,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:04,293 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e132f83206171a9085e/lava_callback.json.gz 2025-09-26 10:45:04,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:04,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:45:04,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:04,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e132f83206171a9085e HTTP/1.1" 200 None 2025-09-26 10:45:04,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:04,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e4a2f83206171a908cc HTTP/1.1" 200 None 2025-09-26 10:45:04,387 - lava_callback - INFO - Completed processing callback for node 68d66e4a2f83206171a908cc 2025-09-26 10:45:04,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:45:04,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:04,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e132f83206171a9085e HTTP/1.1" 200 None 2025-09-26 10:45:04,483 - lava_callback - INFO - Completed processing callback for node 68d66e132f83206171a9085e INFO: 172.20.0.1:45512 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:45:07,994 - lava_callback - INFO - Received callback for node 68d66d9e2f83206171a90766 INFO: 172.20.0.1:45526 - "POST /node/68d66d9e2f83206171a90766 HTTP/1.0" 202 Accepted 2025-09-26 10:45:08,001 - lava_callback - INFO - Starting async job submit for node 68d66d9e2f83206171a90766 2025-09-26 10:45:08,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:08,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d9e2f83206171a90766 HTTP/1.1" 200 None 2025-09-26 10:45:08,038 - lava_callback - DEBUG - Processing node 68d66d9e2f83206171a90766: baseline-arm64 2025-09-26 10:45:08,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:08,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:08,673 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d9e2f83206171a90766/log.txt.gz 2025-09-26 10:45:08,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:08,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:08,817 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d9e2f83206171a90766/lava_callback.json.gz 2025-09-26 10:45:08,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:08,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d9e2f83206171a90766 HTTP/1.1" 200 None 2025-09-26 10:45:08,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:08,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:45:08,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:08,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d9e2f83206171a90766 HTTP/1.1" 200 None 2025-09-26 10:45:08,920 - lava_callback - INFO - Completed processing callback for node 68d66d9e2f83206171a90766 2025-09-26 10:45:08,995 - lava_callback - INFO - Received callback for node 68d3cbabcd36afa834e0f2f6 INFO: 172.20.0.1:45538 - "POST /node/68d3cbabcd36afa834e0f2f6 HTTP/1.0" 202 Accepted 2025-09-26 10:45:09,004 - lava_callback - INFO - Starting async job submit for node 68d3cbabcd36afa834e0f2f6 2025-09-26 10:45:09,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:09,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cbabcd36afa834e0f2f6 HTTP/1.1" 200 None 2025-09-26 10:45:09,027 - lava_callback - DEBUG - Processing node 68d3cbabcd36afa834e0f2f6: ltp-ipc 2025-09-26 10:45:09,027 - lava_callback - ERROR - Error processing callback for node 68d3cbabcd36afa834e0f2f6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:45:09,804 - lava_callback - INFO - Received callback for node 68d3cbb2cd36afa834e0f2fc INFO: 172.20.0.1:51120 - "POST /node/68d3cbb2cd36afa834e0f2fc HTTP/1.0" 202 Accepted 2025-09-26 10:45:09,812 - lava_callback - INFO - Starting async job submit for node 68d3cbb2cd36afa834e0f2fc 2025-09-26 10:45:09,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:09,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cbb2cd36afa834e0f2fc HTTP/1.1" 200 None 2025-09-26 10:45:09,827 - lava_callback - DEBUG - Processing node 68d3cbb2cd36afa834e0f2fc: ltp-input 2025-09-26 10:45:09,827 - lava_callback - ERROR - Error processing callback for node 68d3cbb2cd36afa834e0f2fc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:51132 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 10:45:15,371 - lava_callback - INFO - Received callback for node 68d3cba4cd36afa834e0f2f0 INFO: 172.20.0.1:51140 - "POST /node/68d3cba4cd36afa834e0f2f0 HTTP/1.0" 202 Accepted 2025-09-26 10:45:15,376 - lava_callback - INFO - Starting async job submit for node 68d3cba4cd36afa834e0f2f0 2025-09-26 10:45:15,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:15,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cba4cd36afa834e0f2f0 HTTP/1.1" 200 None 2025-09-26 10:45:15,393 - lava_callback - DEBUG - Processing node 68d3cba4cd36afa834e0f2f0: baseline-arm 2025-09-26 10:45:15,394 - lava_callback - ERROR - Error processing callback for node 68d3cba4cd36afa834e0f2f0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:45:16,068 - lava_callback - INFO - Received callback for node 68d3cba6cd36afa834e0f2f3 INFO: 172.20.0.1:51142 - "POST /node/68d3cba6cd36afa834e0f2f3 HTTP/1.0" 202 Accepted 2025-09-26 10:45:16,076 - lava_callback - INFO - Starting async job submit for node 68d3cba6cd36afa834e0f2f3 2025-09-26 10:45:16,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:16,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cba6cd36afa834e0f2f3 HTTP/1.1" 200 None 2025-09-26 10:45:16,090 - lava_callback - DEBUG - Processing node 68d3cba6cd36afa834e0f2f3: baseline-arm 2025-09-26 10:45:16,090 - lava_callback - ERROR - Error processing callback for node 68d3cba6cd36afa834e0f2f3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:51148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51158 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:45:16,768 - lava_callback - INFO - Received callback for node 68d3cbb4cd36afa834e0f2ff INFO: 172.20.0.1:51162 - "POST /node/68d3cbb4cd36afa834e0f2ff HTTP/1.0" 202 Accepted 2025-09-26 10:45:16,773 - lava_callback - INFO - Starting async job submit for node 68d3cbb4cd36afa834e0f2ff 2025-09-26 10:45:16,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:16,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cbb4cd36afa834e0f2ff HTTP/1.1" 200 None 2025-09-26 10:45:16,787 - lava_callback - DEBUG - Processing node 68d3cbb4cd36afa834e0f2ff: baseline-arm 2025-09-26 10:45:16,787 - lava_callback - ERROR - Error processing callback for node 68d3cbb4cd36afa834e0f2ff: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:45:17,451 - lava_callback - INFO - Received callback for node 68d3cbb5cd36afa834e0f302 INFO: 172.20.0.1:51174 - "POST /node/68d3cbb5cd36afa834e0f302 HTTP/1.0" 202 Accepted 2025-09-26 10:45:17,457 - lava_callback - INFO - Starting async job submit for node 68d3cbb5cd36afa834e0f302 2025-09-26 10:45:17,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:17,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cbb5cd36afa834e0f302 HTTP/1.1" 200 None 2025-09-26 10:45:17,472 - lava_callback - DEBUG - Processing node 68d3cbb5cd36afa834e0f302: baseline-arm 2025-09-26 10:45:17,472 - lava_callback - ERROR - Error processing callback for node 68d3cbb5cd36afa834e0f302: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:45:17,786 - lava_callback - INFO - Received callback for node 68d66e112f83206171a9085b INFO: 172.20.0.1:51182 - "POST /node/68d66e112f83206171a9085b HTTP/1.0" 202 Accepted 2025-09-26 10:45:17,792 - lava_callback - INFO - Starting async job submit for node 68d66e112f83206171a9085b 2025-09-26 10:45:17,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:17,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e112f83206171a9085b HTTP/1.1" 200 None 2025-09-26 10:45:17,831 - lava_callback - DEBUG - Processing node 68d66e112f83206171a9085b: baseline-arm64 2025-09-26 10:45:18,174 - lava_callback - INFO - Received callback for node 68d3cbb9cd36afa834e0f307 INFO: 172.20.0.1:51184 - "POST /node/68d3cbb9cd36afa834e0f307 HTTP/1.0" 202 Accepted 2025-09-26 10:45:18,192 - lava_callback - INFO - Starting async job submit for node 68d3cbb9cd36afa834e0f307 2025-09-26 10:45:18,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:18,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:18,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cbb9cd36afa834e0f307 HTTP/1.1" 200 None 2025-09-26 10:45:18,215 - lava_callback - DEBUG - Processing node 68d3cbb9cd36afa834e0f307: baseline-arm 2025-09-26 10:45:18,215 - lava_callback - ERROR - Error processing callback for node 68d3cbb9cd36afa834e0f307: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:45570 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:45:21,670 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:21,671 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e112f83206171a9085b/log.txt.gz 2025-09-26 10:45:21,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:21,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:21,983 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e112f83206171a9085b/lava_callback.json.gz 2025-09-26 10:45:22,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:22,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e112f83206171a9085b HTTP/1.1" 200 None 2025-09-26 10:45:22,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:22,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:45:22,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:22,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e112f83206171a9085b HTTP/1.1" 200 None 2025-09-26 10:45:22,223 - lava_callback - INFO - Completed processing callback for node 68d66e112f83206171a9085b 2025-09-26 10:45:23,648 - lava_callback - INFO - Received callback for node 68d66de52f83206171a907ee INFO: 172.20.0.1:45578 - "POST /node/68d66de52f83206171a907ee HTTP/1.0" 202 Accepted 2025-09-26 10:45:23,657 - lava_callback - INFO - Starting async job submit for node 68d66de52f83206171a907ee 2025-09-26 10:45:23,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:23,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66de52f83206171a907ee HTTP/1.1" 200 None 2025-09-26 10:45:23,720 - lava_callback - DEBUG - Processing node 68d66de52f83206171a907ee: baseline-arm64 2025-09-26 10:45:24,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:24,412 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:24,413 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66de52f83206171a907ee/log.txt.gz 2025-09-26 10:45:24,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:24,598 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:24,600 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66de52f83206171a907ee/lava_callback.json.gz 2025-09-26 10:45:24,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:24,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66de52f83206171a907ee HTTP/1.1" 200 None 2025-09-26 10:45:24,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:24,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:45:24,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:24,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66de52f83206171a907ee HTTP/1.1" 200 None 2025-09-26 10:45:24,748 - lava_callback - INFO - Completed processing callback for node 68d66de52f83206171a907ee 2025-09-26 10:45:25,502 - lava_callback - INFO - Received callback for node 68d66e752f83206171a90934 INFO: 172.20.0.1:45590 - "POST /node/68d66e752f83206171a90934 HTTP/1.0" 202 Accepted 2025-09-26 10:45:25,509 - lava_callback - INFO - Starting async job submit for node 68d66e752f83206171a90934 2025-09-26 10:45:25,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:25,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e752f83206171a90934 HTTP/1.1" 200 None 2025-09-26 10:45:25,554 - lava_callback - DEBUG - Processing node 68d66e752f83206171a90934: baseline-arm64 2025-09-26 10:45:25,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:45594 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:45:28,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:28,113 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e752f83206171a90934/log.txt.gz 2025-09-26 10:45:28,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:28,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:28,250 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e752f83206171a90934/lava_callback.json.gz 2025-09-26 10:45:28,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:28,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e752f83206171a90934 HTTP/1.1" 200 None 2025-09-26 10:45:28,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:28,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:45:28,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:28,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e752f83206171a90934 HTTP/1.1" 200 None 2025-09-26 10:45:28,340 - lava_callback - INFO - Completed processing callback for node 68d66e752f83206171a90934 2025-09-26 10:45:29,039 - lava_callback - INFO - Received callback for node 68d3cbc6cd36afa834e0f321 INFO: 172.20.0.1:45600 - "POST /node/68d3cbc6cd36afa834e0f321 HTTP/1.0" 202 Accepted 2025-09-26 10:45:29,045 - lava_callback - INFO - Starting async job submit for node 68d3cbc6cd36afa834e0f321 2025-09-26 10:45:29,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:29,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cbc6cd36afa834e0f321 HTTP/1.1" 200 None 2025-09-26 10:45:29,075 - lava_callback - DEBUG - Processing node 68d3cbc6cd36afa834e0f321: ltp-timers 2025-09-26 10:45:29,075 - lava_callback - ERROR - Error processing callback for node 68d3cbc6cd36afa834e0f321: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:45:33,633 - lava_callback - INFO - Received callback for node 68d66e732f83206171a90931 INFO: 172.20.0.1:33042 - "POST /node/68d66e732f83206171a90931 HTTP/1.0" 202 Accepted 2025-09-26 10:45:33,641 - lava_callback - INFO - Starting async job submit for node 68d66e732f83206171a90931 2025-09-26 10:45:33,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:33,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e732f83206171a90931 HTTP/1.1" 200 None 2025-09-26 10:45:33,678 - lava_callback - DEBUG - Processing node 68d66e732f83206171a90931: baseline-arm64 2025-09-26 10:45:34,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:34,270 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:34,271 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e732f83206171a90931/log.txt.gz 2025-09-26 10:45:34,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:34,464 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:34,464 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e732f83206171a90931/lava_callback.json.gz 2025-09-26 10:45:34,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:34,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e732f83206171a90931 HTTP/1.1" 200 None 2025-09-26 10:45:34,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:34,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:45:34,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:34,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e732f83206171a90931 HTTP/1.1" 200 None 2025-09-26 10:45:34,587 - lava_callback - INFO - Completed processing callback for node 68d66e732f83206171a90931 2025-09-26 10:45:34,912 - lava_callback - INFO - Received callback for node 68d3cbbbcd36afa834e0f30a INFO: 172.20.0.1:33052 - "POST /node/68d3cbbbcd36afa834e0f30a HTTP/1.0" 202 Accepted 2025-09-26 10:45:34,920 - lava_callback - INFO - Starting async job submit for node 68d3cbbbcd36afa834e0f30a 2025-09-26 10:45:34,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:34,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cbbbcd36afa834e0f30a HTTP/1.1" 200 None 2025-09-26 10:45:34,939 - lava_callback - DEBUG - Processing node 68d3cbbbcd36afa834e0f30a: baseline-arm 2025-09-26 10:45:34,939 - lava_callback - ERROR - Error processing callback for node 68d3cbbbcd36afa834e0f30a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:33056 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:45:38,204 - lava_callback - INFO - Received callback for node 68d66e7a2f83206171a9093a INFO: 172.20.0.1:33060 - "POST /node/68d66e7a2f83206171a9093a HTTP/1.0" 202 Accepted 2025-09-26 10:45:38,210 - lava_callback - INFO - Starting async job submit for node 68d66e7a2f83206171a9093a 2025-09-26 10:45:38,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:38,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e7a2f83206171a9093a HTTP/1.1" 200 None 2025-09-26 10:45:38,245 - lava_callback - DEBUG - Processing node 68d66e7a2f83206171a9093a: baseline-arm64 2025-09-26 10:45:38,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:40,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:40,972 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e7a2f83206171a9093a/log.txt.gz 2025-09-26 10:45:40,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:41,215 - lava_callback - INFO - Received callback for node 68d66e782f83206171a90937 INFO: 172.20.0.1:58944 - "POST /node/68d66e782f83206171a90937 HTTP/1.0" 202 Accepted 2025-09-26 10:45:41,221 - lava_callback - INFO - Starting async job submit for node 68d66e782f83206171a90937 2025-09-26 10:45:41,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:41,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e782f83206171a90937 HTTP/1.1" 200 None 2025-09-26 10:45:41,268 - lava_callback - DEBUG - Processing node 68d66e782f83206171a90937: baseline-arm64 2025-09-26 10:45:41,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:43,436 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:43,437 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e7a2f83206171a9093a/lava_callback.json.gz 2025-09-26 10:45:43,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:43,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:43,460 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e782f83206171a90937/log.txt.gz 2025-09-26 10:45:43,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:43,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e7a2f83206171a9093a HTTP/1.1" 200 None 2025-09-26 10:45:43,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:43,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:45:43,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:43,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e7a2f83206171a9093a HTTP/1.1" 200 None 2025-09-26 10:45:43,533 - lava_callback - INFO - Completed processing callback for node 68d66e7a2f83206171a9093a 2025-09-26 10:45:46,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:46,069 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e782f83206171a90937/lava_callback.json.gz 2025-09-26 10:45:46,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:46,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e782f83206171a90937 HTTP/1.1" 200 None 2025-09-26 10:45:46,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:46,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:45:46,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:46,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e782f83206171a90937 HTTP/1.1" 200 None 2025-09-26 10:45:46,207 - lava_callback - INFO - Completed processing callback for node 68d66e782f83206171a90937 INFO: 172.20.0.1:58960 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:45:47,118 - lava_callback - INFO - Received callback for node 68d66e7f2f83206171a90940 INFO: 172.20.0.1:58974 - "POST /node/68d66e7f2f83206171a90940 HTTP/1.0" 202 Accepted 2025-09-26 10:45:47,129 - lava_callback - INFO - Starting async job submit for node 68d66e7f2f83206171a90940 2025-09-26 10:45:47,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:47,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e7f2f83206171a90940 HTTP/1.1" 200 None 2025-09-26 10:45:47,168 - lava_callback - DEBUG - Processing node 68d66e7f2f83206171a90940: baseline-arm64 2025-09-26 10:45:47,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:47,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:47,732 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e7f2f83206171a90940/log.txt.gz 2025-09-26 10:45:47,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:47,889 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:47,890 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e7f2f83206171a90940/lava_callback.json.gz 2025-09-26 10:45:47,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:47,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e7f2f83206171a90940 HTTP/1.1" 200 None 2025-09-26 10:45:47,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:47,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:45:47,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:47,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e7f2f83206171a90940 HTTP/1.1" 200 None 2025-09-26 10:45:47,995 - lava_callback - INFO - Completed processing callback for node 68d66e7f2f83206171a90940 2025-09-26 10:45:48,979 - lava_callback - INFO - Received callback for node 68d3cbcecd36afa834e0f32a INFO: 172.20.0.1:58978 - "POST /node/68d3cbcecd36afa834e0f32a HTTP/1.0" 202 Accepted 2025-09-26 10:45:48,988 - lava_callback - INFO - Starting async job submit for node 68d3cbcecd36afa834e0f32a 2025-09-26 10:45:48,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:49,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cbcecd36afa834e0f32a HTTP/1.1" 200 None 2025-09-26 10:45:49,011 - lava_callback - DEBUG - Processing node 68d3cbcecd36afa834e0f32a: ltp-ipc 2025-09-26 10:45:49,011 - lava_callback - ERROR - Error processing callback for node 68d3cbcecd36afa834e0f32a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:45:49,392 - lava_callback - INFO - Received callback for node 68d66e7d2f83206171a9093d INFO: 172.20.0.1:40074 - "POST /node/68d66e7d2f83206171a9093d HTTP/1.0" 202 Accepted 2025-09-26 10:45:49,402 - lava_callback - INFO - Starting async job submit for node 68d66e7d2f83206171a9093d 2025-09-26 10:45:49,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:49,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e7d2f83206171a9093d HTTP/1.1" 200 None 2025-09-26 10:45:49,451 - lava_callback - DEBUG - Processing node 68d66e7d2f83206171a9093d: baseline-arm64 2025-09-26 10:45:49,753 - lava_callback - INFO - Received callback for node 68d3cbd6cd36afa834e0f333 INFO: 172.20.0.1:40082 - "POST /node/68d3cbd6cd36afa834e0f333 HTTP/1.0" 202 Accepted 2025-09-26 10:45:49,771 - lava_callback - INFO - Starting async job submit for node 68d3cbd6cd36afa834e0f333 2025-09-26 10:45:49,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:49,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cbd6cd36afa834e0f333 HTTP/1.1" 200 None 2025-09-26 10:45:49,848 - lava_callback - DEBUG - Processing node 68d3cbd6cd36afa834e0f333: ltp-pty 2025-09-26 10:45:49,848 - lava_callback - ERROR - Error processing callback for node 68d3cbd6cd36afa834e0f333: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:45:49,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:50,601 - lava_callback - INFO - Received callback for node 68d66e842f83206171a90947 INFO: 172.20.0.1:40090 - "POST /node/68d66e842f83206171a90947 HTTP/1.0" 202 Accepted 2025-09-26 10:45:50,611 - lava_callback - INFO - Starting async job submit for node 68d66e842f83206171a90947 2025-09-26 10:45:50,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:50,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e842f83206171a90947 HTTP/1.1" 200 None 2025-09-26 10:45:50,646 - lava_callback - DEBUG - Processing node 68d66e842f83206171a90947: baseline-arm64 2025-09-26 10:45:50,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:51,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:51,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:51,513 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e7d2f83206171a9093d/log.txt.gz 2025-09-26 10:45:51,516 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e842f83206171a90947/log.txt.gz 2025-09-26 10:45:51,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:51,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:51,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:51,683 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e7d2f83206171a9093d/lava_callback.json.gz 2025-09-26 10:45:51,708 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:51,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:51,713 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e842f83206171a90947/lava_callback.json.gz 2025-09-26 10:45:51,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:51,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e7d2f83206171a9093d HTTP/1.1" 200 None 2025-09-26 10:45:51,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e842f83206171a90947 HTTP/1.1" 200 None 2025-09-26 10:45:51,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:51,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:51,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:45:51,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:51,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:45:51,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:51,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e7d2f83206171a9093d HTTP/1.1" 200 None 2025-09-26 10:45:51,796 - lava_callback - INFO - Completed processing callback for node 68d66e7d2f83206171a9093d 2025-09-26 10:45:51,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e842f83206171a90947 HTTP/1.1" 200 None 2025-09-26 10:45:51,814 - lava_callback - INFO - Completed processing callback for node 68d66e842f83206171a90947 INFO: 172.20.0.1:40096 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:45:57,010 - lava_callback - INFO - Received callback for node 68d66e872f83206171a9094a INFO: 172.20.0.1:40110 - "POST /node/68d66e872f83206171a9094a HTTP/1.0" 202 Accepted 2025-09-26 10:45:57,018 - lava_callback - INFO - Starting async job submit for node 68d66e872f83206171a9094a 2025-09-26 10:45:57,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:57,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e872f83206171a9094a HTTP/1.1" 200 None 2025-09-26 10:45:57,069 - lava_callback - DEBUG - Processing node 68d66e872f83206171a9094a: baseline-arm64 2025-09-26 10:45:57,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:57,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:57,669 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e872f83206171a9094a/log.txt.gz 2025-09-26 10:45:57,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:45:57,811 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:45:57,812 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e872f83206171a9094a/lava_callback.json.gz 2025-09-26 10:45:57,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:57,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e872f83206171a9094a HTTP/1.1" 200 None 2025-09-26 10:45:57,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:57,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:45:57,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:45:57,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e872f83206171a9094a HTTP/1.1" 200 None 2025-09-26 10:45:57,906 - lava_callback - INFO - Completed processing callback for node 68d66e872f83206171a9094a INFO: 172.20.0.1:39580 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:46:08,423 - lava_callback - INFO - Received callback for node 68d3caa1cd36afa834e0f0c2 INFO: 172.20.0.1:39596 - "POST /node/68d3caa1cd36afa834e0f0c2 HTTP/1.0" 202 Accepted 2025-09-26 10:46:08,434 - lava_callback - INFO - Starting async job submit for node 68d3caa1cd36afa834e0f0c2 2025-09-26 10:46:08,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:08,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3caa1cd36afa834e0f0c2 HTTP/1.1" 200 None 2025-09-26 10:46:08,618 - lava_callback - DEBUG - Processing node 68d3caa1cd36afa834e0f0c2: ltp-fs-bind 2025-09-26 10:46:09,000 - lava_callback - INFO - Received callback for node 68d3cbe6cd36afa834e0f344 INFO: 172.20.0.1:39610 - "POST /node/68d3cbe6cd36afa834e0f344 HTTP/1.0" 202 Accepted 2025-09-26 10:46:09,015 - lava_callback - INFO - Starting async job submit for node 68d3cbe6cd36afa834e0f344 2025-09-26 10:46:09,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:09,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cbe6cd36afa834e0f344 HTTP/1.1" 200 None 2025-09-26 10:46:09,100 - lava_callback - DEBUG - Processing node 68d3cbe6cd36afa834e0f344: ltp-ipc 2025-09-26 10:46:09,100 - lava_callback - ERROR - Error processing callback for node 68d3cbe6cd36afa834e0f344: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:46:09,267 - lava_callback - ERROR - Error processing callback for node 68d3caa1cd36afa834e0f0c2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:46:09,806 - lava_callback - INFO - Received callback for node 68d3cbe9cd36afa834e0f347 INFO: 172.20.0.1:40438 - "POST /node/68d3cbe9cd36afa834e0f347 HTTP/1.0" 202 Accepted 2025-09-26 10:46:09,816 - lava_callback - INFO - Starting async job submit for node 68d3cbe9cd36afa834e0f347 2025-09-26 10:46:09,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:09,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cbe9cd36afa834e0f347 HTTP/1.1" 200 None 2025-09-26 10:46:09,836 - lava_callback - DEBUG - Processing node 68d3cbe9cd36afa834e0f347: ltp-pty 2025-09-26 10:46:09,836 - lava_callback - ERROR - Error processing callback for node 68d3cbe9cd36afa834e0f347: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:40450 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 10:46:16,454 - lava_callback - INFO - Received callback for node 68d66e522f83206171a908e9 INFO: 172.20.0.1:40464 - "POST /node/68d66e522f83206171a908e9 HTTP/1.0" 202 Accepted 2025-09-26 10:46:16,462 - lava_callback - INFO - Starting async job submit for node 68d66e522f83206171a908e9 2025-09-26 10:46:16,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:16,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e522f83206171a908e9 HTTP/1.1" 200 None 2025-09-26 10:46:16,506 - lava_callback - DEBUG - Processing node 68d66e522f83206171a908e9: baseline-arm64 INFO: 172.20.0.1:40478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40494 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:46:16,639 - lava_callback - INFO - Received callback for node 68d66dcd2f83206171a907b4 INFO: 172.20.0.1:40498 - "POST /node/68d66dcd2f83206171a907b4 HTTP/1.0" 202 Accepted 2025-09-26 10:46:16,664 - lava_callback - INFO - Starting async job submit for node 68d66dcd2f83206171a907b4 2025-09-26 10:46:16,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:16,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dcd2f83206171a907b4 HTTP/1.1" 200 None 2025-09-26 10:46:16,791 - lava_callback - DEBUG - Processing node 68d66dcd2f83206171a907b4: baseline-arm64 2025-09-26 10:46:17,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:46:17,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:46:17,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:46:17,578 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e522f83206171a908e9/log.txt.gz 2025-09-26 10:46:17,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:46:17,595 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:46:17,595 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dcd2f83206171a907b4/log.txt.gz 2025-09-26 10:46:17,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:46:18,527 - lava_callback - INFO - Received callback for node 68d40a2ccd36afa834e16ef7 INFO: 172.20.0.1:40514 - "POST /node/68d40a2ccd36afa834e16ef7 HTTP/1.0" 202 Accepted 2025-09-26 10:46:18,533 - lava_callback - INFO - Starting async job submit for node 68d40a2ccd36afa834e16ef7 2025-09-26 10:46:18,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:18,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a2ccd36afa834e16ef7 HTTP/1.1" 200 None 2025-09-26 10:46:18,572 - lava_callback - DEBUG - Processing node 68d40a2ccd36afa834e16ef7: baseline-arm 2025-09-26 10:46:18,792 - lava_callback - ERROR - Error processing callback for node 68d40a2ccd36afa834e16ef7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:46:19,338 - lava_callback - INFO - Received callback for node 68d66dd02f83206171a907c3 INFO: 172.20.0.1:47618 - "POST /node/68d66dd02f83206171a907c3 HTTP/1.0" 202 Accepted 2025-09-26 10:46:19,344 - lava_callback - INFO - Starting async job submit for node 68d66dd02f83206171a907c3 2025-09-26 10:46:19,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:19,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dd02f83206171a907c3 HTTP/1.1" 200 None 2025-09-26 10:46:19,401 - lava_callback - DEBUG - Processing node 68d66dd02f83206171a907c3: baseline-arm64 2025-09-26 10:46:19,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:47622 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:46:20,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:46:20,029 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e522f83206171a908e9/lava_callback.json.gz 2025-09-26 10:46:20,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:46:20,048 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:46:20,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:20,052 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dcd2f83206171a907b4/lava_callback.json.gz 2025-09-26 10:46:20,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:20,072 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dd02f83206171a907c3/log.txt.gz 2025-09-26 10:46:20,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:46:20,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e522f83206171a908e9 HTTP/1.1" 200 None 2025-09-26 10:46:20,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:20,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dcd2f83206171a907b4 HTTP/1.1" 200 None 2025-09-26 10:46:20,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:20,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:46:20,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:20,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:46:20,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:20,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e522f83206171a908e9 HTTP/1.1" 200 None 2025-09-26 10:46:20,187 - lava_callback - INFO - Completed processing callback for node 68d66e522f83206171a908e9 2025-09-26 10:46:20,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66dcd2f83206171a907b4 HTTP/1.1" 200 None 2025-09-26 10:46:20,208 - lava_callback - INFO - Completed processing callback for node 68d66dcd2f83206171a907b4 2025-09-26 10:46:20,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:46:20,281 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dd02f83206171a907c3/lava_callback.json.gz 2025-09-26 10:46:20,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:20,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dd02f83206171a907c3 HTTP/1.1" 200 None 2025-09-26 10:46:20,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:20,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:46:20,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:20,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66dd02f83206171a907c3 HTTP/1.1" 200 None 2025-09-26 10:46:20,470 - lava_callback - INFO - Completed processing callback for node 68d66dd02f83206171a907c3 INFO: 172.20.0.1:47636 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:46:34,541 - lava_callback - INFO - Received callback for node 68d66a3e2f83206171a9043f INFO: 172.20.0.1:55372 - "POST /node/68d66a3e2f83206171a9043f HTTP/1.0" 202 Accepted 2025-09-26 10:46:34,547 - lava_callback - INFO - Starting async job submit for node 68d66a3e2f83206171a9043f 2025-09-26 10:46:34,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:34,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66a3e2f83206171a9043f HTTP/1.1" 200 None 2025-09-26 10:46:34,610 - lava_callback - DEBUG - Processing node 68d66a3e2f83206171a9043f: baseline-x86-kcidebug-intel 2025-09-26 10:46:34,753 - lava_callback - INFO - Received callback for node 68d66ea12f83206171a90978 INFO: 172.20.0.1:55382 - "POST /node/68d66ea12f83206171a90978 HTTP/1.0" 202 Accepted 2025-09-26 10:46:34,778 - lava_callback - INFO - Starting async job submit for node 68d66ea12f83206171a90978 2025-09-26 10:46:34,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:34,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ea12f83206171a90978 HTTP/1.1" 200 None 2025-09-26 10:46:34,905 - lava_callback - DEBUG - Processing node 68d66ea12f83206171a90978: baseline-arm64-broonie 2025-09-26 10:46:34,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:46:35,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:46:35,881 - lava_callback - INFO - Received callback for node 68d3cbf9cd36afa834e0f359 INFO: 172.20.0.1:55394 - "POST /node/68d3cbf9cd36afa834e0f359 HTTP/1.0" 202 Accepted 2025-09-26 10:46:35,886 - lava_callback - INFO - Starting async job submit for node 68d3cbf9cd36afa834e0f359 2025-09-26 10:46:35,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:35,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cbf9cd36afa834e0f359 HTTP/1.1" 200 None 2025-09-26 10:46:35,909 - lava_callback - DEBUG - Processing node 68d3cbf9cd36afa834e0f359: baseline-arm 2025-09-26 10:46:35,909 - lava_callback - ERROR - Error processing callback for node 68d3cbf9cd36afa834e0f359: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:55410 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:46:36,586 - lava_callback - INFO - Received callback for node 68d3cbfbcd36afa834e0f360 INFO: 172.20.0.1:55418 - "POST /node/68d3cbfbcd36afa834e0f360 HTTP/1.0" 202 Accepted 2025-09-26 10:46:36,592 - lava_callback - INFO - Starting async job submit for node 68d3cbfbcd36afa834e0f360 2025-09-26 10:46:36,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:36,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cbfbcd36afa834e0f360 HTTP/1.1" 200 None 2025-09-26 10:46:36,608 - lava_callback - DEBUG - Processing node 68d3cbfbcd36afa834e0f360: baseline-arm 2025-09-26 10:46:36,608 - lava_callback - ERROR - Error processing callback for node 68d3cbfbcd36afa834e0f360: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:46:36,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:46:36,747 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d66ea12f83206171a90978/log.txt.gz 2025-09-26 10:46:36,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:46:36,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:46:36,778 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d66a3e2f83206171a9043f/log.txt.gz 2025-09-26 10:46:36,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:46:36,874 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:46:36,875 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d66ea12f83206171a90978/lava_callback.json.gz 2025-09-26 10:46:36,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:36,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ea12f83206171a90978 HTTP/1.1" 200 None 2025-09-26 10:46:36,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:36,946 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:46:36,947 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d66a3e2f83206171a9043f/lava_callback.json.gz 2025-09-26 10:46:36,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:46:36,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 DEBUG: Setup failed for 68d66a3e2f83206171a9043f. Transitting job node result: incomplete -> fail 2025-09-26 10:46:37,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:37,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66a3e2f83206171a9043f HTTP/1.1" 200 None 2025-09-26 10:46:37,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:37,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5682eb70fb2a1e20f2821 HTTP/1.1" 200 None 2025-09-26 10:46:37,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:37,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66ea12f83206171a90978 HTTP/1.1" 200 None 2025-09-26 10:46:37,121 - lava_callback - INFO - Completed processing callback for node 68d66ea12f83206171a90978 2025-09-26 10:46:37,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66a3e2f83206171a9043f HTTP/1.1" 200 None 2025-09-26 10:46:37,169 - lava_callback - INFO - Completed processing callback for node 68d66a3e2f83206171a9043f 2025-09-26 10:46:37,552 - lava_callback - INFO - Received callback for node 68d66ebb2f83206171a909aa INFO: 172.20.0.1:55426 - "POST /node/68d66ebb2f83206171a909aa HTTP/1.0" 202 Accepted 2025-09-26 10:46:37,559 - lava_callback - INFO - Starting async job submit for node 68d66ebb2f83206171a909aa 2025-09-26 10:46:37,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:37,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ebb2f83206171a909aa HTTP/1.1" 200 None 2025-09-26 10:46:37,618 - lava_callback - DEBUG - Processing node 68d66ebb2f83206171a909aa: baseline-arm64-broonie 2025-09-26 10:46:37,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:46:38,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:46:38,056 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d66ebb2f83206171a909aa/log.txt.gz 2025-09-26 10:46:38,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:46:38,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:46:38,199 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d66ebb2f83206171a909aa/lava_callback.json.gz 2025-09-26 10:46:38,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:38,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ebb2f83206171a909aa HTTP/1.1" 200 None 2025-09-26 10:46:38,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:38,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:46:38,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:38,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66ebb2f83206171a909aa HTTP/1.1" 200 None 2025-09-26 10:46:38,311 - lava_callback - INFO - Completed processing callback for node 68d66ebb2f83206171a909aa 2025-09-26 10:46:42,566 - lava_callback - INFO - Received callback for node 68d66e552f83206171a908ec INFO: 172.20.0.1:45286 - "POST /node/68d66e552f83206171a908ec HTTP/1.0" 202 Accepted 2025-09-26 10:46:42,572 - lava_callback - INFO - Starting async job submit for node 68d66e552f83206171a908ec 2025-09-26 10:46:42,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:42,592 - lava_callback - INFO - Received callback for node 68d66e602f83206171a90918 INFO: 172.20.0.1:45294 - "POST /node/68d66e602f83206171a90918 HTTP/1.0" 202 Accepted 2025-09-26 10:46:42,598 - lava_callback - INFO - Starting async job submit for node 68d66e602f83206171a90918 2025-09-26 10:46:42,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:42,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e552f83206171a908ec HTTP/1.1" 200 None 2025-09-26 10:46:42,634 - lava_callback - DEBUG - Processing node 68d66e552f83206171a908ec: baseline-arm64 2025-09-26 10:46:42,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e602f83206171a90918 HTTP/1.1" 200 None 2025-09-26 10:46:42,666 - lava_callback - DEBUG - Processing node 68d66e602f83206171a90918: baseline-arm64 2025-09-26 10:46:43,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:46:43,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:46:44,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:46:44,964 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e602f83206171a90918/log.txt.gz 2025-09-26 10:46:44,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:46:45,003 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:46:45,004 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e552f83206171a908ec/log.txt.gz 2025-09-26 10:46:45,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:46:45,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:46:45,121 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e602f83206171a90918/lava_callback.json.gz 2025-09-26 10:46:45,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:45,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e602f83206171a90918 HTTP/1.1" 200 None 2025-09-26 10:46:45,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:45,188 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:46:45,189 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e552f83206171a908ec/lava_callback.json.gz 2025-09-26 10:46:45,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:46:45,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:45,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:45,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e552f83206171a908ec HTTP/1.1" 200 None 2025-09-26 10:46:45,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:45,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:46:45,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:45,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e602f83206171a90918 HTTP/1.1" 200 None 2025-09-26 10:46:45,290 - lava_callback - INFO - Completed processing callback for node 68d66e602f83206171a90918 2025-09-26 10:46:45,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e552f83206171a908ec HTTP/1.1" 200 None 2025-09-26 10:46:45,316 - lava_callback - INFO - Completed processing callback for node 68d66e552f83206171a908ec INFO: 172.20.0.1:45298 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:46:47,942 - lava_callback - INFO - Received callback for node 68d66edd2f83206171a90a03 INFO: 172.20.0.1:45308 - "POST /node/68d66edd2f83206171a90a03 HTTP/1.0" 202 Accepted 2025-09-26 10:46:47,949 - lava_callback - INFO - Starting async job submit for node 68d66edd2f83206171a90a03 2025-09-26 10:46:47,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:47,974 - lava_callback - INFO - Received callback for node 68d66eb22f83206171a909a0 INFO: 172.20.0.1:45324 - "POST /node/68d66eb22f83206171a909a0 HTTP/1.0" 202 Accepted 2025-09-26 10:46:47,982 - lava_callback - INFO - Starting async job submit for node 68d66eb22f83206171a909a0 2025-09-26 10:46:48,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:48,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66edd2f83206171a90a03 HTTP/1.1" 200 None 2025-09-26 10:46:48,025 - lava_callback - DEBUG - Processing node 68d66edd2f83206171a90a03: baseline-arm64-pengutronix 2025-09-26 10:46:48,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66eb22f83206171a909a0 HTTP/1.1" 200 None 2025-09-26 10:46:48,071 - lava_callback - DEBUG - Processing node 68d66eb22f83206171a909a0: baseline-arm64-broonie 2025-09-26 10:46:48,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:46:48,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:46:50,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:46:50,332 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d66eb22f83206171a909a0/log.txt.gz 2025-09-26 10:46:50,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:46:50,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:46:50,348 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d66edd2f83206171a90a03/log.txt.gz 2025-09-26 10:46:50,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:46:50,492 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:46:50,493 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d66eb22f83206171a909a0/lava_callback.json.gz 2025-09-26 10:46:50,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:50,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66eb22f83206171a909a0 HTTP/1.1" 200 None 2025-09-26 10:46:50,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:50,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:46:50,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:46:50,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:50,591 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d66edd2f83206171a90a03/lava_callback.json.gz 2025-09-26 10:46:50,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:50,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66edd2f83206171a90a03 HTTP/1.1" 200 None 2025-09-26 10:46:50,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:50,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66eb22f83206171a909a0 HTTP/1.1" 200 None 2025-09-26 10:46:50,661 - lava_callback - INFO - Completed processing callback for node 68d66eb22f83206171a909a0 2025-09-26 10:46:50,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:46:50,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:50,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66edd2f83206171a90a03 HTTP/1.1" 200 None 2025-09-26 10:46:50,818 - lava_callback - INFO - Completed processing callback for node 68d66edd2f83206171a90a03 2025-09-26 10:46:54,336 - lava_callback - INFO - Received callback for node 68d66ee22f83206171a90a0e INFO: 172.20.0.1:56858 - "POST /node/68d66ee22f83206171a90a0e HTTP/1.0" 202 Accepted 2025-09-26 10:46:54,342 - lava_callback - INFO - Starting async job submit for node 68d66ee22f83206171a90a0e 2025-09-26 10:46:54,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:54,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ee22f83206171a90a0e HTTP/1.1" 200 None 2025-09-26 10:46:54,380 - lava_callback - DEBUG - Processing node 68d66ee22f83206171a90a0e: baseline-arm64-pengutronix 2025-09-26 10:46:54,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:46:55,226 - lava_callback - INFO - Received callback for node 68d3cc0acd36afa834e0f384 INFO: 172.20.0.1:56868 - "POST /node/68d3cc0acd36afa834e0f384 HTTP/1.0" 202 Accepted 2025-09-26 10:46:55,231 - lava_callback - INFO - Starting async job submit for node 68d3cc0acd36afa834e0f384 2025-09-26 10:46:55,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:55,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc0acd36afa834e0f384 HTTP/1.1" 200 None 2025-09-26 10:46:55,245 - lava_callback - DEBUG - Processing node 68d3cc0acd36afa834e0f384: baseline-arm 2025-09-26 10:46:55,245 - lava_callback - ERROR - Error processing callback for node 68d3cc0acd36afa834e0f384: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:46:55,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:46:55,922 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d66ee22f83206171a90a0e/log.txt.gz 2025-09-26 10:46:55,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:46:55,928 - lava_callback - INFO - Received callback for node 68d3cc0ccd36afa834e0f387 INFO: 172.20.0.1:56882 - "POST /node/68d3cc0ccd36afa834e0f387 HTTP/1.0" 202 Accepted 2025-09-26 10:46:55,937 - lava_callback - INFO - Starting async job submit for node 68d3cc0ccd36afa834e0f387 2025-09-26 10:46:55,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:55,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc0ccd36afa834e0f387 HTTP/1.1" 200 None 2025-09-26 10:46:55,950 - lava_callback - DEBUG - Processing node 68d3cc0ccd36afa834e0f387: baseline-arm 2025-09-26 10:46:55,950 - lava_callback - ERROR - Error processing callback for node 68d3cc0ccd36afa834e0f387: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:56898 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:46:56,614 - lava_callback - INFO - Received callback for node 68d3cc10cd36afa834e0f390 INFO: 172.20.0.1:56910 - "POST /node/68d3cc10cd36afa834e0f390 HTTP/1.0" 202 Accepted 2025-09-26 10:46:56,620 - lava_callback - INFO - Starting async job submit for node 68d3cc10cd36afa834e0f390 2025-09-26 10:46:56,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:56,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc10cd36afa834e0f390 HTTP/1.1" 200 None 2025-09-26 10:46:56,634 - lava_callback - DEBUG - Processing node 68d3cc10cd36afa834e0f390: baseline-arm 2025-09-26 10:46:56,634 - lava_callback - ERROR - Error processing callback for node 68d3cc10cd36afa834e0f390: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:46:57,315 - lava_callback - INFO - Received callback for node 68d3cc12cd36afa834e0f396 INFO: 172.20.0.1:56922 - "POST /node/68d3cc12cd36afa834e0f396 HTTP/1.0" 202 Accepted 2025-09-26 10:46:57,320 - lava_callback - INFO - Starting async job submit for node 68d3cc12cd36afa834e0f396 2025-09-26 10:46:57,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:57,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc12cd36afa834e0f396 HTTP/1.1" 200 None 2025-09-26 10:46:57,340 - lava_callback - DEBUG - Processing node 68d3cc12cd36afa834e0f396: baseline-arm 2025-09-26 10:46:57,340 - lava_callback - ERROR - Error processing callback for node 68d3cc12cd36afa834e0f396: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:46:58,049 - lava_callback - INFO - Received callback for node 68d3cc1bcd36afa834e0f3ab INFO: 172.20.0.1:56924 - "POST /node/68d3cc1bcd36afa834e0f3ab HTTP/1.0" 202 Accepted 2025-09-26 10:46:58,054 - lava_callback - INFO - Starting async job submit for node 68d3cc1bcd36afa834e0f3ab 2025-09-26 10:46:58,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:58,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc1bcd36afa834e0f3ab HTTP/1.1" 200 None 2025-09-26 10:46:58,068 - lava_callback - DEBUG - Processing node 68d3cc1bcd36afa834e0f3ab: baseline-arm 2025-09-26 10:46:58,068 - lava_callback - ERROR - Error processing callback for node 68d3cc1bcd36afa834e0f3ab: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:46:58,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:46:58,289 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d66ee22f83206171a90a0e/lava_callback.json.gz 2025-09-26 10:46:58,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:58,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ee22f83206171a90a0e HTTP/1.1" 200 None 2025-09-26 10:46:58,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:58,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:46:58,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:46:58,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66ee22f83206171a90a0e HTTP/1.1" 200 None 2025-09-26 10:46:58,388 - lava_callback - INFO - Completed processing callback for node 68d66ee22f83206171a90a0e 2025-09-26 10:47:02,333 - lava_callback - INFO - Received callback for node 68d66eec2f83206171a90a18 INFO: 172.20.0.1:46642 - "POST /node/68d66eec2f83206171a90a18 HTTP/1.0" 202 Accepted 2025-09-26 10:47:02,346 - lava_callback - INFO - Starting async job submit for node 68d66eec2f83206171a90a18 2025-09-26 10:47:02,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:02,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66eec2f83206171a90a18 HTTP/1.1" 200 None 2025-09-26 10:47:02,411 - lava_callback - DEBUG - Processing node 68d66eec2f83206171a90a18: baseline-arm64-foundriesio 2025-09-26 10:47:02,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:03,024 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:03,025 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d66eec2f83206171a90a18/log.txt.gz 2025-09-26 10:47:03,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:03,036 - lava_callback - INFO - Received callback for node 68d3c785cd36afa834e0e2c1 INFO: 172.20.0.1:46654 - "POST /node/68d3c785cd36afa834e0e2c1 HTTP/1.0" 202 Accepted 2025-09-26 10:47:03,046 - lava_callback - INFO - Starting async job submit for node 68d3c785cd36afa834e0e2c1 2025-09-26 10:47:03,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:03,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c785cd36afa834e0e2c1 HTTP/1.1" 200 None 2025-09-26 10:47:03,168 - lava_callback - DEBUG - Processing node 68d3c785cd36afa834e0e2c1: baseline-arm 2025-09-26 10:47:03,306 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:03,358 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d66eec2f83206171a90a18/lava_callback.json.gz 2025-09-26 10:47:03,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:03,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66eec2f83206171a90a18 HTTP/1.1" 200 None 2025-09-26 10:47:03,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:03,603 - lava_callback - ERROR - Error processing callback for node 68d3c785cd36afa834e0e2c1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:47:03,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:47:03,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:03,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66eec2f83206171a90a18 HTTP/1.1" 200 None 2025-09-26 10:47:03,662 - lava_callback - INFO - Completed processing callback for node 68d66eec2f83206171a90a18 2025-09-26 10:47:06,260 - lava_callback - INFO - Received callback for node 68d66ee72f83206171a90a15 INFO: 172.20.0.1:46660 - "POST /node/68d66ee72f83206171a90a15 HTTP/1.0" 202 Accepted 2025-09-26 10:47:06,271 - lava_callback - INFO - Starting async job submit for node 68d66ee72f83206171a90a15 2025-09-26 10:47:06,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:06,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ee72f83206171a90a15 HTTP/1.1" 200 None 2025-09-26 10:47:06,323 - lava_callback - DEBUG - Processing node 68d66ee72f83206171a90a15: baseline-arm64-foundriesio INFO: 172.20.0.1:46666 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:47:06,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:06,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:06,778 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d66ee72f83206171a90a15/log.txt.gz 2025-09-26 10:47:06,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:06,946 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:06,947 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d66ee72f83206171a90a15/lava_callback.json.gz 2025-09-26 10:47:06,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:06,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ee72f83206171a90a15 HTTP/1.1" 200 None 2025-09-26 10:47:06,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:07,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:47:07,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:07,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66ee72f83206171a90a15 HTTP/1.1" 200 None 2025-09-26 10:47:07,043 - lava_callback - INFO - Completed processing callback for node 68d66ee72f83206171a90a15 2025-09-26 10:47:07,884 - lava_callback - INFO - Received callback for node 68d66eaf2f83206171a90995 INFO: 172.20.0.1:46672 - "POST /node/68d66eaf2f83206171a90995 HTTP/1.0" 202 Accepted 2025-09-26 10:47:07,891 - lava_callback - INFO - Starting async job submit for node 68d66eaf2f83206171a90995 2025-09-26 10:47:07,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:07,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66eaf2f83206171a90995 HTTP/1.1" 200 None 2025-09-26 10:47:07,927 - lava_callback - DEBUG - Processing node 68d66eaf2f83206171a90995: baseline-arm64-broonie 2025-09-26 10:47:08,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:08,474 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:08,474 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d66eaf2f83206171a90995/log.txt.gz 2025-09-26 10:47:08,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:08,594 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:08,595 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d66eaf2f83206171a90995/lava_callback.json.gz 2025-09-26 10:47:08,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:08,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66eaf2f83206171a90995 HTTP/1.1" 200 None 2025-09-26 10:47:08,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:08,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:47:08,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:08,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66eaf2f83206171a90995 HTTP/1.1" 200 None 2025-09-26 10:47:08,729 - lava_callback - INFO - Completed processing callback for node 68d66eaf2f83206171a90995 2025-09-26 10:47:15,078 - lava_callback - INFO - Received callback for node 68d3cc20cd36afa834e0f3ba INFO: 172.20.0.1:49752 - "POST /node/68d3cc20cd36afa834e0f3ba HTTP/1.0" 202 Accepted 2025-09-26 10:47:15,085 - lava_callback - INFO - Starting async job submit for node 68d3cc20cd36afa834e0f3ba 2025-09-26 10:47:15,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:15,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc20cd36afa834e0f3ba HTTP/1.1" 200 None 2025-09-26 10:47:15,106 - lava_callback - DEBUG - Processing node 68d3cc20cd36afa834e0f3ba: baseline-arm 2025-09-26 10:47:15,106 - lava_callback - ERROR - Error processing callback for node 68d3cc20cd36afa834e0f3ba: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:49756 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 10:47:15,790 - lava_callback - INFO - Received callback for node 68d3cc22cd36afa834e0f3c0 INFO: 172.20.0.1:49768 - "POST /node/68d3cc22cd36afa834e0f3c0 HTTP/1.0" 202 Accepted 2025-09-26 10:47:15,799 - lava_callback - INFO - Starting async job submit for node 68d3cc22cd36afa834e0f3c0 2025-09-26 10:47:15,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:15,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc22cd36afa834e0f3c0 HTTP/1.1" 200 None 2025-09-26 10:47:15,820 - lava_callback - DEBUG - Processing node 68d3cc22cd36afa834e0f3c0: baseline-arm 2025-09-26 10:47:15,820 - lava_callback - ERROR - Error processing callback for node 68d3cc22cd36afa834e0f3c0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:47:16,443 - lava_callback - INFO - Received callback for node 68d3cc26cd36afa834e0f3cc INFO: 172.20.0.1:49774 - "POST /node/68d3cc26cd36afa834e0f3cc HTTP/1.0" 202 Accepted 2025-09-26 10:47:16,451 - lava_callback - INFO - Starting async job submit for node 68d3cc26cd36afa834e0f3cc 2025-09-26 10:47:16,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:16,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc26cd36afa834e0f3cc HTTP/1.1" 200 None 2025-09-26 10:47:16,476 - lava_callback - DEBUG - Processing node 68d3cc26cd36afa834e0f3cc: baseline-arm 2025-09-26 10:47:16,476 - lava_callback - ERROR - Error processing callback for node 68d3cc26cd36afa834e0f3cc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:49788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49796 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:47:17,157 - lava_callback - INFO - Received callback for node 68d3cc29cd36afa834e0f3d5 INFO: 172.20.0.1:49798 - "POST /node/68d3cc29cd36afa834e0f3d5 HTTP/1.0" 202 Accepted 2025-09-26 10:47:17,165 - lava_callback - INFO - Starting async job submit for node 68d3cc29cd36afa834e0f3d5 2025-09-26 10:47:17,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:17,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc29cd36afa834e0f3d5 HTTP/1.1" 200 None 2025-09-26 10:47:17,180 - lava_callback - DEBUG - Processing node 68d3cc29cd36afa834e0f3d5: baseline-arm 2025-09-26 10:47:17,180 - lava_callback - ERROR - Error processing callback for node 68d3cc29cd36afa834e0f3d5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:47:17,841 - lava_callback - INFO - Received callback for node 68d3cc2dcd36afa834e0f3de INFO: 172.20.0.1:49814 - "POST /node/68d3cc2dcd36afa834e0f3de HTTP/1.0" 202 Accepted 2025-09-26 10:47:17,849 - lava_callback - INFO - Starting async job submit for node 68d3cc2dcd36afa834e0f3de 2025-09-26 10:47:17,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:17,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc2dcd36afa834e0f3de HTTP/1.1" 200 None 2025-09-26 10:47:17,866 - lava_callback - DEBUG - Processing node 68d3cc2dcd36afa834e0f3de: baseline-arm 2025-09-26 10:47:17,866 - lava_callback - ERROR - Error processing callback for node 68d3cc2dcd36afa834e0f3de: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:47:18,521 - lava_callback - INFO - Received callback for node 68d3cc2fcd36afa834e0f3e4 INFO: 172.20.0.1:49816 - "POST /node/68d3cc2fcd36afa834e0f3e4 HTTP/1.0" 202 Accepted 2025-09-26 10:47:18,527 - lava_callback - INFO - Starting async job submit for node 68d3cc2fcd36afa834e0f3e4 2025-09-26 10:47:18,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:18,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc2fcd36afa834e0f3e4 HTTP/1.1" 200 None 2025-09-26 10:47:18,542 - lava_callback - DEBUG - Processing node 68d3cc2fcd36afa834e0f3e4: baseline-arm 2025-09-26 10:47:18,542 - lava_callback - ERROR - Error processing callback for node 68d3cc2fcd36afa834e0f3e4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:43154 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:47:20,889 - lava_callback - INFO - Received callback for node 68d3cc2acd36afa834e0f3d8 INFO: 172.20.0.1:43162 - "POST /node/68d3cc2acd36afa834e0f3d8 HTTP/1.0" 202 Accepted 2025-09-26 10:47:20,896 - lava_callback - INFO - Starting async job submit for node 68d3cc2acd36afa834e0f3d8 2025-09-26 10:47:20,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:20,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc2acd36afa834e0f3d8 HTTP/1.1" 200 None 2025-09-26 10:47:20,914 - lava_callback - DEBUG - Processing node 68d3cc2acd36afa834e0f3d8: baseline-arm64-baylibre 2025-09-26 10:47:20,914 - lava_callback - ERROR - Error processing callback for node 68d3cc2acd36afa834e0f3d8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:43176 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:47:28,136 - lava_callback - INFO - Received callback for node 68d3c68fcd36afa834e0e086 INFO: 172.20.0.1:43192 - "POST /node/68d3c68fcd36afa834e0e086 HTTP/1.0" 202 Accepted 2025-09-26 10:47:28,146 - lava_callback - INFO - Starting async job submit for node 68d3c68fcd36afa834e0e086 2025-09-26 10:47:28,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:28,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3c68fcd36afa834e0e086 HTTP/1.1" 200 None 2025-09-26 10:47:28,322 - lava_callback - DEBUG - Processing node 68d3c68fcd36afa834e0e086: ltp-cve 2025-09-26 10:47:29,052 - lava_callback - ERROR - Error processing callback for node 68d3c68fcd36afa834e0e086: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:47:29,627 - lava_callback - INFO - Received callback for node 68d66ed52f83206171a909f1 INFO: 172.20.0.1:59676 - "POST /node/68d66ed52f83206171a909f1 HTTP/1.0" 202 Accepted 2025-09-26 10:47:29,637 - lava_callback - INFO - Starting async job submit for node 68d66ed52f83206171a909f1 2025-09-26 10:47:29,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:29,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ed52f83206171a909f1 HTTP/1.1" 200 None 2025-09-26 10:47:29,673 - lava_callback - DEBUG - Processing node 68d66ed52f83206171a909f1: baseline-arm64-broonie 2025-09-26 10:47:29,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:30,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:30,294 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d66ed52f83206171a909f1/log.txt.gz 2025-09-26 10:47:30,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:30,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:30,412 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d66ed52f83206171a909f1/lava_callback.json.gz 2025-09-26 10:47:30,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:30,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ed52f83206171a909f1 HTTP/1.1" 200 None 2025-09-26 10:47:30,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:30,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:47:30,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:30,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66ed52f83206171a909f1 HTTP/1.1" 200 None 2025-09-26 10:47:30,616 - lava_callback - INFO - Completed processing callback for node 68d66ed52f83206171a909f1 2025-09-26 10:47:31,915 - lava_callback - INFO - Received callback for node 68d66ef62f83206171a90a1e INFO: 172.20.0.1:59680 - "POST /node/68d66ef62f83206171a90a1e HTTP/1.0" 202 Accepted 2025-09-26 10:47:31,924 - lava_callback - INFO - Starting async job submit for node 68d66ef62f83206171a90a1e 2025-09-26 10:47:31,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:31,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ef62f83206171a90a1e HTTP/1.1" 200 None 2025-09-26 10:47:31,964 - lava_callback - DEBUG - Processing node 68d66ef62f83206171a90a1e: baseline-x86 2025-09-26 10:47:32,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:32,503 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:32,504 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d66ef62f83206171a90a1e/log.txt.gz 2025-09-26 10:47:32,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:32,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:32,688 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d66ef62f83206171a90a1e/lava_callback.json.gz 2025-09-26 10:47:32,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:32,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ef62f83206171a90a1e HTTP/1.1" 200 None 2025-09-26 10:47:32,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:32,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c3e2be2da4660698f86 HTTP/1.1" 200 None 2025-09-26 10:47:32,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:32,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66ef62f83206171a90a1e HTTP/1.1" 200 None 2025-09-26 10:47:32,775 - lava_callback - INFO - Completed processing callback for node 68d66ef62f83206171a90a1e 2025-09-26 10:47:34,606 - lava_callback - INFO - Received callback for node 68d66e8c2f83206171a9094d INFO: 172.20.0.1:59686 - "POST /node/68d66e8c2f83206171a9094d HTTP/1.0" 202 Accepted 2025-09-26 10:47:34,612 - lava_callback - INFO - Starting async job submit for node 68d66e8c2f83206171a9094d 2025-09-26 10:47:34,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:34,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e8c2f83206171a9094d HTTP/1.1" 200 None 2025-09-26 10:47:34,646 - lava_callback - DEBUG - Processing node 68d66e8c2f83206171a9094d: baseline-arm64 2025-09-26 10:47:34,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:35,159 - lava_callback - INFO - Received callback for node 68d3cc37cd36afa834e0f3f7 INFO: 172.20.0.1:59688 - "POST /node/68d3cc37cd36afa834e0f3f7 HTTP/1.0" 202 Accepted 2025-09-26 10:47:35,168 - lava_callback - INFO - Starting async job submit for node 68d3cc37cd36afa834e0f3f7 2025-09-26 10:47:35,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:35,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc37cd36afa834e0f3f7 HTTP/1.1" 200 None 2025-09-26 10:47:35,182 - lava_callback - DEBUG - Processing node 68d3cc37cd36afa834e0f3f7: baseline-arm 2025-09-26 10:47:35,182 - lava_callback - ERROR - Error processing callback for node 68d3cc37cd36afa834e0f3f7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:47:35,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:35,677 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e8c2f83206171a9094d/log.txt.gz 2025-09-26 10:47:35,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:35,846 - lava_callback - INFO - Received callback for node 68d3cc3bcd36afa834e0f3fd INFO: 172.20.0.1:59702 - "POST /node/68d3cc3bcd36afa834e0f3fd HTTP/1.0" 202 Accepted 2025-09-26 10:47:35,852 - lava_callback - INFO - Starting async job submit for node 68d3cc3bcd36afa834e0f3fd 2025-09-26 10:47:35,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:35,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc3bcd36afa834e0f3fd HTTP/1.1" 200 None 2025-09-26 10:47:35,866 - lava_callback - DEBUG - Processing node 68d3cc3bcd36afa834e0f3fd: baseline-arm 2025-09-26 10:47:35,866 - lava_callback - ERROR - Error processing callback for node 68d3cc3bcd36afa834e0f3fd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:59706 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:47:37,492 - lava_callback - INFO - Received callback for node 68d66ea62f83206171a9097f INFO: 172.20.0.1:59710 - "POST /node/68d66ea62f83206171a9097f HTTP/1.0" 202 Accepted 2025-09-26 10:47:37,502 - lava_callback - INFO - Starting async job submit for node 68d66ea62f83206171a9097f 2025-09-26 10:47:37,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:37,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ea62f83206171a9097f HTTP/1.1" 200 None 2025-09-26 10:47:37,537 - lava_callback - DEBUG - Processing node 68d66ea62f83206171a9097f: baseline-arm64-broonie 2025-09-26 10:47:37,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:38,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:38,054 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d66ea62f83206171a9097f/log.txt.gz 2025-09-26 10:47:38,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:38,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:38,089 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e8c2f83206171a9094d/lava_callback.json.gz 2025-09-26 10:47:38,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:38,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e8c2f83206171a9094d HTTP/1.1" 200 None 2025-09-26 10:47:38,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:38,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:47:38,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:38,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e8c2f83206171a9094d HTTP/1.1" 200 None 2025-09-26 10:47:38,189 - lava_callback - INFO - Completed processing callback for node 68d66e8c2f83206171a9094d 2025-09-26 10:47:38,217 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:38,218 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d66ea62f83206171a9097f/lava_callback.json.gz 2025-09-26 10:47:38,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:38,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ea62f83206171a9097f HTTP/1.1" 200 None 2025-09-26 10:47:38,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:38,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:47:38,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:38,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66ea62f83206171a9097f HTTP/1.1" 200 None 2025-09-26 10:47:38,384 - lava_callback - INFO - Completed processing callback for node 68d66ea62f83206171a9097f 2025-09-26 10:47:38,972 - lava_callback - INFO - Received callback for node 68d66e8c2f83206171a90950 INFO: 172.20.0.1:59716 - "POST /node/68d66e8c2f83206171a90950 HTTP/1.0" 202 Accepted 2025-09-26 10:47:38,981 - lava_callback - INFO - Starting async job submit for node 68d66e8c2f83206171a90950 2025-09-26 10:47:39,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:39,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e8c2f83206171a90950 HTTP/1.1" 200 None 2025-09-26 10:47:39,029 - lava_callback - DEBUG - Processing node 68d66e8c2f83206171a90950: baseline-arm64 2025-09-26 10:47:39,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:39,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:39,548 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e8c2f83206171a90950/log.txt.gz 2025-09-26 10:47:39,553 - lava_callback - INFO - Received callback for node 68d66ec32f83206171a909d9 INFO: 172.20.0.1:52972 - "POST /node/68d66ec32f83206171a909d9 HTTP/1.0" 202 Accepted 2025-09-26 10:47:39,561 - lava_callback - INFO - Starting async job submit for node 68d66ec32f83206171a909d9 2025-09-26 10:47:39,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:39,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:39,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ec32f83206171a909d9 HTTP/1.1" 200 None 2025-09-26 10:47:39,619 - lava_callback - DEBUG - Processing node 68d66ec32f83206171a909d9: baseline-arm64-broonie 2025-09-26 10:47:39,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:39,811 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e8c2f83206171a90950/lava_callback.json.gz 2025-09-26 10:47:39,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:39,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e8c2f83206171a90950 HTTP/1.1" 200 None 2025-09-26 10:47:39,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:40,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:47:40,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:40,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e8c2f83206171a90950 HTTP/1.1" 200 None 2025-09-26 10:47:40,116 - lava_callback - INFO - Completed processing callback for node 68d66e8c2f83206171a90950 2025-09-26 10:47:40,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:40,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:40,535 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d66ec32f83206171a909d9/log.txt.gz 2025-09-26 10:47:40,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:40,671 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:40,672 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d66ec32f83206171a909d9/lava_callback.json.gz 2025-09-26 10:47:40,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:40,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ec32f83206171a909d9 HTTP/1.1" 200 None 2025-09-26 10:47:40,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:40,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:47:40,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:40,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66ec32f83206171a909d9 HTTP/1.1" 200 None 2025-09-26 10:47:40,756 - lava_callback - INFO - Completed processing callback for node 68d66ec32f83206171a909d9 2025-09-26 10:47:40,867 - lava_callback - INFO - Received callback for node 68d3cc42cd36afa834e0f428 INFO: 172.20.0.1:52986 - "POST /node/68d3cc42cd36afa834e0f428 HTTP/1.0" 202 Accepted 2025-09-26 10:47:40,883 - lava_callback - INFO - Starting async job submit for node 68d3cc42cd36afa834e0f428 2025-09-26 10:47:40,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:40,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc42cd36afa834e0f428 HTTP/1.1" 200 None 2025-09-26 10:47:40,909 - lava_callback - DEBUG - Processing node 68d3cc42cd36afa834e0f428: baseline-arm64-baylibre 2025-09-26 10:47:40,909 - lava_callback - ERROR - Error processing callback for node 68d3cc42cd36afa834e0f428: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:47:45,146 - lava_callback - INFO - Received callback for node 68d66eda2f83206171a909fc INFO: 172.20.0.1:52992 - "POST /node/68d66eda2f83206171a909fc HTTP/1.0" 202 Accepted 2025-09-26 10:47:45,157 - lava_callback - INFO - Starting async job submit for node 68d66eda2f83206171a909fc 2025-09-26 10:47:45,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:45,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66eda2f83206171a909fc HTTP/1.1" 200 None 2025-09-26 10:47:45,212 - lava_callback - DEBUG - Processing node 68d66eda2f83206171a909fc: baseline-arm64-broonie 2025-09-26 10:47:45,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:45,730 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:45,731 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d66eda2f83206171a909fc/log.txt.gz 2025-09-26 10:47:45,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:45,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:45,884 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d66eda2f83206171a909fc/lava_callback.json.gz 2025-09-26 10:47:45,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:45,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66eda2f83206171a909fc HTTP/1.1" 200 None 2025-09-26 10:47:45,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:45,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:47:45,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:45,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66eda2f83206171a909fc HTTP/1.1" 200 None 2025-09-26 10:47:45,969 - lava_callback - INFO - Completed processing callback for node 68d66eda2f83206171a909fc INFO: 172.20.0.1:53006 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:47:47,772 - lava_callback - INFO - Received callback for node 68d66ec72f83206171a909e0 INFO: 172.20.0.1:53008 - "POST /node/68d66ec72f83206171a909e0 HTTP/1.0" 202 Accepted 2025-09-26 10:47:47,781 - lava_callback - INFO - Starting async job submit for node 68d66ec72f83206171a909e0 2025-09-26 10:47:47,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:47,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ec72f83206171a909e0 HTTP/1.1" 200 None 2025-09-26 10:47:47,830 - lava_callback - DEBUG - Processing node 68d66ec72f83206171a909e0: baseline-arm64-broonie 2025-09-26 10:47:48,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:48,983 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:48,984 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d66ec72f83206171a909e0/log.txt.gz 2025-09-26 10:47:48,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:49,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:49,145 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d66ec72f83206171a909e0/lava_callback.json.gz 2025-09-26 10:47:49,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:49,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ec72f83206171a909e0 HTTP/1.1" 200 None 2025-09-26 10:47:49,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:49,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:47:49,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:49,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66ec72f83206171a909e0 HTTP/1.1" 200 None 2025-09-26 10:47:49,309 - lava_callback - INFO - Completed processing callback for node 68d66ec72f83206171a909e0 2025-09-26 10:47:53,690 - lava_callback - INFO - Received callback for node 68d66e582f83206171a908ef INFO: 172.20.0.1:37998 - "POST /node/68d66e582f83206171a908ef HTTP/1.0" 202 Accepted 2025-09-26 10:47:53,700 - lava_callback - INFO - Starting async job submit for node 68d66e582f83206171a908ef 2025-09-26 10:47:53,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:53,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e582f83206171a908ef HTTP/1.1" 200 None 2025-09-26 10:47:53,761 - lava_callback - DEBUG - Processing node 68d66e582f83206171a908ef: baseline-arm64 2025-09-26 10:47:54,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:54,422 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:54,423 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e582f83206171a908ef/log.txt.gz 2025-09-26 10:47:54,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:54,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:54,563 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e582f83206171a908ef/lava_callback.json.gz 2025-09-26 10:47:54,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:54,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e582f83206171a908ef HTTP/1.1" 200 None 2025-09-26 10:47:54,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:54,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:47:54,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:54,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e582f83206171a908ef HTTP/1.1" 200 None 2025-09-26 10:47:54,704 - lava_callback - INFO - Completed processing callback for node 68d66e582f83206171a908ef 2025-09-26 10:47:55,372 - lava_callback - INFO - Received callback for node 68d66ef62f83206171a90a21 INFO: 172.20.0.1:38006 - "POST /node/68d66ef62f83206171a90a21 HTTP/1.0" 202 Accepted 2025-09-26 10:47:55,381 - lava_callback - INFO - Starting async job submit for node 68d66ef62f83206171a90a21 2025-09-26 10:47:55,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:55,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ef62f83206171a90a21 HTTP/1.1" 200 None 2025-09-26 10:47:55,439 - lava_callback - DEBUG - Processing node 68d66ef62f83206171a90a21: baseline-arm 2025-09-26 10:47:55,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:38012 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:47:56,575 - lava_callback - INFO - Received callback for node 68d66efe2f83206171a90a3c INFO: 172.20.0.1:38024 - "POST /node/68d66efe2f83206171a90a3c HTTP/1.0" 202 Accepted 2025-09-26 10:47:56,581 - lava_callback - INFO - Starting async job submit for node 68d66efe2f83206171a90a3c 2025-09-26 10:47:56,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:56,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66efe2f83206171a90a3c HTTP/1.1" 200 None 2025-09-26 10:47:56,615 - lava_callback - DEBUG - Processing node 68d66efe2f83206171a90a3c: baseline-arm 2025-09-26 10:47:56,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:57,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:57,184 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66efe2f83206171a90a3c/log.txt.gz 2025-09-26 10:47:57,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:57,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:57,192 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66ef62f83206171a90a21/log.txt.gz 2025-09-26 10:47:57,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:57,347 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:57,348 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66ef62f83206171a90a21/lava_callback.json.gz 2025-09-26 10:47:57,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:57,381 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66efe2f83206171a90a3c/lava_callback.json.gz 2025-09-26 10:47:57,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:57,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:57,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ef62f83206171a90a21 HTTP/1.1" 200 None 2025-09-26 10:47:57,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:57,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66efe2f83206171a90a3c HTTP/1.1" 200 None 2025-09-26 10:47:57,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:57,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:47:57,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:57,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:47:57,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:57,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66ef62f83206171a90a21 HTTP/1.1" 200 None 2025-09-26 10:47:57,520 - lava_callback - INFO - Completed processing callback for node 68d66ef62f83206171a90a21 2025-09-26 10:47:57,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66efe2f83206171a90a3c HTTP/1.1" 200 None 2025-09-26 10:47:57,541 - lava_callback - INFO - Completed processing callback for node 68d66efe2f83206171a90a3c 2025-09-26 10:47:57,871 - lava_callback - INFO - Received callback for node 68d66efd2f83206171a90a39 INFO: 172.20.0.1:38026 - "POST /node/68d66efd2f83206171a90a39 HTTP/1.0" 202 Accepted 2025-09-26 10:47:57,881 - lava_callback - INFO - Starting async job submit for node 68d66efd2f83206171a90a39 2025-09-26 10:47:57,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:57,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66efd2f83206171a90a39 HTTP/1.1" 200 None 2025-09-26 10:47:57,919 - lava_callback - DEBUG - Processing node 68d66efd2f83206171a90a39: baseline-arm 2025-09-26 10:47:58,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:58,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:58,375 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66efd2f83206171a90a39/log.txt.gz 2025-09-26 10:47:58,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:47:58,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:47:58,516 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66efd2f83206171a90a39/lava_callback.json.gz 2025-09-26 10:47:58,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:58,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66efd2f83206171a90a39 HTTP/1.1" 200 None 2025-09-26 10:47:58,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:58,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:47:58,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:58,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66efd2f83206171a90a39 HTTP/1.1" 200 None 2025-09-26 10:47:58,636 - lava_callback - INFO - Completed processing callback for node 68d66efd2f83206171a90a39 2025-09-26 10:47:59,026 - lava_callback - INFO - Received callback for node 68d66f012f83206171a90a5f INFO: 172.20.0.1:38040 - "POST /node/68d66f012f83206171a90a5f HTTP/1.0" 202 Accepted 2025-09-26 10:47:59,033 - lava_callback - INFO - Starting async job submit for node 68d66f012f83206171a90a5f 2025-09-26 10:47:59,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:59,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f012f83206171a90a5f HTTP/1.1" 200 None 2025-09-26 10:47:59,076 - lava_callback - DEBUG - Processing node 68d66f012f83206171a90a5f: baseline-arm 2025-09-26 10:47:59,133 - lava_callback - INFO - Received callback for node 68d3cacbcd36afa834e0f120 2025-09-26 10:47:59,139 - lava_callback - INFO - Received callback for node 68d66ef72f83206171a90a24 INFO: 172.20.0.1:38044 - "POST /node/68d3cacbcd36afa834e0f120 HTTP/1.0" 202 Accepted INFO: 172.20.0.1:38050 - "POST /node/68d66ef72f83206171a90a24 HTTP/1.0" 202 Accepted 2025-09-26 10:47:59,180 - lava_callback - INFO - Starting async job submit for node 68d3cacbcd36afa834e0f120 2025-09-26 10:47:59,180 - lava_callback - INFO - Starting async job submit for node 68d66ef72f83206171a90a24 2025-09-26 10:47:59,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:59,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ef72f83206171a90a24 HTTP/1.1" 200 None 2025-09-26 10:47:59,459 - lava_callback - DEBUG - Processing node 68d66ef72f83206171a90a24: baseline-arm 2025-09-26 10:47:59,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:47:59,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cacbcd36afa834e0f120 HTTP/1.1" 200 None 2025-09-26 10:47:59,802 - lava_callback - DEBUG - Processing node 68d3cacbcd36afa834e0f120: ltp-fs-bind 2025-09-26 10:47:59,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:48:00,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:48:00,274 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f012f83206171a90a5f/log.txt.gz 2025-09-26 10:48:00,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:48:00,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:48:00,304 - lava_callback - INFO - Received callback for node 68d66ef92f83206171a90a27 INFO: 172.20.0.1:37722 - "POST /node/68d66ef92f83206171a90a27 HTTP/1.0" 202 Accepted 2025-09-26 10:48:00,335 - lava_callback - INFO - Starting async job submit for node 68d66ef92f83206171a90a27 2025-09-26 10:48:00,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:00,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ef92f83206171a90a27 HTTP/1.1" 200 None 2025-09-26 10:48:00,480 - lava_callback - DEBUG - Processing node 68d66ef92f83206171a90a27: baseline-arm 2025-09-26 10:48:01,178 - lava_callback - ERROR - Error processing callback for node 68d3cacbcd36afa834e0f120: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:48:01,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:48:01,201 - lava_callback - INFO - Received callback for node 68d66f232f83206171a90ab4 INFO: 172.20.0.1:37724 - "POST /node/68d66f232f83206171a90ab4 HTTP/1.0" 202 Accepted 2025-09-26 10:48:01,207 - lava_callback - INFO - Starting async job submit for node 68d66f232f83206171a90ab4 2025-09-26 10:48:01,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:01,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f232f83206171a90ab4 HTTP/1.1" 200 None 2025-09-26 10:48:01,247 - lava_callback - DEBUG - Processing node 68d66f232f83206171a90ab4: baseline-arm 2025-09-26 10:48:01,670 - lava_callback - INFO - Received callback for node 68d66ef92f83206171a90a2a INFO: 172.20.0.1:37732 - "POST /node/68d66ef92f83206171a90a2a HTTP/1.0" 202 Accepted 2025-09-26 10:48:01,680 - lava_callback - INFO - Starting async job submit for node 68d66ef92f83206171a90a2a 2025-09-26 10:48:01,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:48:01,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:01,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ef92f83206171a90a2a HTTP/1.1" 200 None 2025-09-26 10:48:01,732 - lava_callback - DEBUG - Processing node 68d66ef92f83206171a90a2a: baseline-arm 2025-09-26 10:48:02,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:48:03,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:48:03,075 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66ef72f83206171a90a24/log.txt.gz 2025-09-26 10:48:03,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:48:03,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:48:03,138 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66ef92f83206171a90a2a/log.txt.gz 2025-09-26 10:48:03,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:48:03,276 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:48:03,277 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:48:03,278 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66ef92f83206171a90a27/log.txt.gz 2025-09-26 10:48:03,278 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f232f83206171a90ab4/log.txt.gz 2025-09-26 10:48:03,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:48:03,282 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f012f83206171a90a5f/lava_callback.json.gz 2025-09-26 10:48:03,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:48:03,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:48:03,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:03,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f012f83206171a90a5f HTTP/1.1" 200 None 2025-09-26 10:48:03,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:03,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:48:03,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:03,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:48:03,393 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66ef72f83206171a90a24/lava_callback.json.gz 2025-09-26 10:48:03,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:03,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f012f83206171a90a5f HTTP/1.1" 200 None 2025-09-26 10:48:03,443 - lava_callback - INFO - Completed processing callback for node 68d66f012f83206171a90a5f 2025-09-26 10:48:03,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:48:03,446 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66ef92f83206171a90a2a/lava_callback.json.gz 2025-09-26 10:48:03,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:03,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ef72f83206171a90a24 HTTP/1.1" 200 None 2025-09-26 10:48:03,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:03,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ef92f83206171a90a2a HTTP/1.1" 200 None 2025-09-26 10:48:03,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:03,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:48:03,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:03,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:48:03,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:03,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66ef72f83206171a90a24 HTTP/1.1" 200 None 2025-09-26 10:48:03,590 - lava_callback - INFO - Completed processing callback for node 68d66ef72f83206171a90a24 2025-09-26 10:48:03,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:48:03,621 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f232f83206171a90ab4/lava_callback.json.gz 2025-09-26 10:48:03,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:48:03,641 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66ef92f83206171a90a27/lava_callback.json.gz 2025-09-26 10:48:03,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66ef92f83206171a90a2a HTTP/1.1" 200 None 2025-09-26 10:48:03,667 - lava_callback - INFO - Completed processing callback for node 68d66ef92f83206171a90a2a 2025-09-26 10:48:03,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:03,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:03,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f232f83206171a90ab4 HTTP/1.1" 200 None 2025-09-26 10:48:03,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:03,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ef92f83206171a90a27 HTTP/1.1" 200 None 2025-09-26 10:48:03,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:03,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:48:03,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:03,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:48:03,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:03,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f232f83206171a90ab4 HTTP/1.1" 200 None 2025-09-26 10:48:03,815 - lava_callback - INFO - Completed processing callback for node 68d66f232f83206171a90ab4 2025-09-26 10:48:03,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66ef92f83206171a90a27 HTTP/1.1" 200 None 2025-09-26 10:48:03,840 - lava_callback - INFO - Completed processing callback for node 68d66ef92f83206171a90a27 2025-09-26 10:48:04,989 - lava_callback - INFO - Received callback for node 68d66e482f83206171a908c5 INFO: 172.20.0.1:37744 - "POST /node/68d66e482f83206171a908c5 HTTP/1.0" 202 Accepted 2025-09-26 10:48:05,004 - lava_callback - INFO - Starting async job submit for node 68d66e482f83206171a908c5 2025-09-26 10:48:05,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:05,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e482f83206171a908c5 HTTP/1.1" 200 None 2025-09-26 10:48:05,054 - lava_callback - DEBUG - Processing node 68d66e482f83206171a908c5: baseline-arm64 2025-09-26 10:48:05,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:48:05,868 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:48:05,869 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e482f83206171a908c5/log.txt.gz 2025-09-26 10:48:05,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:48:06,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:48:06,062 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e482f83206171a908c5/lava_callback.json.gz 2025-09-26 10:48:06,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:06,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e482f83206171a908c5 HTTP/1.1" 200 None 2025-09-26 10:48:06,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:06,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:48:06,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:06,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e482f83206171a908c5 HTTP/1.1" 200 None 2025-09-26 10:48:06,193 - lava_callback - INFO - Completed processing callback for node 68d66e482f83206171a908c5 INFO: 172.20.0.1:37754 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:48:09,067 - lava_callback - INFO - Received callback for node 68d66f252f83206171a90ab7 INFO: 172.20.0.1:37758 - "POST /node/68d66f252f83206171a90ab7 HTTP/1.0" 202 Accepted 2025-09-26 10:48:09,075 - lava_callback - INFO - Starting async job submit for node 68d66f252f83206171a90ab7 2025-09-26 10:48:09,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:09,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f252f83206171a90ab7 HTTP/1.1" 200 None 2025-09-26 10:48:09,152 - lava_callback - DEBUG - Processing node 68d66f252f83206171a90ab7: baseline-arm 2025-09-26 10:48:09,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:48:09,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:48:09,669 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f252f83206171a90ab7/log.txt.gz 2025-09-26 10:48:09,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:48:09,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:48:09,813 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f252f83206171a90ab7/lava_callback.json.gz 2025-09-26 10:48:09,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:09,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f252f83206171a90ab7 HTTP/1.1" 200 None 2025-09-26 10:48:09,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:09,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:48:09,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:09,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f252f83206171a90ab7 HTTP/1.1" 200 None 2025-09-26 10:48:09,904 - lava_callback - INFO - Completed processing callback for node 68d66f252f83206171a90ab7 2025-09-26 10:48:12,871 - lava_callback - INFO - Received callback for node 68d3cc5fcd36afa834e0f480 INFO: 172.20.0.1:44172 - "POST /node/68d3cc5fcd36afa834e0f480 HTTP/1.0" 202 Accepted 2025-09-26 10:48:12,876 - lava_callback - INFO - Starting async job submit for node 68d3cc5fcd36afa834e0f480 2025-09-26 10:48:12,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:12,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc5fcd36afa834e0f480 HTTP/1.1" 200 None 2025-09-26 10:48:12,896 - lava_callback - DEBUG - Processing node 68d3cc5fcd36afa834e0f480: baseline-arm64-clabbe 2025-09-26 10:48:12,896 - lava_callback - ERROR - Error processing callback for node 68d3cc5fcd36afa834e0f480: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:48:13,518 - lava_callback - INFO - Received callback for node 68d3cc59cd36afa834e0f46f INFO: 172.20.0.1:44176 - "POST /node/68d3cc59cd36afa834e0f46f HTTP/1.0" 202 Accepted 2025-09-26 10:48:13,523 - lava_callback - INFO - Starting async job submit for node 68d3cc59cd36afa834e0f46f 2025-09-26 10:48:13,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:13,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc59cd36afa834e0f46f HTTP/1.1" 200 None 2025-09-26 10:48:13,537 - lava_callback - DEBUG - Processing node 68d3cc59cd36afa834e0f46f: baseline-arm64-clabbe 2025-09-26 10:48:13,537 - lava_callback - ERROR - Error processing callback for node 68d3cc59cd36afa834e0f46f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:48:14,160 - lava_callback - INFO - Received callback for node 68d3cc61cd36afa834e0f484 INFO: 172.20.0.1:44190 - "POST /node/68d3cc61cd36afa834e0f484 HTTP/1.0" 202 Accepted 2025-09-26 10:48:14,165 - lava_callback - INFO - Starting async job submit for node 68d3cc61cd36afa834e0f484 2025-09-26 10:48:14,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:14,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc61cd36afa834e0f484 HTTP/1.1" 200 None 2025-09-26 10:48:14,181 - lava_callback - DEBUG - Processing node 68d3cc61cd36afa834e0f484: baseline-arm64-clabbe 2025-09-26 10:48:14,181 - lava_callback - ERROR - Error processing callback for node 68d3cc61cd36afa834e0f484: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:48:14,821 - lava_callback - INFO - Received callback for node 68d3cc63cd36afa834e0f489 INFO: 172.20.0.1:44206 - "POST /node/68d3cc63cd36afa834e0f489 HTTP/1.0" 202 Accepted 2025-09-26 10:48:14,828 - lava_callback - INFO - Starting async job submit for node 68d3cc63cd36afa834e0f489 2025-09-26 10:48:14,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:14,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc63cd36afa834e0f489 HTTP/1.1" 200 None 2025-09-26 10:48:14,842 - lava_callback - DEBUG - Processing node 68d3cc63cd36afa834e0f489: baseline-arm64-clabbe 2025-09-26 10:48:14,842 - lava_callback - ERROR - Error processing callback for node 68d3cc63cd36afa834e0f489: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:44222 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 10:48:15,473 - lava_callback - INFO - Received callback for node 68d3cc65cd36afa834e0f48f INFO: 172.20.0.1:44236 - "POST /node/68d3cc65cd36afa834e0f48f HTTP/1.0" 202 Accepted 2025-09-26 10:48:15,481 - lava_callback - INFO - Starting async job submit for node 68d3cc65cd36afa834e0f48f 2025-09-26 10:48:15,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:15,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc65cd36afa834e0f48f HTTP/1.1" 200 None 2025-09-26 10:48:15,499 - lava_callback - DEBUG - Processing node 68d3cc65cd36afa834e0f48f: baseline-arm64-clabbe 2025-09-26 10:48:15,499 - lava_callback - ERROR - Error processing callback for node 68d3cc65cd36afa834e0f48f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:48:15,937 - lava_callback - INFO - Received callback for node 68d3cc6dcd36afa834e0f4ab INFO: 172.20.0.1:44238 - "POST /node/68d3cc6dcd36afa834e0f4ab HTTP/1.0" 202 Accepted 2025-09-26 10:48:15,943 - lava_callback - INFO - Starting async job submit for node 68d3cc6dcd36afa834e0f4ab 2025-09-26 10:48:15,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:15,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc6dcd36afa834e0f4ab HTTP/1.1" 200 None 2025-09-26 10:48:15,958 - lava_callback - DEBUG - Processing node 68d3cc6dcd36afa834e0f4ab: baseline-arm 2025-09-26 10:48:15,958 - lava_callback - ERROR - Error processing callback for node 68d3cc6dcd36afa834e0f4ab: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:44242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35008 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:48:21,230 - lava_callback - INFO - Received callback for node 68d66e5a2f83206171a908fa INFO: 172.20.0.1:35020 - "POST /node/68d66e5a2f83206171a908fa HTTP/1.0" 202 Accepted 2025-09-26 10:48:21,241 - lava_callback - INFO - Starting async job submit for node 68d66e5a2f83206171a908fa 2025-09-26 10:48:21,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:21,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e5a2f83206171a908fa HTTP/1.1" 200 None 2025-09-26 10:48:21,298 - lava_callback - DEBUG - Processing node 68d66e5a2f83206171a908fa: baseline-arm64 2025-09-26 10:48:21,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:48:24,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:48:24,286 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e5a2f83206171a908fa/log.txt.gz 2025-09-26 10:48:24,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:48:24,463 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:48:24,463 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e5a2f83206171a908fa/lava_callback.json.gz 2025-09-26 10:48:24,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:24,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e5a2f83206171a908fa HTTP/1.1" 200 None 2025-09-26 10:48:24,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:24,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:48:24,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:24,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e5a2f83206171a908fa HTTP/1.1" 200 None 2025-09-26 10:48:24,590 - lava_callback - INFO - Completed processing callback for node 68d66e5a2f83206171a908fa 2025-09-26 10:48:24,680 - lava_callback - INFO - Received callback for node 68d66e652f83206171a9091e INFO: 172.20.0.1:35032 - "POST /node/68d66e652f83206171a9091e HTTP/1.0" 202 Accepted 2025-09-26 10:48:24,691 - lava_callback - INFO - Starting async job submit for node 68d66e652f83206171a9091e 2025-09-26 10:48:24,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:24,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e652f83206171a9091e HTTP/1.1" 200 None 2025-09-26 10:48:24,760 - lava_callback - DEBUG - Processing node 68d66e652f83206171a9091e: baseline-arm64 2025-09-26 10:48:25,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:48:25,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:48:25,316 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e652f83206171a9091e/log.txt.gz 2025-09-26 10:48:25,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:48:25,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:48:25,558 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e652f83206171a9091e/lava_callback.json.gz 2025-09-26 10:48:25,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:25,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e652f83206171a9091e HTTP/1.1" 200 None 2025-09-26 10:48:25,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:25,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:48:25,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:25,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e652f83206171a9091e HTTP/1.1" 200 None 2025-09-26 10:48:25,649 - lava_callback - INFO - Completed processing callback for node 68d66e652f83206171a9091e INFO: 172.20.0.1:35044 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:48:35,131 - lava_callback - INFO - Received callback for node 68d3cc6ecd36afa834e0f4b5 INFO: 172.20.0.1:52816 - "POST /node/68d3cc6ecd36afa834e0f4b5 HTTP/1.0" 202 Accepted 2025-09-26 10:48:35,137 - lava_callback - INFO - Starting async job submit for node 68d3cc6ecd36afa834e0f4b5 2025-09-26 10:48:35,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:35,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc6ecd36afa834e0f4b5 HTTP/1.1" 200 None 2025-09-26 10:48:35,151 - lava_callback - DEBUG - Processing node 68d3cc6ecd36afa834e0f4b5: baseline-arm 2025-09-26 10:48:35,151 - lava_callback - ERROR - Error processing callback for node 68d3cc6ecd36afa834e0f4b5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:48:35,810 - lava_callback - INFO - Received callback for node 68d3cc7acd36afa834e0f4cb INFO: 172.20.0.1:52818 - "POST /node/68d3cc7acd36afa834e0f4cb HTTP/1.0" 202 Accepted 2025-09-26 10:48:35,817 - lava_callback - INFO - Starting async job submit for node 68d3cc7acd36afa834e0f4cb 2025-09-26 10:48:35,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:35,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc7acd36afa834e0f4cb HTTP/1.1" 200 None 2025-09-26 10:48:35,835 - lava_callback - DEBUG - Processing node 68d3cc7acd36afa834e0f4cb: baseline-arm 2025-09-26 10:48:35,835 - lava_callback - ERROR - Error processing callback for node 68d3cc7acd36afa834e0f4cb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:52820 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:48:36,514 - lava_callback - INFO - Received callback for node 68d3cc7ccd36afa834e0f4ce INFO: 172.20.0.1:52836 - "POST /node/68d3cc7ccd36afa834e0f4ce HTTP/1.0" 202 Accepted 2025-09-26 10:48:36,520 - lava_callback - INFO - Starting async job submit for node 68d3cc7ccd36afa834e0f4ce 2025-09-26 10:48:36,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:36,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc7ccd36afa834e0f4ce HTTP/1.1" 200 None 2025-09-26 10:48:36,540 - lava_callback - DEBUG - Processing node 68d3cc7ccd36afa834e0f4ce: baseline-arm 2025-09-26 10:48:36,540 - lava_callback - ERROR - Error processing callback for node 68d3cc7ccd36afa834e0f4ce: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:48:44,211 - lava_callback - INFO - Received callback for node 68d40a2ecd36afa834e16efa INFO: 172.20.0.1:36586 - "POST /node/68d40a2ecd36afa834e16efa HTTP/1.0" 202 Accepted 2025-09-26 10:48:44,219 - lava_callback - INFO - Starting async job submit for node 68d40a2ecd36afa834e16efa 2025-09-26 10:48:44,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:44,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a2ecd36afa834e16efa HTTP/1.1" 200 None 2025-09-26 10:48:44,310 - lava_callback - DEBUG - Processing node 68d40a2ecd36afa834e16efa: baseline-arm 2025-09-26 10:48:44,573 - lava_callback - ERROR - Error processing callback for node 68d40a2ecd36afa834e16efa: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:36596 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:48:53,012 - lava_callback - INFO - Received callback for node 68d66eb62f83206171a909a7 INFO: 172.20.0.1:33822 - "POST /node/68d66eb62f83206171a909a7 HTTP/1.0" 202 Accepted 2025-09-26 10:48:53,019 - lava_callback - INFO - Starting async job submit for node 68d66eb62f83206171a909a7 2025-09-26 10:48:53,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:53,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66eb62f83206171a909a7 HTTP/1.1" 200 None 2025-09-26 10:48:53,057 - lava_callback - DEBUG - Processing node 68d66eb62f83206171a909a7: baseline-arm64-broonie 2025-09-26 10:48:53,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:48:53,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:48:53,682 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d66eb62f83206171a909a7/log.txt.gz 2025-09-26 10:48:53,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:48:53,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:48:53,870 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d66eb62f83206171a909a7/lava_callback.json.gz 2025-09-26 10:48:53,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:53,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66eb62f83206171a909a7 HTTP/1.1" 200 None 2025-09-26 10:48:53,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:53,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:48:53,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:53,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66eb62f83206171a909a7 HTTP/1.1" 200 None 2025-09-26 10:48:53,960 - lava_callback - INFO - Completed processing callback for node 68d66eb62f83206171a909a7 2025-09-26 10:48:55,657 - lava_callback - INFO - Received callback for node 68d3cc82cd36afa834e0f4ec INFO: 172.20.0.1:33834 - "POST /node/68d3cc82cd36afa834e0f4ec HTTP/1.0" 202 Accepted 2025-09-26 10:48:55,666 - lava_callback - INFO - Starting async job submit for node 68d3cc82cd36afa834e0f4ec 2025-09-26 10:48:55,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:55,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc82cd36afa834e0f4ec HTTP/1.1" 200 None 2025-09-26 10:48:55,684 - lava_callback - DEBUG - Processing node 68d3cc82cd36afa834e0f4ec: baseline-arm 2025-09-26 10:48:55,684 - lava_callback - ERROR - Error processing callback for node 68d3cc82cd36afa834e0f4ec: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:48:56,364 - lava_callback - INFO - Received callback for node 68d3cc84cd36afa834e0f4ef INFO: 172.20.0.1:33846 - "POST /node/68d3cc84cd36afa834e0f4ef HTTP/1.0" 202 Accepted 2025-09-26 10:48:56,371 - lava_callback - INFO - Starting async job submit for node 68d3cc84cd36afa834e0f4ef 2025-09-26 10:48:56,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:56,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc84cd36afa834e0f4ef HTTP/1.1" 200 None 2025-09-26 10:48:56,397 - lava_callback - DEBUG - Processing node 68d3cc84cd36afa834e0f4ef: baseline-arm 2025-09-26 10:48:56,397 - lava_callback - ERROR - Error processing callback for node 68d3cc84cd36afa834e0f4ef: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:33856 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:48:56,520 - lava_callback - INFO - Received callback for node 68d66e912f83206171a90956 INFO: 172.20.0.1:33870 - "POST /node/68d66e912f83206171a90956 HTTP/1.0" 202 Accepted 2025-09-26 10:48:56,528 - lava_callback - INFO - Starting async job submit for node 68d66e912f83206171a90956 2025-09-26 10:48:56,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:56,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e912f83206171a90956 HTTP/1.1" 200 None 2025-09-26 10:48:56,568 - lava_callback - DEBUG - Processing node 68d66e912f83206171a90956: baseline-arm64 2025-09-26 10:48:56,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:48:57,084 - lava_callback - INFO - Received callback for node 68d3cc89cd36afa834e0f4f5 INFO: 172.20.0.1:33880 - "POST /node/68d3cc89cd36afa834e0f4f5 HTTP/1.0" 202 Accepted 2025-09-26 10:48:57,093 - lava_callback - INFO - Starting async job submit for node 68d3cc89cd36afa834e0f4f5 2025-09-26 10:48:57,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:57,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc89cd36afa834e0f4f5 HTTP/1.1" 200 None 2025-09-26 10:48:57,117 - lava_callback - DEBUG - Processing node 68d3cc89cd36afa834e0f4f5: baseline-arm 2025-09-26 10:48:57,117 - lava_callback - ERROR - Error processing callback for node 68d3cc89cd36afa834e0f4f5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:48:57,412 - lava_callback - INFO - Received callback for node 68d66e8f2f83206171a90953 INFO: 172.20.0.1:33892 - "POST /node/68d66e8f2f83206171a90953 HTTP/1.0" 202 Accepted 2025-09-26 10:48:57,420 - lava_callback - INFO - Starting async job submit for node 68d66e8f2f83206171a90953 2025-09-26 10:48:57,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:57,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e8f2f83206171a90953 HTTP/1.1" 200 None 2025-09-26 10:48:57,464 - lava_callback - DEBUG - Processing node 68d66e8f2f83206171a90953: baseline-arm64 2025-09-26 10:48:57,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:48:57,826 - lava_callback - INFO - Received callback for node 68d3cc8acd36afa834e0f4f8 INFO: 172.20.0.1:33904 - "POST /node/68d3cc8acd36afa834e0f4f8 HTTP/1.0" 202 Accepted 2025-09-26 10:48:57,832 - lava_callback - INFO - Starting async job submit for node 68d3cc8acd36afa834e0f4f8 2025-09-26 10:48:57,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:57,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc8acd36afa834e0f4f8 HTTP/1.1" 200 None 2025-09-26 10:48:57,847 - lava_callback - DEBUG - Processing node 68d3cc8acd36afa834e0f4f8: baseline-arm 2025-09-26 10:48:57,847 - lava_callback - ERROR - Error processing callback for node 68d3cc8acd36afa834e0f4f8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:48:58,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:48:58,754 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e8f2f83206171a90953/log.txt.gz 2025-09-26 10:48:58,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:48:58,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:48:58,788 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e912f83206171a90956/log.txt.gz 2025-09-26 10:48:58,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:48:58,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:48:58,965 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e8f2f83206171a90953/lava_callback.json.gz 2025-09-26 10:48:58,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:48:59,001 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e912f83206171a90956/lava_callback.json.gz 2025-09-26 10:48:59,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:59,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:59,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e8f2f83206171a90953 HTTP/1.1" 200 None 2025-09-26 10:48:59,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:59,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e912f83206171a90956 HTTP/1.1" 200 None 2025-09-26 10:48:59,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:59,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:48:59,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:59,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:48:59,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:48:59,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e8f2f83206171a90953 HTTP/1.1" 200 None 2025-09-26 10:48:59,107 - lava_callback - INFO - Completed processing callback for node 68d66e8f2f83206171a90953 2025-09-26 10:48:59,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e912f83206171a90956 HTTP/1.1" 200 None 2025-09-26 10:48:59,141 - lava_callback - INFO - Completed processing callback for node 68d66e912f83206171a90956 2025-09-26 10:49:02,487 - lava_callback - INFO - Received callback for node 68d66f272f83206171a90ac1 INFO: 172.20.0.1:41294 - "POST /node/68d66f272f83206171a90ac1 HTTP/1.0" 202 Accepted 2025-09-26 10:49:02,496 - lava_callback - INFO - Starting async job submit for node 68d66f272f83206171a90ac1 2025-09-26 10:49:02,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:02,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f272f83206171a90ac1 HTTP/1.1" 200 None 2025-09-26 10:49:02,542 - lava_callback - DEBUG - Processing node 68d66f272f83206171a90ac1: baseline-arm 2025-09-26 10:49:03,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:49:04,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:49:04,408 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f272f83206171a90ac1/log.txt.gz 2025-09-26 10:49:04,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:49:04,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:49:04,570 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f272f83206171a90ac1/lava_callback.json.gz 2025-09-26 10:49:04,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:04,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f272f83206171a90ac1 HTTP/1.1" 200 None 2025-09-26 10:49:04,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:04,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:49:04,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:04,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f272f83206171a90ac1 HTTP/1.1" 200 None 2025-09-26 10:49:04,650 - lava_callback - INFO - Completed processing callback for node 68d66f272f83206171a90ac1 INFO: 172.20.0.1:41304 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:49:06,545 - lava_callback - INFO - Received callback for node 68d66f272f83206171a90aba INFO: 172.20.0.1:41306 - "POST /node/68d66f272f83206171a90aba HTTP/1.0" 202 Accepted 2025-09-26 10:49:06,552 - lava_callback - INFO - Starting async job submit for node 68d66f272f83206171a90aba 2025-09-26 10:49:06,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:06,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f272f83206171a90aba HTTP/1.1" 200 None 2025-09-26 10:49:06,595 - lava_callback - DEBUG - Processing node 68d66f272f83206171a90aba: baseline-arm 2025-09-26 10:49:06,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:49:09,481 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:49:09,482 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f272f83206171a90aba/log.txt.gz 2025-09-26 10:49:09,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:49:11,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:49:11,993 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f272f83206171a90aba/lava_callback.json.gz 2025-09-26 10:49:12,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:12,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f272f83206171a90aba HTTP/1.1" 200 None 2025-09-26 10:49:12,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:12,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:49:12,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:12,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f272f83206171a90aba HTTP/1.1" 200 None 2025-09-26 10:49:12,069 - lava_callback - INFO - Completed processing callback for node 68d66f272f83206171a90aba INFO: 172.20.0.1:43048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34132 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:49:23,607 - lava_callback - INFO - Received callback for node 68d66d6b2f83206171a906df INFO: 172.20.0.1:34146 - "POST /node/68d66d6b2f83206171a906df HTTP/1.0" 202 Accepted 2025-09-26 10:49:23,618 - lava_callback - INFO - Starting async job submit for node 68d66d6b2f83206171a906df 2025-09-26 10:49:23,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:23,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d6b2f83206171a906df HTTP/1.1" 200 None 2025-09-26 10:49:23,669 - lava_callback - DEBUG - Processing node 68d66d6b2f83206171a906df: baseline-arm64 2025-09-26 10:49:24,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:49:24,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:49:24,739 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d6b2f83206171a906df/log.txt.gz 2025-09-26 10:49:24,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:49:24,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:49:24,882 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d6b2f83206171a906df/lava_callback.json.gz DEBUG: 68d66d6b2f83206171a906df Transitting job node result: pass -> incomplete 2025-09-26 10:49:24,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:24,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d6b2f83206171a906df HTTP/1.1" 200 None 2025-09-26 10:49:24,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:24,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:49:24,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:24,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d6b2f83206171a906df HTTP/1.1" 200 None 2025-09-26 10:49:24,981 - lava_callback - INFO - Completed processing callback for node 68d66d6b2f83206171a906df INFO: 172.20.0.1:34150 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:49:34,626 - lava_callback - INFO - Received callback for node 68d66f342f83206171a90ade INFO: 172.20.0.1:53614 - "POST /node/68d66f342f83206171a90ade HTTP/1.0" 202 Accepted 2025-09-26 10:49:34,632 - lava_callback - INFO - Starting async job submit for node 68d66f342f83206171a90ade 2025-09-26 10:49:34,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:34,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f342f83206171a90ade HTTP/1.1" 200 None 2025-09-26 10:49:34,678 - lava_callback - DEBUG - Processing node 68d66f342f83206171a90ade: baseline-arm 2025-09-26 10:49:34,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:49:35,036 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:49:35,036 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f342f83206171a90ade/log.txt.gz 2025-09-26 10:49:35,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:49:35,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:49:35,229 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f342f83206171a90ade/lava_callback.json.gz 2025-09-26 10:49:35,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:35,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f342f83206171a90ade HTTP/1.1" 200 None 2025-09-26 10:49:35,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:35,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:49:35,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:35,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f342f83206171a90ade HTTP/1.1" 200 None 2025-09-26 10:49:35,379 - lava_callback - INFO - Completed processing callback for node 68d66f342f83206171a90ade 2025-09-26 10:49:35,730 - lava_callback - INFO - Received callback for node 68d66f022f83206171a90a62 INFO: 172.20.0.1:53620 - "POST /node/68d66f022f83206171a90a62 HTTP/1.0" 202 Accepted 2025-09-26 10:49:35,740 - lava_callback - INFO - Starting async job submit for node 68d66f022f83206171a90a62 2025-09-26 10:49:35,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:35,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f022f83206171a90a62 HTTP/1.1" 200 None 2025-09-26 10:49:35,777 - lava_callback - DEBUG - Processing node 68d66f022f83206171a90a62: baseline-arm 2025-09-26 10:49:36,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:49:36,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:49:36,241 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f022f83206171a90a62/log.txt.gz 2025-09-26 10:49:36,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:49:36,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:49:36,385 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f022f83206171a90a62/lava_callback.json.gz 2025-09-26 10:49:36,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:36,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f022f83206171a90a62 HTTP/1.1" 200 None 2025-09-26 10:49:36,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:36,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:49:36,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:36,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f022f83206171a90a62 HTTP/1.1" 200 None 2025-09-26 10:49:36,480 - lava_callback - INFO - Completed processing callback for node 68d66f022f83206171a90a62 INFO: 172.20.0.1:53630 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:49:36,783 - lava_callback - INFO - Received callback for node 68d66f382f83206171a90ae7 INFO: 172.20.0.1:53632 - "POST /node/68d66f382f83206171a90ae7 HTTP/1.0" 202 Accepted 2025-09-26 10:49:36,790 - lava_callback - INFO - Starting async job submit for node 68d66f382f83206171a90ae7 2025-09-26 10:49:36,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:36,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f382f83206171a90ae7 HTTP/1.1" 200 None 2025-09-26 10:49:36,834 - lava_callback - DEBUG - Processing node 68d66f382f83206171a90ae7: baseline-arm 2025-09-26 10:49:36,958 - lava_callback - INFO - Received callback for node 68d66f312f83206171a90ad8 INFO: 172.20.0.1:53636 - "POST /node/68d66f312f83206171a90ad8 HTTP/1.0" 202 Accepted 2025-09-26 10:49:36,991 - lava_callback - INFO - Starting async job submit for node 68d66f312f83206171a90ad8 2025-09-26 10:49:37,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:37,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f312f83206171a90ad8 HTTP/1.1" 200 None 2025-09-26 10:49:37,119 - lava_callback - DEBUG - Processing node 68d66f312f83206171a90ad8: baseline-arm 2025-09-26 10:49:37,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:49:37,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:49:37,621 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:49:37,621 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f382f83206171a90ae7/log.txt.gz 2025-09-26 10:49:37,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:49:37,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:49:37,748 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f312f83206171a90ad8/log.txt.gz 2025-09-26 10:49:37,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:49:37,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:49:37,822 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f382f83206171a90ae7/lava_callback.json.gz 2025-09-26 10:49:37,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:37,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f382f83206171a90ae7 HTTP/1.1" 200 None 2025-09-26 10:49:37,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:37,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:49:37,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:37,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:49:37,922 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f312f83206171a90ad8/lava_callback.json.gz 2025-09-26 10:49:37,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f382f83206171a90ae7 HTTP/1.1" 200 None 2025-09-26 10:49:37,950 - lava_callback - INFO - Completed processing callback for node 68d66f382f83206171a90ae7 2025-09-26 10:49:37,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:37,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f312f83206171a90ad8 HTTP/1.1" 200 None 2025-09-26 10:49:37,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:38,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:49:38,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:38,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f312f83206171a90ad8 HTTP/1.1" 200 None 2025-09-26 10:49:38,043 - lava_callback - INFO - Completed processing callback for node 68d66f312f83206171a90ad8 2025-09-26 10:49:40,921 - lava_callback - INFO - Received callback for node 68d66f362f83206171a90ae4 INFO: 172.20.0.1:50302 - "POST /node/68d66f362f83206171a90ae4 HTTP/1.0" 202 Accepted 2025-09-26 10:49:40,928 - lava_callback - INFO - Starting async job submit for node 68d66f362f83206171a90ae4 2025-09-26 10:49:40,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:40,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f362f83206171a90ae4 HTTP/1.1" 200 None 2025-09-26 10:49:40,976 - lava_callback - DEBUG - Processing node 68d66f362f83206171a90ae4: baseline-arm 2025-09-26 10:49:41,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:49:41,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:49:41,373 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f362f83206171a90ae4/log.txt.gz 2025-09-26 10:49:41,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:49:41,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:49:41,515 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f362f83206171a90ae4/lava_callback.json.gz 2025-09-26 10:49:41,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:41,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f362f83206171a90ae4 HTTP/1.1" 200 None 2025-09-26 10:49:41,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:41,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:49:41,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:41,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f362f83206171a90ae4 HTTP/1.1" 200 None 2025-09-26 10:49:41,602 - lava_callback - INFO - Completed processing callback for node 68d66f362f83206171a90ae4 2025-09-26 10:49:42,166 - lava_callback - INFO - Received callback for node 68d66f322f83206171a90adb INFO: 172.20.0.1:50316 - "POST /node/68d66f322f83206171a90adb HTTP/1.0" 202 Accepted 2025-09-26 10:49:42,176 - lava_callback - INFO - Starting async job submit for node 68d66f322f83206171a90adb 2025-09-26 10:49:42,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:42,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f322f83206171a90adb HTTP/1.1" 200 None 2025-09-26 10:49:42,230 - lava_callback - DEBUG - Processing node 68d66f322f83206171a90adb: baseline-arm 2025-09-26 10:49:42,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:49:42,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:49:42,707 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f322f83206171a90adb/log.txt.gz 2025-09-26 10:49:42,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:49:42,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:49:42,827 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f322f83206171a90adb/lava_callback.json.gz 2025-09-26 10:49:42,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:42,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f322f83206171a90adb HTTP/1.1" 200 None 2025-09-26 10:49:42,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:42,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:49:42,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:42,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f322f83206171a90adb HTTP/1.1" 200 None 2025-09-26 10:49:42,975 - lava_callback - INFO - Completed processing callback for node 68d66f322f83206171a90adb 2025-09-26 10:49:44,160 - lava_callback - INFO - Received callback for node 68d66f342f83206171a90ae1 INFO: 172.20.0.1:50322 - "POST /node/68d66f342f83206171a90ae1 HTTP/1.0" 202 Accepted 2025-09-26 10:49:44,168 - lava_callback - INFO - Starting async job submit for node 68d66f342f83206171a90ae1 2025-09-26 10:49:44,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:44,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f342f83206171a90ae1 HTTP/1.1" 200 None 2025-09-26 10:49:44,209 - lava_callback - DEBUG - Processing node 68d66f342f83206171a90ae1: baseline-arm 2025-09-26 10:49:44,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:49:45,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:49:45,854 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f342f83206171a90ae1/log.txt.gz 2025-09-26 10:49:45,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:49:46,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:49:46,017 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f342f83206171a90ae1/lava_callback.json.gz 2025-09-26 10:49:46,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:46,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f342f83206171a90ae1 HTTP/1.1" 200 None 2025-09-26 10:49:46,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:46,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:49:46,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:46,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f342f83206171a90ae1 HTTP/1.1" 200 None 2025-09-26 10:49:46,114 - lava_callback - INFO - Completed processing callback for node 68d66f342f83206171a90ae1 INFO: 172.20.0.1:50328 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:49:47,046 - lava_callback - INFO - Received callback for node 68d3cd16cd36afa834e0f5da INFO: 172.20.0.1:50342 - "POST /node/68d3cd16cd36afa834e0f5da HTTP/1.0" 202 Accepted 2025-09-26 10:49:47,056 - lava_callback - INFO - Starting async job submit for node 68d3cd16cd36afa834e0f5da 2025-09-26 10:49:47,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:47,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cd16cd36afa834e0f5da HTTP/1.1" 200 None 2025-09-26 10:49:47,135 - lava_callback - DEBUG - Processing node 68d3cd16cd36afa834e0f5da: baseline-arm64 2025-09-26 10:49:48,352 - lava_callback - ERROR - Error processing callback for node 68d3cd16cd36afa834e0f5da: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:49:52,976 - lava_callback - INFO - Received callback for node 68d66f9d2f83206171a90bda INFO: 172.20.0.1:55356 - "POST /node/68d66f9d2f83206171a90bda HTTP/1.0" 202 Accepted 2025-09-26 10:49:52,984 - lava_callback - INFO - Starting async job submit for node 68d66f9d2f83206171a90bda 2025-09-26 10:49:53,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:53,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f9d2f83206171a90bda HTTP/1.1" 200 None 2025-09-26 10:49:53,018 - lava_callback - DEBUG - Processing node 68d66f9d2f83206171a90bda: baseline-arm-pengutronix 2025-09-26 10:49:53,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:49:53,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:49:53,324 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d66f9d2f83206171a90bda/log.txt.gz 2025-09-26 10:49:53,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:49:53,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:49:53,451 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d66f9d2f83206171a90bda/lava_callback.json.gz 2025-09-26 10:49:53,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:53,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f9d2f83206171a90bda HTTP/1.1" 200 None 2025-09-26 10:49:53,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:53,495 - lava_callback - INFO - Received callback for node 68d66f772f83206171a90b9c INFO: 172.20.0.1:55370 - "POST /node/68d66f772f83206171a90b9c HTTP/1.0" 202 Accepted 2025-09-26 10:49:53,502 - lava_callback - INFO - Starting async job submit for node 68d66f772f83206171a90b9c 2025-09-26 10:49:53,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:53,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:49:53,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:53,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f772f83206171a90b9c HTTP/1.1" 200 None 2025-09-26 10:49:53,542 - lava_callback - DEBUG - Processing node 68d66f772f83206171a90b9c: baseline-arm-broonie 2025-09-26 10:49:53,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f9d2f83206171a90bda HTTP/1.1" 200 None 2025-09-26 10:49:53,587 - lava_callback - INFO - Completed processing callback for node 68d66f9d2f83206171a90bda 2025-09-26 10:49:53,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:49:55,918 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:49:55,919 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d66f772f83206171a90b9c/log.txt.gz 2025-09-26 10:49:55,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:49:56,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:49:56,082 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d66f772f83206171a90b9c/lava_callback.json.gz 2025-09-26 10:49:56,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:56,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f772f83206171a90b9c HTTP/1.1" 200 None 2025-09-26 10:49:56,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:56,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:49:56,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:49:56,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f772f83206171a90b9c HTTP/1.1" 200 None 2025-09-26 10:49:56,178 - lava_callback - INFO - Completed processing callback for node 68d66f772f83206171a90b9c INFO: 172.20.0.1:55382 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:50:01,895 - lava_callback - INFO - Received callback for node 68d66e682f83206171a90921 INFO: 172.20.0.1:44902 - "POST /node/68d66e682f83206171a90921 HTTP/1.0" 202 Accepted 2025-09-26 10:50:01,901 - lava_callback - INFO - Starting async job submit for node 68d66e682f83206171a90921 2025-09-26 10:50:01,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:01,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e682f83206171a90921 HTTP/1.1" 200 None 2025-09-26 10:50:01,935 - lava_callback - DEBUG - Processing node 68d66e682f83206171a90921: baseline-arm64 2025-09-26 10:50:02,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:02,659 - lava_callback - INFO - Received callback for node 68d66f622f83206171a90b68 INFO: 172.20.0.1:44916 - "POST /node/68d66f622f83206171a90b68 HTTP/1.0" 202 Accepted 2025-09-26 10:50:02,665 - lava_callback - INFO - Starting async job submit for node 68d66f622f83206171a90b68 2025-09-26 10:50:02,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:02,702 - lava_callback - INFO - Received callback for node 68d66f2b2f83206171a90ac8 INFO: 172.20.0.1:44918 - "POST /node/68d66f2b2f83206171a90ac8 HTTP/1.0" 202 Accepted 2025-09-26 10:50:02,712 - lava_callback - INFO - Starting async job submit for node 68d66f2b2f83206171a90ac8 2025-09-26 10:50:02,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f622f83206171a90b68 HTTP/1.1" 200 None 2025-09-26 10:50:02,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:02,740 - lava_callback - DEBUG - Processing node 68d66f622f83206171a90b68: baseline-arm-baylibre 2025-09-26 10:50:02,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f2b2f83206171a90ac8 HTTP/1.1" 200 None 2025-09-26 10:50:02,818 - lava_callback - DEBUG - Processing node 68d66f2b2f83206171a90ac8: baseline-arm 2025-09-26 10:50:03,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:03,215 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e682f83206171a90921/log.txt.gz 2025-09-26 10:50:03,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:03,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:03,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:05,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:05,285 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d66f622f83206171a90b68/log.txt.gz 2025-09-26 10:50:05,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:05,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:05,322 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e682f83206171a90921/lava_callback.json.gz 2025-09-26 10:50:05,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:05,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e682f83206171a90921 HTTP/1.1" 200 None 2025-09-26 10:50:05,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:05,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:50:05,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:05,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e682f83206171a90921 HTTP/1.1" 200 None 2025-09-26 10:50:05,412 - lava_callback - INFO - Completed processing callback for node 68d66e682f83206171a90921 2025-09-26 10:50:05,435 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:05,436 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f2b2f83206171a90ac8/log.txt.gz 2025-09-26 10:50:05,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:44928 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:50:07,223 - lava_callback - INFO - Received callback for node 68d66f9e2f83206171a90bdd INFO: 172.20.0.1:44944 - "POST /node/68d66f9e2f83206171a90bdd HTTP/1.0" 202 Accepted 2025-09-26 10:50:07,272 - lava_callback - INFO - Starting async job submit for node 68d66f9e2f83206171a90bdd 2025-09-26 10:50:07,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:07,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f9e2f83206171a90bdd HTTP/1.1" 200 None 2025-09-26 10:50:07,304 - lava_callback - DEBUG - Processing node 68d66f9e2f83206171a90bdd: baseline-arm-pengutronix 2025-09-26 10:50:07,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:07,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:07,743 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d66f9e2f83206171a90bdd/log.txt.gz 2025-09-26 10:50:07,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:07,755 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:07,756 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f2b2f83206171a90ac8/lava_callback.json.gz 2025-09-26 10:50:07,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:07,784 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d66f622f83206171a90b68/lava_callback.json.gz 2025-09-26 10:50:07,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:07,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:07,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f2b2f83206171a90ac8 HTTP/1.1" 200 None 2025-09-26 10:50:07,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:07,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f622f83206171a90b68 HTTP/1.1" 200 None 2025-09-26 10:50:07,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:07,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:50:07,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:07,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:50:07,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:07,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f2b2f83206171a90ac8 HTTP/1.1" 200 None 2025-09-26 10:50:07,903 - lava_callback - INFO - Completed processing callback for node 68d66f2b2f83206171a90ac8 2025-09-26 10:50:07,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f622f83206171a90b68 HTTP/1.1" 200 None 2025-09-26 10:50:07,913 - lava_callback - INFO - Completed processing callback for node 68d66f622f83206171a90b68 2025-09-26 10:50:07,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:08,000 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d66f9e2f83206171a90bdd/lava_callback.json.gz 2025-09-26 10:50:08,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:08,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f9e2f83206171a90bdd HTTP/1.1" 200 None 2025-09-26 10:50:08,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:08,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:50:08,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:08,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f9e2f83206171a90bdd HTTP/1.1" 200 None 2025-09-26 10:50:08,109 - lava_callback - INFO - Completed processing callback for node 68d66f9e2f83206171a90bdd 2025-09-26 10:50:08,177 - lava_callback - INFO - Received callback for node 68d3cd19cd36afa834e0f5dd INFO: 172.20.0.1:44958 - "POST /node/68d3cd19cd36afa834e0f5dd HTTP/1.0" 202 Accepted 2025-09-26 10:50:08,188 - lava_callback - INFO - Starting async job submit for node 68d3cd19cd36afa834e0f5dd 2025-09-26 10:50:08,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:08,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cd19cd36afa834e0f5dd HTTP/1.1" 200 None 2025-09-26 10:50:08,270 - lava_callback - DEBUG - Processing node 68d3cd19cd36afa834e0f5dd: baseline-arm64 2025-09-26 10:50:08,477 - lava_callback - INFO - Received callback for node 68d66dfa2f83206171a90817 INFO: 172.20.0.1:44970 - "POST /node/68d66dfa2f83206171a90817 HTTP/1.0" 202 Accepted 2025-09-26 10:50:08,508 - lava_callback - INFO - Starting async job submit for node 68d66dfa2f83206171a90817 2025-09-26 10:50:08,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:08,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dfa2f83206171a90817 HTTP/1.1" 200 None 2025-09-26 10:50:08,635 - lava_callback - DEBUG - Processing node 68d66dfa2f83206171a90817: baseline-arm64 2025-09-26 10:50:09,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:09,629 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:09,660 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dfa2f83206171a90817/log.txt.gz 2025-09-26 10:50:09,698 - lava_callback - ERROR - Error processing callback for node 68d3cd19cd36afa834e0f5dd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:50:09,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:09,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:09,938 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66dfa2f83206171a90817/lava_callback.json.gz 2025-09-26 10:50:09,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:09,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66dfa2f83206171a90817 HTTP/1.1" 200 None 2025-09-26 10:50:09,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:09,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:50:09,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:10,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66dfa2f83206171a90817 HTTP/1.1" 200 None 2025-09-26 10:50:10,023 - lava_callback - INFO - Completed processing callback for node 68d66dfa2f83206171a90817 2025-09-26 10:50:13,200 - lava_callback - INFO - Received callback for node 68d66f752f83206171a90b99 INFO: 172.20.0.1:36868 - "POST /node/68d66f752f83206171a90b99 HTTP/1.0" 202 Accepted 2025-09-26 10:50:13,205 - lava_callback - INFO - Starting async job submit for node 68d66f752f83206171a90b99 2025-09-26 10:50:13,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:13,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f752f83206171a90b99 HTTP/1.1" 200 None 2025-09-26 10:50:13,243 - lava_callback - DEBUG - Processing node 68d66f752f83206171a90b99: baseline-arm-broonie 2025-09-26 10:50:13,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:15,163 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 INFO: 172.20.0.1:36884 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 10:50:15,164 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d66f752f83206171a90b99/log.txt.gz 2025-09-26 10:50:15,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:15,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:15,298 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d66f752f83206171a90b99/lava_callback.json.gz 2025-09-26 10:50:15,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:15,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f752f83206171a90b99 HTTP/1.1" 200 None 2025-09-26 10:50:15,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:15,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:50:15,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:15,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f752f83206171a90b99 HTTP/1.1" 200 None 2025-09-26 10:50:15,390 - lava_callback - INFO - Completed processing callback for node 68d66f752f83206171a90b99 INFO: 172.20.0.1:36890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36896 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:50:17,687 - lava_callback - INFO - Received callback for node 68d66e9a2f83206171a90963 INFO: 172.20.0.1:36902 - "POST /node/68d66e9a2f83206171a90963 HTTP/1.0" 202 Accepted 2025-09-26 10:50:17,693 - lava_callback - INFO - Starting async job submit for node 68d66e9a2f83206171a90963 2025-09-26 10:50:17,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:17,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e9a2f83206171a90963 HTTP/1.1" 200 None 2025-09-26 10:50:17,732 - lava_callback - DEBUG - Processing node 68d66e9a2f83206171a90963: baseline-arm64 2025-09-26 10:50:18,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:19,848 - lava_callback - INFO - Received callback for node 68d66e992f83206171a90960 INFO: 172.20.0.1:55280 - "POST /node/68d66e992f83206171a90960 HTTP/1.0" 202 Accepted 2025-09-26 10:50:19,858 - lava_callback - INFO - Starting async job submit for node 68d66e992f83206171a90960 2025-09-26 10:50:19,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:55282 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:50:19,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e992f83206171a90960 HTTP/1.1" 200 None 2025-09-26 10:50:19,911 - lava_callback - DEBUG - Processing node 68d66e992f83206171a90960: baseline-arm64 2025-09-26 10:50:19,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:19,966 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e9a2f83206171a90963/log.txt.gz 2025-09-26 10:50:20,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:20,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:20,266 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e9a2f83206171a90963/lava_callback.json.gz 2025-09-26 10:50:20,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:20,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:20,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e9a2f83206171a90963 HTTP/1.1" 200 None 2025-09-26 10:50:20,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:20,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:50:20,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:20,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e9a2f83206171a90963 HTTP/1.1" 200 None 2025-09-26 10:50:20,371 - lava_callback - INFO - Completed processing callback for node 68d66e9a2f83206171a90963 2025-09-26 10:50:20,464 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:20,465 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e992f83206171a90960/log.txt.gz 2025-09-26 10:50:20,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:20,590 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:20,590 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e992f83206171a90960/lava_callback.json.gz 2025-09-26 10:50:20,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:20,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e992f83206171a90960 HTTP/1.1" 200 None 2025-09-26 10:50:20,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:20,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:50:20,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:20,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e992f83206171a90960 HTTP/1.1" 200 None 2025-09-26 10:50:20,670 - lava_callback - INFO - Completed processing callback for node 68d66e992f83206171a90960 2025-09-26 10:50:21,207 - lava_callback - INFO - Received callback for node 68d66f872f83206171a90bb6 INFO: 172.20.0.1:55296 - "POST /node/68d66f872f83206171a90bb6 HTTP/1.0" 202 Accepted 2025-09-26 10:50:21,213 - lava_callback - INFO - Starting async job submit for node 68d66f872f83206171a90bb6 2025-09-26 10:50:21,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:21,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f872f83206171a90bb6 HTTP/1.1" 200 None 2025-09-26 10:50:21,247 - lava_callback - DEBUG - Processing node 68d66f872f83206171a90bb6: baseline-arm-clabbe 2025-09-26 10:50:21,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:21,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:21,714 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d66f872f83206171a90bb6/log.txt.gz 2025-09-26 10:50:21,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:21,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:21,830 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d66f872f83206171a90bb6/lava_callback.json.gz 2025-09-26 10:50:21,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:21,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f872f83206171a90bb6 HTTP/1.1" 200 None 2025-09-26 10:50:21,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:21,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:50:21,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:21,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f872f83206171a90bb6 HTTP/1.1" 200 None 2025-09-26 10:50:21,918 - lava_callback - INFO - Completed processing callback for node 68d66f872f83206171a90bb6 2025-09-26 10:50:23,964 - lava_callback - INFO - Received callback for node 68d66d6e2f83206171a906e2 INFO: 172.20.0.1:55312 - "POST /node/68d66d6e2f83206171a906e2 HTTP/1.0" 202 Accepted 2025-09-26 10:50:23,971 - lava_callback - INFO - Starting async job submit for node 68d66d6e2f83206171a906e2 2025-09-26 10:50:24,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:24,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d6e2f83206171a906e2 HTTP/1.1" 200 None 2025-09-26 10:50:24,016 - lava_callback - DEBUG - Processing node 68d66d6e2f83206171a906e2: baseline-arm64 2025-09-26 10:50:24,460 - lava_callback - INFO - Received callback for node 68d66f652f83206171a90b7f INFO: 172.20.0.1:55326 - "POST /node/68d66f652f83206171a90b7f HTTP/1.0" 202 Accepted 2025-09-26 10:50:24,481 - lava_callback - INFO - Starting async job submit for node 68d66f652f83206171a90b7f 2025-09-26 10:50:24,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:24,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f652f83206171a90b7f HTTP/1.1" 200 None 2025-09-26 10:50:24,642 - lava_callback - DEBUG - Processing node 68d66f652f83206171a90b7f: baseline-arm-baylibre 2025-09-26 10:50:25,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:25,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:25,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:25,269 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d6e2f83206171a906e2/log.txt.gz 2025-09-26 10:50:25,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:25,318 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:25,319 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d66f652f83206171a90b7f/log.txt.gz 2025-09-26 10:50:25,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:25,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:25,458 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d66f652f83206171a90b7f/lava_callback.json.gz 2025-09-26 10:50:25,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:25,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:25,492 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d6e2f83206171a906e2/lava_callback.json.gz 2025-09-26 10:50:25,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f652f83206171a90b7f HTTP/1.1" 200 None 2025-09-26 10:50:25,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 DEBUG: Setup failed for 68d66d6e2f83206171a906e2. Transitting job node result: incomplete -> fail 2025-09-26 10:50:25,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:25,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:50:25,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:25,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d6e2f83206171a906e2 HTTP/1.1" 200 None 2025-09-26 10:50:25,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:25,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:50:25,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:25,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f652f83206171a90b7f HTTP/1.1" 200 None 2025-09-26 10:50:25,635 - lava_callback - INFO - Completed processing callback for node 68d66f652f83206171a90b7f 2025-09-26 10:50:25,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d6e2f83206171a906e2 HTTP/1.1" 200 None 2025-09-26 10:50:25,681 - lava_callback - INFO - Completed processing callback for node 68d66d6e2f83206171a906e2 INFO: 172.20.0.1:55330 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:50:28,957 - lava_callback - INFO - Received callback for node 68d66f6c2f83206171a90b90 INFO: 172.20.0.1:55344 - "POST /node/68d66f6c2f83206171a90b90 HTTP/1.0" 202 Accepted 2025-09-26 10:50:28,962 - lava_callback - INFO - Starting async job submit for node 68d66f6c2f83206171a90b90 2025-09-26 10:50:29,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:29,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f6c2f83206171a90b90 HTTP/1.1" 200 None 2025-09-26 10:50:29,015 - lava_callback - DEBUG - Processing node 68d66f6c2f83206171a90b90: baseline-arm-baylibre 2025-09-26 10:50:29,199 - lava_callback - INFO - Received callback for node 68d3cce8cd36afa834e0f580 INFO: 172.20.0.1:55352 - "POST /node/68d3cce8cd36afa834e0f580 HTTP/1.0" 202 Accepted 2025-09-26 10:50:29,205 - lava_callback - INFO - Starting async job submit for node 68d3cce8cd36afa834e0f580 2025-09-26 10:50:29,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:29,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:29,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cce8cd36afa834e0f580 HTTP/1.1" 200 None 2025-09-26 10:50:29,231 - lava_callback - DEBUG - Processing node 68d3cce8cd36afa834e0f580: ltp-watchqueue 2025-09-26 10:50:29,231 - lava_callback - ERROR - Error processing callback for node 68d3cce8cd36afa834e0f580: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:50:29,815 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:29,816 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d66f6c2f83206171a90b90/log.txt.gz 2025-09-26 10:50:29,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:29,957 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:29,958 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d66f6c2f83206171a90b90/lava_callback.json.gz 2025-09-26 10:50:29,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:29,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f6c2f83206171a90b90 HTTP/1.1" 200 None 2025-09-26 10:50:29,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:30,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:50:30,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:30,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f6c2f83206171a90b90 HTTP/1.1" 200 None 2025-09-26 10:50:30,051 - lava_callback - INFO - Completed processing callback for node 68d66f6c2f83206171a90b90 2025-09-26 10:50:30,986 - lava_callback - INFO - Received callback for node 68d66f6f2f83206171a90b93 INFO: 172.20.0.1:59864 - "POST /node/68d66f6f2f83206171a90b93 HTTP/1.0" 202 Accepted 2025-09-26 10:50:30,992 - lava_callback - INFO - Starting async job submit for node 68d66f6f2f83206171a90b93 2025-09-26 10:50:31,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:31,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f6f2f83206171a90b93 HTTP/1.1" 200 None 2025-09-26 10:50:31,042 - lava_callback - DEBUG - Processing node 68d66f6f2f83206171a90b93: baseline-arm-baylibre 2025-09-26 10:50:31,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:31,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:31,451 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d66f6f2f83206171a90b93/log.txt.gz 2025-09-26 10:50:31,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:31,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:31,601 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d66f6f2f83206171a90b93/lava_callback.json.gz 2025-09-26 10:50:31,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:31,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f6f2f83206171a90b93 HTTP/1.1" 200 None 2025-09-26 10:50:31,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:31,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:50:31,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:31,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f6f2f83206171a90b93 HTTP/1.1" 200 None 2025-09-26 10:50:31,692 - lava_callback - INFO - Completed processing callback for node 68d66f6f2f83206171a90b93 2025-09-26 10:50:34,275 - lava_callback - INFO - Received callback for node 68d66ecb2f83206171a909e7 INFO: 172.20.0.1:59874 - "POST /node/68d66ecb2f83206171a909e7 HTTP/1.0" 202 Accepted 2025-09-26 10:50:34,282 - lava_callback - INFO - Starting async job submit for node 68d66ecb2f83206171a909e7 2025-09-26 10:50:34,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:34,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ecb2f83206171a909e7 HTTP/1.1" 200 None 2025-09-26 10:50:34,350 - lava_callback - DEBUG - Processing node 68d66ecb2f83206171a909e7: baseline-arm64-broonie 2025-09-26 10:50:34,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:35,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:35,050 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d66ecb2f83206171a909e7/log.txt.gz 2025-09-26 10:50:35,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:35,185 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:35,185 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d66ecb2f83206171a909e7/lava_callback.json.gz 2025-09-26 10:50:35,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:35,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ecb2f83206171a909e7 HTTP/1.1" 200 None 2025-09-26 10:50:35,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:35,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:50:35,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:35,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66ecb2f83206171a909e7 HTTP/1.1" 200 None 2025-09-26 10:50:35,283 - lava_callback - INFO - Completed processing callback for node 68d66ecb2f83206171a909e7 INFO: 172.20.0.1:59890 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:50:43,036 - lava_callback - INFO - Received callback for node 68d66f6a2f83206171a90b8d INFO: 172.20.0.1:36712 - "POST /node/68d66f6a2f83206171a90b8d HTTP/1.0" 202 Accepted 2025-09-26 10:50:43,042 - lava_callback - INFO - Starting async job submit for node 68d66f6a2f83206171a90b8d 2025-09-26 10:50:43,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:43,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f6a2f83206171a90b8d HTTP/1.1" 200 None 2025-09-26 10:50:43,098 - lava_callback - DEBUG - Processing node 68d66f6a2f83206171a90b8d: baseline-arm-baylibre 2025-09-26 10:50:43,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:44,186 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:44,186 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d66f6a2f83206171a90b8d/log.txt.gz 2025-09-26 10:50:44,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:44,368 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:44,369 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d66f6a2f83206171a90b8d/lava_callback.json.gz 2025-09-26 10:50:44,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:44,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f6a2f83206171a90b8d HTTP/1.1" 200 None 2025-09-26 10:50:44,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:44,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:50:44,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:44,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f6a2f83206171a90b8d HTTP/1.1" 200 None 2025-09-26 10:50:44,466 - lava_callback - INFO - Completed processing callback for node 68d66f6a2f83206171a90b8d INFO: 172.20.0.1:36728 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:50:48,078 - lava_callback - INFO - Received callback for node 68d3cbf7cd36afa834e0f356 INFO: 172.20.0.1:36744 - "POST /node/68d3cbf7cd36afa834e0f356 HTTP/1.0" 202 Accepted 2025-09-26 10:50:48,085 - lava_callback - INFO - Starting async job submit for node 68d3cbf7cd36afa834e0f356 2025-09-26 10:50:48,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:48,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cbf7cd36afa834e0f356 HTTP/1.1" 200 None 2025-09-26 10:50:48,134 - lava_callback - DEBUG - Processing node 68d3cbf7cd36afa834e0f356: ltp-watchqueue 2025-09-26 10:50:48,547 - lava_callback - ERROR - Error processing callback for node 68d3cbf7cd36afa834e0f356: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:50:52,256 - lava_callback - INFO - Received callback for node 68d66f992f83206171a90bcf INFO: 172.20.0.1:52176 - "POST /node/68d66f992f83206171a90bcf HTTP/1.0" 202 Accepted 2025-09-26 10:50:52,262 - lava_callback - INFO - Starting async job submit for node 68d66f992f83206171a90bcf 2025-09-26 10:50:52,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:52,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f992f83206171a90bcf HTTP/1.1" 200 None 2025-09-26 10:50:52,313 - lava_callback - DEBUG - Processing node 68d66f992f83206171a90bcf: baseline-arm-pengutronix 2025-09-26 10:50:52,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:53,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:53,621 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d66f992f83206171a90bcf/log.txt.gz 2025-09-26 10:50:53,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:53,785 - lava_callback - INFO - Received callback for node 68d66ed02f83206171a909ee INFO: 172.20.0.1:52182 - "POST /node/68d66ed02f83206171a909ee HTTP/1.0" 202 Accepted 2025-09-26 10:50:53,792 - lava_callback - INFO - Starting async job submit for node 68d66ed02f83206171a909ee 2025-09-26 10:50:53,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:53,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ed02f83206171a909ee HTTP/1.1" 200 None 2025-09-26 10:50:53,844 - lava_callback - DEBUG - Processing node 68d66ed02f83206171a909ee: baseline-arm64-broonie 2025-09-26 10:50:54,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:54,353 - lava_callback - INFO - Received callback for node 68d40a30cd36afa834e16efd INFO: 172.20.0.1:52186 - "POST /node/68d40a30cd36afa834e16efd HTTP/1.0" 202 Accepted 2025-09-26 10:50:54,359 - lava_callback - INFO - Starting async job submit for node 68d40a30cd36afa834e16efd 2025-09-26 10:50:54,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:54,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a30cd36afa834e16efd HTTP/1.1" 200 None 2025-09-26 10:50:54,394 - lava_callback - DEBUG - Processing node 68d40a30cd36afa834e16efd: baseline-arm 2025-09-26 10:50:54,641 - lava_callback - ERROR - Error processing callback for node 68d40a30cd36afa834e16efd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:50:55,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:55,986 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d66f992f83206171a90bcf/lava_callback.json.gz 2025-09-26 10:50:55,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:56,044 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d66ed02f83206171a909ee/log.txt.gz 2025-09-26 10:50:56,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:56,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:56,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f992f83206171a90bcf HTTP/1.1" 200 None 2025-09-26 10:50:56,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:56,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:50:56,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:56,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f992f83206171a90bcf HTTP/1.1" 200 None 2025-09-26 10:50:56,113 - lava_callback - INFO - Completed processing callback for node 68d66f992f83206171a90bcf INFO: 172.20.0.1:52188 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:50:56,589 - lava_callback - INFO - Received callback for node 68d66f672f83206171a90b86 INFO: 172.20.0.1:52194 - "POST /node/68d66f672f83206171a90b86 HTTP/1.0" 202 Accepted 2025-09-26 10:50:56,595 - lava_callback - INFO - Starting async job submit for node 68d66f672f83206171a90b86 2025-09-26 10:50:56,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:56,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f672f83206171a90b86 HTTP/1.1" 200 None 2025-09-26 10:50:56,639 - lava_callback - DEBUG - Processing node 68d66f672f83206171a90b86: baseline-arm-baylibre 2025-09-26 10:50:56,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:58,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:58,406 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d66ed02f83206171a909ee/lava_callback.json.gz 2025-09-26 10:50:58,426 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:58,426 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d66f672f83206171a90b86/log.txt.gz 2025-09-26 10:50:58,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:58,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:50:58,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ed02f83206171a909ee HTTP/1.1" 200 None 2025-09-26 10:50:58,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:58,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:50:58,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:58,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66ed02f83206171a909ee HTTP/1.1" 200 None 2025-09-26 10:50:58,536 - lava_callback - INFO - Completed processing callback for node 68d66ed02f83206171a909ee 2025-09-26 10:50:58,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:50:58,646 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d66f672f83206171a90b86/lava_callback.json.gz 2025-09-26 10:50:58,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:58,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f672f83206171a90b86 HTTP/1.1" 200 None 2025-09-26 10:50:58,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:58,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:50:58,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:50:58,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f672f83206171a90b86 HTTP/1.1" 200 None 2025-09-26 10:50:58,733 - lava_callback - INFO - Completed processing callback for node 68d66f672f83206171a90b86 2025-09-26 10:51:02,848 - lava_callback - INFO - Received callback for node 68d66f2e2f83206171a90ad2 INFO: 172.20.0.1:51296 - "POST /node/68d66f2e2f83206171a90ad2 HTTP/1.0" 202 Accepted 2025-09-26 10:51:02,854 - lava_callback - INFO - Starting async job submit for node 68d66f2e2f83206171a90ad2 2025-09-26 10:51:02,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:02,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f2e2f83206171a90ad2 HTTP/1.1" 200 None 2025-09-26 10:51:02,898 - lava_callback - DEBUG - Processing node 68d66f2e2f83206171a90ad2: baseline-arm 2025-09-26 10:51:03,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:51:03,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:51:03,400 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f2e2f83206171a90ad2/log.txt.gz 2025-09-26 10:51:03,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:51:03,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:51:03,561 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f2e2f83206171a90ad2/lava_callback.json.gz 2025-09-26 10:51:03,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:03,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f2e2f83206171a90ad2 HTTP/1.1" 200 None 2025-09-26 10:51:03,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:03,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:51:03,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:03,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f2e2f83206171a90ad2 HTTP/1.1" 200 None 2025-09-26 10:51:03,652 - lava_callback - INFO - Completed processing callback for node 68d66f2e2f83206171a90ad2 INFO: 172.20.0.1:51302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45016 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 10:51:15,819 - lava_callback - INFO - Received callback for node 68d66f392f83206171a90aea INFO: 172.20.0.1:45028 - "POST /node/68d66f392f83206171a90aea HTTP/1.0" 202 Accepted 2025-09-26 10:51:15,825 - lava_callback - INFO - Starting async job submit for node 68d66f392f83206171a90aea 2025-09-26 10:51:15,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:15,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f392f83206171a90aea HTTP/1.1" 200 None 2025-09-26 10:51:15,898 - lava_callback - DEBUG - Processing node 68d66f392f83206171a90aea: baseline-arm 2025-09-26 10:51:16,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:45032 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:51:17,290 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:51:17,291 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f392f83206171a90aea/log.txt.gz 2025-09-26 10:51:17,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:45040 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:51:19,023 - lava_callback - INFO - Received callback for node 68d66f3a2f83206171a90aed INFO: 172.20.0.1:45052 - "POST /node/68d66f3a2f83206171a90aed HTTP/1.0" 202 Accepted 2025-09-26 10:51:19,032 - lava_callback - INFO - Starting async job submit for node 68d66f3a2f83206171a90aed 2025-09-26 10:51:19,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:19,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f3a2f83206171a90aed HTTP/1.1" 200 None 2025-09-26 10:51:19,073 - lava_callback - DEBUG - Processing node 68d66f3a2f83206171a90aed: baseline-arm 2025-09-26 10:51:19,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:51:19,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:51:19,605 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f3a2f83206171a90aed/log.txt.gz 2025-09-26 10:51:19,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:51:19,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:51:19,614 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f392f83206171a90aea/lava_callback.json.gz 2025-09-26 10:51:19,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:19,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f392f83206171a90aea HTTP/1.1" 200 None 2025-09-26 10:51:19,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:19,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:51:19,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:19,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f392f83206171a90aea HTTP/1.1" 200 None 2025-09-26 10:51:19,710 - lava_callback - INFO - Completed processing callback for node 68d66f392f83206171a90aea INFO: 172.20.0.1:42482 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:51:21,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:51:21,994 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f3a2f83206171a90aed/lava_callback.json.gz 2025-09-26 10:51:22,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:22,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f3a2f83206171a90aed HTTP/1.1" 200 None 2025-09-26 10:51:22,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:22,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:51:22,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:22,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f3a2f83206171a90aed HTTP/1.1" 200 None 2025-09-26 10:51:22,089 - lava_callback - INFO - Completed processing callback for node 68d66f3a2f83206171a90aed 2025-09-26 10:51:26,510 - lava_callback - INFO - Received callback for node 68d66de02f83206171a907e8 INFO: 172.20.0.1:42486 - "POST /node/68d66de02f83206171a907e8 HTTP/1.0" 202 Accepted 2025-09-26 10:51:26,516 - lava_callback - INFO - Starting async job submit for node 68d66de02f83206171a907e8 INFO: 172.20.0.1:42502 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:51:26,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:26,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66de02f83206171a907e8 HTTP/1.1" 200 None 2025-09-26 10:51:26,576 - lava_callback - DEBUG - Processing node 68d66de02f83206171a907e8: baseline-arm64 2025-09-26 10:51:26,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:51:29,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:51:29,030 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66de02f83206171a907e8/log.txt.gz 2025-09-26 10:51:29,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:51:29,272 - lava_callback - INFO - Received callback for node 68d3cd28cd36afa834e0f5ef INFO: 172.20.0.1:42512 - "POST /node/68d3cd28cd36afa834e0f5ef HTTP/1.0" 202 Accepted 2025-09-26 10:51:29,282 - lava_callback - INFO - Starting async job submit for node 68d3cd28cd36afa834e0f5ef 2025-09-26 10:51:29,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:29,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cd28cd36afa834e0f5ef HTTP/1.1" 200 None 2025-09-26 10:51:29,324 - lava_callback - DEBUG - Processing node 68d3cd28cd36afa834e0f5ef: baseline-arm-broonie 2025-09-26 10:51:29,324 - lava_callback - ERROR - Error processing callback for node 68d3cd28cd36afa834e0f5ef: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:51:29,462 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:51:29,462 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66de02f83206171a907e8/lava_callback.json.gz 2025-09-26 10:51:29,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:29,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66de02f83206171a907e8 HTTP/1.1" 200 None 2025-09-26 10:51:29,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:29,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:51:29,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:29,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66de02f83206171a907e8 HTTP/1.1" 200 None 2025-09-26 10:51:29,598 - lava_callback - INFO - Completed processing callback for node 68d66de02f83206171a907e8 INFO: 172.20.0.1:42504 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:51:37,822 - lava_callback - INFO - Received callback for node 68d66e9e2f83206171a90971 INFO: 172.20.0.1:42506 - "POST /node/68d66e9e2f83206171a90971 HTTP/1.0" 202 Accepted 2025-09-26 10:51:37,828 - lava_callback - INFO - Starting async job submit for node 68d66e9e2f83206171a90971 2025-09-26 10:51:37,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:37,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e9e2f83206171a90971 HTTP/1.1" 200 None 2025-09-26 10:51:37,879 - lava_callback - DEBUG - Processing node 68d66e9e2f83206171a90971: baseline-arm64 2025-09-26 10:51:38,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:51:38,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:51:38,405 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e9e2f83206171a90971/log.txt.gz 2025-09-26 10:51:38,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:51:39,107 - lava_callback - INFO - Received callback for node 68d3cfaacd36afa834e0fb1b INFO: 172.20.0.1:42518 - "POST /node/68d3cfaacd36afa834e0fb1b HTTP/1.0" 202 Accepted 2025-09-26 10:51:39,113 - lava_callback - INFO - Starting async job submit for node 68d3cfaacd36afa834e0fb1b 2025-09-26 10:51:39,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:39,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cfaacd36afa834e0fb1b HTTP/1.1" 200 None 2025-09-26 10:51:39,160 - lava_callback - DEBUG - Processing node 68d3cfaacd36afa834e0fb1b: baseline-arm64 2025-09-26 10:51:39,464 - lava_callback - ERROR - Error processing callback for node 68d3cfaacd36afa834e0fb1b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:51:40,728 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:51:40,728 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e9e2f83206171a90971/lava_callback.json.gz 2025-09-26 10:51:40,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:40,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e9e2f83206171a90971 HTTP/1.1" 200 None 2025-09-26 10:51:40,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:40,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:51:40,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:40,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e9e2f83206171a90971 HTTP/1.1" 200 None 2025-09-26 10:51:40,817 - lava_callback - INFO - Completed processing callback for node 68d66e9e2f83206171a90971 2025-09-26 10:51:42,430 - lava_callback - INFO - Received callback for node 68d66e9d2f83206171a90966 INFO: 172.20.0.1:42644 - "POST /node/68d66e9d2f83206171a90966 HTTP/1.0" 202 Accepted 2025-09-26 10:51:42,436 - lava_callback - INFO - Starting async job submit for node 68d66e9d2f83206171a90966 2025-09-26 10:51:42,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:42,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e9d2f83206171a90966 HTTP/1.1" 200 None 2025-09-26 10:51:42,470 - lava_callback - DEBUG - Processing node 68d66e9d2f83206171a90966: baseline-arm64 2025-09-26 10:51:42,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:51:43,123 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:51:43,123 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e9d2f83206171a90966/log.txt.gz 2025-09-26 10:51:43,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:51:43,270 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:51:43,271 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e9d2f83206171a90966/lava_callback.json.gz 2025-09-26 10:51:43,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:43,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e9d2f83206171a90966 HTTP/1.1" 200 None 2025-09-26 10:51:43,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:43,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:51:43,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:43,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e9d2f83206171a90966 HTTP/1.1" 200 None 2025-09-26 10:51:43,382 - lava_callback - INFO - Completed processing callback for node 68d66e9d2f83206171a90966 INFO: 172.20.0.1:42646 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:51:47,533 - lava_callback - INFO - Received callback for node 68d66e6b2f83206171a90924 INFO: 172.20.0.1:42652 - "POST /node/68d66e6b2f83206171a90924 HTTP/1.0" 202 Accepted 2025-09-26 10:51:47,542 - lava_callback - INFO - Starting async job submit for node 68d66e6b2f83206171a90924 2025-09-26 10:51:47,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:47,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e6b2f83206171a90924 HTTP/1.1" 200 None 2025-09-26 10:51:47,588 - lava_callback - DEBUG - Processing node 68d66e6b2f83206171a90924: baseline-arm64 2025-09-26 10:51:47,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:51:49,507 - lava_callback - INFO - Received callback for node 68d3cd31cd36afa834e0f5f8 INFO: 172.20.0.1:46478 - "POST /node/68d3cd31cd36afa834e0f5f8 HTTP/1.0" 202 Accepted 2025-09-26 10:51:49,513 - lava_callback - INFO - Starting async job submit for node 68d3cd31cd36afa834e0f5f8 2025-09-26 10:51:49,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:49,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cd31cd36afa834e0f5f8 HTTP/1.1" 200 None 2025-09-26 10:51:49,551 - lava_callback - DEBUG - Processing node 68d3cd31cd36afa834e0f5f8: ltp-sched 2025-09-26 10:51:49,551 - lava_callback - ERROR - Error processing callback for node 68d3cd31cd36afa834e0f5f8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:51:50,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:51:50,169 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e6b2f83206171a90924/log.txt.gz 2025-09-26 10:51:50,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:51:50,309 - lava_callback - INFO - Received callback for node 68d3cd32cd36afa834e0f5fb INFO: 172.20.0.1:46494 - "POST /node/68d3cd32cd36afa834e0f5fb HTTP/1.0" 202 Accepted 2025-09-26 10:51:50,315 - lava_callback - INFO - Starting async job submit for node 68d3cd32cd36afa834e0f5fb 2025-09-26 10:51:50,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:50,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cd32cd36afa834e0f5fb HTTP/1.1" 200 None 2025-09-26 10:51:50,338 - lava_callback - DEBUG - Processing node 68d3cd32cd36afa834e0f5fb: baseline-arm-broonie 2025-09-26 10:51:50,338 - lava_callback - ERROR - Error processing callback for node 68d3cd32cd36afa834e0f5fb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:51:51,077 - lava_callback - INFO - Received callback for node 68d3cd3dcd36afa834e0f617 INFO: 172.20.0.1:46500 - "POST /node/68d3cd3dcd36afa834e0f617 HTTP/1.0" 202 Accepted 2025-09-26 10:51:51,083 - lava_callback - INFO - Starting async job submit for node 68d3cd3dcd36afa834e0f617 2025-09-26 10:51:51,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:51,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cd3dcd36afa834e0f617 HTTP/1.1" 200 None 2025-09-26 10:51:51,097 - lava_callback - DEBUG - Processing node 68d3cd3dcd36afa834e0f617: ltp-pty 2025-09-26 10:51:51,097 - lava_callback - ERROR - Error processing callback for node 68d3cd3dcd36afa834e0f617: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:51:51,856 - lava_callback - INFO - Received callback for node 68d3cd44cd36afa834e0f61d INFO: 172.20.0.1:46516 - "POST /node/68d3cd44cd36afa834e0f61d HTTP/1.0" 202 Accepted 2025-09-26 10:51:51,865 - lava_callback - INFO - Starting async job submit for node 68d3cd44cd36afa834e0f61d 2025-09-26 10:51:51,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:51,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cd44cd36afa834e0f61d HTTP/1.1" 200 None 2025-09-26 10:51:51,882 - lava_callback - DEBUG - Processing node 68d3cd44cd36afa834e0f61d: ltp-sched 2025-09-26 10:51:51,882 - lava_callback - ERROR - Error processing callback for node 68d3cd44cd36afa834e0f61d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:51:52,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:51:52,487 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e6b2f83206171a90924/lava_callback.json.gz 2025-09-26 10:51:52,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:52,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e6b2f83206171a90924 HTTP/1.1" 200 None 2025-09-26 10:51:52,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:52,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:51:52,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:52,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e6b2f83206171a90924 HTTP/1.1" 200 None 2025-09-26 10:51:52,574 - lava_callback - INFO - Completed processing callback for node 68d66e6b2f83206171a90924 2025-09-26 10:51:52,715 - lava_callback - INFO - Received callback for node 68d3cd44cd36afa834e0f620 INFO: 172.20.0.1:46526 - "POST /node/68d3cd44cd36afa834e0f620 HTTP/1.0" 202 Accepted 2025-09-26 10:51:52,723 - lava_callback - INFO - Starting async job submit for node 68d3cd44cd36afa834e0f620 2025-09-26 10:51:52,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:52,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cd44cd36afa834e0f620 HTTP/1.1" 200 None 2025-09-26 10:51:52,738 - lava_callback - DEBUG - Processing node 68d3cd44cd36afa834e0f620: baseline-arm-broonie 2025-09-26 10:51:52,739 - lava_callback - ERROR - Error processing callback for node 68d3cd44cd36afa834e0f620: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:51:54,121 - lava_callback - INFO - Received callback for node 68d3cd36cd36afa834e0f5ff INFO: 172.20.0.1:46540 - "POST /node/68d3cd36cd36afa834e0f5ff HTTP/1.0" 202 Accepted 2025-09-26 10:51:54,132 - lava_callback - INFO - Starting async job submit for node 68d3cd36cd36afa834e0f5ff 2025-09-26 10:51:54,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:54,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cd36cd36afa834e0f5ff HTTP/1.1" 200 None 2025-09-26 10:51:54,209 - lava_callback - DEBUG - Processing node 68d3cd36cd36afa834e0f5ff: baseline-arm64 2025-09-26 10:51:55,218 - lava_callback - ERROR - Error processing callback for node 68d3cd36cd36afa834e0f5ff: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:51:55,858 - lava_callback - INFO - Received callback for node 68d66e4d2f83206171a908d7 INFO: 172.20.0.1:46550 - "POST /node/68d66e4d2f83206171a908d7 HTTP/1.0" 202 Accepted 2025-09-26 10:51:55,864 - lava_callback - INFO - Starting async job submit for node 68d66e4d2f83206171a908d7 2025-09-26 10:51:55,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:55,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e4d2f83206171a908d7 HTTP/1.1" 200 None 2025-09-26 10:51:55,900 - lava_callback - DEBUG - Processing node 68d66e4d2f83206171a908d7: baseline-arm64 2025-09-26 10:51:56,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:51:56,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:51:56,387 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e4d2f83206171a908d7/log.txt.gz 2025-09-26 10:51:56,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:46558 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:51:56,544 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:51:56,545 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e4d2f83206171a908d7/lava_callback.json.gz 2025-09-26 10:51:56,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:56,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e4d2f83206171a908d7 HTTP/1.1" 200 None 2025-09-26 10:51:56,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:56,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:51:56,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:51:56,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e4d2f83206171a908d7 HTTP/1.1" 200 None 2025-09-26 10:51:56,623 - lava_callback - INFO - Completed processing callback for node 68d66e4d2f83206171a908d7 2025-09-26 10:52:00,355 - lava_callback - INFO - Received callback for node 68d66f912f83206171a90bc2 INFO: 172.20.0.1:57596 - "POST /node/68d66f912f83206171a90bc2 HTTP/1.0" 202 Accepted 2025-09-26 10:52:00,361 - lava_callback - INFO - Starting async job submit for node 68d66f912f83206171a90bc2 2025-09-26 10:52:00,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:00,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f912f83206171a90bc2 HTTP/1.1" 200 None 2025-09-26 10:52:00,406 - lava_callback - DEBUG - Processing node 68d66f912f83206171a90bc2: baseline-arm-clabbe 2025-09-26 10:52:00,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:52:00,912 - lava_callback - INFO - Received callback for node 68d66e5e2f83206171a90909 INFO: 172.20.0.1:57606 - "POST /node/68d66e5e2f83206171a90909 HTTP/1.0" 202 Accepted 2025-09-26 10:52:00,918 - lava_callback - INFO - Starting async job submit for node 68d66e5e2f83206171a90909 2025-09-26 10:52:00,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:00,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e5e2f83206171a90909 HTTP/1.1" 200 None 2025-09-26 10:52:00,971 - lava_callback - DEBUG - Processing node 68d66e5e2f83206171a90909: baseline-arm64 2025-09-26 10:52:01,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:52:01,707 - lava_callback - INFO - Received callback for node 68d66f2f2f83206171a90ad5 INFO: 172.20.0.1:57622 - "POST /node/68d66f2f2f83206171a90ad5 HTTP/1.0" 202 Accepted 2025-09-26 10:52:01,714 - lava_callback - INFO - Starting async job submit for node 68d66f2f2f83206171a90ad5 2025-09-26 10:52:01,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:01,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f2f2f83206171a90ad5 HTTP/1.1" 200 None 2025-09-26 10:52:01,746 - lava_callback - DEBUG - Processing node 68d66f2f2f83206171a90ad5: baseline-arm 2025-09-26 10:52:02,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:52:02,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:52:02,104 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d66f912f83206171a90bc2/log.txt.gz 2025-09-26 10:52:02,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:52:02,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:52:02,125 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e5e2f83206171a90909/log.txt.gz 2025-09-26 10:52:02,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:52:03,595 - lava_callback - INFO - Received callback for node 68d66e372f83206171a90896 INFO: 172.20.0.1:57630 - "POST /node/68d66e372f83206171a90896 HTTP/1.0" 202 Accepted 2025-09-26 10:52:03,601 - lava_callback - INFO - Starting async job submit for node 68d66e372f83206171a90896 2025-09-26 10:52:03,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:03,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e372f83206171a90896 HTTP/1.1" 200 None 2025-09-26 10:52:03,646 - lava_callback - DEBUG - Processing node 68d66e372f83206171a90896: baseline-arm64 2025-09-26 10:52:04,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:52:04,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:52:04,571 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d66f912f83206171a90bc2/lava_callback.json.gz 2025-09-26 10:52:04,587 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:52:04,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:52:04,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:04,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:52:04,600 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f2f2f83206171a90ad5/log.txt.gz 2025-09-26 10:52:04,600 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e5e2f83206171a90909/lava_callback.json.gz 2025-09-26 10:52:04,605 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e372f83206171a90896/log.txt.gz 2025-09-26 10:52:04,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:52:04,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:04,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:52:04,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f912f83206171a90bc2 HTTP/1.1" 200 None 2025-09-26 10:52:04,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:04,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e5e2f83206171a90909 HTTP/1.1" 200 None 2025-09-26 10:52:04,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:04,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:52:04,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:04,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:52:04,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:04,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f912f83206171a90bc2 HTTP/1.1" 200 None 2025-09-26 10:52:04,721 - lava_callback - INFO - Completed processing callback for node 68d66f912f83206171a90bc2 2025-09-26 10:52:04,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e5e2f83206171a90909 HTTP/1.1" 200 None 2025-09-26 10:52:04,737 - lava_callback - INFO - Completed processing callback for node 68d66e5e2f83206171a90909 INFO: 172.20.0.1:57638 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:52:06,991 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:52:06,992 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e372f83206171a90896/lava_callback.json.gz 2025-09-26 10:52:07,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:52:07,011 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f2f2f83206171a90ad5/lava_callback.json.gz 2025-09-26 10:52:07,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:07,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:07,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f2f2f83206171a90ad5 HTTP/1.1" 200 None 2025-09-26 10:52:07,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e372f83206171a90896 HTTP/1.1" 200 None 2025-09-26 10:52:07,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:07,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:07,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:52:07,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:07,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:52:07,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:07,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f2f2f83206171a90ad5 HTTP/1.1" 200 None 2025-09-26 10:52:07,163 - lava_callback - INFO - Completed processing callback for node 68d66f2f2f83206171a90ad5 2025-09-26 10:52:07,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e372f83206171a90896 HTTP/1.1" 200 None 2025-09-26 10:52:07,165 - lava_callback - INFO - Completed processing callback for node 68d66e372f83206171a90896 2025-09-26 10:52:08,139 - lava_callback - INFO - Received callback for node 68d3ccb7cd36afa834e0f539 INFO: 172.20.0.1:57646 - "POST /node/68d3ccb7cd36afa834e0f539 HTTP/1.0" 202 Accepted 2025-09-26 10:52:08,146 - lava_callback - INFO - Starting async job submit for node 68d3ccb7cd36afa834e0f539 2025-09-26 10:52:08,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:08,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ccb7cd36afa834e0f539 HTTP/1.1" 200 None 2025-09-26 10:52:08,198 - lava_callback - DEBUG - Processing node 68d3ccb7cd36afa834e0f539: ltp-timers 2025-09-26 10:52:08,596 - lava_callback - ERROR - Error processing callback for node 68d3ccb7cd36afa834e0f539: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:52:09,404 - lava_callback - INFO - Received callback for node 68d3cd49cd36afa834e0f623 INFO: 172.20.0.1:48876 - "POST /node/68d3cd49cd36afa834e0f623 HTTP/1.0" 202 Accepted 2025-09-26 10:52:09,414 - lava_callback - INFO - Starting async job submit for node 68d3cd49cd36afa834e0f623 2025-09-26 10:52:09,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:09,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cd49cd36afa834e0f623 HTTP/1.1" 200 None 2025-09-26 10:52:09,429 - lava_callback - DEBUG - Processing node 68d3cd49cd36afa834e0f623: ltp-smoketest 2025-09-26 10:52:09,429 - lava_callback - ERROR - Error processing callback for node 68d3cd49cd36afa834e0f623: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:52:10,162 - lava_callback - INFO - Received callback for node 68d3cd54cd36afa834e0f62f INFO: 172.20.0.1:48882 - "POST /node/68d3cd54cd36afa834e0f62f HTTP/1.0" 202 Accepted 2025-09-26 10:52:10,171 - lava_callback - INFO - Starting async job submit for node 68d3cd54cd36afa834e0f62f 2025-09-26 10:52:10,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:10,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cd54cd36afa834e0f62f HTTP/1.1" 200 None 2025-09-26 10:52:10,185 - lava_callback - DEBUG - Processing node 68d3cd54cd36afa834e0f62f: ltp-sched 2025-09-26 10:52:10,185 - lava_callback - ERROR - Error processing callback for node 68d3cd54cd36afa834e0f62f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:52:10,923 - lava_callback - INFO - Received callback for node 68d3cd58cd36afa834e0f638 INFO: 172.20.0.1:48890 - "POST /node/68d3cd58cd36afa834e0f638 HTTP/1.0" 202 Accepted 2025-09-26 10:52:10,931 - lava_callback - INFO - Starting async job submit for node 68d3cd58cd36afa834e0f638 2025-09-26 10:52:10,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:10,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cd58cd36afa834e0f638 HTTP/1.1" 200 None 2025-09-26 10:52:10,987 - lava_callback - DEBUG - Processing node 68d3cd58cd36afa834e0f638: ltp-smoketest 2025-09-26 10:52:10,987 - lava_callback - ERROR - Error processing callback for node 68d3cd58cd36afa834e0f638: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:48898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43882 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:52:26,926 - lava_callback - INFO - Received callback for node 68d3cd39cd36afa834e0f614 INFO: 172.20.0.1:43898 - "POST /node/68d3cd39cd36afa834e0f614 HTTP/1.0" 202 Accepted 2025-09-26 10:52:26,933 - lava_callback - INFO - Starting async job submit for node 68d3cd39cd36afa834e0f614 2025-09-26 10:52:26,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:26,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cd39cd36afa834e0f614 HTTP/1.1" 200 None 2025-09-26 10:52:26,987 - lava_callback - DEBUG - Processing node 68d3cd39cd36afa834e0f614: baseline-arm64 2025-09-26 10:52:27,908 - lava_callback - ERROR - Error processing callback for node 68d3cd39cd36afa834e0f614: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:52:29,420 - lava_callback - INFO - Received callback for node 68d3cd63cd36afa834e0f648 INFO: 172.20.0.1:40502 - "POST /node/68d3cd63cd36afa834e0f648 HTTP/1.0" 202 Accepted 2025-09-26 10:52:29,426 - lava_callback - INFO - Starting async job submit for node 68d3cd63cd36afa834e0f648 2025-09-26 10:52:29,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:29,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cd63cd36afa834e0f648 HTTP/1.1" 200 None 2025-09-26 10:52:29,442 - lava_callback - DEBUG - Processing node 68d3cd63cd36afa834e0f648: ltp-syscalls 2025-09-26 10:52:29,442 - lava_callback - ERROR - Error processing callback for node 68d3cd63cd36afa834e0f648: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:52:33,905 - lava_callback - INFO - Received callback for node 68d66fad2f83206171a90bf4 INFO: 172.20.0.1:40506 - "POST /node/68d66fad2f83206171a90bf4 HTTP/1.0" 202 Accepted 2025-09-26 10:52:33,916 - lava_callback - INFO - Starting async job submit for node 68d66fad2f83206171a90bf4 2025-09-26 10:52:33,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:33,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66fad2f83206171a90bf4 HTTP/1.1" 200 None 2025-09-26 10:52:33,985 - lava_callback - DEBUG - Processing node 68d66fad2f83206171a90bf4: ltp-dio 2025-09-26 10:52:34,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:52:35,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:52:35,825 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-68d66fad2f83206171a90bf4/log.txt.gz 2025-09-26 10:52:35,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:40518 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:52:38,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:52:38,162 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-68d66fad2f83206171a90bf4/lava_callback.json.gz 2025-09-26 10:52:38,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:38,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66fad2f83206171a90bf4 HTTP/1.1" 200 None 2025-09-26 10:52:38,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:38,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:52:38,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:38,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66fad2f83206171a90bf4 HTTP/1.1" 200 None 2025-09-26 10:52:38,309 - lava_callback - INFO - Completed processing callback for node 68d66fad2f83206171a90bf4 2025-09-26 10:52:41,008 - lava_callback - INFO - Received callback for node 68d3cfafcd36afa834e0fb40 INFO: 172.20.0.1:32864 - "POST /node/68d3cfafcd36afa834e0fb40 HTTP/1.0" 202 Accepted 2025-09-26 10:52:41,018 - lava_callback - INFO - Starting async job submit for node 68d3cfafcd36afa834e0fb40 2025-09-26 10:52:41,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:41,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cfafcd36afa834e0fb40 HTTP/1.1" 200 None 2025-09-26 10:52:41,060 - lava_callback - DEBUG - Processing node 68d3cfafcd36afa834e0fb40: baseline-arm64 2025-09-26 10:52:41,380 - lava_callback - ERROR - Error processing callback for node 68d3cfafcd36afa834e0fb40: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:32876 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:52:47,594 - lava_callback - INFO - Received callback for node 68d66e322f83206171a90890 INFO: 172.20.0.1:32892 - "POST /node/68d66e322f83206171a90890 HTTP/1.0" 202 Accepted 2025-09-26 10:52:47,601 - lava_callback - INFO - Starting async job submit for node 68d66e322f83206171a90890 2025-09-26 10:52:47,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:47,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e322f83206171a90890 HTTP/1.1" 200 None 2025-09-26 10:52:47,650 - lava_callback - DEBUG - Processing node 68d66e322f83206171a90890: baseline-arm64 2025-09-26 10:52:48,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:52:49,369 - lava_callback - INFO - Received callback for node 68d3cd77cd36afa834e0f695 INFO: 172.20.0.1:50398 - "POST /node/68d3cd77cd36afa834e0f695 HTTP/1.0" 202 Accepted 2025-09-26 10:52:49,375 - lava_callback - INFO - Starting async job submit for node 68d3cd77cd36afa834e0f695 2025-09-26 10:52:49,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:49,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cd77cd36afa834e0f695 HTTP/1.1" 200 None 2025-09-26 10:52:49,389 - lava_callback - DEBUG - Processing node 68d3cd77cd36afa834e0f695: ltp-syscalls 2025-09-26 10:52:49,389 - lava_callback - ERROR - Error processing callback for node 68d3cd77cd36afa834e0f695: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:52:49,779 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:52:49,780 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e322f83206171a90890/log.txt.gz 2025-09-26 10:52:49,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:52:52,079 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:52:52,080 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e322f83206171a90890/lava_callback.json.gz DEBUG: 68d66e322f83206171a90890 Transitting job node result: pass -> incomplete 2025-09-26 10:52:52,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:52,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e322f83206171a90890 HTTP/1.1" 200 None 2025-09-26 10:52:52,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:52,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:52:52,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:52:52,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e322f83206171a90890 HTTP/1.1" 200 None 2025-09-26 10:52:52,173 - lava_callback - INFO - Completed processing callback for node 68d66e322f83206171a90890 INFO: 172.20.0.1:50412 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:53:00,908 - lava_callback - INFO - Received callback for node 68d66f572f83206171a90b40 INFO: 172.20.0.1:53032 - "POST /node/68d66f572f83206171a90b40 HTTP/1.0" 202 Accepted 2025-09-26 10:53:00,914 - lava_callback - INFO - Starting async job submit for node 68d66f572f83206171a90b40 2025-09-26 10:53:00,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:00,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f572f83206171a90b40 HTTP/1.1" 200 None 2025-09-26 10:53:00,957 - lava_callback - DEBUG - Processing node 68d66f572f83206171a90b40: baseline-arm 2025-09-26 10:53:01,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:53:01,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:53:01,360 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f572f83206171a90b40/log.txt.gz 2025-09-26 10:53:01,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:53:03,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:53:03,678 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f572f83206171a90b40/lava_callback.json.gz 2025-09-26 10:53:03,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:03,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f572f83206171a90b40 HTTP/1.1" 200 None 2025-09-26 10:53:03,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:03,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:53:03,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:03,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f572f83206171a90b40 HTTP/1.1" 200 None 2025-09-26 10:53:03,756 - lava_callback - INFO - Completed processing callback for node 68d66f572f83206171a90b40 INFO: 172.20.0.1:53044 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:53:09,501 - lava_callback - INFO - Received callback for node 68d3cd7fcd36afa834e0f69b INFO: 172.20.0.1:33834 - "POST /node/68d3cd7fcd36afa834e0f69b HTTP/1.0" 202 Accepted 2025-09-26 10:53:09,507 - lava_callback - INFO - Starting async job submit for node 68d3cd7fcd36afa834e0f69b 2025-09-26 10:53:09,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:09,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cd7fcd36afa834e0f69b HTTP/1.1" 200 None 2025-09-26 10:53:09,524 - lava_callback - DEBUG - Processing node 68d3cd7fcd36afa834e0f69b: ltp-syscalls-ipc 2025-09-26 10:53:09,525 - lava_callback - ERROR - Error processing callback for node 68d3cd7fcd36afa834e0f69b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:33836 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 10:53:16,410 - lava_callback - INFO - Received callback for node 68d40a34cd36afa834e16f00 INFO: 172.20.0.1:33848 - "POST /node/68d40a34cd36afa834e16f00 HTTP/1.0" 202 Accepted 2025-09-26 10:53:16,416 - lava_callback - INFO - Starting async job submit for node 68d40a34cd36afa834e16f00 2025-09-26 10:53:16,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:16,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a34cd36afa834e16f00 HTTP/1.1" 200 None 2025-09-26 10:53:16,455 - lava_callback - DEBUG - Processing node 68d40a34cd36afa834e16f00: baseline-arm INFO: 172.20.0.1:33862 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:53:16,684 - lava_callback - ERROR - Error processing callback for node 68d40a34cd36afa834e16f00: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:53:18,238 - lava_callback - INFO - Received callback for node 68d66e632f83206171a9091b INFO: 172.20.0.1:33870 - "POST /node/68d66e632f83206171a9091b HTTP/1.0" 202 Accepted 2025-09-26 10:53:18,244 - lava_callback - INFO - Starting async job submit for node 68d66e632f83206171a9091b 2025-09-26 10:53:18,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:18,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e632f83206171a9091b HTTP/1.1" 200 None 2025-09-26 10:53:18,301 - lava_callback - DEBUG - Processing node 68d66e632f83206171a9091b: baseline-arm64 INFO: 172.20.0.1:33874 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:53:18,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:53:19,927 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:53:19,928 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e632f83206171a9091b/log.txt.gz 2025-09-26 10:53:19,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:46310 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:53:22,241 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:53:22,242 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e632f83206171a9091b/lava_callback.json.gz 2025-09-26 10:53:22,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:22,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e632f83206171a9091b HTTP/1.1" 200 None 2025-09-26 10:53:22,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:22,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:53:22,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:22,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e632f83206171a9091b HTTP/1.1" 200 None 2025-09-26 10:53:22,343 - lava_callback - INFO - Completed processing callback for node 68d66e632f83206171a9091b 2025-09-26 10:53:23,033 - lava_callback - INFO - Received callback for node 68d66e6e2f83206171a90927 INFO: 172.20.0.1:46316 - "POST /node/68d66e6e2f83206171a90927 HTTP/1.0" 202 Accepted 2025-09-26 10:53:23,039 - lava_callback - INFO - Starting async job submit for node 68d66e6e2f83206171a90927 2025-09-26 10:53:23,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:23,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e6e2f83206171a90927 HTTP/1.1" 200 None 2025-09-26 10:53:23,075 - lava_callback - DEBUG - Processing node 68d66e6e2f83206171a90927: baseline-arm64 2025-09-26 10:53:23,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:53:24,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:53:24,600 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e6e2f83206171a90927/log.txt.gz 2025-09-26 10:53:24,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:53:24,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:53:24,805 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e6e2f83206171a90927/lava_callback.json.gz 2025-09-26 10:53:24,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:24,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e6e2f83206171a90927 HTTP/1.1" 200 None 2025-09-26 10:53:24,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:24,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:53:24,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:24,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e6e2f83206171a90927 HTTP/1.1" 200 None 2025-09-26 10:53:24,885 - lava_callback - INFO - Completed processing callback for node 68d66e6e2f83206171a90927 INFO: 172.20.0.1:46322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50336 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:53:39,446 - lava_callback - INFO - Received callback for node 68d66f932f83206171a90bc5 INFO: 172.20.0.1:45572 - "POST /node/68d66f932f83206171a90bc5 HTTP/1.0" 202 Accepted 2025-09-26 10:53:39,452 - lava_callback - INFO - Starting async job submit for node 68d66f932f83206171a90bc5 2025-09-26 10:53:39,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:39,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f932f83206171a90bc5 HTTP/1.1" 200 None 2025-09-26 10:53:39,489 - lava_callback - DEBUG - Processing node 68d66f932f83206171a90bc5: baseline-arm-clabbe 2025-09-26 10:53:39,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:53:40,232 - lava_callback - INFO - Received callback for node 68d66e702f83206171a9092a INFO: 172.20.0.1:45578 - "POST /node/68d66e702f83206171a9092a HTTP/1.0" 202 Accepted 2025-09-26 10:53:40,238 - lava_callback - INFO - Starting async job submit for node 68d66e702f83206171a9092a 2025-09-26 10:53:40,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:40,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e702f83206171a9092a HTTP/1.1" 200 None 2025-09-26 10:53:40,274 - lava_callback - DEBUG - Processing node 68d66e702f83206171a9092a: baseline-arm64 2025-09-26 10:53:40,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:53:40,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:53:40,773 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d66f932f83206171a90bc5/log.txt.gz 2025-09-26 10:53:40,777 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:53:40,778 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e702f83206171a9092a/log.txt.gz 2025-09-26 10:53:40,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:53:40,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:53:42,763 - lava_callback - INFO - Received callback for node 68d66e3d2f83206171a9089d INFO: 172.20.0.1:45586 - "POST /node/68d66e3d2f83206171a9089d HTTP/1.0" 202 Accepted 2025-09-26 10:53:42,769 - lava_callback - INFO - Starting async job submit for node 68d66e3d2f83206171a9089d 2025-09-26 10:53:42,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:42,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e3d2f83206171a9089d HTTP/1.1" 200 None 2025-09-26 10:53:42,817 - lava_callback - DEBUG - Processing node 68d66e3d2f83206171a9089d: baseline-arm64 2025-09-26 10:53:43,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:53:43,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:53:43,212 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e702f83206171a9092a/lava_callback.json.gz 2025-09-26 10:53:43,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:43,276 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d66f932f83206171a90bc5/lava_callback.json.gz 2025-09-26 10:53:43,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:43,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f932f83206171a90bc5 HTTP/1.1" 200 None 2025-09-26 10:53:43,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:43,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:53:43,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e702f83206171a9092a HTTP/1.1" 200 None 2025-09-26 10:53:43,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:43,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:53:43,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:43,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:53:43,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:43,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f932f83206171a90bc5 HTTP/1.1" 200 None 2025-09-26 10:53:43,432 - lava_callback - INFO - Completed processing callback for node 68d66f932f83206171a90bc5 2025-09-26 10:53:43,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e702f83206171a9092a HTTP/1.1" 200 None 2025-09-26 10:53:43,445 - lava_callback - INFO - Completed processing callback for node 68d66e702f83206171a9092a 2025-09-26 10:53:43,611 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:53:43,611 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e3d2f83206171a9089d/log.txt.gz 2025-09-26 10:53:43,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:53:43,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:53:43,804 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e3d2f83206171a9089d/lava_callback.json.gz 2025-09-26 10:53:43,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:43,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e3d2f83206171a9089d HTTP/1.1" 200 None 2025-09-26 10:53:43,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:43,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:53:43,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:43,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e3d2f83206171a9089d HTTP/1.1" 200 None 2025-09-26 10:53:43,901 - lava_callback - INFO - Completed processing callback for node 68d66e3d2f83206171a9089d INFO: 172.20.0.1:45592 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:53:49,435 - lava_callback - INFO - Received callback for node 68d3cdadcd36afa834e0f6da INFO: 172.20.0.1:52906 - "POST /node/68d3cdadcd36afa834e0f6da HTTP/1.0" 202 Accepted 2025-09-26 10:53:49,441 - lava_callback - INFO - Starting async job submit for node 68d3cdadcd36afa834e0f6da 2025-09-26 10:53:49,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:49,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cdadcd36afa834e0f6da HTTP/1.1" 200 None 2025-09-26 10:53:49,455 - lava_callback - DEBUG - Processing node 68d3cdadcd36afa834e0f6da: ltp-syscalls 2025-09-26 10:53:49,455 - lava_callback - ERROR - Error processing callback for node 68d3cdadcd36afa834e0f6da: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:52916 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:53:56,685 - lava_callback - INFO - Received callback for node 68d3cdbacd36afa834e0f6fe INFO: 172.20.0.1:52930 - "POST /node/68d3cdbacd36afa834e0f6fe HTTP/1.0" 202 Accepted 2025-09-26 10:53:56,690 - lava_callback - INFO - Starting async job submit for node 68d3cdbacd36afa834e0f6fe 2025-09-26 10:53:56,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:56,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cdbacd36afa834e0f6fe HTTP/1.1" 200 None 2025-09-26 10:53:56,704 - lava_callback - DEBUG - Processing node 68d3cdbacd36afa834e0f6fe: baseline-arm 2025-09-26 10:53:56,704 - lava_callback - ERROR - Error processing callback for node 68d3cdbacd36afa834e0f6fe: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:53:57,422 - lava_callback - INFO - Received callback for node 68d3cdbacd36afa834e0f701 INFO: 172.20.0.1:52938 - "POST /node/68d3cdbacd36afa834e0f701 HTTP/1.0" 202 Accepted 2025-09-26 10:53:57,431 - lava_callback - INFO - Starting async job submit for node 68d3cdbacd36afa834e0f701 2025-09-26 10:53:57,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:57,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cdbacd36afa834e0f701 HTTP/1.1" 200 None 2025-09-26 10:53:57,447 - lava_callback - DEBUG - Processing node 68d3cdbacd36afa834e0f701: baseline-arm 2025-09-26 10:53:57,447 - lava_callback - ERROR - Error processing callback for node 68d3cdbacd36afa834e0f701: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:53:58,127 - lava_callback - INFO - Received callback for node 68d3cdbdcd36afa834e0f706 INFO: 172.20.0.1:52950 - "POST /node/68d3cdbdcd36afa834e0f706 HTTP/1.0" 202 Accepted 2025-09-26 10:53:58,136 - lava_callback - INFO - Starting async job submit for node 68d3cdbdcd36afa834e0f706 2025-09-26 10:53:58,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:58,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cdbdcd36afa834e0f706 HTTP/1.1" 200 None 2025-09-26 10:53:58,150 - lava_callback - DEBUG - Processing node 68d3cdbdcd36afa834e0f706: baseline-arm 2025-09-26 10:53:58,150 - lava_callback - ERROR - Error processing callback for node 68d3cdbdcd36afa834e0f706: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:53:58,839 - lava_callback - INFO - Received callback for node 68d3cdbdcd36afa834e0f709 INFO: 172.20.0.1:52952 - "POST /node/68d3cdbdcd36afa834e0f709 HTTP/1.0" 202 Accepted 2025-09-26 10:53:58,845 - lava_callback - INFO - Starting async job submit for node 68d3cdbdcd36afa834e0f709 2025-09-26 10:53:58,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:58,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cdbdcd36afa834e0f709 HTTP/1.1" 200 None 2025-09-26 10:53:58,862 - lava_callback - DEBUG - Processing node 68d3cdbdcd36afa834e0f709: baseline-arm 2025-09-26 10:53:58,862 - lava_callback - ERROR - Error processing callback for node 68d3cdbdcd36afa834e0f709: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:53:59,559 - lava_callback - INFO - Received callback for node 68d3cdbfcd36afa834e0f70c INFO: 172.20.0.1:49936 - "POST /node/68d3cdbfcd36afa834e0f70c HTTP/1.0" 202 Accepted 2025-09-26 10:53:59,564 - lava_callback - INFO - Starting async job submit for node 68d3cdbfcd36afa834e0f70c 2025-09-26 10:53:59,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:53:59,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cdbfcd36afa834e0f70c HTTP/1.1" 200 None 2025-09-26 10:53:59,579 - lava_callback - DEBUG - Processing node 68d3cdbfcd36afa834e0f70c: baseline-arm 2025-09-26 10:53:59,579 - lava_callback - ERROR - Error processing callback for node 68d3cdbfcd36afa834e0f70c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:54:02,465 - lava_callback - INFO - Received callback for node 68d66f572f83206171a90b43 INFO: 172.20.0.1:49938 - "POST /node/68d66f572f83206171a90b43 HTTP/1.0" 202 Accepted 2025-09-26 10:54:02,471 - lava_callback - INFO - Starting async job submit for node 68d66f572f83206171a90b43 2025-09-26 10:54:02,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:54:02,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f572f83206171a90b43 HTTP/1.1" 200 None 2025-09-26 10:54:02,504 - lava_callback - DEBUG - Processing node 68d66f572f83206171a90b43: baseline-arm 2025-09-26 10:54:02,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:54:04,344 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:54:04,345 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f572f83206171a90b43/log.txt.gz 2025-09-26 10:54:04,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:49944 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:54:06,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:54:06,679 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f572f83206171a90b43/lava_callback.json.gz 2025-09-26 10:54:06,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:54:06,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f572f83206171a90b43 HTTP/1.1" 200 None 2025-09-26 10:54:06,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:54:06,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:54:06,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:54:06,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f572f83206171a90b43 HTTP/1.1" 200 None 2025-09-26 10:54:06,764 - lava_callback - INFO - Completed processing callback for node 68d66f572f83206171a90b43 2025-09-26 10:54:09,422 - lava_callback - INFO - Received callback for node 68d3cdc6cd36afa834e0f712 INFO: 172.20.0.1:34840 - "POST /node/68d3cdc6cd36afa834e0f712 HTTP/1.0" 202 Accepted 2025-09-26 10:54:09,430 - lava_callback - INFO - Starting async job submit for node 68d3cdc6cd36afa834e0f712 2025-09-26 10:54:09,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:54:09,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cdc6cd36afa834e0f712 HTTP/1.1" 200 None 2025-09-26 10:54:09,447 - lava_callback - DEBUG - Processing node 68d3cdc6cd36afa834e0f712: ltp-syscalls-ipc 2025-09-26 10:54:09,447 - lava_callback - ERROR - Error processing callback for node 68d3cdc6cd36afa834e0f712: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:54:12,676 - lava_callback - INFO - Received callback for node 68d66e3f2f83206171a908b4 INFO: 172.20.0.1:34856 - "POST /node/68d66e3f2f83206171a908b4 HTTP/1.0" 202 Accepted 2025-09-26 10:54:12,682 - lava_callback - INFO - Starting async job submit for node 68d66e3f2f83206171a908b4 2025-09-26 10:54:12,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:54:12,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e3f2f83206171a908b4 HTTP/1.1" 200 None 2025-09-26 10:54:12,728 - lava_callback - DEBUG - Processing node 68d66e3f2f83206171a908b4: baseline-arm64 INFO: 172.20.0.1:34858 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:54:13,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:54:13,647 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:54:13,647 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e3f2f83206171a908b4/log.txt.gz 2025-09-26 10:54:13,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:34870 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 10:54:15,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:54:15,993 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e3f2f83206171a908b4/lava_callback.json.gz 2025-09-26 10:54:16,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:54:16,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e3f2f83206171a908b4 HTTP/1.1" 200 None 2025-09-26 10:54:16,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:54:16,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:54:16,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:54:16,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e3f2f83206171a908b4 HTTP/1.1" 200 None 2025-09-26 10:54:16,078 - lava_callback - INFO - Completed processing callback for node 68d66e3f2f83206171a908b4 INFO: 172.20.0.1:34872 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:54:17,697 - lava_callback - INFO - Received callback for node 68d3cdc1cd36afa834e0f70f INFO: 172.20.0.1:34884 - "POST /node/68d3cdc1cd36afa834e0f70f HTTP/1.0" 202 Accepted 2025-09-26 10:54:17,702 - lava_callback - INFO - Starting async job submit for node 68d3cdc1cd36afa834e0f70f 2025-09-26 10:54:17,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:54:17,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cdc1cd36afa834e0f70f HTTP/1.1" 200 None 2025-09-26 10:54:17,718 - lava_callback - DEBUG - Processing node 68d3cdc1cd36afa834e0f70f: baseline-arm 2025-09-26 10:54:17,718 - lava_callback - ERROR - Error processing callback for node 68d3cdc1cd36afa834e0f70f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:54:18,396 - lava_callback - INFO - Received callback for node 68d3cdc9cd36afa834e0f715 INFO: 172.20.0.1:34900 - "POST /node/68d3cdc9cd36afa834e0f715 HTTP/1.0" 202 Accepted 2025-09-26 10:54:18,405 - lava_callback - INFO - Starting async job submit for node 68d3cdc9cd36afa834e0f715 2025-09-26 10:54:18,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:54:18,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cdc9cd36afa834e0f715 HTTP/1.1" 200 None 2025-09-26 10:54:18,421 - lava_callback - DEBUG - Processing node 68d3cdc9cd36afa834e0f715: baseline-arm 2025-09-26 10:54:18,421 - lava_callback - ERROR - Error processing callback for node 68d3cdc9cd36afa834e0f715: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:34910 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:54:19,155 - lava_callback - INFO - Received callback for node 68d3cdcccd36afa834e0f718 INFO: 172.20.0.1:34918 - "POST /node/68d3cdcccd36afa834e0f718 HTTP/1.0" 202 Accepted 2025-09-26 10:54:19,163 - lava_callback - INFO - Starting async job submit for node 68d3cdcccd36afa834e0f718 2025-09-26 10:54:19,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:54:19,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cdcccd36afa834e0f718 HTTP/1.1" 200 None 2025-09-26 10:54:19,184 - lava_callback - DEBUG - Processing node 68d3cdcccd36afa834e0f718: baseline-arm 2025-09-26 10:54:19,184 - lava_callback - ERROR - Error processing callback for node 68d3cdcccd36afa834e0f718: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:37958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37972 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:54:29,507 - lava_callback - INFO - Received callback for node 68d3cdd7cd36afa834e0f72b INFO: 172.20.0.1:41736 - "POST /node/68d3cdd7cd36afa834e0f72b HTTP/1.0" 202 Accepted 2025-09-26 10:54:29,513 - lava_callback - INFO - Starting async job submit for node 68d3cdd7cd36afa834e0f72b 2025-09-26 10:54:29,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:54:29,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cdd7cd36afa834e0f72b HTTP/1.1" 200 None 2025-09-26 10:54:29,529 - lava_callback - DEBUG - Processing node 68d3cdd7cd36afa834e0f72b: ltp-timers 2025-09-26 10:54:29,529 - lava_callback - ERROR - Error processing callback for node 68d3cdd7cd36afa834e0f72b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:41740 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.20.0.1:41754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45868 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:54:58,106 - lava_callback - INFO - Received callback for node 68d3cdfccd36afa834e0f798 INFO: 172.20.0.1:45874 - "POST /node/68d3cdfccd36afa834e0f798 HTTP/1.0" 202 Accepted 2025-09-26 10:54:58,115 - lava_callback - INFO - Starting async job submit for node 68d3cdfccd36afa834e0f798 2025-09-26 10:54:58,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:54:58,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cdfccd36afa834e0f798 HTTP/1.1" 200 None 2025-09-26 10:54:58,161 - lava_callback - DEBUG - Processing node 68d3cdfccd36afa834e0f798: baseline-arm 2025-09-26 10:54:58,162 - lava_callback - ERROR - Error processing callback for node 68d3cdfccd36afa834e0f798: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:54:58,834 - lava_callback - INFO - Received callback for node 68d3cdfdcd36afa834e0f79b INFO: 172.20.0.1:45880 - "POST /node/68d3cdfdcd36afa834e0f79b HTTP/1.0" 202 Accepted 2025-09-26 10:54:58,839 - lava_callback - INFO - Starting async job submit for node 68d3cdfdcd36afa834e0f79b 2025-09-26 10:54:58,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:54:58,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cdfdcd36afa834e0f79b HTTP/1.1" 200 None 2025-09-26 10:54:58,863 - lava_callback - DEBUG - Processing node 68d3cdfdcd36afa834e0f79b: baseline-arm 2025-09-26 10:54:58,863 - lava_callback - ERROR - Error processing callback for node 68d3cdfdcd36afa834e0f79b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:54:59,561 - lava_callback - INFO - Received callback for node 68d3cdffcd36afa834e0f79e INFO: 172.20.0.1:36462 - "POST /node/68d3cdffcd36afa834e0f79e HTTP/1.0" 202 Accepted 2025-09-26 10:54:59,567 - lava_callback - INFO - Starting async job submit for node 68d3cdffcd36afa834e0f79e 2025-09-26 10:54:59,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:54:59,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cdffcd36afa834e0f79e HTTP/1.1" 200 None 2025-09-26 10:54:59,604 - lava_callback - DEBUG - Processing node 68d3cdffcd36afa834e0f79e: baseline-arm 2025-09-26 10:54:59,604 - lava_callback - ERROR - Error processing callback for node 68d3cdffcd36afa834e0f79e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:55:00,298 - lava_callback - INFO - Received callback for node 68d3cdffcd36afa834e0f7a1 INFO: 172.20.0.1:36470 - "POST /node/68d3cdffcd36afa834e0f7a1 HTTP/1.0" 202 Accepted 2025-09-26 10:55:00,304 - lava_callback - INFO - Starting async job submit for node 68d3cdffcd36afa834e0f7a1 2025-09-26 10:55:00,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:00,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cdffcd36afa834e0f7a1 HTTP/1.1" 200 None 2025-09-26 10:55:00,320 - lava_callback - DEBUG - Processing node 68d3cdffcd36afa834e0f7a1: baseline-arm 2025-09-26 10:55:00,320 - lava_callback - ERROR - Error processing callback for node 68d3cdffcd36afa834e0f7a1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:36472 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:55:08,177 - lava_callback - INFO - Received callback for node 68d66f592f83206171a90b46 INFO: 172.20.0.1:36486 - "POST /node/68d66f592f83206171a90b46 HTTP/1.0" 202 Accepted 2025-09-26 10:55:08,183 - lava_callback - INFO - Starting async job submit for node 68d66f592f83206171a90b46 2025-09-26 10:55:08,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:08,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f592f83206171a90b46 HTTP/1.1" 200 None 2025-09-26 10:55:08,215 - lava_callback - DEBUG - Processing node 68d66f592f83206171a90b46: baseline-arm 2025-09-26 10:55:08,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:55:09,185 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:55:09,186 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f592f83206171a90b46/log.txt.gz 2025-09-26 10:55:09,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:55:09,534 - lava_callback - INFO - Received callback for node 68d3cdfccd36afa834e0f795 INFO: 172.20.0.1:46986 - "POST /node/68d3cdfccd36afa834e0f795 HTTP/1.0" 202 Accepted 2025-09-26 10:55:09,540 - lava_callback - INFO - Starting async job submit for node 68d3cdfccd36afa834e0f795 2025-09-26 10:55:09,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:09,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cdfccd36afa834e0f795 HTTP/1.1" 200 None 2025-09-26 10:55:09,555 - lava_callback - DEBUG - Processing node 68d3cdfccd36afa834e0f795: ltp-syscalls-ipc 2025-09-26 10:55:09,555 - lava_callback - ERROR - Error processing callback for node 68d3cdfccd36afa834e0f795: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:55:11,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:55:11,469 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f592f83206171a90b46/lava_callback.json.gz 2025-09-26 10:55:11,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:11,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f592f83206171a90b46 HTTP/1.1" 200 None 2025-09-26 10:55:11,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:11,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:55:11,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:11,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f592f83206171a90b46 HTTP/1.1" 200 None 2025-09-26 10:55:11,546 - lava_callback - INFO - Completed processing callback for node 68d66f592f83206171a90b46 INFO: 172.20.0.1:46992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46998 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:55:17,259 - lava_callback - INFO - Received callback for node 68d3ce01cd36afa834e0f7a4 INFO: 172.20.0.1:47010 - "POST /node/68d3ce01cd36afa834e0f7a4 HTTP/1.0" 202 Accepted 2025-09-26 10:55:17,265 - lava_callback - INFO - Starting async job submit for node 68d3ce01cd36afa834e0f7a4 2025-09-26 10:55:17,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:17,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce01cd36afa834e0f7a4 HTTP/1.1" 200 None 2025-09-26 10:55:17,280 - lava_callback - DEBUG - Processing node 68d3ce01cd36afa834e0f7a4: baseline-arm 2025-09-26 10:55:17,280 - lava_callback - ERROR - Error processing callback for node 68d3ce01cd36afa834e0f7a4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:55:18,023 - lava_callback - INFO - Received callback for node 68d3ce02cd36afa834e0f7a7 INFO: 172.20.0.1:47016 - "POST /node/68d3ce02cd36afa834e0f7a7 HTTP/1.0" 202 Accepted 2025-09-26 10:55:18,028 - lava_callback - INFO - Starting async job submit for node 68d3ce02cd36afa834e0f7a7 2025-09-26 10:55:18,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:18,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce02cd36afa834e0f7a7 HTTP/1.1" 200 None 2025-09-26 10:55:18,043 - lava_callback - DEBUG - Processing node 68d3ce02cd36afa834e0f7a7: baseline-arm 2025-09-26 10:55:18,043 - lava_callback - ERROR - Error processing callback for node 68d3ce02cd36afa834e0f7a7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:55:18,742 - lava_callback - INFO - Received callback for node 68d3ce03cd36afa834e0f7aa INFO: 172.20.0.1:47032 - "POST /node/68d3ce03cd36afa834e0f7aa HTTP/1.0" 202 Accepted 2025-09-26 10:55:18,750 - lava_callback - INFO - Starting async job submit for node 68d3ce03cd36afa834e0f7aa 2025-09-26 10:55:18,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:18,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce03cd36afa834e0f7aa HTTP/1.1" 200 None 2025-09-26 10:55:18,765 - lava_callback - DEBUG - Processing node 68d3ce03cd36afa834e0f7aa: baseline-arm 2025-09-26 10:55:18,765 - lava_callback - ERROR - Error processing callback for node 68d3ce03cd36afa834e0f7aa: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:47038 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:55:19,459 - lava_callback - INFO - Received callback for node 68d3ce04cd36afa834e0f7ad INFO: 172.20.0.1:35042 - "POST /node/68d3ce04cd36afa834e0f7ad HTTP/1.0" 202 Accepted 2025-09-26 10:55:19,464 - lava_callback - INFO - Starting async job submit for node 68d3ce04cd36afa834e0f7ad 2025-09-26 10:55:19,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:19,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce04cd36afa834e0f7ad HTTP/1.1" 200 None 2025-09-26 10:55:19,479 - lava_callback - DEBUG - Processing node 68d3ce04cd36afa834e0f7ad: baseline-arm 2025-09-26 10:55:19,479 - lava_callback - ERROR - Error processing callback for node 68d3ce04cd36afa834e0f7ad: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:35054 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:55:20,202 - lava_callback - INFO - Received callback for node 68d3ce09cd36afa834e0f7b3 INFO: 172.20.0.1:35066 - "POST /node/68d3ce09cd36afa834e0f7b3 HTTP/1.0" 202 Accepted 2025-09-26 10:55:20,211 - lava_callback - INFO - Starting async job submit for node 68d3ce09cd36afa834e0f7b3 2025-09-26 10:55:20,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:20,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce09cd36afa834e0f7b3 HTTP/1.1" 200 None 2025-09-26 10:55:20,225 - lava_callback - DEBUG - Processing node 68d3ce09cd36afa834e0f7b3: baseline-arm 2025-09-26 10:55:20,225 - lava_callback - ERROR - Error processing callback for node 68d3ce09cd36afa834e0f7b3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:55:20,902 - lava_callback - INFO - Received callback for node 68d3ce0acd36afa834e0f7b6 INFO: 172.20.0.1:35076 - "POST /node/68d3ce0acd36afa834e0f7b6 HTTP/1.0" 202 Accepted 2025-09-26 10:55:20,907 - lava_callback - INFO - Starting async job submit for node 68d3ce0acd36afa834e0f7b6 2025-09-26 10:55:20,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:20,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce0acd36afa834e0f7b6 HTTP/1.1" 200 None 2025-09-26 10:55:20,925 - lava_callback - DEBUG - Processing node 68d3ce0acd36afa834e0f7b6: baseline-arm 2025-09-26 10:55:20,925 - lava_callback - ERROR - Error processing callback for node 68d3ce0acd36afa834e0f7b6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:55:21,625 - lava_callback - INFO - Received callback for node 68d3ce0ccd36afa834e0f7b9 INFO: 172.20.0.1:35080 - "POST /node/68d3ce0ccd36afa834e0f7b9 HTTP/1.0" 202 Accepted 2025-09-26 10:55:21,633 - lava_callback - INFO - Starting async job submit for node 68d3ce0ccd36afa834e0f7b9 2025-09-26 10:55:21,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:21,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce0ccd36afa834e0f7b9 HTTP/1.1" 200 None 2025-09-26 10:55:21,650 - lava_callback - DEBUG - Processing node 68d3ce0ccd36afa834e0f7b9: baseline-arm 2025-09-26 10:55:21,650 - lava_callback - ERROR - Error processing callback for node 68d3ce0ccd36afa834e0f7b9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:55:22,351 - lava_callback - INFO - Received callback for node 68d3ce0dcd36afa834e0f7bc INFO: 172.20.0.1:35094 - "POST /node/68d3ce0dcd36afa834e0f7bc HTTP/1.0" 202 Accepted 2025-09-26 10:55:22,357 - lava_callback - INFO - Starting async job submit for node 68d3ce0dcd36afa834e0f7bc 2025-09-26 10:55:22,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:22,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce0dcd36afa834e0f7bc HTTP/1.1" 200 None 2025-09-26 10:55:22,373 - lava_callback - DEBUG - Processing node 68d3ce0dcd36afa834e0f7bc: baseline-arm 2025-09-26 10:55:22,373 - lava_callback - ERROR - Error processing callback for node 68d3ce0dcd36afa834e0f7bc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:55:23,063 - lava_callback - INFO - Received callback for node 68d3ce0fcd36afa834e0f7bf INFO: 172.20.0.1:35096 - "POST /node/68d3ce0fcd36afa834e0f7bf HTTP/1.0" 202 Accepted 2025-09-26 10:55:23,069 - lava_callback - INFO - Starting async job submit for node 68d3ce0fcd36afa834e0f7bf 2025-09-26 10:55:23,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:23,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce0fcd36afa834e0f7bf HTTP/1.1" 200 None 2025-09-26 10:55:23,082 - lava_callback - DEBUG - Processing node 68d3ce0fcd36afa834e0f7bf: baseline-arm 2025-09-26 10:55:23,082 - lava_callback - ERROR - Error processing callback for node 68d3ce0fcd36afa834e0f7bf: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:55:23,811 - lava_callback - INFO - Received callback for node 68d3ce10cd36afa834e0f7c2 INFO: 172.20.0.1:35112 - "POST /node/68d3ce10cd36afa834e0f7c2 HTTP/1.0" 202 Accepted 2025-09-26 10:55:23,817 - lava_callback - INFO - Starting async job submit for node 68d3ce10cd36afa834e0f7c2 2025-09-26 10:55:23,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:23,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce10cd36afa834e0f7c2 HTTP/1.1" 200 None 2025-09-26 10:55:23,834 - lava_callback - DEBUG - Processing node 68d3ce10cd36afa834e0f7c2: baseline-arm 2025-09-26 10:55:23,834 - lava_callback - ERROR - Error processing callback for node 68d3ce10cd36afa834e0f7c2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:55:24,571 - lava_callback - INFO - Received callback for node 68d3ce11cd36afa834e0f7c5 INFO: 172.20.0.1:35116 - "POST /node/68d3ce11cd36afa834e0f7c5 HTTP/1.0" 202 Accepted 2025-09-26 10:55:24,576 - lava_callback - INFO - Starting async job submit for node 68d3ce11cd36afa834e0f7c5 2025-09-26 10:55:24,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:24,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce11cd36afa834e0f7c5 HTTP/1.1" 200 None 2025-09-26 10:55:24,593 - lava_callback - DEBUG - Processing node 68d3ce11cd36afa834e0f7c5: baseline-arm 2025-09-26 10:55:24,593 - lava_callback - ERROR - Error processing callback for node 68d3ce11cd36afa834e0f7c5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:55:25,293 - lava_callback - INFO - Received callback for node 68d3ce12cd36afa834e0f7c8 INFO: 172.20.0.1:35122 - "POST /node/68d3ce12cd36afa834e0f7c8 HTTP/1.0" 202 Accepted 2025-09-26 10:55:25,311 - lava_callback - INFO - Starting async job submit for node 68d3ce12cd36afa834e0f7c8 2025-09-26 10:55:25,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:25,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce12cd36afa834e0f7c8 HTTP/1.1" 200 None 2025-09-26 10:55:25,349 - lava_callback - DEBUG - Processing node 68d3ce12cd36afa834e0f7c8: baseline-arm 2025-09-26 10:55:25,349 - lava_callback - ERROR - Error processing callback for node 68d3ce12cd36afa834e0f7c8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:35124 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:55:28,357 - lava_callback - INFO - Received callback for node 68d66baf2f83206171a9044b INFO: 172.20.0.1:35132 - "POST /node/68d66baf2f83206171a9044b HTTP/1.0" 202 Accepted 2025-09-26 10:55:28,364 - lava_callback - INFO - Starting async job submit for node 68d66baf2f83206171a9044b 2025-09-26 10:55:28,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:28,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66baf2f83206171a9044b HTTP/1.1" 200 None 2025-09-26 10:55:28,400 - lava_callback - DEBUG - Processing node 68d66baf2f83206171a9044b: blktests-ddp-x86 2025-09-26 10:55:29,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:55:29,269 - lava_callback - INFO - Received callback for node 68d66e422f83206171a908b7 INFO: 172.20.0.1:35142 - "POST /node/68d66e422f83206171a908b7 HTTP/1.0" 202 Accepted 2025-09-26 10:55:29,275 - lava_callback - INFO - Starting async job submit for node 68d66e422f83206171a908b7 2025-09-26 10:55:29,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:29,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e422f83206171a908b7 HTTP/1.1" 200 None 2025-09-26 10:55:29,310 - lava_callback - DEBUG - Processing node 68d66e422f83206171a908b7: baseline-arm64 2025-09-26 10:55:29,584 - lava_callback - INFO - Received callback for node 68d3ce18cd36afa834e0f7ce INFO: 172.20.0.1:48538 - "POST /node/68d3ce18cd36afa834e0f7ce HTTP/1.0" 202 Accepted 2025-09-26 10:55:29,609 - lava_callback - INFO - Starting async job submit for node 68d3ce18cd36afa834e0f7ce 2025-09-26 10:55:29,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:29,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce18cd36afa834e0f7ce HTTP/1.1" 200 None 2025-09-26 10:55:29,693 - lava_callback - DEBUG - Processing node 68d3ce18cd36afa834e0f7ce: ltp-timers 2025-09-26 10:55:29,693 - lava_callback - ERROR - Error processing callback for node 68d3ce18cd36afa834e0f7ce: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:55:29,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:55:30,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:55:30,385 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e422f83206171a908b7/log.txt.gz 2025-09-26 10:55:30,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:55:30,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:55:30,414 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/blktests-ddp-x86-68d66baf2f83206171a9044b/log.txt.gz 2025-09-26 10:55:30,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:55:32,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:55:32,691 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/blktests-ddp-x86-68d66baf2f83206171a9044b/lava_callback.json.gz 2025-09-26 10:55:32,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:55:32,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:32,742 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e422f83206171a908b7/lava_callback.json.gz 2025-09-26 10:55:32,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:32,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66baf2f83206171a9044b HTTP/1.1" 200 None 2025-09-26 10:55:32,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e422f83206171a908b7 HTTP/1.1" 200 None 2025-09-26 10:55:32,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:32,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:32,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56829b70fb2a1e20f281e HTTP/1.1" 200 None 2025-09-26 10:55:32,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:32,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:55:32,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:32,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66baf2f83206171a9044b HTTP/1.1" 200 None 2025-09-26 10:55:32,840 - lava_callback - INFO - Completed processing callback for node 68d66baf2f83206171a9044b 2025-09-26 10:55:32,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e422f83206171a908b7 HTTP/1.1" 200 None 2025-09-26 10:55:32,847 - lava_callback - INFO - Completed processing callback for node 68d66e422f83206171a908b7 2025-09-26 10:55:34,081 - lava_callback - INFO - Received callback for node 68d3ccc1cd36afa834e0f54a INFO: 172.20.0.1:48546 - "POST /node/68d3ccc1cd36afa834e0f54a HTTP/1.0" 202 Accepted 2025-09-26 10:55:34,088 - lava_callback - INFO - Starting async job submit for node 68d3ccc1cd36afa834e0f54a 2025-09-26 10:55:34,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:34,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ccc1cd36afa834e0f54a HTTP/1.1" 200 None 2025-09-26 10:55:34,157 - lava_callback - DEBUG - Processing node 68d3ccc1cd36afa834e0f54a: ltp-watchqueue 2025-09-26 10:55:34,595 - lava_callback - ERROR - Error processing callback for node 68d3ccc1cd36afa834e0f54a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:48554 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:55:36,739 - lava_callback - INFO - Received callback for node 68d66e442f83206171a908be INFO: 172.20.0.1:48570 - "POST /node/68d66e442f83206171a908be HTTP/1.0" 202 Accepted 2025-09-26 10:55:36,746 - lava_callback - INFO - Starting async job submit for node 68d66e442f83206171a908be 2025-09-26 10:55:36,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:36,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e442f83206171a908be HTTP/1.1" 200 None 2025-09-26 10:55:36,798 - lava_callback - DEBUG - Processing node 68d66e442f83206171a908be: baseline-arm64 2025-09-26 10:55:37,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:55:37,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:55:37,316 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e442f83206171a908be/log.txt.gz 2025-09-26 10:55:37,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:55:37,475 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:55:37,476 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e442f83206171a908be/lava_callback.json.gz 2025-09-26 10:55:37,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:37,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e442f83206171a908be HTTP/1.1" 200 None 2025-09-26 10:55:37,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:37,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:55:37,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:37,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e442f83206171a908be HTTP/1.1" 200 None 2025-09-26 10:55:37,553 - lava_callback - INFO - Completed processing callback for node 68d66e442f83206171a908be 2025-09-26 10:55:42,976 - lava_callback - INFO - Received callback for node 68d40a35cd36afa834e16f03 INFO: 172.20.0.1:57310 - "POST /node/68d40a35cd36afa834e16f03 HTTP/1.0" 202 Accepted 2025-09-26 10:55:42,982 - lava_callback - INFO - Starting async job submit for node 68d40a35cd36afa834e16f03 2025-09-26 10:55:43,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:43,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a35cd36afa834e16f03 HTTP/1.1" 200 None 2025-09-26 10:55:43,021 - lava_callback - DEBUG - Processing node 68d40a35cd36afa834e16f03: baseline-arm 2025-09-26 10:55:43,264 - lava_callback - ERROR - Error processing callback for node 68d40a35cd36afa834e16f03: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:57324 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:55:56,136 - lava_callback - INFO - Received callback for node 68d3ce38cd36afa834e0f81c INFO: 172.20.0.1:55038 - "POST /node/68d3ce38cd36afa834e0f81c HTTP/1.0" 202 Accepted 2025-09-26 10:55:56,141 - lava_callback - INFO - Starting async job submit for node 68d3ce38cd36afa834e0f81c 2025-09-26 10:55:56,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:56,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce38cd36afa834e0f81c HTTP/1.1" 200 None 2025-09-26 10:55:56,156 - lava_callback - DEBUG - Processing node 68d3ce38cd36afa834e0f81c: baseline-arm 2025-09-26 10:55:56,156 - lava_callback - ERROR - Error processing callback for node 68d3ce38cd36afa834e0f81c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:55052 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:55:56,850 - lava_callback - INFO - Received callback for node 68d3ce38cd36afa834e0f81f INFO: 172.20.0.1:55068 - "POST /node/68d3ce38cd36afa834e0f81f HTTP/1.0" 202 Accepted 2025-09-26 10:55:56,855 - lava_callback - INFO - Starting async job submit for node 68d3ce38cd36afa834e0f81f 2025-09-26 10:55:56,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:55:56,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce38cd36afa834e0f81f HTTP/1.1" 200 None 2025-09-26 10:55:56,868 - lava_callback - DEBUG - Processing node 68d3ce38cd36afa834e0f81f: baseline-arm 2025-09-26 10:55:56,868 - lava_callback - ERROR - Error processing callback for node 68d3ce38cd36afa834e0f81f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:56:04,373 - lava_callback - INFO - Received callback for node 68d66f592f83206171a90b49 INFO: 172.20.0.1:54444 - "POST /node/68d66f592f83206171a90b49 HTTP/1.0" 202 Accepted 2025-09-26 10:56:04,379 - lava_callback - INFO - Starting async job submit for node 68d66f592f83206171a90b49 2025-09-26 10:56:04,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:56:04,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f592f83206171a90b49 HTTP/1.1" 200 None 2025-09-26 10:56:04,419 - lava_callback - DEBUG - Processing node 68d66f592f83206171a90b49: baseline-arm 2025-09-26 10:56:04,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:56:05,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:56:05,426 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f592f83206171a90b49/log.txt.gz 2025-09-26 10:56:05,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:54456 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:56:07,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:56:07,786 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f592f83206171a90b49/lava_callback.json.gz 2025-09-26 10:56:07,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:56:07,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f592f83206171a90b49 HTTP/1.1" 200 None 2025-09-26 10:56:07,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:56:07,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:56:07,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:56:07,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f592f83206171a90b49 HTTP/1.1" 200 None 2025-09-26 10:56:07,865 - lava_callback - INFO - Completed processing callback for node 68d66f592f83206171a90b49 2025-09-26 10:56:09,533 - lava_callback - INFO - Received callback for node 68d3ce34cd36afa834e0f815 INFO: 172.20.0.1:33474 - "POST /node/68d3ce34cd36afa834e0f815 HTTP/1.0" 202 Accepted 2025-09-26 10:56:09,539 - lava_callback - INFO - Starting async job submit for node 68d3ce34cd36afa834e0f815 2025-09-26 10:56:09,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:56:09,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce34cd36afa834e0f815 HTTP/1.1" 200 None 2025-09-26 10:56:09,555 - lava_callback - DEBUG - Processing node 68d3ce34cd36afa834e0f815: baseline-arm-broonie 2025-09-26 10:56:09,555 - lava_callback - ERROR - Error processing callback for node 68d3ce34cd36afa834e0f815: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:56:14,882 - lava_callback - INFO - Received callback for node 68d3ce3ecd36afa834e0f825 INFO: 172.20.0.1:33488 - "POST /node/68d3ce3ecd36afa834e0f825 HTTP/1.0" 202 Accepted 2025-09-26 10:56:14,888 - lava_callback - INFO - Starting async job submit for node 68d3ce3ecd36afa834e0f825 2025-09-26 10:56:14,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:56:14,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce3ecd36afa834e0f825 HTTP/1.1" 200 None 2025-09-26 10:56:14,901 - lava_callback - DEBUG - Processing node 68d3ce3ecd36afa834e0f825: baseline-arm 2025-09-26 10:56:14,901 - lava_callback - ERROR - Error processing callback for node 68d3ce3ecd36afa834e0f825: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:33498 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 10:56:15,582 - lava_callback - INFO - Received callback for node 68d3ce3fcd36afa834e0f828 INFO: 172.20.0.1:33508 - "POST /node/68d3ce3fcd36afa834e0f828 HTTP/1.0" 202 Accepted 2025-09-26 10:56:15,591 - lava_callback - INFO - Starting async job submit for node 68d3ce3fcd36afa834e0f828 2025-09-26 10:56:15,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:56:15,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce3fcd36afa834e0f828 HTTP/1.1" 200 None 2025-09-26 10:56:15,607 - lava_callback - DEBUG - Processing node 68d3ce3fcd36afa834e0f828: baseline-arm 2025-09-26 10:56:15,607 - lava_callback - ERROR - Error processing callback for node 68d3ce3fcd36afa834e0f828: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:56:16,269 - lava_callback - INFO - Received callback for node 68d3ce4bcd36afa834e0f834 INFO: 172.20.0.1:33524 - "POST /node/68d3ce4bcd36afa834e0f834 HTTP/1.0" 202 Accepted 2025-09-26 10:56:16,277 - lava_callback - INFO - Starting async job submit for node 68d3ce4bcd36afa834e0f834 2025-09-26 10:56:16,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:56:16,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce4bcd36afa834e0f834 HTTP/1.1" 200 None 2025-09-26 10:56:16,291 - lava_callback - DEBUG - Processing node 68d3ce4bcd36afa834e0f834: baseline-arm 2025-09-26 10:56:16,291 - lava_callback - ERROR - Error processing callback for node 68d3ce4bcd36afa834e0f834: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:33534 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:56:16,953 - lava_callback - INFO - Received callback for node 68d3ce4ccd36afa834e0f837 INFO: 172.20.0.1:33540 - "POST /node/68d3ce4ccd36afa834e0f837 HTTP/1.0" 202 Accepted 2025-09-26 10:56:16,958 - lava_callback - INFO - Starting async job submit for node 68d3ce4ccd36afa834e0f837 2025-09-26 10:56:16,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:56:16,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce4ccd36afa834e0f837 HTTP/1.1" 200 None 2025-09-26 10:56:16,977 - lava_callback - DEBUG - Processing node 68d3ce4ccd36afa834e0f837: baseline-arm 2025-09-26 10:56:16,977 - lava_callback - ERROR - Error processing callback for node 68d3ce4ccd36afa834e0f837: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:33544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34380 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:56:29,612 - lava_callback - INFO - Received callback for node 68d3ce54cd36afa834e0f848 INFO: 172.20.0.1:47088 - "POST /node/68d3ce54cd36afa834e0f848 HTTP/1.0" 202 Accepted 2025-09-26 10:56:29,620 - lava_callback - INFO - Starting async job submit for node 68d3ce54cd36afa834e0f848 2025-09-26 10:56:29,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:56:29,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce54cd36afa834e0f848 HTTP/1.1" 200 None 2025-09-26 10:56:29,641 - lava_callback - DEBUG - Processing node 68d3ce54cd36afa834e0f848: baseline-arm-broonie 2025-09-26 10:56:29,641 - lava_callback - ERROR - Error processing callback for node 68d3ce54cd36afa834e0f848: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:56:34,720 - lava_callback - INFO - Received callback for node 68d3ce4dcd36afa834e0f83b INFO: 172.20.0.1:47096 - "POST /node/68d3ce4dcd36afa834e0f83b HTTP/1.0" 202 Accepted 2025-09-26 10:56:34,729 - lava_callback - INFO - Starting async job submit for node 68d3ce4dcd36afa834e0f83b 2025-09-26 10:56:34,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:56:34,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce4dcd36afa834e0f83b HTTP/1.1" 200 None 2025-09-26 10:56:34,745 - lava_callback - DEBUG - Processing node 68d3ce4dcd36afa834e0f83b: baseline-arm 2025-09-26 10:56:34,745 - lava_callback - ERROR - Error processing callback for node 68d3ce4dcd36afa834e0f83b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:56:35,403 - lava_callback - INFO - Received callback for node 68d3ce50cd36afa834e0f842 INFO: 172.20.0.1:47112 - "POST /node/68d3ce50cd36afa834e0f842 HTTP/1.0" 202 Accepted 2025-09-26 10:56:35,409 - lava_callback - INFO - Starting async job submit for node 68d3ce50cd36afa834e0f842 2025-09-26 10:56:35,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:56:35,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce50cd36afa834e0f842 HTTP/1.1" 200 None 2025-09-26 10:56:35,422 - lava_callback - DEBUG - Processing node 68d3ce50cd36afa834e0f842: baseline-arm 2025-09-26 10:56:35,423 - lava_callback - ERROR - Error processing callback for node 68d3ce50cd36afa834e0f842: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:47118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45212 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:56:55,395 - lava_callback - INFO - Received callback for node 68d3ce71cd36afa834e0f898 INFO: 172.20.0.1:56906 - "POST /node/68d3ce71cd36afa834e0f898 HTTP/1.0" 202 Accepted 2025-09-26 10:56:55,401 - lava_callback - INFO - Starting async job submit for node 68d3ce71cd36afa834e0f898 2025-09-26 10:56:55,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:56:55,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce71cd36afa834e0f898 HTTP/1.1" 200 None 2025-09-26 10:56:55,425 - lava_callback - DEBUG - Processing node 68d3ce71cd36afa834e0f898: baseline-arm 2025-09-26 10:56:55,425 - lava_callback - ERROR - Error processing callback for node 68d3ce71cd36afa834e0f898: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:56916 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:56:59,041 - lava_callback - INFO - Received callback for node 68d66f2c2f83206171a90acb INFO: 172.20.0.1:56918 - "POST /node/68d66f2c2f83206171a90acb HTTP/1.0" 202 Accepted 2025-09-26 10:56:59,047 - lava_callback - INFO - Starting async job submit for node 68d66f2c2f83206171a90acb 2025-09-26 10:56:59,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:56:59,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f2c2f83206171a90acb HTTP/1.1" 200 None 2025-09-26 10:56:59,095 - lava_callback - DEBUG - Processing node 68d66f2c2f83206171a90acb: baseline-arm 2025-09-26 10:56:59,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:57:00,126 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:57:00,126 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f2c2f83206171a90acb/log.txt.gz 2025-09-26 10:57:00,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:57:02,435 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:57:02,436 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f2c2f83206171a90acb/lava_callback.json.gz 2025-09-26 10:57:02,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:02,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f2c2f83206171a90acb HTTP/1.1" 200 None 2025-09-26 10:57:02,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:02,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:57:02,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:02,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f2c2f83206171a90acb HTTP/1.1" 200 None 2025-09-26 10:57:02,535 - lava_callback - INFO - Completed processing callback for node 68d66f2c2f83206171a90acb INFO: 172.20.0.1:57732 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:57:07,494 - lava_callback - INFO - Received callback for node 68d66f5b2f83206171a90b50 INFO: 172.20.0.1:57748 - "POST /node/68d66f5b2f83206171a90b50 HTTP/1.0" 202 Accepted 2025-09-26 10:57:07,500 - lava_callback - INFO - Starting async job submit for node 68d66f5b2f83206171a90b50 2025-09-26 10:57:07,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:07,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f5b2f83206171a90b50 HTTP/1.1" 200 None 2025-09-26 10:57:07,531 - lava_callback - DEBUG - Processing node 68d66f5b2f83206171a90b50: baseline-arm 2025-09-26 10:57:07,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:57:09,478 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:57:09,478 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f5b2f83206171a90b50/log.txt.gz 2025-09-26 10:57:09,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:57:11,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:57:11,788 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f5b2f83206171a90b50/lava_callback.json.gz 2025-09-26 10:57:11,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:11,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f5b2f83206171a90b50 HTTP/1.1" 200 None 2025-09-26 10:57:11,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:11,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:57:11,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:11,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f5b2f83206171a90b50 HTTP/1.1" 200 None 2025-09-26 10:57:11,897 - lava_callback - INFO - Completed processing callback for node 68d66f5b2f83206171a90b50 2025-09-26 10:57:14,939 - lava_callback - INFO - Received callback for node 68d3ce74cd36afa834e0f89b INFO: 172.20.0.1:40356 - "POST /node/68d3ce74cd36afa834e0f89b HTTP/1.0" 202 Accepted 2025-09-26 10:57:14,945 - lava_callback - INFO - Starting async job submit for node 68d3ce74cd36afa834e0f89b 2025-09-26 10:57:14,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:14,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce74cd36afa834e0f89b HTTP/1.1" 200 None 2025-09-26 10:57:14,959 - lava_callback - DEBUG - Processing node 68d3ce74cd36afa834e0f89b: baseline-arm 2025-09-26 10:57:14,959 - lava_callback - ERROR - Error processing callback for node 68d3ce74cd36afa834e0f89b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:40368 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 10:57:15,635 - lava_callback - INFO - Received callback for node 68d3ce78cd36afa834e0f89e INFO: 172.20.0.1:40384 - "POST /node/68d3ce78cd36afa834e0f89e HTTP/1.0" 202 Accepted 2025-09-26 10:57:15,644 - lava_callback - INFO - Starting async job submit for node 68d3ce78cd36afa834e0f89e 2025-09-26 10:57:15,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:15,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce78cd36afa834e0f89e HTTP/1.1" 200 None 2025-09-26 10:57:15,661 - lava_callback - DEBUG - Processing node 68d3ce78cd36afa834e0f89e: baseline-arm 2025-09-26 10:57:15,661 - lava_callback - ERROR - Error processing callback for node 68d3ce78cd36afa834e0f89e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:57:16,342 - lava_callback - INFO - Received callback for node 68d3ce79cd36afa834e0f8a1 INFO: 172.20.0.1:40396 - "POST /node/68d3ce79cd36afa834e0f8a1 HTTP/1.0" 202 Accepted 2025-09-26 10:57:16,351 - lava_callback - INFO - Starting async job submit for node 68d3ce79cd36afa834e0f8a1 2025-09-26 10:57:16,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:16,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce79cd36afa834e0f8a1 HTTP/1.1" 200 None 2025-09-26 10:57:16,366 - lava_callback - DEBUG - Processing node 68d3ce79cd36afa834e0f8a1: baseline-arm 2025-09-26 10:57:16,366 - lava_callback - ERROR - Error processing callback for node 68d3ce79cd36afa834e0f8a1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:40408 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:57:17,052 - lava_callback - INFO - Received callback for node 68d3ce7ecd36afa834e0f8aa INFO: 172.20.0.1:40412 - "POST /node/68d3ce7ecd36afa834e0f8aa HTTP/1.0" 202 Accepted 2025-09-26 10:57:17,060 - lava_callback - INFO - Starting async job submit for node 68d3ce7ecd36afa834e0f8aa 2025-09-26 10:57:17,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:17,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce7ecd36afa834e0f8aa HTTP/1.1" 200 None 2025-09-26 10:57:17,077 - lava_callback - DEBUG - Processing node 68d3ce7ecd36afa834e0f8aa: baseline-arm 2025-09-26 10:57:17,077 - lava_callback - ERROR - Error processing callback for node 68d3ce7ecd36afa834e0f8aa: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:57:17,768 - lava_callback - INFO - Received callback for node 68d3ce7fcd36afa834e0f8ad INFO: 172.20.0.1:40428 - "POST /node/68d3ce7fcd36afa834e0f8ad HTTP/1.0" 202 Accepted 2025-09-26 10:57:17,774 - lava_callback - INFO - Starting async job submit for node 68d3ce7fcd36afa834e0f8ad 2025-09-26 10:57:17,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:17,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce7fcd36afa834e0f8ad HTTP/1.1" 200 None 2025-09-26 10:57:17,788 - lava_callback - DEBUG - Processing node 68d3ce7fcd36afa834e0f8ad: baseline-arm 2025-09-26 10:57:17,788 - lava_callback - ERROR - Error processing callback for node 68d3ce7fcd36afa834e0f8ad: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:57:18,463 - lava_callback - INFO - Received callback for node 68d3ce81cd36afa834e0f8b0 INFO: 172.20.0.1:40436 - "POST /node/68d3ce81cd36afa834e0f8b0 HTTP/1.0" 202 Accepted 2025-09-26 10:57:18,469 - lava_callback - INFO - Starting async job submit for node 68d3ce81cd36afa834e0f8b0 2025-09-26 10:57:18,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:18,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce81cd36afa834e0f8b0 HTTP/1.1" 200 None 2025-09-26 10:57:18,482 - lava_callback - DEBUG - Processing node 68d3ce81cd36afa834e0f8b0: baseline-arm 2025-09-26 10:57:18,482 - lava_callback - ERROR - Error processing callback for node 68d3ce81cd36afa834e0f8b0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:57:19,170 - lava_callback - INFO - Received callback for node 68d3ce81cd36afa834e0f8b3 INFO: 172.20.0.1:40444 - "POST /node/68d3ce81cd36afa834e0f8b3 HTTP/1.0" 202 Accepted 2025-09-26 10:57:19,176 - lava_callback - INFO - Starting async job submit for node 68d3ce81cd36afa834e0f8b3 2025-09-26 10:57:19,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:19,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce81cd36afa834e0f8b3 HTTP/1.1" 200 None 2025-09-26 10:57:19,201 - lava_callback - DEBUG - Processing node 68d3ce81cd36afa834e0f8b3: baseline-arm 2025-09-26 10:57:19,202 - lava_callback - ERROR - Error processing callback for node 68d3ce81cd36afa834e0f8b3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:37722 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:57:19,868 - lava_callback - INFO - Received callback for node 68d3ce89cd36afa834e0f8bd INFO: 172.20.0.1:37730 - "POST /node/68d3ce89cd36afa834e0f8bd HTTP/1.0" 202 Accepted 2025-09-26 10:57:19,877 - lava_callback - INFO - Starting async job submit for node 68d3ce89cd36afa834e0f8bd 2025-09-26 10:57:19,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:19,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce89cd36afa834e0f8bd HTTP/1.1" 200 None 2025-09-26 10:57:19,895 - lava_callback - DEBUG - Processing node 68d3ce89cd36afa834e0f8bd: baseline-arm 2025-09-26 10:57:19,895 - lava_callback - ERROR - Error processing callback for node 68d3ce89cd36afa834e0f8bd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:37734 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:57:20,611 - lava_callback - INFO - Received callback for node 68d3ce89cd36afa834e0f8c0 INFO: 172.20.0.1:37740 - "POST /node/68d3ce89cd36afa834e0f8c0 HTTP/1.0" 202 Accepted 2025-09-26 10:57:20,619 - lava_callback - INFO - Starting async job submit for node 68d3ce89cd36afa834e0f8c0 2025-09-26 10:57:20,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:20,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce89cd36afa834e0f8c0 HTTP/1.1" 200 None 2025-09-26 10:57:20,634 - lava_callback - DEBUG - Processing node 68d3ce89cd36afa834e0f8c0: baseline-arm 2025-09-26 10:57:20,634 - lava_callback - ERROR - Error processing callback for node 68d3ce89cd36afa834e0f8c0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:37754 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:57:35,133 - lava_callback - INFO - Received callback for node 68d3ce8fcd36afa834e0f8c9 INFO: 172.20.0.1:59192 - "POST /node/68d3ce8fcd36afa834e0f8c9 HTTP/1.0" 202 Accepted 2025-09-26 10:57:35,138 - lava_callback - INFO - Starting async job submit for node 68d3ce8fcd36afa834e0f8c9 2025-09-26 10:57:35,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:35,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce8fcd36afa834e0f8c9 HTTP/1.1" 200 None 2025-09-26 10:57:35,152 - lava_callback - DEBUG - Processing node 68d3ce8fcd36afa834e0f8c9: baseline-arm 2025-09-26 10:57:35,152 - lava_callback - ERROR - Error processing callback for node 68d3ce8fcd36afa834e0f8c9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:57:35,851 - lava_callback - INFO - Received callback for node 68d3ce90cd36afa834e0f8cc INFO: 172.20.0.1:59200 - "POST /node/68d3ce90cd36afa834e0f8cc HTTP/1.0" 202 Accepted 2025-09-26 10:57:35,857 - lava_callback - INFO - Starting async job submit for node 68d3ce90cd36afa834e0f8cc 2025-09-26 10:57:35,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:35,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce90cd36afa834e0f8cc HTTP/1.1" 200 None 2025-09-26 10:57:35,871 - lava_callback - DEBUG - Processing node 68d3ce90cd36afa834e0f8cc: baseline-arm 2025-09-26 10:57:35,872 - lava_callback - ERROR - Error processing callback for node 68d3ce90cd36afa834e0f8cc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:59210 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:57:36,572 - lava_callback - INFO - Received callback for node 68d3ce91cd36afa834e0f8cf INFO: 172.20.0.1:59218 - "POST /node/68d3ce91cd36afa834e0f8cf HTTP/1.0" 202 Accepted 2025-09-26 10:57:36,579 - lava_callback - INFO - Starting async job submit for node 68d3ce91cd36afa834e0f8cf 2025-09-26 10:57:36,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:36,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce91cd36afa834e0f8cf HTTP/1.1" 200 None 2025-09-26 10:57:36,599 - lava_callback - DEBUG - Processing node 68d3ce91cd36afa834e0f8cf: baseline-arm 2025-09-26 10:57:36,599 - lava_callback - ERROR - Error processing callback for node 68d3ce91cd36afa834e0f8cf: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:57:38,310 - lava_callback - INFO - Received callback for node 68d3ce92cd36afa834e0f8d2 INFO: 172.20.0.1:59232 - "POST /node/68d3ce92cd36afa834e0f8d2 HTTP/1.0" 202 Accepted 2025-09-26 10:57:38,315 - lava_callback - INFO - Starting async job submit for node 68d3ce92cd36afa834e0f8d2 2025-09-26 10:57:38,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:38,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce92cd36afa834e0f8d2 HTTP/1.1" 200 None 2025-09-26 10:57:38,330 - lava_callback - DEBUG - Processing node 68d3ce92cd36afa834e0f8d2: baseline-arm 2025-09-26 10:57:38,330 - lava_callback - ERROR - Error processing callback for node 68d3ce92cd36afa834e0f8d2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:57:39,029 - lava_callback - INFO - Received callback for node 68d3ce9dcd36afa834e0f8e9 INFO: 172.20.0.1:59242 - "POST /node/68d3ce9dcd36afa834e0f8e9 HTTP/1.0" 202 Accepted 2025-09-26 10:57:39,034 - lava_callback - INFO - Starting async job submit for node 68d3ce9dcd36afa834e0f8e9 2025-09-26 10:57:39,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:39,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce9dcd36afa834e0f8e9 HTTP/1.1" 200 None 2025-09-26 10:57:39,051 - lava_callback - DEBUG - Processing node 68d3ce9dcd36afa834e0f8e9: baseline-arm 2025-09-26 10:57:39,051 - lava_callback - ERROR - Error processing callback for node 68d3ce9dcd36afa834e0f8e9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:57:45,012 - lava_callback - INFO - Received callback for node 68d66e352f83206171a90893 INFO: 172.20.0.1:58800 - "POST /node/68d66e352f83206171a90893 HTTP/1.0" 202 Accepted 2025-09-26 10:57:45,019 - lava_callback - INFO - Starting async job submit for node 68d66e352f83206171a90893 2025-09-26 10:57:45,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:45,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e352f83206171a90893 HTTP/1.1" 200 None 2025-09-26 10:57:45,082 - lava_callback - DEBUG - Processing node 68d66e352f83206171a90893: baseline-arm64 2025-09-26 10:57:45,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:58808 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:57:48,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:57:48,087 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e352f83206171a90893/log.txt.gz 2025-09-26 10:57:48,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:57:50,398 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:57:50,398 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66e352f83206171a90893/lava_callback.json.gz DEBUG: 68d66e352f83206171a90893 Transitting job node result: pass -> incomplete 2025-09-26 10:57:50,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:50,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e352f83206171a90893 HTTP/1.1" 200 None 2025-09-26 10:57:50,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:50,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:57:50,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:50,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e352f83206171a90893 HTTP/1.1" 200 None 2025-09-26 10:57:50,489 - lava_callback - INFO - Completed processing callback for node 68d66e352f83206171a90893 2025-09-26 10:57:55,060 - lava_callback - INFO - Received callback for node 68d3ce9ecd36afa834e0f8ec INFO: 172.20.0.1:42444 - "POST /node/68d3ce9ecd36afa834e0f8ec HTTP/1.0" 202 Accepted 2025-09-26 10:57:55,066 - lava_callback - INFO - Starting async job submit for node 68d3ce9ecd36afa834e0f8ec 2025-09-26 10:57:55,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:55,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce9ecd36afa834e0f8ec HTTP/1.1" 200 None 2025-09-26 10:57:55,086 - lava_callback - DEBUG - Processing node 68d3ce9ecd36afa834e0f8ec: baseline-arm 2025-09-26 10:57:55,086 - lava_callback - ERROR - Error processing callback for node 68d3ce9ecd36afa834e0f8ec: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:57:55,812 - lava_callback - INFO - Received callback for node 68d3cea2cd36afa834e0f8f5 INFO: 172.20.0.1:42456 - "POST /node/68d3cea2cd36afa834e0f8f5 HTTP/1.0" 202 Accepted 2025-09-26 10:57:55,818 - lava_callback - INFO - Starting async job submit for node 68d3cea2cd36afa834e0f8f5 2025-09-26 10:57:55,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:55,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cea2cd36afa834e0f8f5 HTTP/1.1" 200 None 2025-09-26 10:57:55,833 - lava_callback - DEBUG - Processing node 68d3cea2cd36afa834e0f8f5: baseline-arm 2025-09-26 10:57:55,833 - lava_callback - ERROR - Error processing callback for node 68d3cea2cd36afa834e0f8f5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:42470 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:57:56,640 - lava_callback - INFO - Received callback for node 68d3cea4cd36afa834e0f8f8 INFO: 172.20.0.1:42484 - "POST /node/68d3cea4cd36afa834e0f8f8 HTTP/1.0" 202 Accepted 2025-09-26 10:57:56,646 - lava_callback - INFO - Starting async job submit for node 68d3cea4cd36afa834e0f8f8 2025-09-26 10:57:56,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:57:56,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cea4cd36afa834e0f8f8 HTTP/1.1" 200 None 2025-09-26 10:57:56,661 - lava_callback - DEBUG - Processing node 68d3cea4cd36afa834e0f8f8: baseline-arm 2025-09-26 10:57:56,661 - lava_callback - ERROR - Error processing callback for node 68d3cea4cd36afa834e0f8f8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 10:58:01,087 - lava_callback - INFO - Received callback for node 68d66f5f2f83206171a90b62 INFO: 172.20.0.1:41486 - "POST /node/68d66f5f2f83206171a90b62 HTTP/1.0" 202 Accepted 2025-09-26 10:58:01,092 - lava_callback - INFO - Starting async job submit for node 68d66f5f2f83206171a90b62 2025-09-26 10:58:01,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:58:01,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f5f2f83206171a90b62 HTTP/1.1" 200 None 2025-09-26 10:58:01,130 - lava_callback - DEBUG - Processing node 68d66f5f2f83206171a90b62: baseline-arm 2025-09-26 10:58:01,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:58:01,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:58:01,993 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f5f2f83206171a90b62/log.txt.gz 2025-09-26 10:58:02,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:58:04,291 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:58:04,292 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f5f2f83206171a90b62/lava_callback.json.gz 2025-09-26 10:58:04,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:58:04,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f5f2f83206171a90b62 HTTP/1.1" 200 None 2025-09-26 10:58:04,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:58:04,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:58:04,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:58:04,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f5f2f83206171a90b62 HTTP/1.1" 200 None 2025-09-26 10:58:04,384 - lava_callback - INFO - Completed processing callback for node 68d66f5f2f83206171a90b62 INFO: 172.20.0.1:41496 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:58:07,472 - lava_callback - INFO - Received callback for node 68d40a39cd36afa834e16f06 INFO: 172.20.0.1:41508 - "POST /node/68d40a39cd36afa834e16f06 HTTP/1.0" 202 Accepted 2025-09-26 10:58:07,478 - lava_callback - INFO - Starting async job submit for node 68d40a39cd36afa834e16f06 2025-09-26 10:58:07,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:58:07,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a39cd36afa834e16f06 HTTP/1.1" 200 None 2025-09-26 10:58:07,535 - lava_callback - DEBUG - Processing node 68d40a39cd36afa834e16f06: baseline-arm 2025-09-26 10:58:07,801 - lava_callback - ERROR - Error processing callback for node 68d40a39cd36afa834e16f06: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 10:58:08,065 - lava_callback - INFO - Received callback for node 68d66f5d2f83206171a90b5b INFO: 172.20.0.1:41512 - "POST /node/68d66f5d2f83206171a90b5b HTTP/1.0" 202 Accepted 2025-09-26 10:58:08,074 - lava_callback - INFO - Starting async job submit for node 68d66f5d2f83206171a90b5b 2025-09-26 10:58:08,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:58:08,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f5d2f83206171a90b5b HTTP/1.1" 200 None 2025-09-26 10:58:08,110 - lava_callback - DEBUG - Processing node 68d66f5d2f83206171a90b5b: baseline-arm 2025-09-26 10:58:08,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:58:08,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:58:08,656 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f5d2f83206171a90b5b/log.txt.gz 2025-09-26 10:58:08,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:58:08,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:58:08,784 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f5d2f83206171a90b5b/lava_callback.json.gz 2025-09-26 10:58:08,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:58:08,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f5d2f83206171a90b5b HTTP/1.1" 200 None 2025-09-26 10:58:08,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:58:08,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:58:08,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:58:08,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f5d2f83206171a90b5b HTTP/1.1" 200 None 2025-09-26 10:58:08,877 - lava_callback - INFO - Completed processing callback for node 68d66f5d2f83206171a90b5b 2025-09-26 10:58:09,707 - lava_callback - INFO - Received callback for node 68d3ceb7cd36afa834e0f92f INFO: 172.20.0.1:45066 - "POST /node/68d3ceb7cd36afa834e0f92f HTTP/1.0" 202 Accepted 2025-09-26 10:58:09,715 - lava_callback - INFO - Starting async job submit for node 68d3ceb7cd36afa834e0f92f 2025-09-26 10:58:09,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:58:09,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ceb7cd36afa834e0f92f HTTP/1.1" 200 None 2025-09-26 10:58:09,727 - lava_callback - DEBUG - Processing node 68d3ceb7cd36afa834e0f92f: ltp-timers 2025-09-26 10:58:09,727 - lava_callback - ERROR - Error processing callback for node 68d3ceb7cd36afa834e0f92f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:45068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34408 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:58:29,793 - lava_callback - INFO - Received callback for node 68d3cec7cd36afa834e0f946 INFO: 172.20.0.1:49640 - "POST /node/68d3cec7cd36afa834e0f946 HTTP/1.0" 202 Accepted 2025-09-26 10:58:29,802 - lava_callback - INFO - Starting async job submit for node 68d3cec7cd36afa834e0f946 2025-09-26 10:58:29,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:58:29,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cec7cd36afa834e0f946 HTTP/1.1" 200 None 2025-09-26 10:58:29,858 - lava_callback - DEBUG - Processing node 68d3cec7cd36afa834e0f946: ltp-watchqueue 2025-09-26 10:58:29,858 - lava_callback - ERROR - Error processing callback for node 68d3cec7cd36afa834e0f946: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:49654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52442 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:58:49,755 - lava_callback - INFO - Received callback for node 68d3cee3cd36afa834e0f97d INFO: 172.20.0.1:45148 - "POST /node/68d3cee3cd36afa834e0f97d HTTP/1.0" 202 Accepted 2025-09-26 10:58:49,760 - lava_callback - INFO - Starting async job submit for node 68d3cee3cd36afa834e0f97d 2025-09-26 10:58:49,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:58:49,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cee3cd36afa834e0f97d HTTP/1.1" 200 None 2025-09-26 10:58:49,774 - lava_callback - DEBUG - Processing node 68d3cee3cd36afa834e0f97d: ltp-watchqueue 2025-09-26 10:58:49,774 - lava_callback - ERROR - Error processing callback for node 68d3cee3cd36afa834e0f97d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:45152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38910 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:59:07,892 - lava_callback - INFO - Received callback for node 68d66f602f83206171a90b65 INFO: 172.20.0.1:38914 - "POST /node/68d66f602f83206171a90b65 HTTP/1.0" 202 Accepted 2025-09-26 10:59:07,901 - lava_callback - INFO - Starting async job submit for node 68d66f602f83206171a90b65 2025-09-26 10:59:07,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:59:07,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f602f83206171a90b65 HTTP/1.1" 200 None 2025-09-26 10:59:07,932 - lava_callback - DEBUG - Processing node 68d66f602f83206171a90b65: baseline-arm 2025-09-26 10:59:08,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:59:09,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:59:09,654 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f602f83206171a90b65/log.txt.gz 2025-09-26 10:59:09,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:59:11,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:59:11,920 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66f602f83206171a90b65/lava_callback.json.gz 2025-09-26 10:59:11,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:59:11,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66f602f83206171a90b65 HTTP/1.1" 200 None 2025-09-26 10:59:11,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:59:11,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c122be2da4660698f48 HTTP/1.1" 200 None 2025-09-26 10:59:11,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:59:12,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66f602f83206171a90b65 HTTP/1.1" 200 None 2025-09-26 10:59:12,005 - lava_callback - INFO - Completed processing callback for node 68d66f602f83206171a90b65 INFO: 172.20.0.1:44370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35692 - "GET / HTTP/1.0" 200 OK 2025-09-26 10:59:50,639 - lava_callback - INFO - Received callback for node 68d66d622f83206171a906d6 INFO: 172.20.0.1:41362 - "POST /node/68d66d622f83206171a906d6 HTTP/1.0" 202 Accepted 2025-09-26 10:59:50,647 - lava_callback - INFO - Starting async job submit for node 68d66d622f83206171a906d6 2025-09-26 10:59:50,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:59:50,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d622f83206171a906d6 HTTP/1.1" 200 None 2025-09-26 10:59:50,694 - lava_callback - DEBUG - Processing node 68d66d622f83206171a906d6: baseline-arm64 2025-09-26 10:59:51,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:59:51,264 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:59:51,264 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d622f83206171a906d6/log.txt.gz 2025-09-26 10:59:51,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 10:59:53,573 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 10:59:53,574 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d66d622f83206171a906d6/lava_callback.json.gz DEBUG: Setup failed for 68d66d622f83206171a906d6. Transitting job node result: incomplete -> fail 2025-09-26 10:59:53,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:59:53,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66d622f83206171a906d6 HTTP/1.1" 200 None 2025-09-26 10:59:53,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:59:53,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5680ab70fb2a1e20f2809 HTTP/1.1" 200 None 2025-09-26 10:59:53,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:59:53,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66d622f83206171a906d6 HTTP/1.1" 200 None 2025-09-26 10:59:53,704 - lava_callback - INFO - Completed processing callback for node 68d66d622f83206171a906d6 2025-09-26 10:59:54,280 - lava_callback - INFO - Received callback for node 68d3ce33cd36afa834e0f812 INFO: 172.20.0.1:41378 - "POST /node/68d3ce33cd36afa834e0f812 HTTP/1.0" 202 Accepted 2025-09-26 10:59:54,287 - lava_callback - INFO - Starting async job submit for node 68d3ce33cd36afa834e0f812 2025-09-26 10:59:54,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 10:59:54,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ce33cd36afa834e0f812 HTTP/1.1" 200 None 2025-09-26 10:59:54,350 - lava_callback - DEBUG - Processing node 68d3ce33cd36afa834e0f812: ltp-watchqueue 2025-09-26 10:59:54,772 - lava_callback - ERROR - Error processing callback for node 68d3ce33cd36afa834e0f812: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:41392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40820 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:00:10,055 - lava_callback - INFO - Received callback for node 68d3cf34cd36afa834e0fa30 INFO: 172.20.0.1:45806 - "POST /node/68d3cf34cd36afa834e0fa30 HTTP/1.0" 202 Accepted 2025-09-26 11:00:10,060 - lava_callback - INFO - Starting async job submit for node 68d3cf34cd36afa834e0fa30 2025-09-26 11:00:10,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:00:10,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cf34cd36afa834e0fa30 HTTP/1.1" 200 None 2025-09-26 11:00:10,074 - lava_callback - DEBUG - Processing node 68d3cf34cd36afa834e0fa30: baseline-arm-broonie 2025-09-26 11:00:10,074 - lava_callback - ERROR - Error processing callback for node 68d3cf34cd36afa834e0fa30: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:45822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53908 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:00:22,581 - lava_callback - INFO - Received callback for node 68d40a3bcd36afa834e16f09 INFO: 172.20.0.1:53914 - "POST /node/68d40a3bcd36afa834e16f09 HTTP/1.0" 202 Accepted 2025-09-26 11:00:22,587 - lava_callback - INFO - Starting async job submit for node 68d40a3bcd36afa834e16f09 2025-09-26 11:00:22,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:00:22,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a3bcd36afa834e16f09 HTTP/1.1" 200 None 2025-09-26 11:00:22,640 - lava_callback - DEBUG - Processing node 68d40a3bcd36afa834e16f09: baseline-arm 2025-09-26 11:00:22,861 - lava_callback - ERROR - Error processing callback for node 68d40a3bcd36afa834e16f09: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:53928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40838 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:00:49,801 - lava_callback - INFO - Received callback for node 68d3cf5acd36afa834e0fa58 INFO: 172.20.0.1:39062 - "POST /node/68d3cf5acd36afa834e0fa58 HTTP/1.0" 202 Accepted 2025-09-26 11:00:49,807 - lava_callback - INFO - Starting async job submit for node 68d3cf5acd36afa834e0fa58 2025-09-26 11:00:49,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:00:49,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cf5acd36afa834e0fa58 HTTP/1.1" 200 None 2025-09-26 11:00:49,822 - lava_callback - DEBUG - Processing node 68d3cf5acd36afa834e0fa58: baseline-arm-broonie 2025-09-26 11:00:49,822 - lava_callback - ERROR - Error processing callback for node 68d3cf5acd36afa834e0fa58: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:39064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47132 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:01:10,050 - lava_callback - INFO - Received callback for node 68d3cf65cd36afa834e0fa64 INFO: 172.20.0.1:59070 - "POST /node/68d3cf65cd36afa834e0fa64 HTTP/1.0" 202 Accepted 2025-09-26 11:01:10,056 - lava_callback - INFO - Starting async job submit for node 68d3cf65cd36afa834e0fa64 2025-09-26 11:01:10,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:01:10,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cf65cd36afa834e0fa64 HTTP/1.1" 200 None 2025-09-26 11:01:10,071 - lava_callback - DEBUG - Processing node 68d3cf65cd36afa834e0fa64: baseline-arm-broonie 2025-09-26 11:01:10,071 - lava_callback - ERROR - Error processing callback for node 68d3cf65cd36afa834e0fa64: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:59072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60582 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:01:48,535 - lava_callback - INFO - Received callback for node 68d3cd69cd36afa834e0f65b INFO: 172.20.0.1:60594 - "POST /node/68d3cd69cd36afa834e0f65b HTTP/1.0" 202 Accepted 2025-09-26 11:01:48,546 - lava_callback - INFO - Starting async job submit for node 68d3cd69cd36afa834e0f65b 2025-09-26 11:01:48,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:01:48,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cd69cd36afa834e0f65b HTTP/1.1" 200 None 2025-09-26 11:01:48,639 - lava_callback - DEBUG - Processing node 68d3cd69cd36afa834e0f65b: ltp-smoketest 2025-09-26 11:01:49,034 - lava_callback - ERROR - Error processing callback for node 68d3cd69cd36afa834e0f65b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:01:53,767 - lava_callback - INFO - Received callback for node 68d3cf4acd36afa834e0fa46 INFO: 172.20.0.1:36124 - "POST /node/68d3cf4acd36afa834e0fa46 HTTP/1.0" 202 Accepted 2025-09-26 11:01:53,773 - lava_callback - INFO - Starting async job submit for node 68d3cf4acd36afa834e0fa46 2025-09-26 11:01:53,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:01:53,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cf4acd36afa834e0fa46 HTTP/1.1" 200 None 2025-09-26 11:01:53,841 - lava_callback - DEBUG - Processing node 68d3cf4acd36afa834e0fa46: baseline-arm-broonie 2025-09-26 11:01:54,054 - lava_callback - ERROR - Error processing callback for node 68d3cf4acd36afa834e0fa46: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:36126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36208 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 11:02:15,525 - lava_callback - INFO - Received callback for node 68d66e962f83206171a90959 INFO: 172.20.0.1:36218 - "POST /node/68d66e962f83206171a90959 HTTP/1.0" 202 Accepted 2025-09-26 11:02:15,535 - lava_callback - INFO - Starting async job submit for node 68d66e962f83206171a90959 2025-09-26 11:02:15,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:02:15,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e962f83206171a90959 HTTP/1.1" 200 None 2025-09-26 11:02:15,605 - lava_callback - DEBUG - Processing node 68d66e962f83206171a90959: ltp-smoketest 2025-09-26 11:02:16,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:36220 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:02:17,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:02:17,019 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d66e962f83206171a90959/log.txt.gz 2025-09-26 11:02:17,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:02:19,296 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:02:19,297 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d66e962f83206171a90959/lava_callback.json.gz 2025-09-26 11:02:19,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:02:19,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66e962f83206171a90959 HTTP/1.1" 200 None 2025-09-26 11:02:19,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:02:19,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c942f83206171a8fe61 HTTP/1.1" 200 None 2025-09-26 11:02:19,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:02:19,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66e962f83206171a90959 HTTP/1.1" 200 None 2025-09-26 11:02:19,481 - lava_callback - INFO - Completed processing callback for node 68d66e962f83206171a90959 INFO: 172.20.0.1:58596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58598 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:02:21,590 - lava_callback - INFO - Received callback for node 68d3cfb9cd36afa834e0fb5e INFO: 172.20.0.1:58600 - "POST /node/68d3cfb9cd36afa834e0fb5e HTTP/1.0" 202 Accepted 2025-09-26 11:02:21,597 - lava_callback - INFO - Starting async job submit for node 68d3cfb9cd36afa834e0fb5e 2025-09-26 11:02:21,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:02:21,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cfb9cd36afa834e0fb5e HTTP/1.1" 200 None 2025-09-26 11:02:21,613 - lava_callback - DEBUG - Processing node 68d3cfb9cd36afa834e0fb5e: baseline-arm64-baylibre 2025-09-26 11:02:21,613 - lava_callback - ERROR - Error processing callback for node 68d3cfb9cd36afa834e0fb5e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:58604 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:02:35,588 - lava_callback - INFO - Received callback for node 68d3cfc2cd36afa834e0fb88 INFO: 172.20.0.1:59756 - "POST /node/68d3cfc2cd36afa834e0fb88 HTTP/1.0" 202 Accepted 2025-09-26 11:02:35,593 - lava_callback - INFO - Starting async job submit for node 68d3cfc2cd36afa834e0fb88 2025-09-26 11:02:35,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:02:35,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cfc2cd36afa834e0fb88 HTTP/1.1" 200 None 2025-09-26 11:02:35,607 - lava_callback - DEBUG - Processing node 68d3cfc2cd36afa834e0fb88: baseline-arm 2025-09-26 11:02:35,608 - lava_callback - ERROR - Error processing callback for node 68d3cfc2cd36afa834e0fb88: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:02:36,279 - lava_callback - INFO - Received callback for node 68d3cfc4cd36afa834e0fb8e INFO: 172.20.0.1:59766 - "POST /node/68d3cfc4cd36afa834e0fb8e HTTP/1.0" 202 Accepted 2025-09-26 11:02:36,287 - lava_callback - INFO - Starting async job submit for node 68d3cfc4cd36afa834e0fb8e 2025-09-26 11:02:36,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:02:36,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cfc4cd36afa834e0fb8e HTTP/1.1" 200 None 2025-09-26 11:02:36,324 - lava_callback - DEBUG - Processing node 68d3cfc4cd36afa834e0fb8e: baseline-arm 2025-09-26 11:02:36,324 - lava_callback - ERROR - Error processing callback for node 68d3cfc4cd36afa834e0fb8e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:59774 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:02:36,981 - lava_callback - INFO - Received callback for node 68d3cfc9cd36afa834e0fbaf INFO: 172.20.0.1:59780 - "POST /node/68d3cfc9cd36afa834e0fbaf HTTP/1.0" 202 Accepted 2025-09-26 11:02:36,989 - lava_callback - INFO - Starting async job submit for node 68d3cfc9cd36afa834e0fbaf 2025-09-26 11:02:36,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:02:37,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cfc9cd36afa834e0fbaf HTTP/1.1" 200 None 2025-09-26 11:02:37,008 - lava_callback - DEBUG - Processing node 68d3cfc9cd36afa834e0fbaf: baseline-arm 2025-09-26 11:02:37,008 - lava_callback - ERROR - Error processing callback for node 68d3cfc9cd36afa834e0fbaf: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:02:37,687 - lava_callback - INFO - Received callback for node 68d3cfcacd36afa834e0fbb5 INFO: 172.20.0.1:59790 - "POST /node/68d3cfcacd36afa834e0fbb5 HTTP/1.0" 202 Accepted 2025-09-26 11:02:37,695 - lava_callback - INFO - Starting async job submit for node 68d3cfcacd36afa834e0fbb5 2025-09-26 11:02:37,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:02:37,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cfcacd36afa834e0fbb5 HTTP/1.1" 200 None 2025-09-26 11:02:37,708 - lava_callback - DEBUG - Processing node 68d3cfcacd36afa834e0fbb5: baseline-arm 2025-09-26 11:02:37,708 - lava_callback - ERROR - Error processing callback for node 68d3cfcacd36afa834e0fbb5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:02:41,610 - lava_callback - INFO - Received callback for node 68d3cfc4cd36afa834e0fb8c INFO: 172.20.0.1:57766 - "POST /node/68d3cfc4cd36afa834e0fb8c HTTP/1.0" 202 Accepted 2025-09-26 11:02:41,616 - lava_callback - INFO - Starting async job submit for node 68d3cfc4cd36afa834e0fb8c 2025-09-26 11:02:41,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:02:41,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cfc4cd36afa834e0fb8c HTTP/1.1" 200 None 2025-09-26 11:02:41,637 - lava_callback - DEBUG - Processing node 68d3cfc4cd36afa834e0fb8c: baseline-arm64-baylibre 2025-09-26 11:02:41,637 - lava_callback - ERROR - Error processing callback for node 68d3cfc4cd36afa834e0fb8c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:02:41,776 - lava_callback - INFO - Received callback for node 68d40a3ccd36afa834e16f0c INFO: 172.20.0.1:57772 - "POST /node/68d40a3ccd36afa834e16f0c HTTP/1.0" 202 Accepted 2025-09-26 11:02:41,782 - lava_callback - INFO - Starting async job submit for node 68d40a3ccd36afa834e16f0c 2025-09-26 11:02:41,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:02:41,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a3ccd36afa834e16f0c HTTP/1.1" 200 None 2025-09-26 11:02:41,816 - lava_callback - DEBUG - Processing node 68d40a3ccd36afa834e16f0c: baseline-arm 2025-09-26 11:02:42,071 - lava_callback - ERROR - Error processing callback for node 68d40a3ccd36afa834e16f0c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:57788 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:02:53,484 - lava_callback - INFO - Received callback for node 68d3cfd3cd36afa834e0fbda INFO: 172.20.0.1:55566 - "POST /node/68d3cfd3cd36afa834e0fbda HTTP/1.0" 202 Accepted 2025-09-26 11:02:53,490 - lava_callback - INFO - Starting async job submit for node 68d3cfd3cd36afa834e0fbda 2025-09-26 11:02:53,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:02:53,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cfd3cd36afa834e0fbda HTTP/1.1" 200 None 2025-09-26 11:02:53,503 - lava_callback - DEBUG - Processing node 68d3cfd3cd36afa834e0fbda: baseline-arm64-clabbe 2025-09-26 11:02:53,503 - lava_callback - ERROR - Error processing callback for node 68d3cfd3cd36afa834e0fbda: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:02:54,156 - lava_callback - INFO - Received callback for node 68d3cfd5cd36afa834e0fbe5 INFO: 172.20.0.1:55574 - "POST /node/68d3cfd5cd36afa834e0fbe5 HTTP/1.0" 202 Accepted 2025-09-26 11:02:54,162 - lava_callback - INFO - Starting async job submit for node 68d3cfd5cd36afa834e0fbe5 2025-09-26 11:02:54,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:02:54,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cfd5cd36afa834e0fbe5 HTTP/1.1" 200 None 2025-09-26 11:02:54,177 - lava_callback - DEBUG - Processing node 68d3cfd5cd36afa834e0fbe5: baseline-arm64-clabbe 2025-09-26 11:02:54,177 - lava_callback - ERROR - Error processing callback for node 68d3cfd5cd36afa834e0fbe5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:02:54,838 - lava_callback - INFO - Received callback for node 68d3cfcccd36afa834e0fbc8 INFO: 172.20.0.1:55586 - "POST /node/68d3cfcccd36afa834e0fbc8 HTTP/1.0" 202 Accepted 2025-09-26 11:02:54,847 - lava_callback - INFO - Starting async job submit for node 68d3cfcccd36afa834e0fbc8 2025-09-26 11:02:54,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:02:54,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cfcccd36afa834e0fbc8 HTTP/1.1" 200 None 2025-09-26 11:02:54,861 - lava_callback - DEBUG - Processing node 68d3cfcccd36afa834e0fbc8: baseline-arm64-clabbe 2025-09-26 11:02:54,861 - lava_callback - ERROR - Error processing callback for node 68d3cfcccd36afa834e0fbc8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:02:55,512 - lava_callback - INFO - Received callback for node 68d3cfd3cd36afa834e0fbdd INFO: 172.20.0.1:55596 - "POST /node/68d3cfd3cd36afa834e0fbdd HTTP/1.0" 202 Accepted 2025-09-26 11:02:55,518 - lava_callback - INFO - Starting async job submit for node 68d3cfd3cd36afa834e0fbdd 2025-09-26 11:02:55,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:02:55,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cfd3cd36afa834e0fbdd HTTP/1.1" 200 None 2025-09-26 11:02:55,556 - lava_callback - DEBUG - Processing node 68d3cfd3cd36afa834e0fbdd: baseline-arm64-clabbe 2025-09-26 11:02:55,556 - lava_callback - ERROR - Error processing callback for node 68d3cfd3cd36afa834e0fbdd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:02:55,723 - lava_callback - INFO - Received callback for node 68d3cfcfcd36afa834e0fbcd INFO: 172.20.0.1:55612 - "POST /node/68d3cfcfcd36afa834e0fbcd HTTP/1.0" 202 Accepted 2025-09-26 11:02:55,730 - lava_callback - INFO - Starting async job submit for node 68d3cfcfcd36afa834e0fbcd 2025-09-26 11:02:55,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:02:55,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cfcfcd36afa834e0fbcd HTTP/1.1" 200 None 2025-09-26 11:02:55,745 - lava_callback - DEBUG - Processing node 68d3cfcfcd36afa834e0fbcd: baseline-arm 2025-09-26 11:02:55,745 - lava_callback - ERROR - Error processing callback for node 68d3cfcfcd36afa834e0fbcd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:02:56,201 - lava_callback - INFO - Received callback for node 68d3cfd4cd36afa834e0fbe0 INFO: 172.20.0.1:55626 - "POST /node/68d3cfd4cd36afa834e0fbe0 HTTP/1.0" 202 Accepted 2025-09-26 11:02:56,206 - lava_callback - INFO - Starting async job submit for node 68d3cfd4cd36afa834e0fbe0 2025-09-26 11:02:56,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:02:56,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cfd4cd36afa834e0fbe0 HTTP/1.1" 200 None 2025-09-26 11:02:56,220 - lava_callback - DEBUG - Processing node 68d3cfd4cd36afa834e0fbe0: baseline-arm64-clabbe 2025-09-26 11:02:56,220 - lava_callback - ERROR - Error processing callback for node 68d3cfd4cd36afa834e0fbe0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:02:56,458 - lava_callback - INFO - Received callback for node 68d3cfcfcd36afa834e0fbd0 INFO: 172.20.0.1:55630 - "POST /node/68d3cfcfcd36afa834e0fbd0 HTTP/1.0" 202 Accepted 2025-09-26 11:02:56,464 - lava_callback - INFO - Starting async job submit for node 68d3cfcfcd36afa834e0fbd0 2025-09-26 11:02:56,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:02:56,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cfcfcd36afa834e0fbd0 HTTP/1.1" 200 None 2025-09-26 11:02:56,479 - lava_callback - DEBUG - Processing node 68d3cfcfcd36afa834e0fbd0: baseline-arm 2025-09-26 11:02:56,479 - lava_callback - ERROR - Error processing callback for node 68d3cfcfcd36afa834e0fbd0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:55640 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:02:57,188 - lava_callback - INFO - Received callback for node 68d3cfd6cd36afa834e0fbeb INFO: 172.20.0.1:55648 - "POST /node/68d3cfd6cd36afa834e0fbeb HTTP/1.0" 202 Accepted 2025-09-26 11:02:57,193 - lava_callback - INFO - Starting async job submit for node 68d3cfd6cd36afa834e0fbeb 2025-09-26 11:02:57,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:02:57,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cfd6cd36afa834e0fbeb HTTP/1.1" 200 None 2025-09-26 11:02:57,208 - lava_callback - DEBUG - Processing node 68d3cfd6cd36afa834e0fbeb: baseline-arm 2025-09-26 11:02:57,208 - lava_callback - ERROR - Error processing callback for node 68d3cfd6cd36afa834e0fbeb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:02:57,892 - lava_callback - INFO - Received callback for node 68d3cfd8cd36afa834e0fbef INFO: 172.20.0.1:55660 - "POST /node/68d3cfd8cd36afa834e0fbef HTTP/1.0" 202 Accepted 2025-09-26 11:02:57,897 - lava_callback - INFO - Starting async job submit for node 68d3cfd8cd36afa834e0fbef 2025-09-26 11:02:57,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:02:57,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cfd8cd36afa834e0fbef HTTP/1.1" 200 None 2025-09-26 11:02:57,933 - lava_callback - DEBUG - Processing node 68d3cfd8cd36afa834e0fbef: baseline-arm 2025-09-26 11:02:57,933 - lava_callback - ERROR - Error processing callback for node 68d3cfd8cd36afa834e0fbef: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:39936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54122 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:03:35,200 - lava_callback - INFO - Received callback for node 68d3cff5cd36afa834e0fc53 INFO: 172.20.0.1:56466 - "POST /node/68d3cff5cd36afa834e0fc53 HTTP/1.0" 202 Accepted 2025-09-26 11:03:35,208 - lava_callback - INFO - Starting async job submit for node 68d3cff5cd36afa834e0fc53 2025-09-26 11:03:35,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:03:35,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cff5cd36afa834e0fc53 HTTP/1.1" 200 None 2025-09-26 11:03:35,226 - lava_callback - DEBUG - Processing node 68d3cff5cd36afa834e0fc53: baseline-arm 2025-09-26 11:03:35,226 - lava_callback - ERROR - Error processing callback for node 68d3cff5cd36afa834e0fc53: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:03:35,903 - lava_callback - INFO - Received callback for node 68d3cff6cd36afa834e0fc56 INFO: 172.20.0.1:56482 - "POST /node/68d3cff6cd36afa834e0fc56 HTTP/1.0" 202 Accepted 2025-09-26 11:03:35,912 - lava_callback - INFO - Starting async job submit for node 68d3cff6cd36afa834e0fc56 2025-09-26 11:03:35,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:03:35,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cff6cd36afa834e0fc56 HTTP/1.1" 200 None 2025-09-26 11:03:35,938 - lava_callback - DEBUG - Processing node 68d3cff6cd36afa834e0fc56: baseline-arm 2025-09-26 11:03:35,938 - lava_callback - ERROR - Error processing callback for node 68d3cff6cd36afa834e0fc56: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:56484 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:03:36,710 - lava_callback - INFO - Received callback for node 68d3cffccd36afa834e0fc5c INFO: 172.20.0.1:56488 - "POST /node/68d3cffccd36afa834e0fc5c HTTP/1.0" 202 Accepted 2025-09-26 11:03:36,718 - lava_callback - INFO - Starting async job submit for node 68d3cffccd36afa834e0fc5c 2025-09-26 11:03:36,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:03:36,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cffccd36afa834e0fc5c HTTP/1.1" 200 None 2025-09-26 11:03:36,746 - lava_callback - DEBUG - Processing node 68d3cffccd36afa834e0fc5c: baseline-arm 2025-09-26 11:03:36,746 - lava_callback - ERROR - Error processing callback for node 68d3cffccd36afa834e0fc5c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:03:37,416 - lava_callback - INFO - Received callback for node 68d3cffccd36afa834e0fc5f INFO: 172.20.0.1:56498 - "POST /node/68d3cffccd36afa834e0fc5f HTTP/1.0" 202 Accepted 2025-09-26 11:03:37,422 - lava_callback - INFO - Starting async job submit for node 68d3cffccd36afa834e0fc5f 2025-09-26 11:03:37,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:03:37,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cffccd36afa834e0fc5f HTTP/1.1" 200 None 2025-09-26 11:03:37,440 - lava_callback - DEBUG - Processing node 68d3cffccd36afa834e0fc5f: baseline-arm 2025-09-26 11:03:37,440 - lava_callback - ERROR - Error processing callback for node 68d3cffccd36afa834e0fc5f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:03:38,149 - lava_callback - INFO - Received callback for node 68d3cffecd36afa834e0fc62 INFO: 172.20.0.1:56514 - "POST /node/68d3cffecd36afa834e0fc62 HTTP/1.0" 202 Accepted 2025-09-26 11:03:38,155 - lava_callback - INFO - Starting async job submit for node 68d3cffecd36afa834e0fc62 2025-09-26 11:03:38,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:03:38,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cffecd36afa834e0fc62 HTTP/1.1" 200 None 2025-09-26 11:03:38,168 - lava_callback - DEBUG - Processing node 68d3cffecd36afa834e0fc62: baseline-arm 2025-09-26 11:03:38,168 - lava_callback - ERROR - Error processing callback for node 68d3cffecd36afa834e0fc62: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:03:38,808 - lava_callback - INFO - Received callback for node 68d3d000cd36afa834e0fc65 INFO: 172.20.0.1:56516 - "POST /node/68d3d000cd36afa834e0fc65 HTTP/1.0" 202 Accepted 2025-09-26 11:03:38,814 - lava_callback - INFO - Starting async job submit for node 68d3d000cd36afa834e0fc65 2025-09-26 11:03:38,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:03:38,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d000cd36afa834e0fc65 HTTP/1.1" 200 None 2025-09-26 11:03:38,828 - lava_callback - DEBUG - Processing node 68d3d000cd36afa834e0fc65: baseline-arm 2025-09-26 11:03:38,828 - lava_callback - ERROR - Error processing callback for node 68d3d000cd36afa834e0fc65: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:03:39,600 - lava_callback - INFO - Received callback for node 68d3d004cd36afa834e0fc68 INFO: 172.20.0.1:40156 - "POST /node/68d3d004cd36afa834e0fc68 HTTP/1.0" 202 Accepted 2025-09-26 11:03:39,611 - lava_callback - INFO - Starting async job submit for node 68d3d004cd36afa834e0fc68 2025-09-26 11:03:39,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:03:39,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d004cd36afa834e0fc68 HTTP/1.1" 200 None 2025-09-26 11:03:39,637 - lava_callback - DEBUG - Processing node 68d3d004cd36afa834e0fc68: baseline-arm 2025-09-26 11:03:39,637 - lava_callback - ERROR - Error processing callback for node 68d3d004cd36afa834e0fc68: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:03:40,389 - lava_callback - INFO - Received callback for node 68d3d004cd36afa834e0fc6b INFO: 172.20.0.1:40172 - "POST /node/68d3d004cd36afa834e0fc6b HTTP/1.0" 202 Accepted 2025-09-26 11:03:40,394 - lava_callback - INFO - Starting async job submit for node 68d3d004cd36afa834e0fc6b 2025-09-26 11:03:40,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:03:40,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d004cd36afa834e0fc6b HTTP/1.1" 200 None 2025-09-26 11:03:40,408 - lava_callback - DEBUG - Processing node 68d3d004cd36afa834e0fc6b: baseline-arm 2025-09-26 11:03:40,408 - lava_callback - ERROR - Error processing callback for node 68d3d004cd36afa834e0fc6b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:40184 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:03:53,676 - lava_callback - INFO - Received callback for node 68d3d033cd36afa834e0fccb INFO: 172.20.0.1:37306 - "POST /node/68d3d033cd36afa834e0fccb HTTP/1.0" 202 Accepted 2025-09-26 11:03:53,682 - lava_callback - INFO - Starting async job submit for node 68d3d033cd36afa834e0fccb 2025-09-26 11:03:53,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:03:53,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d033cd36afa834e0fccb HTTP/1.1" 200 None 2025-09-26 11:03:53,731 - lava_callback - DEBUG - Processing node 68d3d033cd36afa834e0fccb: baseline-arm-broonie 2025-09-26 11:03:53,935 - lava_callback - ERROR - Error processing callback for node 68d3d033cd36afa834e0fccb: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:03:55,519 - lava_callback - INFO - Received callback for node 68d66fcc2f83206171a90c38 INFO: 172.20.0.1:37320 - "POST /node/68d66fcc2f83206171a90c38 HTTP/1.0" 202 Accepted 2025-09-26 11:03:55,525 - lava_callback - INFO - Starting async job submit for node 68d66fcc2f83206171a90c38 2025-09-26 11:03:55,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:03:55,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66fcc2f83206171a90c38 HTTP/1.1" 200 None 2025-09-26 11:03:55,569 - lava_callback - DEBUG - Processing node 68d66fcc2f83206171a90c38: baseline-arm 2025-09-26 11:03:55,640 - lava_callback - INFO - Received callback for node 68d3d006cd36afa834e0fc6e 2025-09-26 11:03:55,645 - lava_callback - INFO - Starting async job submit for node 68d3d006cd36afa834e0fc6e INFO: 172.20.0.1:37332 - "POST /node/68d3d006cd36afa834e0fc6e HTTP/1.0" 202 Accepted 2025-09-26 11:03:55,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:03:55,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d006cd36afa834e0fc6e HTTP/1.1" 200 None 2025-09-26 11:03:55,718 - lava_callback - DEBUG - Processing node 68d3d006cd36afa834e0fc6e: baseline-arm 2025-09-26 11:03:55,723 - lava_callback - ERROR - Error processing callback for node 68d3d006cd36afa834e0fc6e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:03:55,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:03:56,367 - lava_callback - INFO - Received callback for node 68d3d008cd36afa834e0fc71 INFO: 172.20.0.1:37348 - "POST /node/68d3d008cd36afa834e0fc71 HTTP/1.0" 202 Accepted 2025-09-26 11:03:56,376 - lava_callback - INFO - Starting async job submit for node 68d3d008cd36afa834e0fc71 2025-09-26 11:03:56,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:03:56,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d008cd36afa834e0fc71 HTTP/1.1" 200 None 2025-09-26 11:03:56,400 - lava_callback - DEBUG - Processing node 68d3d008cd36afa834e0fc71: baseline-arm 2025-09-26 11:03:56,400 - lava_callback - ERROR - Error processing callback for node 68d3d008cd36afa834e0fc71: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:03:56,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:03:56,440 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66fcc2f83206171a90c38/log.txt.gz 2025-09-26 11:03:56,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:37352 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:03:57,100 - lava_callback - INFO - Received callback for node 68d3d00ccd36afa834e0fc74 INFO: 172.20.0.1:37362 - "POST /node/68d3d00ccd36afa834e0fc74 HTTP/1.0" 202 Accepted 2025-09-26 11:03:57,106 - lava_callback - INFO - Starting async job submit for node 68d3d00ccd36afa834e0fc74 2025-09-26 11:03:57,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:03:57,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d00ccd36afa834e0fc74 HTTP/1.1" 200 None 2025-09-26 11:03:57,127 - lava_callback - DEBUG - Processing node 68d3d00ccd36afa834e0fc74: baseline-arm 2025-09-26 11:03:57,127 - lava_callback - ERROR - Error processing callback for node 68d3d00ccd36afa834e0fc74: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:03:57,809 - lava_callback - INFO - Received callback for node 68d3d00dcd36afa834e0fc77 INFO: 172.20.0.1:37368 - "POST /node/68d3d00dcd36afa834e0fc77 HTTP/1.0" 202 Accepted 2025-09-26 11:03:57,817 - lava_callback - INFO - Starting async job submit for node 68d3d00dcd36afa834e0fc77 2025-09-26 11:03:57,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:03:57,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d00dcd36afa834e0fc77 HTTP/1.1" 200 None 2025-09-26 11:03:57,835 - lava_callback - DEBUG - Processing node 68d3d00dcd36afa834e0fc77: baseline-arm 2025-09-26 11:03:57,835 - lava_callback - ERROR - Error processing callback for node 68d3d00dcd36afa834e0fc77: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:03:58,541 - lava_callback - INFO - Received callback for node 68d3d014cd36afa834e0fc80 INFO: 172.20.0.1:37378 - "POST /node/68d3d014cd36afa834e0fc80 HTTP/1.0" 202 Accepted 2025-09-26 11:03:58,550 - lava_callback - INFO - Starting async job submit for node 68d3d014cd36afa834e0fc80 2025-09-26 11:03:58,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:03:58,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d014cd36afa834e0fc80 HTTP/1.1" 200 None 2025-09-26 11:03:58,574 - lava_callback - DEBUG - Processing node 68d3d014cd36afa834e0fc80: baseline-arm 2025-09-26 11:03:58,574 - lava_callback - ERROR - Error processing callback for node 68d3d014cd36afa834e0fc80: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:03:59,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:03:59,035 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66fcc2f83206171a90c38/lava_callback.json.gz 2025-09-26 11:03:59,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:03:59,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66fcc2f83206171a90c38 HTTP/1.1" 200 None 2025-09-26 11:03:59,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:03:59,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c1b2be2da4660698f4e HTTP/1.1" 200 None 2025-09-26 11:03:59,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:03:59,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66fcc2f83206171a90c38 HTTP/1.1" 200 None 2025-09-26 11:03:59,135 - lava_callback - INFO - Completed processing callback for node 68d66fcc2f83206171a90c38 2025-09-26 11:03:59,347 - lava_callback - INFO - Received callback for node 68d3d017cd36afa834e0fc83 INFO: 172.20.0.1:33172 - "POST /node/68d3d017cd36afa834e0fc83 HTTP/1.0" 202 Accepted 2025-09-26 11:03:59,356 - lava_callback - INFO - Starting async job submit for node 68d3d017cd36afa834e0fc83 2025-09-26 11:03:59,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:03:59,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d017cd36afa834e0fc83 HTTP/1.1" 200 None 2025-09-26 11:03:59,371 - lava_callback - DEBUG - Processing node 68d3d017cd36afa834e0fc83: baseline-arm 2025-09-26 11:03:59,371 - lava_callback - ERROR - Error processing callback for node 68d3d017cd36afa834e0fc83: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:33180 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:04:08,381 - lava_callback - INFO - Received callback for node 68d3d023cd36afa834e0fc9b INFO: 172.20.0.1:33196 - "POST /node/68d3d023cd36afa834e0fc9b HTTP/1.0" 202 Accepted 2025-09-26 11:04:08,387 - lava_callback - INFO - Starting async job submit for node 68d3d023cd36afa834e0fc9b 2025-09-26 11:04:08,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:08,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d023cd36afa834e0fc9b HTTP/1.1" 200 None 2025-09-26 11:04:08,440 - lava_callback - DEBUG - Processing node 68d3d023cd36afa834e0fc9b: baseline-arm-broonie 2025-09-26 11:04:08,687 - lava_callback - ERROR - Error processing callback for node 68d3d023cd36afa834e0fc9b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:04:12,222 - lava_callback - INFO - Received callback for node 68d672c72f83206171a90d8c INFO: 172.20.0.1:41892 - "POST /node/68d672c72f83206171a90d8c HTTP/1.0" 202 Accepted 2025-09-26 11:04:12,228 - lava_callback - INFO - Starting async job submit for node 68d672c72f83206171a90d8c 2025-09-26 11:04:12,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:12,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d672c72f83206171a90d8c HTTP/1.1" 200 None 2025-09-26 11:04:12,268 - lava_callback - DEBUG - Processing node 68d672c72f83206171a90d8c: baseline-arm64 2025-09-26 11:04:12,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:04:13,870 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:04:13,871 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d672c72f83206171a90d8c/log.txt.gz 2025-09-26 11:04:13,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:04:14,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:04:14,018 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d672c72f83206171a90d8c/lava_callback.json.gz 2025-09-26 11:04:14,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:14,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d672c72f83206171a90d8c HTTP/1.1" 200 None 2025-09-26 11:04:14,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:14,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:04:14,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:14,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d672c72f83206171a90d8c HTTP/1.1" 200 None 2025-09-26 11:04:14,127 - lava_callback - INFO - Completed processing callback for node 68d672c72f83206171a90d8c INFO: 172.20.0.1:41894 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 11:04:15,665 - lava_callback - INFO - Received callback for node 68d3d01dcd36afa834e0fc8c INFO: 172.20.0.1:41904 - "POST /node/68d3d01dcd36afa834e0fc8c HTTP/1.0" 202 Accepted 2025-09-26 11:04:15,674 - lava_callback - INFO - Starting async job submit for node 68d3d01dcd36afa834e0fc8c 2025-09-26 11:04:15,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:15,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d01dcd36afa834e0fc8c HTTP/1.1" 200 None 2025-09-26 11:04:15,691 - lava_callback - DEBUG - Processing node 68d3d01dcd36afa834e0fc8c: baseline-arm 2025-09-26 11:04:15,691 - lava_callback - ERROR - Error processing callback for node 68d3d01dcd36afa834e0fc8c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:04:16,361 - lava_callback - INFO - Received callback for node 68d3d01ecd36afa834e0fc92 INFO: 172.20.0.1:41916 - "POST /node/68d3d01ecd36afa834e0fc92 HTTP/1.0" 202 Accepted 2025-09-26 11:04:16,367 - lava_callback - INFO - Starting async job submit for node 68d3d01ecd36afa834e0fc92 2025-09-26 11:04:16,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:16,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d01ecd36afa834e0fc92 HTTP/1.1" 200 None 2025-09-26 11:04:16,382 - lava_callback - DEBUG - Processing node 68d3d01ecd36afa834e0fc92: baseline-arm 2025-09-26 11:04:16,382 - lava_callback - ERROR - Error processing callback for node 68d3d01ecd36afa834e0fc92: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:41922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53812 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:04:27,650 - lava_callback - INFO - Received callback for node 68d672d12f83206171a90d95 INFO: 172.20.0.1:53814 - "POST /node/68d672d12f83206171a90d95 HTTP/1.0" 202 Accepted 2025-09-26 11:04:27,655 - lava_callback - INFO - Starting async job submit for node 68d672d12f83206171a90d95 2025-09-26 11:04:27,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:27,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d672d12f83206171a90d95 HTTP/1.1" 200 None 2025-09-26 11:04:27,702 - lava_callback - DEBUG - Processing node 68d672d12f83206171a90d95: baseline-arm64 2025-09-26 11:04:27,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:04:28,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:04:28,792 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d672d12f83206171a90d95/log.txt.gz 2025-09-26 11:04:28,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:04:31,340 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:04:31,341 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d672d12f83206171a90d95/lava_callback.json.gz 2025-09-26 11:04:31,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:31,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d672d12f83206171a90d95 HTTP/1.1" 200 None 2025-09-26 11:04:31,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:31,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:04:31,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:31,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d672d12f83206171a90d95 HTTP/1.1" 200 None 2025-09-26 11:04:31,481 - lava_callback - INFO - Completed processing callback for node 68d672d12f83206171a90d95 2025-09-26 11:04:35,678 - lava_callback - INFO - Received callback for node 68d3d037cd36afa834e0fcce INFO: 172.20.0.1:54864 - "POST /node/68d3d037cd36afa834e0fcce HTTP/1.0" 202 Accepted 2025-09-26 11:04:35,687 - lava_callback - INFO - Starting async job submit for node 68d3d037cd36afa834e0fcce 2025-09-26 11:04:35,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:35,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d037cd36afa834e0fcce HTTP/1.1" 200 None 2025-09-26 11:04:35,745 - lava_callback - DEBUG - Processing node 68d3d037cd36afa834e0fcce: baseline-arm 2025-09-26 11:04:35,745 - lava_callback - ERROR - Error processing callback for node 68d3d037cd36afa834e0fcce: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:04:36,406 - lava_callback - INFO - Received callback for node 68d3d038cd36afa834e0fcd1 INFO: 172.20.0.1:54866 - "POST /node/68d3d038cd36afa834e0fcd1 HTTP/1.0" 202 Accepted 2025-09-26 11:04:36,417 - lava_callback - INFO - Starting async job submit for node 68d3d038cd36afa834e0fcd1 2025-09-26 11:04:36,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:36,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d038cd36afa834e0fcd1 HTTP/1.1" 200 None 2025-09-26 11:04:36,459 - lava_callback - DEBUG - Processing node 68d3d038cd36afa834e0fcd1: baseline-arm 2025-09-26 11:04:36,459 - lava_callback - ERROR - Error processing callback for node 68d3d038cd36afa834e0fcd1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:54870 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:04:36,669 - lava_callback - INFO - Received callback for node 68d672ca2f83206171a90d8f INFO: 172.20.0.1:54874 - "POST /node/68d672ca2f83206171a90d8f HTTP/1.0" 202 Accepted 2025-09-26 11:04:36,681 - lava_callback - INFO - Starting async job submit for node 68d672ca2f83206171a90d8f 2025-09-26 11:04:36,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:36,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d672ca2f83206171a90d8f HTTP/1.1" 200 None 2025-09-26 11:04:36,769 - lava_callback - DEBUG - Processing node 68d672ca2f83206171a90d8f: baseline-arm64 2025-09-26 11:04:37,205 - lava_callback - INFO - Received callback for node 68d3d03acd36afa834e0fcd4 INFO: 172.20.0.1:54876 - "POST /node/68d3d03acd36afa834e0fcd4 HTTP/1.0" 202 Accepted 2025-09-26 11:04:37,225 - lava_callback - INFO - Starting async job submit for node 68d3d03acd36afa834e0fcd4 2025-09-26 11:04:37,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:37,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:04:37,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d03acd36afa834e0fcd4 HTTP/1.1" 200 None 2025-09-26 11:04:37,289 - lava_callback - DEBUG - Processing node 68d3d03acd36afa834e0fcd4: baseline-arm 2025-09-26 11:04:37,289 - lava_callback - ERROR - Error processing callback for node 68d3d03acd36afa834e0fcd4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:04:37,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:04:37,486 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d672ca2f83206171a90d8f/log.txt.gz 2025-09-26 11:04:37,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:04:37,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:04:37,682 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d672ca2f83206171a90d8f/lava_callback.json.gz 2025-09-26 11:04:37,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:37,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d672ca2f83206171a90d8f HTTP/1.1" 200 None 2025-09-26 11:04:37,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:37,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:04:37,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:37,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d672ca2f83206171a90d8f HTTP/1.1" 200 None 2025-09-26 11:04:37,833 - lava_callback - INFO - Completed processing callback for node 68d672ca2f83206171a90d8f 2025-09-26 11:04:37,934 - lava_callback - INFO - Received callback for node 68d3d03ecd36afa834e0fcd7 INFO: 172.20.0.1:54878 - "POST /node/68d3d03ecd36afa834e0fcd7 HTTP/1.0" 202 Accepted 2025-09-26 11:04:37,945 - lava_callback - INFO - Starting async job submit for node 68d3d03ecd36afa834e0fcd7 2025-09-26 11:04:37,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:37,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d03ecd36afa834e0fcd7 HTTP/1.1" 200 None 2025-09-26 11:04:37,981 - lava_callback - DEBUG - Processing node 68d3d03ecd36afa834e0fcd7: baseline-arm 2025-09-26 11:04:37,981 - lava_callback - ERROR - Error processing callback for node 68d3d03ecd36afa834e0fcd7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:04:41,413 - lava_callback - INFO - Received callback for node 68d672ce2f83206171a90d92 INFO: 172.20.0.1:54290 - "POST /node/68d672ce2f83206171a90d92 HTTP/1.0" 202 Accepted 2025-09-26 11:04:41,422 - lava_callback - INFO - Starting async job submit for node 68d672ce2f83206171a90d92 2025-09-26 11:04:41,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:41,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d672ce2f83206171a90d92 HTTP/1.1" 200 None 2025-09-26 11:04:41,457 - lava_callback - DEBUG - Processing node 68d672ce2f83206171a90d92: baseline-arm64 2025-09-26 11:04:41,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:04:41,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:04:41,959 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d672ce2f83206171a90d92/log.txt.gz 2025-09-26 11:04:41,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:04:42,100 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:04:42,101 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d672ce2f83206171a90d92/lava_callback.json.gz 2025-09-26 11:04:42,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:42,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d672ce2f83206171a90d92 HTTP/1.1" 200 None 2025-09-26 11:04:42,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:42,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:04:42,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:42,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d672ce2f83206171a90d92 HTTP/1.1" 200 None 2025-09-26 11:04:42,198 - lava_callback - INFO - Completed processing callback for node 68d672ce2f83206171a90d92 2025-09-26 11:04:46,347 - lava_callback - INFO - Received callback for node 68d66ef02f83206171a90a1b INFO: 172.20.0.1:54300 - "POST /node/68d66ef02f83206171a90a1b HTTP/1.0" 202 Accepted 2025-09-26 11:04:46,356 - lava_callback - INFO - Starting async job submit for node 68d66ef02f83206171a90a1b 2025-09-26 11:04:46,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:46,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ef02f83206171a90a1b HTTP/1.1" 200 None 2025-09-26 11:04:46,448 - lava_callback - DEBUG - Processing node 68d66ef02f83206171a90a1b: baseline-arm INFO: 172.20.0.1:54304 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:04:46,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:04:48,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:04:48,480 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d66ef02f83206171a90a1b/log.txt.gz 2025-09-26 11:04:48,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:04:51,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:04:51,058 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d66ef02f83206171a90a1b/lava_callback.json.gz DEBUG: Setup failed for 68d66ef02f83206171a90a1b. Transitting job node result: incomplete -> fail 2025-09-26 11:04:51,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:51,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66ef02f83206171a90a1b HTTP/1.1" 200 None 2025-09-26 11:04:51,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:51,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d65c8d2f83206171a8fe37 HTTP/1.1" 200 None 2025-09-26 11:04:51,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:51,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66ef02f83206171a90a1b HTTP/1.1" 200 None 2025-09-26 11:04:51,264 - lava_callback - INFO - Completed processing callback for node 68d66ef02f83206171a90a1b 2025-09-26 11:04:51,850 - lava_callback - INFO - Received callback for node 68d673042f83206171a90daa INFO: 172.20.0.1:57090 - "POST /node/68d673042f83206171a90daa HTTP/1.0" 202 Accepted 2025-09-26 11:04:51,856 - lava_callback - INFO - Starting async job submit for node 68d673042f83206171a90daa 2025-09-26 11:04:51,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:51,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673042f83206171a90daa HTTP/1.1" 200 None 2025-09-26 11:04:51,906 - lava_callback - DEBUG - Processing node 68d673042f83206171a90daa: baseline-arm64 2025-09-26 11:04:52,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:04:53,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:04:53,501 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673042f83206171a90daa/log.txt.gz 2025-09-26 11:04:53,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:04:53,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:04:53,839 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673042f83206171a90daa/lava_callback.json.gz 2025-09-26 11:04:53,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:53,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673042f83206171a90daa HTTP/1.1" 200 None 2025-09-26 11:04:53,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:53,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:04:53,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:53,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673042f83206171a90daa HTTP/1.1" 200 None 2025-09-26 11:04:53,982 - lava_callback - INFO - Completed processing callback for node 68d673042f83206171a90daa 2025-09-26 11:04:56,301 - lava_callback - INFO - Received callback for node 68d3d043cd36afa834e0fcdd INFO: 172.20.0.1:57092 - "POST /node/68d3d043cd36afa834e0fcdd HTTP/1.0" 202 Accepted 2025-09-26 11:04:56,309 - lava_callback - INFO - Starting async job submit for node 68d3d043cd36afa834e0fcdd 2025-09-26 11:04:56,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:56,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d043cd36afa834e0fcdd HTTP/1.1" 200 None 2025-09-26 11:04:56,325 - lava_callback - DEBUG - Processing node 68d3d043cd36afa834e0fcdd: baseline-arm 2025-09-26 11:04:56,325 - lava_callback - ERROR - Error processing callback for node 68d3d043cd36afa834e0fcdd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:57096 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:04:57,046 - lava_callback - INFO - Received callback for node 68d3d044cd36afa834e0fce0 INFO: 172.20.0.1:57108 - "POST /node/68d3d044cd36afa834e0fce0 HTTP/1.0" 202 Accepted 2025-09-26 11:04:57,052 - lava_callback - INFO - Starting async job submit for node 68d3d044cd36afa834e0fce0 2025-09-26 11:04:57,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:57,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d044cd36afa834e0fce0 HTTP/1.1" 200 None 2025-09-26 11:04:57,068 - lava_callback - DEBUG - Processing node 68d3d044cd36afa834e0fce0: baseline-arm 2025-09-26 11:04:57,068 - lava_callback - ERROR - Error processing callback for node 68d3d044cd36afa834e0fce0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:04:57,789 - lava_callback - INFO - Received callback for node 68d3d049cd36afa834e0fce3 INFO: 172.20.0.1:57112 - "POST /node/68d3d049cd36afa834e0fce3 HTTP/1.0" 202 Accepted 2025-09-26 11:04:57,794 - lava_callback - INFO - Starting async job submit for node 68d3d049cd36afa834e0fce3 2025-09-26 11:04:57,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:57,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d049cd36afa834e0fce3 HTTP/1.1" 200 None 2025-09-26 11:04:57,809 - lava_callback - DEBUG - Processing node 68d3d049cd36afa834e0fce3: baseline-arm 2025-09-26 11:04:57,809 - lava_callback - ERROR - Error processing callback for node 68d3d049cd36afa834e0fce3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:04:58,483 - lava_callback - INFO - Received callback for node 68d3d04acd36afa834e0fce6 INFO: 172.20.0.1:57120 - "POST /node/68d3d04acd36afa834e0fce6 HTTP/1.0" 202 Accepted 2025-09-26 11:04:58,489 - lava_callback - INFO - Starting async job submit for node 68d3d04acd36afa834e0fce6 2025-09-26 11:04:58,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:04:58,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d04acd36afa834e0fce6 HTTP/1.1" 200 None 2025-09-26 11:04:58,539 - lava_callback - DEBUG - Processing node 68d3d04acd36afa834e0fce6: baseline-arm 2025-09-26 11:04:58,540 - lava_callback - ERROR - Error processing callback for node 68d3d04acd36afa834e0fce6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:05:02,417 - lava_callback - INFO - Received callback for node 68d40a3dcd36afa834e16f0f INFO: 172.20.0.1:37646 - "POST /node/68d40a3dcd36afa834e16f0f HTTP/1.0" 202 Accepted 2025-09-26 11:05:02,424 - lava_callback - INFO - Starting async job submit for node 68d40a3dcd36afa834e16f0f 2025-09-26 11:05:02,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:02,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a3dcd36afa834e16f0f HTTP/1.1" 200 None 2025-09-26 11:05:02,472 - lava_callback - DEBUG - Processing node 68d40a3dcd36afa834e16f0f: baseline-arm 2025-09-26 11:05:02,710 - lava_callback - ERROR - Error processing callback for node 68d40a3dcd36afa834e16f0f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:37654 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:05:09,031 - lava_callback - INFO - Received callback for node 68d673062f83206171a90dc7 INFO: 172.20.0.1:37656 - "POST /node/68d673062f83206171a90dc7 HTTP/1.0" 202 Accepted 2025-09-26 11:05:09,040 - lava_callback - INFO - Starting async job submit for node 68d673062f83206171a90dc7 2025-09-26 11:05:09,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:09,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673062f83206171a90dc7 HTTP/1.1" 200 None 2025-09-26 11:05:09,075 - lava_callback - DEBUG - Processing node 68d673062f83206171a90dc7: baseline-arm64 2025-09-26 11:05:09,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:05:10,714 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:05:10,714 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673062f83206171a90dc7/log.txt.gz 2025-09-26 11:05:10,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:05:10,847 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:05:10,847 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673062f83206171a90dc7/lava_callback.json.gz 2025-09-26 11:05:10,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:10,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673062f83206171a90dc7 HTTP/1.1" 200 None 2025-09-26 11:05:10,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:10,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:05:10,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:11,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673062f83206171a90dc7 HTTP/1.1" 200 None 2025-09-26 11:05:11,017 - lava_callback - INFO - Completed processing callback for node 68d673062f83206171a90dc7 INFO: 172.20.0.1:55958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40552 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:05:22,231 - lava_callback - INFO - Received callback for node 68d673092f83206171a90dca INFO: 172.20.0.1:40554 - "POST /node/68d673092f83206171a90dca HTTP/1.0" 202 Accepted 2025-09-26 11:05:22,240 - lava_callback - INFO - Starting async job submit for node 68d673092f83206171a90dca 2025-09-26 11:05:22,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:22,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673092f83206171a90dca HTTP/1.1" 200 None 2025-09-26 11:05:22,282 - lava_callback - DEBUG - Processing node 68d673092f83206171a90dca: baseline-arm64 2025-09-26 11:05:22,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:05:23,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:05:23,697 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673092f83206171a90dca/log.txt.gz 2025-09-26 11:05:23,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:05:23,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:05:23,868 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673092f83206171a90dca/lava_callback.json.gz 2025-09-26 11:05:23,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:23,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673092f83206171a90dca HTTP/1.1" 200 None 2025-09-26 11:05:23,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:23,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:05:23,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:23,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673092f83206171a90dca HTTP/1.1" 200 None 2025-09-26 11:05:23,976 - lava_callback - INFO - Completed processing callback for node 68d673092f83206171a90dca 2025-09-26 11:05:24,776 - lava_callback - INFO - Received callback for node 68d6732b2f83206171a90dec INFO: 172.20.0.1:40560 - "POST /node/68d6732b2f83206171a90dec HTTP/1.0" 202 Accepted 2025-09-26 11:05:24,783 - lava_callback - INFO - Starting async job submit for node 68d6732b2f83206171a90dec 2025-09-26 11:05:24,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:24,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6732b2f83206171a90dec HTTP/1.1" 200 None 2025-09-26 11:05:24,830 - lava_callback - DEBUG - Processing node 68d6732b2f83206171a90dec: baseline-arm64 2025-09-26 11:05:25,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:05:25,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:05:25,544 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6732b2f83206171a90dec/log.txt.gz 2025-09-26 11:05:25,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:05:25,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:05:25,687 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6732b2f83206171a90dec/lava_callback.json.gz 2025-09-26 11:05:25,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:25,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6732b2f83206171a90dec HTTP/1.1" 200 None 2025-09-26 11:05:25,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:25,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:05:25,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:25,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6732b2f83206171a90dec HTTP/1.1" 200 None 2025-09-26 11:05:25,803 - lava_callback - INFO - Completed processing callback for node 68d6732b2f83206171a90dec 2025-09-26 11:05:26,157 - lava_callback - INFO - Received callback for node 68d673262f83206171a90de9 INFO: 172.20.0.1:40562 - "POST /node/68d673262f83206171a90de9 HTTP/1.0" 202 Accepted 2025-09-26 11:05:26,167 - lava_callback - INFO - Starting async job submit for node 68d673262f83206171a90de9 2025-09-26 11:05:26,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:26,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673262f83206171a90de9 HTTP/1.1" 200 None 2025-09-26 11:05:26,218 - lava_callback - DEBUG - Processing node 68d673262f83206171a90de9: baseline-arm64 INFO: 172.20.0.1:40568 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:05:26,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:05:29,117 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:05:29,118 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673262f83206171a90de9/log.txt.gz 2025-09-26 11:05:29,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:05:30,097 - lava_callback - INFO - Received callback for node 68d3d06ecd36afa834e0fd31 INFO: 172.20.0.1:42594 - "POST /node/68d3d06ecd36afa834e0fd31 HTTP/1.0" 202 Accepted 2025-09-26 11:05:30,103 - lava_callback - INFO - Starting async job submit for node 68d3d06ecd36afa834e0fd31 2025-09-26 11:05:30,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:30,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d06ecd36afa834e0fd31 HTTP/1.1" 200 None 2025-09-26 11:05:30,117 - lava_callback - DEBUG - Processing node 68d3d06ecd36afa834e0fd31: baseline-arm-broonie 2025-09-26 11:05:30,117 - lava_callback - ERROR - Error processing callback for node 68d3d06ecd36afa834e0fd31: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:05:31,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:05:31,472 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673262f83206171a90de9/lava_callback.json.gz 2025-09-26 11:05:31,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:31,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673262f83206171a90de9 HTTP/1.1" 200 None 2025-09-26 11:05:31,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:31,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:05:31,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:31,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673262f83206171a90de9 HTTP/1.1" 200 None 2025-09-26 11:05:31,569 - lava_callback - INFO - Completed processing callback for node 68d673262f83206171a90de9 2025-09-26 11:05:36,180 - lava_callback - INFO - Received callback for node 68d3d06bcd36afa834e0fd2b INFO: 172.20.0.1:42608 - "POST /node/68d3d06bcd36afa834e0fd2b HTTP/1.0" 202 Accepted 2025-09-26 11:05:36,189 - lava_callback - INFO - Starting async job submit for node 68d3d06bcd36afa834e0fd2b 2025-09-26 11:05:36,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:36,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d06bcd36afa834e0fd2b HTTP/1.1" 200 None 2025-09-26 11:05:36,204 - lava_callback - DEBUG - Processing node 68d3d06bcd36afa834e0fd2b: baseline-arm 2025-09-26 11:05:36,204 - lava_callback - ERROR - Error processing callback for node 68d3d06bcd36afa834e0fd2b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:42612 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:05:36,922 - lava_callback - INFO - Received callback for node 68d3d06ccd36afa834e0fd2e INFO: 172.20.0.1:42628 - "POST /node/68d3d06ccd36afa834e0fd2e HTTP/1.0" 202 Accepted 2025-09-26 11:05:36,933 - lava_callback - INFO - Starting async job submit for node 68d3d06ccd36afa834e0fd2e 2025-09-26 11:05:36,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:37,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d06ccd36afa834e0fd2e HTTP/1.1" 200 None 2025-09-26 11:05:37,006 - lava_callback - DEBUG - Processing node 68d3d06ccd36afa834e0fd2e: baseline-arm 2025-09-26 11:05:37,007 - lava_callback - ERROR - Error processing callback for node 68d3d06ccd36afa834e0fd2e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:05:37,694 - lava_callback - INFO - Received callback for node 68d3d072cd36afa834e0fd34 INFO: 172.20.0.1:42642 - "POST /node/68d3d072cd36afa834e0fd34 HTTP/1.0" 202 Accepted 2025-09-26 11:05:37,713 - lava_callback - INFO - Starting async job submit for node 68d3d072cd36afa834e0fd34 2025-09-26 11:05:37,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:37,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d072cd36afa834e0fd34 HTTP/1.1" 200 None 2025-09-26 11:05:37,789 - lava_callback - DEBUG - Processing node 68d3d072cd36afa834e0fd34: baseline-arm 2025-09-26 11:05:37,789 - lava_callback - ERROR - Error processing callback for node 68d3d072cd36afa834e0fd34: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:05:38,542 - lava_callback - INFO - Received callback for node 68d3d072cd36afa834e0fd37 INFO: 172.20.0.1:42656 - "POST /node/68d3d072cd36afa834e0fd37 HTTP/1.0" 202 Accepted 2025-09-26 11:05:38,553 - lava_callback - INFO - Starting async job submit for node 68d3d072cd36afa834e0fd37 2025-09-26 11:05:38,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:38,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d072cd36afa834e0fd37 HTTP/1.1" 200 None 2025-09-26 11:05:38,583 - lava_callback - DEBUG - Processing node 68d3d072cd36afa834e0fd37: baseline-arm 2025-09-26 11:05:38,583 - lava_callback - ERROR - Error processing callback for node 68d3d072cd36afa834e0fd37: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:05:39,220 - lava_callback - INFO - Received callback for node 68d3d078cd36afa834e0fd3d INFO: 172.20.0.1:42658 - "POST /node/68d3d078cd36afa834e0fd3d HTTP/1.0" 202 Accepted 2025-09-26 11:05:39,229 - lava_callback - INFO - Starting async job submit for node 68d3d078cd36afa834e0fd3d 2025-09-26 11:05:39,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:39,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d078cd36afa834e0fd3d HTTP/1.1" 200 None 2025-09-26 11:05:39,254 - lava_callback - DEBUG - Processing node 68d3d078cd36afa834e0fd3d: baseline-arm 2025-09-26 11:05:39,254 - lava_callback - ERROR - Error processing callback for node 68d3d078cd36afa834e0fd3d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:05:39,909 - lava_callback - INFO - Received callback for node 68d3d078cd36afa834e0fd40 INFO: 172.20.0.1:37300 - "POST /node/68d3d078cd36afa834e0fd40 HTTP/1.0" 202 Accepted 2025-09-26 11:05:39,918 - lava_callback - INFO - Starting async job submit for node 68d3d078cd36afa834e0fd40 2025-09-26 11:05:39,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:39,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d078cd36afa834e0fd40 HTTP/1.1" 200 None 2025-09-26 11:05:39,932 - lava_callback - DEBUG - Processing node 68d3d078cd36afa834e0fd40: baseline-arm 2025-09-26 11:05:39,932 - lava_callback - ERROR - Error processing callback for node 68d3d078cd36afa834e0fd40: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:05:40,623 - lava_callback - INFO - Received callback for node 68d3d07acd36afa834e0fd43 INFO: 172.20.0.1:37314 - "POST /node/68d3d07acd36afa834e0fd43 HTTP/1.0" 202 Accepted 2025-09-26 11:05:40,634 - lava_callback - INFO - Starting async job submit for node 68d3d07acd36afa834e0fd43 2025-09-26 11:05:40,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:40,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d07acd36afa834e0fd43 HTTP/1.1" 200 None 2025-09-26 11:05:40,659 - lava_callback - DEBUG - Processing node 68d3d07acd36afa834e0fd43: baseline-arm 2025-09-26 11:05:40,659 - lava_callback - ERROR - Error processing callback for node 68d3d07acd36afa834e0fd43: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:05:41,324 - lava_callback - INFO - Received callback for node 68d3d07dcd36afa834e0fd46 INFO: 172.20.0.1:37326 - "POST /node/68d3d07dcd36afa834e0fd46 HTTP/1.0" 202 Accepted 2025-09-26 11:05:41,330 - lava_callback - INFO - Starting async job submit for node 68d3d07dcd36afa834e0fd46 2025-09-26 11:05:41,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:41,334 - lava_callback - INFO - Received callback for node 68d673242f83206171a90de6 INFO: 172.20.0.1:37334 - "POST /node/68d673242f83206171a90de6 HTTP/1.0" 202 Accepted 2025-09-26 11:05:41,342 - lava_callback - INFO - Starting async job submit for node 68d673242f83206171a90de6 2025-09-26 11:05:41,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d07dcd36afa834e0fd46 HTTP/1.1" 200 None 2025-09-26 11:05:41,374 - lava_callback - DEBUG - Processing node 68d3d07dcd36afa834e0fd46: baseline-arm 2025-09-26 11:05:41,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:41,375 - lava_callback - ERROR - Error processing callback for node 68d3d07dcd36afa834e0fd46: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:05:41,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673242f83206171a90de6 HTTP/1.1" 200 None 2025-09-26 11:05:41,391 - lava_callback - DEBUG - Processing node 68d673242f83206171a90de6: baseline-arm64 2025-09-26 11:05:41,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:05:42,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:05:42,083 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673242f83206171a90de6/log.txt.gz 2025-09-26 11:05:42,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:05:42,255 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:05:42,256 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673242f83206171a90de6/lava_callback.json.gz 2025-09-26 11:05:42,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:42,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673242f83206171a90de6 HTTP/1.1" 200 None 2025-09-26 11:05:42,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:42,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:05:42,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:42,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673242f83206171a90de6 HTTP/1.1" 200 None 2025-09-26 11:05:42,355 - lava_callback - INFO - Completed processing callback for node 68d673242f83206171a90de6 2025-09-26 11:05:42,796 - lava_callback - INFO - Received callback for node 68d673212f83206171a90de3 INFO: 172.20.0.1:37342 - "POST /node/68d673212f83206171a90de3 HTTP/1.0" 202 Accepted 2025-09-26 11:05:42,803 - lava_callback - INFO - Starting async job submit for node 68d673212f83206171a90de3 2025-09-26 11:05:42,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:42,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673212f83206171a90de3 HTTP/1.1" 200 None 2025-09-26 11:05:42,843 - lava_callback - DEBUG - Processing node 68d673212f83206171a90de3: baseline-arm64 2025-09-26 11:05:43,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:05:44,198 - lava_callback - INFO - Received callback for node 68d6731f2f83206171a90de0 INFO: 172.20.0.1:37346 - "POST /node/68d6731f2f83206171a90de0 HTTP/1.0" 202 Accepted 2025-09-26 11:05:44,228 - lava_callback - INFO - Starting async job submit for node 68d6731f2f83206171a90de0 2025-09-26 11:05:44,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:44,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6731f2f83206171a90de0 HTTP/1.1" 200 None 2025-09-26 11:05:44,264 - lava_callback - DEBUG - Processing node 68d6731f2f83206171a90de0: baseline-arm64 2025-09-26 11:05:44,550 - lava_callback - INFO - Received callback for node 68d672d52f83206171a90d98 INFO: 172.20.0.1:37350 - "POST /node/68d672d52f83206171a90d98 HTTP/1.0" 202 Accepted 2025-09-26 11:05:44,566 - lava_callback - INFO - Starting async job submit for node 68d672d52f83206171a90d98 2025-09-26 11:05:44,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:44,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:05:44,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d672d52f83206171a90d98 HTTP/1.1" 200 None 2025-09-26 11:05:44,670 - lava_callback - DEBUG - Processing node 68d672d52f83206171a90d98: baseline-arm64 2025-09-26 11:05:44,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:05:45,642 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:05:45,643 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d672d52f83206171a90d98/log.txt.gz 2025-09-26 11:05:45,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:05:45,662 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:05:45,663 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6731f2f83206171a90de0/log.txt.gz 2025-09-26 11:05:45,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:05:45,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:05:45,707 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673212f83206171a90de3/log.txt.gz 2025-09-26 11:05:45,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:05:45,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:05:45,819 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d672d52f83206171a90d98/lava_callback.json.gz 2025-09-26 11:05:45,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:45,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:05:45,844 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6731f2f83206171a90de0/lava_callback.json.gz 2025-09-26 11:05:45,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:45,878 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:05:45,879 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673212f83206171a90de3/lava_callback.json.gz 2025-09-26 11:05:45,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d672d52f83206171a90d98 HTTP/1.1" 200 None 2025-09-26 11:05:45,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:45,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:45,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6731f2f83206171a90de0 HTTP/1.1" 200 None 2025-09-26 11:05:45,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:45,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673212f83206171a90de3 HTTP/1.1" 200 None 2025-09-26 11:05:45,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:05:45,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:45,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:45,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:05:45,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:45,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:05:45,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:05:46,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6731f2f83206171a90de0 HTTP/1.1" 200 None 2025-09-26 11:05:46,036 - lava_callback - INFO - Completed processing callback for node 68d6731f2f83206171a90de0 2025-09-26 11:05:46,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d672d52f83206171a90d98 HTTP/1.1" 200 None 2025-09-26 11:05:46,114 - lava_callback - INFO - Completed processing callback for node 68d672d52f83206171a90d98 2025-09-26 11:05:46,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673212f83206171a90de3 HTTP/1.1" 200 None 2025-09-26 11:05:46,118 - lava_callback - INFO - Completed processing callback for node 68d673212f83206171a90de3 INFO: 172.20.0.1:37352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49684 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:06:02,565 - lava_callback - INFO - Received callback for node 68d672d82f83206171a90d9b INFO: 172.20.0.1:57846 - "POST /node/68d672d82f83206171a90d9b HTTP/1.0" 202 Accepted 2025-09-26 11:06:02,573 - lava_callback - INFO - Starting async job submit for node 68d672d82f83206171a90d9b 2025-09-26 11:06:02,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:02,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d672d82f83206171a90d9b HTTP/1.1" 200 None 2025-09-26 11:06:02,612 - lava_callback - DEBUG - Processing node 68d672d82f83206171a90d9b: baseline-arm64 2025-09-26 11:06:02,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:06:03,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:06:03,421 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d672d82f83206171a90d9b/log.txt.gz 2025-09-26 11:06:03,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:06:03,598 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:06:03,599 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d672d82f83206171a90d9b/lava_callback.json.gz 2025-09-26 11:06:03,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:03,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d672d82f83206171a90d9b HTTP/1.1" 200 None 2025-09-26 11:06:03,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:03,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:06:03,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:03,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d672d82f83206171a90d9b HTTP/1.1" 200 None 2025-09-26 11:06:03,737 - lava_callback - INFO - Completed processing callback for node 68d672d82f83206171a90d9b INFO: 172.20.0.1:57848 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:06:08,536 - lava_callback - INFO - Received callback for node 68d3d04dcd36afa834e0fce9 INFO: 172.20.0.1:57862 - "POST /node/68d3d04dcd36afa834e0fce9 HTTP/1.0" 202 Accepted 2025-09-26 11:06:08,546 - lava_callback - INFO - Starting async job submit for node 68d3d04dcd36afa834e0fce9 2025-09-26 11:06:08,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:08,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d04dcd36afa834e0fce9 HTTP/1.1" 200 None 2025-09-26 11:06:08,596 - lava_callback - DEBUG - Processing node 68d3d04dcd36afa834e0fce9: baseline-arm-broonie 2025-09-26 11:06:08,808 - lava_callback - ERROR - Error processing callback for node 68d3d04dcd36afa834e0fce9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:06:10,416 - lava_callback - INFO - Received callback for node 68d673552f83206171a90e4b INFO: 172.20.0.1:34982 - "POST /node/68d673552f83206171a90e4b HTTP/1.0" 202 Accepted 2025-09-26 11:06:10,423 - lava_callback - INFO - Starting async job submit for node 68d673552f83206171a90e4b 2025-09-26 11:06:10,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:10,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673552f83206171a90e4b HTTP/1.1" 200 None 2025-09-26 11:06:10,469 - lava_callback - DEBUG - Processing node 68d673552f83206171a90e4b: baseline-arm64 2025-09-26 11:06:10,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:06:11,103 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:06:11,104 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673552f83206171a90e4b/log.txt.gz 2025-09-26 11:06:11,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:06:12,948 - lava_callback - INFO - Received callback for node 68d6730b2f83206171a90dcd INFO: 172.20.0.1:34986 - "POST /node/68d6730b2f83206171a90dcd HTTP/1.0" 202 Accepted 2025-09-26 11:06:12,954 - lava_callback - INFO - Starting async job submit for node 68d6730b2f83206171a90dcd 2025-09-26 11:06:12,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:12,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6730b2f83206171a90dcd HTTP/1.1" 200 None 2025-09-26 11:06:12,991 - lava_callback - DEBUG - Processing node 68d6730b2f83206171a90dcd: baseline-arm64 2025-09-26 11:06:13,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:06:13,585 - lava_callback - INFO - Received callback for node 68d3d099cd36afa834e0fd6b INFO: 172.20.0.1:35002 - "POST /node/68d3d099cd36afa834e0fd6b HTTP/1.0" 202 Accepted 2025-09-26 11:06:13,592 - lava_callback - INFO - Starting async job submit for node 68d3d099cd36afa834e0fd6b 2025-09-26 11:06:13,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:13,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d099cd36afa834e0fd6b HTTP/1.1" 200 None 2025-09-26 11:06:13,619 - lava_callback - DEBUG - Processing node 68d3d099cd36afa834e0fd6b: baseline-arm-broonie 2025-09-26 11:06:13,619 - lava_callback - ERROR - Error processing callback for node 68d3d099cd36afa834e0fd6b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:06:13,816 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:06:13,817 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673552f83206171a90e4b/lava_callback.json.gz 2025-09-26 11:06:13,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:06:13,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:13,853 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6730b2f83206171a90dcd/log.txt.gz 2025-09-26 11:06:13,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:06:13,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673552f83206171a90e4b HTTP/1.1" 200 None 2025-09-26 11:06:13,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:13,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:06:13,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:13,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673552f83206171a90e4b HTTP/1.1" 200 None 2025-09-26 11:06:13,940 - lava_callback - INFO - Completed processing callback for node 68d673552f83206171a90e4b INFO: 172.20.0.1:35008 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 11:06:16,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:06:16,254 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6730b2f83206171a90dcd/lava_callback.json.gz 2025-09-26 11:06:16,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:16,277 - lava_callback - INFO - Received callback for node 68d673532f83206171a90e45 INFO: 172.20.0.1:35014 - "POST /node/68d673532f83206171a90e45 HTTP/1.0" 202 Accepted 2025-09-26 11:06:16,286 - lava_callback - INFO - Starting async job submit for node 68d673532f83206171a90e45 2025-09-26 11:06:16,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:16,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6730b2f83206171a90dcd HTTP/1.1" 200 None 2025-09-26 11:06:16,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:16,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673532f83206171a90e45 HTTP/1.1" 200 None 2025-09-26 11:06:16,332 - lava_callback - DEBUG - Processing node 68d673532f83206171a90e45: baseline-arm64 2025-09-26 11:06:16,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:06:16,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:35026 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:06:16,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6730b2f83206171a90dcd HTTP/1.1" 200 None 2025-09-26 11:06:16,532 - lava_callback - INFO - Completed processing callback for node 68d6730b2f83206171a90dcd 2025-09-26 11:06:17,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:06:17,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:06:17,145 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673532f83206171a90e45/log.txt.gz 2025-09-26 11:06:17,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:06:17,303 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:06:17,304 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673532f83206171a90e45/lava_callback.json.gz 2025-09-26 11:06:17,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:17,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673532f83206171a90e45 HTTP/1.1" 200 None 2025-09-26 11:06:17,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:17,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:06:17,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:17,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673532f83206171a90e45 HTTP/1.1" 200 None 2025-09-26 11:06:17,411 - lava_callback - INFO - Completed processing callback for node 68d673532f83206171a90e45 INFO: 172.20.0.1:38348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38366 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:06:27,319 - lava_callback - INFO - Received callback for node 68d673582f83206171a90e52 INFO: 172.20.0.1:38380 - "POST /node/68d673582f83206171a90e52 HTTP/1.0" 202 Accepted 2025-09-26 11:06:27,329 - lava_callback - INFO - Starting async job submit for node 68d673582f83206171a90e52 2025-09-26 11:06:27,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:27,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673582f83206171a90e52 HTTP/1.1" 200 None 2025-09-26 11:06:27,384 - lava_callback - DEBUG - Processing node 68d673582f83206171a90e52: baseline-arm64 2025-09-26 11:06:27,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:06:29,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:06:29,018 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673582f83206171a90e52/log.txt.gz 2025-09-26 11:06:29,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:06:29,142 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:06:29,143 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673582f83206171a90e52/lava_callback.json.gz 2025-09-26 11:06:29,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:29,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673582f83206171a90e52 HTTP/1.1" 200 None 2025-09-26 11:06:29,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:29,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:06:29,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:29,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673582f83206171a90e52 HTTP/1.1" 200 None 2025-09-26 11:06:29,227 - lava_callback - INFO - Completed processing callback for node 68d673582f83206171a90e52 2025-09-26 11:06:36,412 - lava_callback - INFO - Received callback for node 68d673102f83206171a90dd0 INFO: 172.20.0.1:37184 - "POST /node/68d673102f83206171a90dd0 HTTP/1.0" 202 Accepted 2025-09-26 11:06:36,418 - lava_callback - INFO - Starting async job submit for node 68d673102f83206171a90dd0 2025-09-26 11:06:36,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:36,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673102f83206171a90dd0 HTTP/1.1" 200 None 2025-09-26 11:06:36,465 - lava_callback - DEBUG - Processing node 68d673102f83206171a90dd0: baseline-arm64 INFO: 172.20.0.1:37194 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:06:36,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:06:39,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:06:39,578 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673102f83206171a90dd0/log.txt.gz 2025-09-26 11:06:39,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:06:40,242 - lava_callback - INFO - Received callback for node 68d3cc1ccd36afa834e0f3b1 INFO: 172.20.0.1:36468 - "POST /node/68d3cc1ccd36afa834e0f3b1 HTTP/1.0" 202 Accepted 2025-09-26 11:06:40,253 - lava_callback - INFO - Starting async job submit for node 68d3cc1ccd36afa834e0f3b1 2025-09-26 11:06:40,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:40,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cc1ccd36afa834e0f3b1 HTTP/1.1" 200 None 2025-09-26 11:06:40,323 - lava_callback - DEBUG - Processing node 68d3cc1ccd36afa834e0f3b1: baseline-arm 2025-09-26 11:06:40,770 - lava_callback - ERROR - Error processing callback for node 68d3cc1ccd36afa834e0f3b1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:06:41,610 - lava_callback - INFO - Received callback for node 68d672df2f83206171a90da1 INFO: 172.20.0.1:36478 - "POST /node/68d672df2f83206171a90da1 HTTP/1.0" 202 Accepted 2025-09-26 11:06:41,615 - lava_callback - INFO - Starting async job submit for node 68d672df2f83206171a90da1 2025-09-26 11:06:41,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:41,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d672df2f83206171a90da1 HTTP/1.1" 200 None 2025-09-26 11:06:41,651 - lava_callback - DEBUG - Processing node 68d672df2f83206171a90da1: baseline-arm64 2025-09-26 11:06:41,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:06:42,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:06:42,330 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d672df2f83206171a90da1/log.txt.gz 2025-09-26 11:06:42,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:06:42,334 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673102f83206171a90dd0/lava_callback.json.gz 2025-09-26 11:06:42,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:06:42,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:42,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673102f83206171a90dd0 HTTP/1.1" 200 None 2025-09-26 11:06:42,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:42,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:06:42,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:42,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673102f83206171a90dd0 HTTP/1.1" 200 None 2025-09-26 11:06:42,444 - lava_callback - INFO - Completed processing callback for node 68d673102f83206171a90dd0 2025-09-26 11:06:42,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:06:42,551 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d672df2f83206171a90da1/lava_callback.json.gz 2025-09-26 11:06:42,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:42,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d672df2f83206171a90da1 HTTP/1.1" 200 None 2025-09-26 11:06:42,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:42,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:06:42,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:42,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d672df2f83206171a90da1 HTTP/1.1" 200 None 2025-09-26 11:06:42,676 - lava_callback - INFO - Completed processing callback for node 68d672df2f83206171a90da1 2025-09-26 11:06:42,985 - lava_callback - INFO - Received callback for node 68d672dd2f83206171a90d9e INFO: 172.20.0.1:36494 - "POST /node/68d672dd2f83206171a90d9e HTTP/1.0" 202 Accepted 2025-09-26 11:06:42,993 - lava_callback - INFO - Starting async job submit for node 68d672dd2f83206171a90d9e 2025-09-26 11:06:43,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:43,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d672dd2f83206171a90d9e HTTP/1.1" 200 None 2025-09-26 11:06:43,028 - lava_callback - DEBUG - Processing node 68d672dd2f83206171a90d9e: baseline-arm64 2025-09-26 11:06:43,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:06:43,390 - lava_callback - INFO - Received callback for node 68d673312f83206171a90df6 INFO: 172.20.0.1:36508 - "POST /node/68d673312f83206171a90df6 HTTP/1.0" 202 Accepted 2025-09-26 11:06:43,408 - lava_callback - INFO - Starting async job submit for node 68d673312f83206171a90df6 2025-09-26 11:06:43,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:43,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673312f83206171a90df6 HTTP/1.1" 200 None 2025-09-26 11:06:43,467 - lava_callback - DEBUG - Processing node 68d673312f83206171a90df6: baseline-arm64 2025-09-26 11:06:43,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:06:43,607 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d672dd2f83206171a90d9e/log.txt.gz 2025-09-26 11:06:43,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:06:43,896 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:06:43,989 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d672dd2f83206171a90d9e/lava_callback.json.gz 2025-09-26 11:06:44,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:44,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d672dd2f83206171a90d9e HTTP/1.1" 200 None 2025-09-26 11:06:44,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:44,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:06:44,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:06:44,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:44,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d672dd2f83206171a90d9e HTTP/1.1" 200 None 2025-09-26 11:06:44,243 - lava_callback - INFO - Completed processing callback for node 68d672dd2f83206171a90d9e 2025-09-26 11:06:44,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:06:44,350 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673312f83206171a90df6/log.txt.gz 2025-09-26 11:06:44,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:06:44,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:06:44,543 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673312f83206171a90df6/lava_callback.json.gz 2025-09-26 11:06:44,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:44,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673312f83206171a90df6 HTTP/1.1" 200 None 2025-09-26 11:06:44,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:44,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:06:44,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:44,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673312f83206171a90df6 HTTP/1.1" 200 None 2025-09-26 11:06:44,651 - lava_callback - INFO - Completed processing callback for node 68d673312f83206171a90df6 2025-09-26 11:06:44,852 - lava_callback - INFO - Received callback for node 68d6735a2f83206171a90e55 INFO: 172.20.0.1:36516 - "POST /node/68d6735a2f83206171a90e55 HTTP/1.0" 202 Accepted 2025-09-26 11:06:44,862 - lava_callback - INFO - Starting async job submit for node 68d6735a2f83206171a90e55 2025-09-26 11:06:44,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:44,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6735a2f83206171a90e55 HTTP/1.1" 200 None 2025-09-26 11:06:44,916 - lava_callback - DEBUG - Processing node 68d6735a2f83206171a90e55: baseline-arm64 2025-09-26 11:06:45,411 - lava_callback - INFO - Received callback for node 68d6732e2f83206171a90df3 INFO: 172.20.0.1:36522 - "POST /node/68d6732e2f83206171a90df3 HTTP/1.0" 202 Accepted 2025-09-26 11:06:45,431 - lava_callback - INFO - Starting async job submit for node 68d6732e2f83206171a90df3 2025-09-26 11:06:45,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:45,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:06:45,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6732e2f83206171a90df3 HTTP/1.1" 200 None 2025-09-26 11:06:45,467 - lava_callback - DEBUG - Processing node 68d6732e2f83206171a90df3: baseline-arm64 2025-09-26 11:06:45,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:36524 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:06:48,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:06:48,079 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6735a2f83206171a90e55/log.txt.gz 2025-09-26 11:06:48,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:06:48,134 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:06:48,135 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6732e2f83206171a90df3/log.txt.gz 2025-09-26 11:06:48,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:06:48,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:06:48,301 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6735a2f83206171a90e55/lava_callback.json.gz 2025-09-26 11:06:48,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:48,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:06:48,362 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6732e2f83206171a90df3/lava_callback.json.gz 2025-09-26 11:06:48,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:48,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6735a2f83206171a90e55 HTTP/1.1" 200 None 2025-09-26 11:06:48,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:48,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:06:48,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:48,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6732e2f83206171a90df3 HTTP/1.1" 200 None 2025-09-26 11:06:48,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:48,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:06:48,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:48,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6735a2f83206171a90e55 HTTP/1.1" 200 None 2025-09-26 11:06:48,475 - lava_callback - INFO - Completed processing callback for node 68d6735a2f83206171a90e55 2025-09-26 11:06:48,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6732e2f83206171a90df3 HTTP/1.1" 200 None 2025-09-26 11:06:48,509 - lava_callback - INFO - Completed processing callback for node 68d6732e2f83206171a90df3 2025-09-26 11:06:55,449 - lava_callback - INFO - Received callback for node 68d6736c2f83206171a90e68 INFO: 172.20.0.1:55308 - "POST /node/68d6736c2f83206171a90e68 HTTP/1.0" 202 Accepted 2025-09-26 11:06:55,459 - lava_callback - INFO - Starting async job submit for node 68d6736c2f83206171a90e68 2025-09-26 11:06:55,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:55,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6736c2f83206171a90e68 HTTP/1.1" 200 None 2025-09-26 11:06:55,510 - lava_callback - DEBUG - Processing node 68d6736c2f83206171a90e68: baseline-arm64 2025-09-26 11:06:55,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:06:56,066 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:06:56,067 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6736c2f83206171a90e68/log.txt.gz 2025-09-26 11:06:56,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:06:56,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:06:56,241 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6736c2f83206171a90e68/lava_callback.json.gz 2025-09-26 11:06:56,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:56,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6736c2f83206171a90e68 HTTP/1.1" 200 None 2025-09-26 11:06:56,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:56,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:06:56,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:56,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6736c2f83206171a90e68 HTTP/1.1" 200 None 2025-09-26 11:06:56,348 - lava_callback - INFO - Completed processing callback for node 68d6736c2f83206171a90e68 2025-09-26 11:06:56,378 - lava_callback - INFO - Received callback for node 68d3d0c9cd36afa834e0fe2a INFO: 172.20.0.1:55320 - "POST /node/68d3d0c9cd36afa834e0fe2a HTTP/1.0" 202 Accepted 2025-09-26 11:06:56,387 - lava_callback - INFO - Starting async job submit for node 68d3d0c9cd36afa834e0fe2a 2025-09-26 11:06:56,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:56,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d0c9cd36afa834e0fe2a HTTP/1.1" 200 None 2025-09-26 11:06:56,424 - lava_callback - DEBUG - Processing node 68d3d0c9cd36afa834e0fe2a: baseline-arm 2025-09-26 11:06:56,424 - lava_callback - ERROR - Error processing callback for node 68d3d0c9cd36afa834e0fe2a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:55334 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:06:57,671 - lava_callback - INFO - Received callback for node 68d3d0cdcd36afa834e0fe2d INFO: 172.20.0.1:55340 - "POST /node/68d3d0cdcd36afa834e0fe2d HTTP/1.0" 202 Accepted 2025-09-26 11:06:57,676 - lava_callback - INFO - Starting async job submit for node 68d3d0cdcd36afa834e0fe2d 2025-09-26 11:06:57,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:57,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d0cdcd36afa834e0fe2d HTTP/1.1" 200 None 2025-09-26 11:06:57,691 - lava_callback - DEBUG - Processing node 68d3d0cdcd36afa834e0fe2d: baseline-arm 2025-09-26 11:06:57,691 - lava_callback - ERROR - Error processing callback for node 68d3d0cdcd36afa834e0fe2d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:06:58,390 - lava_callback - INFO - Received callback for node 68d3d0cecd36afa834e0fe30 INFO: 172.20.0.1:55356 - "POST /node/68d3d0cecd36afa834e0fe30 HTTP/1.0" 202 Accepted 2025-09-26 11:06:58,396 - lava_callback - INFO - Starting async job submit for node 68d3d0cecd36afa834e0fe30 2025-09-26 11:06:58,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:58,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d0cecd36afa834e0fe30 HTTP/1.1" 200 None 2025-09-26 11:06:58,412 - lava_callback - DEBUG - Processing node 68d3d0cecd36afa834e0fe30: baseline-arm 2025-09-26 11:06:58,412 - lava_callback - ERROR - Error processing callback for node 68d3d0cecd36afa834e0fe30: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:06:59,652 - lava_callback - INFO - Received callback for node 68d673732f83206171a90e6e INFO: 172.20.0.1:49662 - "POST /node/68d673732f83206171a90e6e HTTP/1.0" 202 Accepted 2025-09-26 11:06:59,658 - lava_callback - INFO - Starting async job submit for node 68d673732f83206171a90e6e 2025-09-26 11:06:59,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:06:59,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673732f83206171a90e6e HTTP/1.1" 200 None 2025-09-26 11:06:59,704 - lava_callback - DEBUG - Processing node 68d673732f83206171a90e6e: baseline-arm64 2025-09-26 11:06:59,917 - lava_callback - INFO - Received callback for node 68d673132f83206171a90dd3 INFO: 172.20.0.1:49678 - "POST /node/68d673132f83206171a90dd3 HTTP/1.0" 202 Accepted 2025-09-26 11:06:59,941 - lava_callback - INFO - Starting async job submit for node 68d673132f83206171a90dd3 2025-09-26 11:07:00,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:00,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673132f83206171a90dd3 HTTP/1.1" 200 None 2025-09-26 11:07:00,095 - lava_callback - DEBUG - Processing node 68d673132f83206171a90dd3: baseline-arm64 2025-09-26 11:07:00,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:00,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:00,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:00,788 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673732f83206171a90e6e/log.txt.gz 2025-09-26 11:07:00,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:00,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:00,915 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673132f83206171a90dd3/log.txt.gz 2025-09-26 11:07:00,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:00,962 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:00,963 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673732f83206171a90e6e/lava_callback.json.gz 2025-09-26 11:07:00,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:01,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673732f83206171a90e6e HTTP/1.1" 200 None 2025-09-26 11:07:01,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:01,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:07:01,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:01,066 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:01,067 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673132f83206171a90dd3/lava_callback.json.gz 2025-09-26 11:07:01,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673732f83206171a90e6e HTTP/1.1" 200 None 2025-09-26 11:07:01,098 - lava_callback - INFO - Completed processing callback for node 68d673732f83206171a90e6e 2025-09-26 11:07:01,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:01,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673132f83206171a90dd3 HTTP/1.1" 200 None 2025-09-26 11:07:01,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:01,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:07:01,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:01,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673132f83206171a90dd3 HTTP/1.1" 200 None 2025-09-26 11:07:01,226 - lava_callback - INFO - Completed processing callback for node 68d673132f83206171a90dd3 2025-09-26 11:07:04,427 - lava_callback - INFO - Received callback for node 68d6736f2f83206171a90e6b INFO: 172.20.0.1:49684 - "POST /node/68d6736f2f83206171a90e6b HTTP/1.0" 202 Accepted 2025-09-26 11:07:04,435 - lava_callback - INFO - Starting async job submit for node 68d6736f2f83206171a90e6b 2025-09-26 11:07:04,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:04,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6736f2f83206171a90e6b HTTP/1.1" 200 None 2025-09-26 11:07:04,503 - lava_callback - DEBUG - Processing node 68d6736f2f83206171a90e6b: baseline-arm64 2025-09-26 11:07:05,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:05,177 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:05,178 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6736f2f83206171a90e6b/log.txt.gz 2025-09-26 11:07:05,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:05,344 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:05,345 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6736f2f83206171a90e6b/lava_callback.json.gz 2025-09-26 11:07:05,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:05,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6736f2f83206171a90e6b HTTP/1.1" 200 None 2025-09-26 11:07:05,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:05,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:07:05,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:05,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6736f2f83206171a90e6b HTTP/1.1" 200 None 2025-09-26 11:07:05,452 - lava_callback - INFO - Completed processing callback for node 68d6736f2f83206171a90e6b INFO: 172.20.0.1:49688 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:07:08,126 - lava_callback - INFO - Received callback for node 68d673172f83206171a90dd6 INFO: 172.20.0.1:49698 - "POST /node/68d673172f83206171a90dd6 HTTP/1.0" 202 Accepted 2025-09-26 11:07:08,132 - lava_callback - INFO - Starting async job submit for node 68d673172f83206171a90dd6 2025-09-26 11:07:08,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:08,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673172f83206171a90dd6 HTTP/1.1" 200 None 2025-09-26 11:07:08,178 - lava_callback - DEBUG - Processing node 68d673172f83206171a90dd6: baseline-arm64 2025-09-26 11:07:08,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:09,574 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:09,575 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673172f83206171a90dd6/log.txt.gz 2025-09-26 11:07:09,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:09,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:09,718 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673172f83206171a90dd6/lava_callback.json.gz 2025-09-26 11:07:09,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:09,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673172f83206171a90dd6 HTTP/1.1" 200 None 2025-09-26 11:07:09,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:09,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:07:09,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:09,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673172f83206171a90dd6 HTTP/1.1" 200 None 2025-09-26 11:07:09,815 - lava_callback - INFO - Completed processing callback for node 68d673172f83206171a90dd6 2025-09-26 11:07:12,099 - lava_callback - INFO - Received callback for node 68d40a3fcd36afa834e16f12 INFO: 172.20.0.1:43096 - "POST /node/68d40a3fcd36afa834e16f12 HTTP/1.0" 202 Accepted 2025-09-26 11:07:12,108 - lava_callback - INFO - Starting async job submit for node 68d40a3fcd36afa834e16f12 2025-09-26 11:07:12,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:12,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a3fcd36afa834e16f12 HTTP/1.1" 200 None 2025-09-26 11:07:12,155 - lava_callback - DEBUG - Processing node 68d40a3fcd36afa834e16f12: baseline-arm 2025-09-26 11:07:12,448 - lava_callback - ERROR - Error processing callback for node 68d40a3fcd36afa834e16f12: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:43098 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 11:07:15,936 - lava_callback - INFO - Received callback for node 68d3d0d0cd36afa834e0fe33 INFO: 172.20.0.1:43110 - "POST /node/68d3d0d0cd36afa834e0fe33 HTTP/1.0" 202 Accepted 2025-09-26 11:07:15,945 - lava_callback - INFO - Starting async job submit for node 68d3d0d0cd36afa834e0fe33 2025-09-26 11:07:15,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:15,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d0d0cd36afa834e0fe33 HTTP/1.1" 200 None 2025-09-26 11:07:15,967 - lava_callback - DEBUG - Processing node 68d3d0d0cd36afa834e0fe33: baseline-arm 2025-09-26 11:07:15,967 - lava_callback - ERROR - Error processing callback for node 68d3d0d0cd36afa834e0fe33: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:07:16,189 - lava_callback - INFO - Received callback for node 68d6731a2f83206171a90dd9 INFO: 172.20.0.1:43116 - "POST /node/68d6731a2f83206171a90dd9 HTTP/1.0" 202 Accepted 2025-09-26 11:07:16,197 - lava_callback - INFO - Starting async job submit for node 68d6731a2f83206171a90dd9 2025-09-26 11:07:16,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:16,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6731a2f83206171a90dd9 HTTP/1.1" 200 None 2025-09-26 11:07:16,236 - lava_callback - DEBUG - Processing node 68d6731a2f83206171a90dd9: baseline-arm64 INFO: 172.20.0.1:43130 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:07:16,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:16,679 - lava_callback - INFO - Received callback for node 68d3d0d2cd36afa834e0fe36 INFO: 172.20.0.1:43142 - "POST /node/68d3d0d2cd36afa834e0fe36 HTTP/1.0" 202 Accepted 2025-09-26 11:07:16,688 - lava_callback - INFO - Starting async job submit for node 68d3d0d2cd36afa834e0fe36 2025-09-26 11:07:16,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:16,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d0d2cd36afa834e0fe36 HTTP/1.1" 200 None 2025-09-26 11:07:16,704 - lava_callback - DEBUG - Processing node 68d3d0d2cd36afa834e0fe36: baseline-arm 2025-09-26 11:07:16,704 - lava_callback - ERROR - Error processing callback for node 68d3d0d2cd36afa834e0fe36: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:07:16,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:16,773 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6731a2f83206171a90dd9/log.txt.gz 2025-09-26 11:07:16,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:16,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:16,960 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6731a2f83206171a90dd9/lava_callback.json.gz 2025-09-26 11:07:16,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:17,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6731a2f83206171a90dd9 HTTP/1.1" 200 None 2025-09-26 11:07:17,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:17,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:07:17,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:17,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6731a2f83206171a90dd9 HTTP/1.1" 200 None 2025-09-26 11:07:17,107 - lava_callback - INFO - Completed processing callback for node 68d6731a2f83206171a90dd9 2025-09-26 11:07:17,411 - lava_callback - INFO - Received callback for node 68d3d0d3cd36afa834e0fe39 INFO: 172.20.0.1:43150 - "POST /node/68d3d0d3cd36afa834e0fe39 HTTP/1.0" 202 Accepted 2025-09-26 11:07:17,417 - lava_callback - INFO - Starting async job submit for node 68d3d0d3cd36afa834e0fe39 2025-09-26 11:07:17,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:17,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d0d3cd36afa834e0fe39 HTTP/1.1" 200 None 2025-09-26 11:07:17,433 - lava_callback - DEBUG - Processing node 68d3d0d3cd36afa834e0fe39: baseline-arm 2025-09-26 11:07:17,433 - lava_callback - ERROR - Error processing callback for node 68d3d0d3cd36afa834e0fe39: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:07:18,100 - lava_callback - INFO - Received callback for node 68d3d0d4cd36afa834e0fe3c INFO: 172.20.0.1:43160 - "POST /node/68d3d0d4cd36afa834e0fe3c HTTP/1.0" 202 Accepted 2025-09-26 11:07:18,106 - lava_callback - INFO - Starting async job submit for node 68d3d0d4cd36afa834e0fe3c 2025-09-26 11:07:18,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:18,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d0d4cd36afa834e0fe3c HTTP/1.1" 200 None 2025-09-26 11:07:18,122 - lava_callback - DEBUG - Processing node 68d3d0d4cd36afa834e0fe3c: baseline-arm 2025-09-26 11:07:18,122 - lava_callback - ERROR - Error processing callback for node 68d3d0d4cd36afa834e0fe3c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:07:18,946 - lava_callback - INFO - Received callback for node 68d673332f83206171a90df9 INFO: 172.20.0.1:43176 - "POST /node/68d673332f83206171a90df9 HTTP/1.0" 202 Accepted 2025-09-26 11:07:18,952 - lava_callback - INFO - Starting async job submit for node 68d673332f83206171a90df9 2025-09-26 11:07:18,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:18,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673332f83206171a90df9 HTTP/1.1" 200 None 2025-09-26 11:07:18,999 - lava_callback - DEBUG - Processing node 68d673332f83206171a90df9: baseline-arm64 2025-09-26 11:07:19,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:38542 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:07:20,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:20,231 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673332f83206171a90df9/log.txt.gz 2025-09-26 11:07:20,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:20,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:20,544 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673332f83206171a90df9/lava_callback.json.gz 2025-09-26 11:07:20,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:20,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673332f83206171a90df9 HTTP/1.1" 200 None 2025-09-26 11:07:20,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:20,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:07:20,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:20,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673332f83206171a90df9 HTTP/1.1" 200 None 2025-09-26 11:07:20,639 - lava_callback - INFO - Completed processing callback for node 68d673332f83206171a90df9 INFO: 172.20.0.1:38556 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:07:23,224 - lava_callback - INFO - Received callback for node 68d673992f83206171a90ec9 INFO: 172.20.0.1:38566 - "POST /node/68d673992f83206171a90ec9 HTTP/1.0" 202 Accepted 2025-09-26 11:07:23,234 - lava_callback - INFO - Starting async job submit for node 68d673992f83206171a90ec9 2025-09-26 11:07:23,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:23,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673992f83206171a90ec9 HTTP/1.1" 200 None 2025-09-26 11:07:23,272 - lava_callback - DEBUG - Processing node 68d673992f83206171a90ec9: baseline-arm64 2025-09-26 11:07:23,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:24,801 - lava_callback - INFO - Received callback for node 68d673842f83206171a90ea4 INFO: 172.20.0.1:38574 - "POST /node/68d673842f83206171a90ea4 HTTP/1.0" 202 Accepted 2025-09-26 11:07:24,807 - lava_callback - INFO - Starting async job submit for node 68d673842f83206171a90ea4 2025-09-26 11:07:24,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:24,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673842f83206171a90ea4 HTTP/1.1" 200 None 2025-09-26 11:07:24,842 - lava_callback - DEBUG - Processing node 68d673842f83206171a90ea4: baseline-arm64 2025-09-26 11:07:25,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:25,566 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:25,566 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673992f83206171a90ec9/log.txt.gz 2025-09-26 11:07:25,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:25,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:25,603 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673842f83206171a90ea4/log.txt.gz 2025-09-26 11:07:25,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:25,750 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:25,751 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673842f83206171a90ea4/lava_callback.json.gz 2025-09-26 11:07:25,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:25,786 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673992f83206171a90ec9/lava_callback.json.gz 2025-09-26 11:07:25,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:25,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:25,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673842f83206171a90ea4 HTTP/1.1" 200 None 2025-09-26 11:07:25,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:25,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673992f83206171a90ec9 HTTP/1.1" 200 None 2025-09-26 11:07:25,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:25,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:07:25,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:25,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:07:25,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:25,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673842f83206171a90ea4 HTTP/1.1" 200 None 2025-09-26 11:07:25,933 - lava_callback - INFO - Completed processing callback for node 68d673842f83206171a90ea4 2025-09-26 11:07:25,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673992f83206171a90ec9 HTTP/1.1" 200 None 2025-09-26 11:07:25,971 - lava_callback - INFO - Completed processing callback for node 68d673992f83206171a90ec9 INFO: 172.20.0.1:38576 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:07:27,254 - lava_callback - INFO - Received callback for node 68d6739e2f83206171a90ed3 INFO: 172.20.0.1:38592 - "POST /node/68d6739e2f83206171a90ed3 HTTP/1.0" 202 Accepted 2025-09-26 11:07:27,262 - lava_callback - INFO - Starting async job submit for node 68d6739e2f83206171a90ed3 2025-09-26 11:07:27,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:27,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6739e2f83206171a90ed3 HTTP/1.1" 200 None 2025-09-26 11:07:27,302 - lava_callback - DEBUG - Processing node 68d6739e2f83206171a90ed3: baseline-arm64 2025-09-26 11:07:27,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:27,902 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:27,903 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6739e2f83206171a90ed3/log.txt.gz 2025-09-26 11:07:27,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:28,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:28,075 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6739e2f83206171a90ed3/lava_callback.json.gz 2025-09-26 11:07:28,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:28,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6739e2f83206171a90ed3 HTTP/1.1" 200 None 2025-09-26 11:07:28,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:28,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:07:28,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:28,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6739e2f83206171a90ed3 HTTP/1.1" 200 None 2025-09-26 11:07:28,187 - lava_callback - INFO - Completed processing callback for node 68d6739e2f83206171a90ed3 2025-09-26 11:07:33,175 - lava_callback - INFO - Received callback for node 68d673872f83206171a90eab INFO: 172.20.0.1:34446 - "POST /node/68d673872f83206171a90eab HTTP/1.0" 202 Accepted 2025-09-26 11:07:33,181 - lava_callback - INFO - Starting async job submit for node 68d673872f83206171a90eab 2025-09-26 11:07:33,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:33,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673872f83206171a90eab HTTP/1.1" 200 None 2025-09-26 11:07:33,231 - lava_callback - DEBUG - Processing node 68d673872f83206171a90eab: baseline-arm64 2025-09-26 11:07:33,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:33,766 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:33,767 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673872f83206171a90eab/log.txt.gz 2025-09-26 11:07:33,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:33,930 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:33,931 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673872f83206171a90eab/lava_callback.json.gz 2025-09-26 11:07:33,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:33,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673872f83206171a90eab HTTP/1.1" 200 None 2025-09-26 11:07:33,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:33,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:07:33,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:34,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673872f83206171a90eab HTTP/1.1" 200 None 2025-09-26 11:07:34,033 - lava_callback - INFO - Completed processing callback for node 68d673872f83206171a90eab INFO: 172.20.0.1:34454 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:07:36,830 - lava_callback - INFO - Received callback for node 68d673b02f83206171a90ef1 INFO: 172.20.0.1:34464 - "POST /node/68d673b02f83206171a90ef1 HTTP/1.0" 202 Accepted 2025-09-26 11:07:36,837 - lava_callback - INFO - Starting async job submit for node 68d673b02f83206171a90ef1 2025-09-26 11:07:36,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:36,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673b02f83206171a90ef1 HTTP/1.1" 200 None 2025-09-26 11:07:36,881 - lava_callback - DEBUG - Processing node 68d673b02f83206171a90ef1: baseline-arm64 2025-09-26 11:07:37,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:38,974 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:38,975 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673b02f83206171a90ef1/log.txt.gz 2025-09-26 11:07:38,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:40,831 - lava_callback - INFO - Received callback for node 68d673b22f83206171a90ef4 INFO: 172.20.0.1:60712 - "POST /node/68d673b22f83206171a90ef4 HTTP/1.0" 202 Accepted 2025-09-26 11:07:40,844 - lava_callback - INFO - Starting async job submit for node 68d673b22f83206171a90ef4 2025-09-26 11:07:40,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:40,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673b22f83206171a90ef4 HTTP/1.1" 200 None 2025-09-26 11:07:40,921 - lava_callback - DEBUG - Processing node 68d673b22f83206171a90ef4: baseline-arm64 2025-09-26 11:07:41,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:42,361 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:42,362 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673b22f83206171a90ef4/log.txt.gz 2025-09-26 11:07:42,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:42,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:42,383 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673b02f83206171a90ef1/lava_callback.json.gz 2025-09-26 11:07:42,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:42,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673b02f83206171a90ef1 HTTP/1.1" 200 None 2025-09-26 11:07:42,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:42,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:07:42,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:42,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673b02f83206171a90ef1 HTTP/1.1" 200 None 2025-09-26 11:07:42,501 - lava_callback - INFO - Completed processing callback for node 68d673b02f83206171a90ef1 2025-09-26 11:07:42,545 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:42,546 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673b22f83206171a90ef4/lava_callback.json.gz 2025-09-26 11:07:42,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:42,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673b22f83206171a90ef4 HTTP/1.1" 200 None 2025-09-26 11:07:42,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:42,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:07:42,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:42,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673b22f83206171a90ef4 HTTP/1.1" 200 None 2025-09-26 11:07:42,684 - lava_callback - INFO - Completed processing callback for node 68d673b22f83206171a90ef4 2025-09-26 11:07:43,769 - lava_callback - INFO - Received callback for node 68d673a12f83206171a90ed6 INFO: 172.20.0.1:60722 - "POST /node/68d673a12f83206171a90ed6 HTTP/1.0" 202 Accepted 2025-09-26 11:07:43,776 - lava_callback - INFO - Starting async job submit for node 68d673a12f83206171a90ed6 2025-09-26 11:07:43,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:43,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673a12f83206171a90ed6 HTTP/1.1" 200 None 2025-09-26 11:07:43,831 - lava_callback - DEBUG - Processing node 68d673a12f83206171a90ed6: baseline-arm64 2025-09-26 11:07:44,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:44,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:44,435 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673a12f83206171a90ed6/log.txt.gz 2025-09-26 11:07:44,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:44,611 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:44,612 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673a12f83206171a90ed6/lava_callback.json.gz 2025-09-26 11:07:44,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:44,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673a12f83206171a90ed6 HTTP/1.1" 200 None 2025-09-26 11:07:44,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:44,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:07:44,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:44,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673a12f83206171a90ed6 HTTP/1.1" 200 None 2025-09-26 11:07:44,725 - lava_callback - INFO - Completed processing callback for node 68d673a12f83206171a90ed6 2025-09-26 11:07:46,018 - lava_callback - INFO - Received callback for node 68d6739b2f83206171a90ed0 INFO: 172.20.0.1:60724 - "POST /node/68d6739b2f83206171a90ed0 HTTP/1.0" 202 Accepted 2025-09-26 11:07:46,024 - lava_callback - INFO - Starting async job submit for node 68d6739b2f83206171a90ed0 2025-09-26 11:07:46,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:46,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6739b2f83206171a90ed0 HTTP/1.1" 200 None 2025-09-26 11:07:46,059 - lava_callback - DEBUG - Processing node 68d6739b2f83206171a90ed0: baseline-arm64 2025-09-26 11:07:46,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:60728 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:07:47,658 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:47,659 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6739b2f83206171a90ed0/log.txt.gz 2025-09-26 11:07:47,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:47,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:47,780 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6739b2f83206171a90ed0/lava_callback.json.gz 2025-09-26 11:07:47,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:47,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6739b2f83206171a90ed0 HTTP/1.1" 200 None 2025-09-26 11:07:47,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:47,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:07:47,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:47,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6739b2f83206171a90ed0 HTTP/1.1" 200 None 2025-09-26 11:07:47,859 - lava_callback - INFO - Completed processing callback for node 68d6739b2f83206171a90ed0 2025-09-26 11:07:48,660 - lava_callback - INFO - Received callback for node 68d673a62f83206171a90edd INFO: 172.20.0.1:60742 - "POST /node/68d673a62f83206171a90edd HTTP/1.0" 202 Accepted 2025-09-26 11:07:48,669 - lava_callback - INFO - Starting async job submit for node 68d673a62f83206171a90edd 2025-09-26 11:07:48,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:48,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673a62f83206171a90edd HTTP/1.1" 200 None 2025-09-26 11:07:48,719 - lava_callback - DEBUG - Processing node 68d673a62f83206171a90edd: baseline-arm64 2025-09-26 11:07:49,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:49,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:49,360 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673a62f83206171a90edd/log.txt.gz 2025-09-26 11:07:49,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:49,566 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:49,567 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673a62f83206171a90edd/lava_callback.json.gz 2025-09-26 11:07:49,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:49,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673a62f83206171a90edd HTTP/1.1" 200 None 2025-09-26 11:07:49,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:49,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:07:49,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:49,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673a62f83206171a90edd HTTP/1.1" 200 None 2025-09-26 11:07:49,663 - lava_callback - INFO - Completed processing callback for node 68d673a62f83206171a90edd 2025-09-26 11:07:49,717 - lava_callback - INFO - Received callback for node 68d673642f83206171a90e5b INFO: 172.20.0.1:55456 - "POST /node/68d673642f83206171a90e5b HTTP/1.0" 202 Accepted 2025-09-26 11:07:49,728 - lava_callback - INFO - Starting async job submit for node 68d673642f83206171a90e5b 2025-09-26 11:07:49,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:49,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673642f83206171a90e5b HTTP/1.1" 200 None 2025-09-26 11:07:49,775 - lava_callback - DEBUG - Processing node 68d673642f83206171a90e5b: baseline-arm64 2025-09-26 11:07:50,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:50,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:50,488 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673642f83206171a90e5b/log.txt.gz 2025-09-26 11:07:50,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:50,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:50,624 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673642f83206171a90e5b/lava_callback.json.gz 2025-09-26 11:07:50,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:50,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673642f83206171a90e5b HTTP/1.1" 200 None 2025-09-26 11:07:50,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:50,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:07:50,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:50,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673642f83206171a90e5b HTTP/1.1" 200 None 2025-09-26 11:07:50,734 - lava_callback - INFO - Completed processing callback for node 68d673642f83206171a90e5b 2025-09-26 11:07:55,493 - lava_callback - INFO - Received callback for node 68d673692f83206171a90e62 INFO: 172.20.0.1:55466 - "POST /node/68d673692f83206171a90e62 HTTP/1.0" 202 Accepted 2025-09-26 11:07:55,502 - lava_callback - INFO - Starting async job submit for node 68d673692f83206171a90e62 2025-09-26 11:07:55,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:55,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673692f83206171a90e62 HTTP/1.1" 200 None 2025-09-26 11:07:55,555 - lava_callback - DEBUG - Processing node 68d673692f83206171a90e62: baseline-arm64 2025-09-26 11:07:55,916 - lava_callback - INFO - Received callback for node 68d673a82f83206171a90ee4 INFO: 172.20.0.1:55476 - "POST /node/68d673a82f83206171a90ee4 HTTP/1.0" 202 Accepted 2025-09-26 11:07:55,945 - lava_callback - INFO - Starting async job submit for node 68d673a82f83206171a90ee4 2025-09-26 11:07:55,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:07:56,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673a82f83206171a90ee4 HTTP/1.1" 200 None 2025-09-26 11:07:56,064 - lava_callback - DEBUG - Processing node 68d673a82f83206171a90ee4: baseline-arm64 2025-09-26 11:07:56,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:55480 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:07:56,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:58,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:58,302 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673a82f83206171a90ee4/log.txt.gz 2025-09-26 11:07:58,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:07:58,306 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673692f83206171a90e62/log.txt.gz 2025-09-26 11:07:58,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:07:58,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:00,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:00,714 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673a82f83206171a90ee4/lava_callback.json.gz 2025-09-26 11:08:00,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:00,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:00,747 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673692f83206171a90e62/lava_callback.json.gz 2025-09-26 11:08:00,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:00,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673a82f83206171a90ee4 HTTP/1.1" 200 None 2025-09-26 11:08:00,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:00,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673692f83206171a90e62 HTTP/1.1" 200 None 2025-09-26 11:08:00,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:00,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:08:00,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:00,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:08:00,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:00,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673a82f83206171a90ee4 HTTP/1.1" 200 None 2025-09-26 11:08:00,854 - lava_callback - INFO - Completed processing callback for node 68d673a82f83206171a90ee4 2025-09-26 11:08:00,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673692f83206171a90e62 HTTP/1.1" 200 None 2025-09-26 11:08:00,883 - lava_callback - INFO - Completed processing callback for node 68d673692f83206171a90e62 2025-09-26 11:08:01,709 - lava_callback - INFO - Received callback for node 68d673ad2f83206171a90eee INFO: 172.20.0.1:46922 - "POST /node/68d673ad2f83206171a90eee HTTP/1.0" 202 Accepted 2025-09-26 11:08:01,718 - lava_callback - INFO - Starting async job submit for node 68d673ad2f83206171a90eee 2025-09-26 11:08:01,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:01,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673ad2f83206171a90eee HTTP/1.1" 200 None 2025-09-26 11:08:01,774 - lava_callback - DEBUG - Processing node 68d673ad2f83206171a90eee: baseline-arm64 2025-09-26 11:08:02,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:02,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:02,363 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673ad2f83206171a90eee/log.txt.gz 2025-09-26 11:08:02,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:02,530 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:02,531 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673ad2f83206171a90eee/lava_callback.json.gz 2025-09-26 11:08:02,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:02,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673ad2f83206171a90eee HTTP/1.1" 200 None 2025-09-26 11:08:02,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:02,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:08:02,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:02,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673ad2f83206171a90eee HTTP/1.1" 200 None 2025-09-26 11:08:02,610 - lava_callback - INFO - Completed processing callback for node 68d673ad2f83206171a90eee 2025-09-26 11:08:03,073 - lava_callback - INFO - Received callback for node 68d673ab2f83206171a90eeb INFO: 172.20.0.1:46938 - "POST /node/68d673ab2f83206171a90eeb HTTP/1.0" 202 Accepted 2025-09-26 11:08:03,079 - lava_callback - INFO - Starting async job submit for node 68d673ab2f83206171a90eeb 2025-09-26 11:08:03,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:03,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673ab2f83206171a90eeb HTTP/1.1" 200 None 2025-09-26 11:08:03,116 - lava_callback - DEBUG - Processing node 68d673ab2f83206171a90eeb: baseline-arm64 2025-09-26 11:08:03,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:05,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:05,799 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673ab2f83206171a90eeb/log.txt.gz 2025-09-26 11:08:05,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:46954 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:08:08,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:08,302 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673ab2f83206171a90eeb/lava_callback.json.gz 2025-09-26 11:08:08,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:08,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673ab2f83206171a90eeb HTTP/1.1" 200 None 2025-09-26 11:08:08,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:08,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:08:08,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:08,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673ab2f83206171a90eeb HTTP/1.1" 200 None 2025-09-26 11:08:08,381 - lava_callback - INFO - Completed processing callback for node 68d673ab2f83206171a90eeb INFO: 172.20.0.1:47304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47318 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:08:19,457 - lava_callback - INFO - Received callback for node 68d6736a2f83206171a90e65 INFO: 172.20.0.1:54626 - "POST /node/68d6736a2f83206171a90e65 HTTP/1.0" 202 Accepted 2025-09-26 11:08:19,466 - lava_callback - INFO - Starting async job submit for node 68d6736a2f83206171a90e65 2025-09-26 11:08:19,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:19,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6736a2f83206171a90e65 HTTP/1.1" 200 None 2025-09-26 11:08:19,516 - lava_callback - DEBUG - Processing node 68d6736a2f83206171a90e65: baseline-arm64 2025-09-26 11:08:20,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:54632 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:08:20,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:20,252 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6736a2f83206171a90e65/log.txt.gz 2025-09-26 11:08:20,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:20,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:20,419 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6736a2f83206171a90e65/lava_callback.json.gz 2025-09-26 11:08:20,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:20,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6736a2f83206171a90e65 HTTP/1.1" 200 None 2025-09-26 11:08:20,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:20,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:08:20,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:20,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6736a2f83206171a90e65 HTTP/1.1" 200 None 2025-09-26 11:08:20,515 - lava_callback - INFO - Completed processing callback for node 68d6736a2f83206171a90e65 INFO: 172.20.0.1:54646 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:08:25,141 - lava_callback - INFO - Received callback for node 68d673632f83206171a90e58 INFO: 172.20.0.1:54654 - "POST /node/68d673632f83206171a90e58 HTTP/1.0" 202 Accepted 2025-09-26 11:08:25,149 - lava_callback - INFO - Starting async job submit for node 68d673632f83206171a90e58 2025-09-26 11:08:25,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:25,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673632f83206171a90e58 HTTP/1.1" 200 None 2025-09-26 11:08:25,213 - lava_callback - DEBUG - Processing node 68d673632f83206171a90e58: baseline-arm64 2025-09-26 11:08:25,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:26,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:26,060 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673632f83206171a90e58/log.txt.gz 2025-09-26 11:08:26,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:54670 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:08:28,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:28,496 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673632f83206171a90e58/lava_callback.json.gz 2025-09-26 11:08:28,519 - lava_callback - INFO - Received callback for node 68d673cd2f83206171a90f3b INFO: 172.20.0.1:54674 - "POST /node/68d673cd2f83206171a90f3b HTTP/1.0" 202 Accepted 2025-09-26 11:08:28,543 - lava_callback - INFO - Starting async job submit for node 68d673cd2f83206171a90f3b 2025-09-26 11:08:28,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:28,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:28,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673632f83206171a90e58 HTTP/1.1" 200 None 2025-09-26 11:08:28,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:28,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673cd2f83206171a90f3b HTTP/1.1" 200 None 2025-09-26 11:08:28,605 - lava_callback - DEBUG - Processing node 68d673cd2f83206171a90f3b: baseline-arm64 2025-09-26 11:08:28,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:08:28,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:28,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673632f83206171a90e58 HTTP/1.1" 200 None 2025-09-26 11:08:28,787 - lava_callback - INFO - Completed processing callback for node 68d673632f83206171a90e58 2025-09-26 11:08:29,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:29,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:29,177 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673cd2f83206171a90f3b/log.txt.gz 2025-09-26 11:08:29,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:29,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:29,298 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673cd2f83206171a90f3b/lava_callback.json.gz 2025-09-26 11:08:29,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:29,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673cd2f83206171a90f3b HTTP/1.1" 200 None 2025-09-26 11:08:29,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:29,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:08:29,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:29,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673cd2f83206171a90f3b HTTP/1.1" 200 None 2025-09-26 11:08:29,386 - lava_callback - INFO - Completed processing callback for node 68d673cd2f83206171a90f3b 2025-09-26 11:08:30,166 - lava_callback - INFO - Received callback for node 68d3d128cd36afa834e0fedf INFO: 172.20.0.1:59586 - "POST /node/68d3d128cd36afa834e0fedf HTTP/1.0" 202 Accepted 2025-09-26 11:08:30,174 - lava_callback - INFO - Starting async job submit for node 68d3d128cd36afa834e0fedf 2025-09-26 11:08:30,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:30,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d128cd36afa834e0fedf HTTP/1.1" 200 None 2025-09-26 11:08:30,200 - lava_callback - DEBUG - Processing node 68d3d128cd36afa834e0fedf: baseline-arm-broonie 2025-09-26 11:08:30,200 - lava_callback - ERROR - Error processing callback for node 68d3d128cd36afa834e0fedf: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:08:35,974 - lava_callback - INFO - Received callback for node 68d673772f83206171a90e7c INFO: 172.20.0.1:59600 - "POST /node/68d673772f83206171a90e7c HTTP/1.0" 202 Accepted 2025-09-26 11:08:35,981 - lava_callback - INFO - Starting async job submit for node 68d673772f83206171a90e7c 2025-09-26 11:08:36,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:36,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673772f83206171a90e7c HTTP/1.1" 200 None 2025-09-26 11:08:36,020 - lava_callback - DEBUG - Processing node 68d673772f83206171a90e7c: baseline-arm64 2025-09-26 11:08:36,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:59612 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:08:38,148 - lava_callback - INFO - Received callback for node 68d673cb2f83206171a90f38 INFO: 172.20.0.1:59622 - "POST /node/68d673cb2f83206171a90f38 HTTP/1.0" 202 Accepted 2025-09-26 11:08:38,157 - lava_callback - INFO - Starting async job submit for node 68d673cb2f83206171a90f38 2025-09-26 11:08:38,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:38,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673cb2f83206171a90f38 HTTP/1.1" 200 None 2025-09-26 11:08:38,192 - lava_callback - DEBUG - Processing node 68d673cb2f83206171a90f38: baseline-arm64 2025-09-26 11:08:38,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:38,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:38,880 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673772f83206171a90e7c/log.txt.gz 2025-09-26 11:08:38,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:38,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:38,916 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673cb2f83206171a90f38/log.txt.gz 2025-09-26 11:08:38,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:39,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:39,054 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673772f83206171a90e7c/lava_callback.json.gz 2025-09-26 11:08:39,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:39,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673772f83206171a90e7c HTTP/1.1" 200 None 2025-09-26 11:08:39,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:39,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:39,131 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673cb2f83206171a90f38/lava_callback.json.gz 2025-09-26 11:08:39,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:08:39,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:39,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:39,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673cb2f83206171a90f38 HTTP/1.1" 200 None 2025-09-26 11:08:39,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:39,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673772f83206171a90e7c HTTP/1.1" 200 None 2025-09-26 11:08:39,226 - lava_callback - INFO - Completed processing callback for node 68d673772f83206171a90e7c 2025-09-26 11:08:39,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:08:39,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:39,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673cb2f83206171a90f38 HTTP/1.1" 200 None 2025-09-26 11:08:39,312 - lava_callback - INFO - Completed processing callback for node 68d673cb2f83206171a90f38 2025-09-26 11:08:44,534 - lava_callback - INFO - Received callback for node 68d673792f83206171a90e7f INFO: 172.20.0.1:39070 - "POST /node/68d673792f83206171a90e7f HTTP/1.0" 202 Accepted 2025-09-26 11:08:44,541 - lava_callback - INFO - Starting async job submit for node 68d673792f83206171a90e7f 2025-09-26 11:08:44,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:44,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673792f83206171a90e7f HTTP/1.1" 200 None 2025-09-26 11:08:44,577 - lava_callback - DEBUG - Processing node 68d673792f83206171a90e7f: baseline-arm64 2025-09-26 11:08:45,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:45,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:45,385 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673792f83206171a90e7f/log.txt.gz 2025-09-26 11:08:45,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:45,545 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:45,545 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673792f83206171a90e7f/lava_callback.json.gz 2025-09-26 11:08:45,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:45,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673792f83206171a90e7f HTTP/1.1" 200 None 2025-09-26 11:08:45,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:45,621 - lava_callback - INFO - Received callback for node 68d673742f83206171a90e75 INFO: 172.20.0.1:39072 - "POST /node/68d673742f83206171a90e75 HTTP/1.0" 202 Accepted 2025-09-26 11:08:45,638 - lava_callback - INFO - Starting async job submit for node 68d673742f83206171a90e75 2025-09-26 11:08:45,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:08:45,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:45,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:45,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673742f83206171a90e75 HTTP/1.1" 200 None 2025-09-26 11:08:45,700 - lava_callback - DEBUG - Processing node 68d673742f83206171a90e75: baseline-arm64 2025-09-26 11:08:45,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673792f83206171a90e7f HTTP/1.1" 200 None 2025-09-26 11:08:45,739 - lava_callback - INFO - Completed processing callback for node 68d673792f83206171a90e7f 2025-09-26 11:08:46,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:46,389 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:46,389 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673742f83206171a90e75/log.txt.gz 2025-09-26 11:08:46,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:39074 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:08:46,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:46,549 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673742f83206171a90e75/lava_callback.json.gz 2025-09-26 11:08:46,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:46,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673742f83206171a90e75 HTTP/1.1" 200 None 2025-09-26 11:08:46,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:46,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:08:46,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:46,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673742f83206171a90e75 HTTP/1.1" 200 None 2025-09-26 11:08:46,651 - lava_callback - INFO - Completed processing callback for node 68d673742f83206171a90e75 2025-09-26 11:08:47,489 - lava_callback - INFO - Received callback for node 68d673e12f83206171a90f64 INFO: 172.20.0.1:39090 - "POST /node/68d673e12f83206171a90f64 HTTP/1.0" 202 Accepted 2025-09-26 11:08:47,497 - lava_callback - INFO - Starting async job submit for node 68d673e12f83206171a90f64 2025-09-26 11:08:47,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:47,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673e12f83206171a90f64 HTTP/1.1" 200 None 2025-09-26 11:08:47,547 - lava_callback - DEBUG - Processing node 68d673e12f83206171a90f64: baseline-arm64 2025-09-26 11:08:47,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:48,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:48,033 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673e12f83206171a90f64/log.txt.gz 2025-09-26 11:08:48,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:48,178 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:48,179 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673e12f83206171a90f64/lava_callback.json.gz 2025-09-26 11:08:48,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:48,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673e12f83206171a90f64 HTTP/1.1" 200 None 2025-09-26 11:08:48,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:48,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:08:48,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:48,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673e12f83206171a90f64 HTTP/1.1" 200 None 2025-09-26 11:08:48,277 - lava_callback - INFO - Completed processing callback for node 68d673e12f83206171a90f64 2025-09-26 11:08:48,733 - lava_callback - INFO - Received callback for node 68d673d32f83206171a90f45 INFO: 172.20.0.1:39092 - "POST /node/68d673d32f83206171a90f45 HTTP/1.0" 202 Accepted 2025-09-26 11:08:48,740 - lava_callback - INFO - Starting async job submit for node 68d673d32f83206171a90f45 2025-09-26 11:08:48,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:48,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673d32f83206171a90f45 HTTP/1.1" 200 None 2025-09-26 11:08:48,786 - lava_callback - DEBUG - Processing node 68d673d32f83206171a90f45: baseline-arm64 2025-09-26 11:08:48,829 - lava_callback - INFO - Received callback for node 68d673d02f83206171a90f42 INFO: 172.20.0.1:39108 - "POST /node/68d673d02f83206171a90f42 HTTP/1.0" 202 Accepted 2025-09-26 11:08:48,862 - lava_callback - INFO - Starting async job submit for node 68d673d02f83206171a90f42 2025-09-26 11:08:48,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:48,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673d02f83206171a90f42 HTTP/1.1" 200 None 2025-09-26 11:08:48,990 - lava_callback - DEBUG - Processing node 68d673d02f83206171a90f42: baseline-arm64 2025-09-26 11:08:49,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:49,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:49,630 - lava_callback - INFO - Received callback for node 68d673eb2f83206171a90f78 INFO: 172.20.0.1:46020 - "POST /node/68d673eb2f83206171a90f78 HTTP/1.0" 202 Accepted 2025-09-26 11:08:49,636 - lava_callback - INFO - Starting async job submit for node 68d673eb2f83206171a90f78 2025-09-26 11:08:49,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:49,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673eb2f83206171a90f78 HTTP/1.1" 200 None 2025-09-26 11:08:49,671 - lava_callback - DEBUG - Processing node 68d673eb2f83206171a90f78: baseline-arm64 2025-09-26 11:08:49,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:50,194 - lava_callback - INFO - Received callback for node 68d3d12fcd36afa834e0fee8 INFO: 172.20.0.1:46034 - "POST /node/68d3d12fcd36afa834e0fee8 HTTP/1.0" 202 Accepted 2025-09-26 11:08:50,202 - lava_callback - INFO - Starting async job submit for node 68d3d12fcd36afa834e0fee8 2025-09-26 11:08:50,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:50,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d12fcd36afa834e0fee8 HTTP/1.1" 200 None 2025-09-26 11:08:50,216 - lava_callback - DEBUG - Processing node 68d3d12fcd36afa834e0fee8: baseline-arm-broonie 2025-09-26 11:08:50,216 - lava_callback - ERROR - Error processing callback for node 68d3d12fcd36afa834e0fee8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:08:50,485 - lava_callback - INFO - Received callback for node 68d673e32f83206171a90f67 INFO: 172.20.0.1:46040 - "POST /node/68d673e32f83206171a90f67 HTTP/1.0" 202 Accepted 2025-09-26 11:08:50,491 - lava_callback - INFO - Starting async job submit for node 68d673e32f83206171a90f67 2025-09-26 11:08:50,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:50,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673e32f83206171a90f67 HTTP/1.1" 200 None 2025-09-26 11:08:50,530 - lava_callback - DEBUG - Processing node 68d673e32f83206171a90f67: baseline-arm64 2025-09-26 11:08:50,893 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:50,896 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673d02f83206171a90f42/log.txt.gz 2025-09-26 11:08:50,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:50,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:50,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:50,939 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673eb2f83206171a90f78/log.txt.gz 2025-09-26 11:08:50,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:50,950 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:50,955 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673d32f83206171a90f45/log.txt.gz 2025-09-26 11:08:50,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:51,016 - lava_callback - INFO - Received callback for node 68d3d13acd36afa834e0fef4 INFO: 172.20.0.1:46044 - "POST /node/68d3d13acd36afa834e0fef4 HTTP/1.0" 202 Accepted 2025-09-26 11:08:51,030 - lava_callback - INFO - Starting async job submit for node 68d3d13acd36afa834e0fef4 2025-09-26 11:08:51,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:51,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d13acd36afa834e0fef4 HTTP/1.1" 200 None 2025-09-26 11:08:51,060 - lava_callback - DEBUG - Processing node 68d3d13acd36afa834e0fef4: baseline-arm-broonie 2025-09-26 11:08:51,060 - lava_callback - ERROR - Error processing callback for node 68d3d13acd36afa834e0fef4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:08:51,164 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:51,164 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673e32f83206171a90f67/log.txt.gz 2025-09-26 11:08:51,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:51,182 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:51,182 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673d32f83206171a90f45/lava_callback.json.gz 2025-09-26 11:08:51,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:51,222 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:51,223 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673eb2f83206171a90f78/lava_callback.json.gz 2025-09-26 11:08:51,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:51,250 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673d02f83206171a90f42/lava_callback.json.gz 2025-09-26 11:08:51,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:51,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:51,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673d32f83206171a90f45 HTTP/1.1" 200 None 2025-09-26 11:08:51,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:51,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673eb2f83206171a90f78 HTTP/1.1" 200 None 2025-09-26 11:08:51,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:51,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673d02f83206171a90f42 HTTP/1.1" 200 None 2025-09-26 11:08:51,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:51,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:08:51,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:08:51,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:51,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:51,398 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:51,399 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673e32f83206171a90f67/lava_callback.json.gz 2025-09-26 11:08:51,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:08:51,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:51,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:51,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673eb2f83206171a90f78 HTTP/1.1" 200 None 2025-09-26 11:08:51,462 - lava_callback - INFO - Completed processing callback for node 68d673eb2f83206171a90f78 2025-09-26 11:08:51,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673d32f83206171a90f45 HTTP/1.1" 200 None 2025-09-26 11:08:51,472 - lava_callback - INFO - Completed processing callback for node 68d673d32f83206171a90f45 2025-09-26 11:08:51,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673e32f83206171a90f67 HTTP/1.1" 200 None 2025-09-26 11:08:51,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:51,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673d02f83206171a90f42 HTTP/1.1" 200 None 2025-09-26 11:08:51,509 - lava_callback - INFO - Completed processing callback for node 68d673d02f83206171a90f42 2025-09-26 11:08:51,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:08:51,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:51,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673e32f83206171a90f67 HTTP/1.1" 200 None 2025-09-26 11:08:51,583 - lava_callback - INFO - Completed processing callback for node 68d673e32f83206171a90f67 2025-09-26 11:08:52,044 - lava_callback - INFO - Received callback for node 68d673ee2f83206171a90f83 INFO: 172.20.0.1:46058 - "POST /node/68d673ee2f83206171a90f83 HTTP/1.0" 202 Accepted 2025-09-26 11:08:52,051 - lava_callback - INFO - Starting async job submit for node 68d673ee2f83206171a90f83 2025-09-26 11:08:52,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:52,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673ee2f83206171a90f83 HTTP/1.1" 200 None 2025-09-26 11:08:52,090 - lava_callback - DEBUG - Processing node 68d673ee2f83206171a90f83: baseline-arm64 2025-09-26 11:08:52,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:52,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:52,501 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673ee2f83206171a90f83/log.txt.gz 2025-09-26 11:08:52,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:52,662 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:52,663 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673ee2f83206171a90f83/lava_callback.json.gz 2025-09-26 11:08:52,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:52,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673ee2f83206171a90f83 HTTP/1.1" 200 None 2025-09-26 11:08:52,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:52,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:08:52,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:52,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673ee2f83206171a90f83 HTTP/1.1" 200 None 2025-09-26 11:08:52,753 - lava_callback - INFO - Completed processing callback for node 68d673ee2f83206171a90f83 2025-09-26 11:08:53,559 - lava_callback - INFO - Received callback for node 68d673b72f83206171a90efb INFO: 172.20.0.1:46068 - "POST /node/68d673b72f83206171a90efb HTTP/1.0" 202 Accepted 2025-09-26 11:08:53,565 - lava_callback - INFO - Starting async job submit for node 68d673b72f83206171a90efb 2025-09-26 11:08:53,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:53,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673b72f83206171a90efb HTTP/1.1" 200 None 2025-09-26 11:08:53,598 - lava_callback - DEBUG - Processing node 68d673b72f83206171a90efb: baseline-arm64 2025-09-26 11:08:53,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:54,831 - lava_callback - INFO - Received callback for node 68d673e82f83206171a90f75 INFO: 172.20.0.1:46084 - "POST /node/68d673e82f83206171a90f75 HTTP/1.0" 202 Accepted 2025-09-26 11:08:54,839 - lava_callback - INFO - Starting async job submit for node 68d673e82f83206171a90f75 2025-09-26 11:08:54,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:54,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673e82f83206171a90f75 HTTP/1.1" 200 None 2025-09-26 11:08:54,877 - lava_callback - DEBUG - Processing node 68d673e82f83206171a90f75: baseline-arm64 2025-09-26 11:08:55,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:46098 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:08:56,531 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:56,532 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673e82f83206171a90f75/log.txt.gz 2025-09-26 11:08:56,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:56,542 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:56,543 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673b72f83206171a90efb/log.txt.gz 2025-09-26 11:08:56,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:56,754 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:56,755 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673e82f83206171a90f75/lava_callback.json.gz 2025-09-26 11:08:56,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:56,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:56,786 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673b72f83206171a90efb/lava_callback.json.gz 2025-09-26 11:08:56,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:56,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673e82f83206171a90f75 HTTP/1.1" 200 None 2025-09-26 11:08:56,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:56,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673b72f83206171a90efb HTTP/1.1" 200 None 2025-09-26 11:08:56,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:56,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:08:56,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:56,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:08:56,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:56,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673b72f83206171a90efb HTTP/1.1" 200 None 2025-09-26 11:08:56,898 - lava_callback - INFO - Completed processing callback for node 68d673b72f83206171a90efb 2025-09-26 11:08:56,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673e82f83206171a90f75 HTTP/1.1" 200 None 2025-09-26 11:08:56,907 - lava_callback - INFO - Completed processing callback for node 68d673e82f83206171a90f75 2025-09-26 11:08:57,187 - lava_callback - INFO - Received callback for node 68d673f62f83206171a90f97 INFO: 172.20.0.1:46104 - "POST /node/68d673f62f83206171a90f97 HTTP/1.0" 202 Accepted 2025-09-26 11:08:57,205 - lava_callback - INFO - Starting async job submit for node 68d673f62f83206171a90f97 2025-09-26 11:08:57,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:57,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673f62f83206171a90f97 HTTP/1.1" 200 None 2025-09-26 11:08:57,259 - lava_callback - DEBUG - Processing node 68d673f62f83206171a90f97: baseline-arm64 2025-09-26 11:08:57,493 - lava_callback - INFO - Received callback for node 68d673f12f83206171a90f8a INFO: 172.20.0.1:46106 - "POST /node/68d673f12f83206171a90f8a HTTP/1.0" 202 Accepted 2025-09-26 11:08:57,508 - lava_callback - INFO - Starting async job submit for node 68d673f12f83206171a90f8a 2025-09-26 11:08:57,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:57,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673f12f83206171a90f8a HTTP/1.1" 200 None 2025-09-26 11:08:57,637 - lava_callback - DEBUG - Processing node 68d673f12f83206171a90f8a: baseline-arm64 2025-09-26 11:08:58,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:58,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:58,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:58,269 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673f62f83206171a90f97/log.txt.gz 2025-09-26 11:08:58,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:58,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:58,394 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673f12f83206171a90f8a/log.txt.gz 2025-09-26 11:08:58,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:58,458 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:58,459 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673f62f83206171a90f97/lava_callback.json.gz 2025-09-26 11:08:58,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:58,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673f62f83206171a90f97 HTTP/1.1" 200 None 2025-09-26 11:08:58,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:58,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:08:58,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:58,555 - lava_callback - INFO - Received callback for node 68d673f42f83206171a90f90 INFO: 172.20.0.1:46110 - "POST /node/68d673f42f83206171a90f90 HTTP/1.0" 202 Accepted 2025-09-26 11:08:58,573 - lava_callback - INFO - Starting async job submit for node 68d673f42f83206171a90f90 2025-09-26 11:08:58,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673f62f83206171a90f97 HTTP/1.1" 200 None 2025-09-26 11:08:58,598 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:58,600 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673f12f83206171a90f8a/lava_callback.json.gz 2025-09-26 11:08:58,613 - lava_callback - INFO - Completed processing callback for node 68d673f62f83206171a90f97 2025-09-26 11:08:58,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:58,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:58,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673f12f83206171a90f8a HTTP/1.1" 200 None 2025-09-26 11:08:58,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:58,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673f42f83206171a90f90 HTTP/1.1" 200 None 2025-09-26 11:08:58,691 - lava_callback - DEBUG - Processing node 68d673f42f83206171a90f90: baseline-arm64 2025-09-26 11:08:58,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:08:58,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:58,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673f12f83206171a90f8a HTTP/1.1" 200 None 2025-09-26 11:08:58,912 - lava_callback - INFO - Completed processing callback for node 68d673f12f83206171a90f8a 2025-09-26 11:08:59,042 - lava_callback - INFO - Received callback for node 68d6738d2f83206171a90ebd INFO: 172.20.0.1:46124 - "POST /node/68d6738d2f83206171a90ebd HTTP/1.0" 202 Accepted 2025-09-26 11:08:59,063 - lava_callback - INFO - Starting async job submit for node 68d6738d2f83206171a90ebd 2025-09-26 11:08:59,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:08:59,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6738d2f83206171a90ebd HTTP/1.1" 200 None 2025-09-26 11:08:59,216 - lava_callback - DEBUG - Processing node 68d6738d2f83206171a90ebd: baseline-arm64 2025-09-26 11:08:59,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:59,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:08:59,656 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673f42f83206171a90f90/log.txt.gz 2025-09-26 11:08:59,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:08:59,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:09:02,185 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:09:02,185 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6738d2f83206171a90ebd/log.txt.gz 2025-09-26 11:09:02,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:09:02,187 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673f42f83206171a90f90/lava_callback.json.gz 2025-09-26 11:09:02,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:02,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:09:02,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673f42f83206171a90f90 HTTP/1.1" 200 None 2025-09-26 11:09:02,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:02,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:09:02,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:02,277 - lava_callback - INFO - Received callback for node 68d6737e2f83206171a90e86 2025-09-26 11:09:02,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673f42f83206171a90f90 HTTP/1.1" 200 None 2025-09-26 11:09:02,306 - lava_callback - INFO - Completed processing callback for node 68d673f42f83206171a90f90 INFO: 172.20.0.1:57922 - "POST /node/68d6737e2f83206171a90e86 HTTP/1.0" 202 Accepted 2025-09-26 11:09:02,311 - lava_callback - INFO - Starting async job submit for node 68d6737e2f83206171a90e86 2025-09-26 11:09:02,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:02,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6737e2f83206171a90e86 HTTP/1.1" 200 None 2025-09-26 11:09:02,386 - lava_callback - DEBUG - Processing node 68d6737e2f83206171a90e86: baseline-arm64 2025-09-26 11:09:02,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:09:02,450 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6738d2f83206171a90ebd/lava_callback.json.gz 2025-09-26 11:09:02,462 - lava_callback - INFO - Received callback for node 68d673e62f83206171a90f6e INFO: 172.20.0.1:57938 - "POST /node/68d673e62f83206171a90f6e HTTP/1.0" 202 Accepted 2025-09-26 11:09:02,510 - lava_callback - INFO - Starting async job submit for node 68d673e62f83206171a90f6e 2025-09-26 11:09:02,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:02,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:02,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6738d2f83206171a90ebd HTTP/1.1" 200 None 2025-09-26 11:09:02,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:02,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673e62f83206171a90f6e HTTP/1.1" 200 None 2025-09-26 11:09:02,671 - lava_callback - DEBUG - Processing node 68d673e62f83206171a90f6e: baseline-arm64 2025-09-26 11:09:02,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:09:02,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:02,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6738d2f83206171a90ebd HTTP/1.1" 200 None 2025-09-26 11:09:02,956 - lava_callback - INFO - Completed processing callback for node 68d6738d2f83206171a90ebd 2025-09-26 11:09:03,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:09:03,535 - lava_callback - INFO - Received callback for node 68d673ba2f83206171a90efe INFO: 172.20.0.1:57944 - "POST /node/68d673ba2f83206171a90efe HTTP/1.0" 202 Accepted 2025-09-26 11:09:03,545 - lava_callback - INFO - Starting async job submit for node 68d673ba2f83206171a90efe 2025-09-26 11:09:03,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:09:03,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:03,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673ba2f83206171a90efe HTTP/1.1" 200 None 2025-09-26 11:09:03,654 - lava_callback - DEBUG - Processing node 68d673ba2f83206171a90efe: baseline-arm64 2025-09-26 11:09:03,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:09:03,773 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6737e2f83206171a90e86/log.txt.gz 2025-09-26 11:09:03,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:09:03,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:09:03,978 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673e62f83206171a90f6e/log.txt.gz 2025-09-26 11:09:04,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:09:04,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:09:04,055 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6737e2f83206171a90e86/lava_callback.json.gz 2025-09-26 11:09:04,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:04,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:09:04,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6737e2f83206171a90e86 HTTP/1.1" 200 None 2025-09-26 11:09:04,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:04,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:09:04,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:04,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6737e2f83206171a90e86 HTTP/1.1" 200 None 2025-09-26 11:09:04,239 - lava_callback - INFO - Completed processing callback for node 68d6737e2f83206171a90e86 2025-09-26 11:09:04,304 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:09:04,305 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673e62f83206171a90f6e/lava_callback.json.gz 2025-09-26 11:09:04,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:04,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673e62f83206171a90f6e HTTP/1.1" 200 None 2025-09-26 11:09:04,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:04,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:09:04,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:04,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:09:04,448 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673ba2f83206171a90efe/log.txt.gz 2025-09-26 11:09:04,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:09:04,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673e62f83206171a90f6e HTTP/1.1" 200 None 2025-09-26 11:09:04,467 - lava_callback - INFO - Completed processing callback for node 68d673e62f83206171a90f6e 2025-09-26 11:09:04,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:09:04,629 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673ba2f83206171a90efe/lava_callback.json.gz 2025-09-26 11:09:04,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:04,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673ba2f83206171a90efe HTTP/1.1" 200 None 2025-09-26 11:09:04,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:04,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:09:04,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:04,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673ba2f83206171a90efe HTTP/1.1" 200 None 2025-09-26 11:09:04,720 - lava_callback - INFO - Completed processing callback for node 68d673ba2f83206171a90efe 2025-09-26 11:09:05,207 - lava_callback - INFO - Received callback for node 68d673fb2f83206171a90f9d INFO: 172.20.0.1:57958 - "POST /node/68d673fb2f83206171a90f9d HTTP/1.0" 202 Accepted 2025-09-26 11:09:05,215 - lava_callback - INFO - Starting async job submit for node 68d673fb2f83206171a90f9d 2025-09-26 11:09:05,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:05,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673fb2f83206171a90f9d HTTP/1.1" 200 None 2025-09-26 11:09:05,258 - lava_callback - DEBUG - Processing node 68d673fb2f83206171a90f9d: baseline-arm64 2025-09-26 11:09:05,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:57964 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:09:06,532 - lava_callback - INFO - Received callback for node 68d673f92f83206171a90f9a INFO: 172.20.0.1:57974 - "POST /node/68d673f92f83206171a90f9a HTTP/1.0" 202 Accepted 2025-09-26 11:09:06,538 - lava_callback - INFO - Starting async job submit for node 68d673f92f83206171a90f9a 2025-09-26 11:09:06,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:06,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673f92f83206171a90f9a HTTP/1.1" 200 None 2025-09-26 11:09:06,580 - lava_callback - DEBUG - Processing node 68d673f92f83206171a90f9a: baseline-arm64 2025-09-26 11:09:06,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:09:07,197 - lava_callback - INFO - Received callback for node 68d6738a2f83206171a90eba INFO: 172.20.0.1:57980 - "POST /node/68d6738a2f83206171a90eba HTTP/1.0" 202 Accepted 2025-09-26 11:09:07,207 - lava_callback - INFO - Starting async job submit for node 68d6738a2f83206171a90eba 2025-09-26 11:09:07,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:07,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6738a2f83206171a90eba HTTP/1.1" 200 None 2025-09-26 11:09:07,243 - lava_callback - DEBUG - Processing node 68d6738a2f83206171a90eba: baseline-arm64 2025-09-26 11:09:07,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:09:08,294 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:09:08,295 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673fb2f83206171a90f9d/log.txt.gz 2025-09-26 11:09:08,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:09:08,301 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6738a2f83206171a90eba/log.txt.gz 2025-09-26 11:09:08,303 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:09:08,304 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673f92f83206171a90f9a/log.txt.gz 2025-09-26 11:09:08,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:09:08,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:09:08,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:09:08,464 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:09:08,465 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673fb2f83206171a90f9d/lava_callback.json.gz 2025-09-26 11:09:08,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:08,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:09:08,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:09:08,538 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6738a2f83206171a90eba/lava_callback.json.gz 2025-09-26 11:09:08,558 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673f92f83206171a90f9a/lava_callback.json.gz 2025-09-26 11:09:08,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673fb2f83206171a90f9d HTTP/1.1" 200 None 2025-09-26 11:09:08,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:08,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:08,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:08,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:09:08,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:08,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673f92f83206171a90f9a HTTP/1.1" 200 None 2025-09-26 11:09:08,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:08,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6738a2f83206171a90eba HTTP/1.1" 200 None 2025-09-26 11:09:08,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:08,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:09:08,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:08,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:09:08,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:08,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673fb2f83206171a90f9d HTTP/1.1" 200 None 2025-09-26 11:09:08,675 - lava_callback - INFO - Completed processing callback for node 68d673fb2f83206171a90f9d 2025-09-26 11:09:08,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6738a2f83206171a90eba HTTP/1.1" 200 None 2025-09-26 11:09:08,756 - lava_callback - INFO - Completed processing callback for node 68d6738a2f83206171a90eba 2025-09-26 11:09:08,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673f92f83206171a90f9a HTTP/1.1" 200 None 2025-09-26 11:09:08,770 - lava_callback - INFO - Completed processing callback for node 68d673f92f83206171a90f9a INFO: 172.20.0.1:53154 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 11:09:16,445 - lava_callback - INFO - Received callback for node 68d40a3fcd36afa834e16f15 INFO: 172.20.0.1:53168 - "POST /node/68d40a3fcd36afa834e16f15 HTTP/1.0" 202 Accepted 2025-09-26 11:09:16,452 - lava_callback - INFO - Starting async job submit for node 68d40a3fcd36afa834e16f15 2025-09-26 11:09:16,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:16,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a3fcd36afa834e16f15 HTTP/1.1" 200 None 2025-09-26 11:09:16,493 - lava_callback - DEBUG - Processing node 68d40a3fcd36afa834e16f15: baseline-arm INFO: 172.20.0.1:53172 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:09:16,786 - lava_callback - ERROR - Error processing callback for node 68d40a3fcd36afa834e16f15: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:45948 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:09:20,582 - lava_callback - INFO - Received callback for node 68d674012f83206171a90fca INFO: 172.20.0.1:45962 - "POST /node/68d674012f83206171a90fca HTTP/1.0" 202 Accepted 2025-09-26 11:09:20,588 - lava_callback - INFO - Starting async job submit for node 68d674012f83206171a90fca 2025-09-26 11:09:20,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:20,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674012f83206171a90fca HTTP/1.1" 200 None 2025-09-26 11:09:20,623 - lava_callback - DEBUG - Processing node 68d674012f83206171a90fca: baseline-arm64 2025-09-26 11:09:20,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:45978 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:09:23,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:09:23,397 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674012f83206171a90fca/log.txt.gz 2025-09-26 11:09:23,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:09:23,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:09:23,535 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674012f83206171a90fca/lava_callback.json.gz 2025-09-26 11:09:23,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:23,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674012f83206171a90fca HTTP/1.1" 200 None 2025-09-26 11:09:23,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:23,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:09:23,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:23,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674012f83206171a90fca HTTP/1.1" 200 None 2025-09-26 11:09:23,643 - lava_callback - INFO - Completed processing callback for node 68d674012f83206171a90fca INFO: 172.20.0.1:45990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60344 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:09:44,098 - lava_callback - INFO - Received callback for node 68d674322f83206171a9101f INFO: 172.20.0.1:40176 - "POST /node/68d674322f83206171a9101f HTTP/1.0" 202 Accepted 2025-09-26 11:09:44,109 - lava_callback - INFO - Starting async job submit for node 68d674322f83206171a9101f 2025-09-26 11:09:44,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:44,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674322f83206171a9101f HTTP/1.1" 200 None 2025-09-26 11:09:44,229 - lava_callback - DEBUG - Processing node 68d674322f83206171a9101f: baseline-arm64 2025-09-26 11:09:45,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:09:45,495 - lava_callback - INFO - Received callback for node 68d6742f2f83206171a9101c INFO: 172.20.0.1:40190 - "POST /node/68d6742f2f83206171a9101c HTTP/1.0" 202 Accepted 2025-09-26 11:09:45,508 - lava_callback - INFO - Starting async job submit for node 68d6742f2f83206171a9101c 2025-09-26 11:09:45,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:45,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6742f2f83206171a9101c HTTP/1.1" 200 None 2025-09-26 11:09:45,591 - lava_callback - DEBUG - Processing node 68d6742f2f83206171a9101c: baseline-arm64 2025-09-26 11:09:46,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:40206 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:09:47,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:09:47,267 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6742f2f83206171a9101c/log.txt.gz 2025-09-26 11:09:47,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:09:47,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:09:47,400 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674322f83206171a9101f/log.txt.gz 2025-09-26 11:09:47,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:09:47,490 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:09:47,491 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6742f2f83206171a9101c/lava_callback.json.gz 2025-09-26 11:09:47,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:47,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6742f2f83206171a9101c HTTP/1.1" 200 None 2025-09-26 11:09:47,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:47,615 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:09:47,616 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674322f83206171a9101f/lava_callback.json.gz 2025-09-26 11:09:47,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:09:47,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:47,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:47,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674322f83206171a9101f HTTP/1.1" 200 None 2025-09-26 11:09:47,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:47,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6742f2f83206171a9101c HTTP/1.1" 200 None 2025-09-26 11:09:47,699 - lava_callback - INFO - Completed processing callback for node 68d6742f2f83206171a9101c 2025-09-26 11:09:47,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:09:47,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:09:47,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674322f83206171a9101f HTTP/1.1" 200 None 2025-09-26 11:09:47,767 - lava_callback - INFO - Completed processing callback for node 68d674322f83206171a9101f INFO: 172.20.0.1:56024 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:10:01,177 - lava_callback - INFO - Received callback for node 68d673c02f83206171a90f14 INFO: 172.20.0.1:57430 - "POST /node/68d673c02f83206171a90f14 HTTP/1.0" 202 Accepted 2025-09-26 11:10:01,187 - lava_callback - INFO - Starting async job submit for node 68d673c02f83206171a90f14 2025-09-26 11:10:01,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:01,217 - lava_callback - INFO - Received callback for node 68d6742c2f83206171a91015 INFO: 172.20.0.1:57436 - "POST /node/68d6742c2f83206171a91015 HTTP/1.0" 202 Accepted 2025-09-26 11:10:01,223 - lava_callback - INFO - Starting async job submit for node 68d6742c2f83206171a91015 2025-09-26 11:10:01,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:01,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673c02f83206171a90f14 HTTP/1.1" 200 None 2025-09-26 11:10:01,261 - lava_callback - DEBUG - Processing node 68d673c02f83206171a90f14: baseline-arm64 2025-09-26 11:10:01,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6742c2f83206171a91015 HTTP/1.1" 200 None 2025-09-26 11:10:01,301 - lava_callback - DEBUG - Processing node 68d6742c2f83206171a91015: baseline-arm64 2025-09-26 11:10:01,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:02,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:02,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:02,891 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673c02f83206171a90f14/log.txt.gz 2025-09-26 11:10:02,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:02,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:02,911 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6742c2f83206171a91015/log.txt.gz 2025-09-26 11:10:02,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:03,104 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:03,105 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673c02f83206171a90f14/lava_callback.json.gz 2025-09-26 11:10:03,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:03,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673c02f83206171a90f14 HTTP/1.1" 200 None 2025-09-26 11:10:03,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:03,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:03,161 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6742c2f83206171a91015/lava_callback.json.gz 2025-09-26 11:10:03,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:10:03,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:03,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:03,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6742c2f83206171a91015 HTTP/1.1" 200 None 2025-09-26 11:10:03,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:03,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673c02f83206171a90f14 HTTP/1.1" 200 None 2025-09-26 11:10:03,228 - lava_callback - INFO - Completed processing callback for node 68d673c02f83206171a90f14 2025-09-26 11:10:03,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:10:03,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:03,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6742c2f83206171a91015 HTTP/1.1" 200 None 2025-09-26 11:10:03,273 - lava_callback - INFO - Completed processing callback for node 68d6742c2f83206171a91015 INFO: 172.20.0.1:57446 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:10:07,309 - lava_callback - INFO - Received callback for node 68d673f12f83206171a90f8d INFO: 172.20.0.1:57462 - "POST /node/68d673f12f83206171a90f8d HTTP/1.0" 202 Accepted 2025-09-26 11:10:07,319 - lava_callback - INFO - Starting async job submit for node 68d673f12f83206171a90f8d 2025-09-26 11:10:07,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:07,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673f12f83206171a90f8d HTTP/1.1" 200 None 2025-09-26 11:10:07,352 - lava_callback - DEBUG - Processing node 68d673f12f83206171a90f8d: baseline-arm64 2025-09-26 11:10:07,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:08,318 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:08,319 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673f12f83206171a90f8d/log.txt.gz 2025-09-26 11:10:08,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:08,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:08,460 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673f12f83206171a90f8d/lava_callback.json.gz 2025-09-26 11:10:08,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:08,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673f12f83206171a90f8d HTTP/1.1" 200 None 2025-09-26 11:10:08,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:08,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:10:08,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:08,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673f12f83206171a90f8d HTTP/1.1" 200 None 2025-09-26 11:10:08,590 - lava_callback - INFO - Completed processing callback for node 68d673f12f83206171a90f8d 2025-09-26 11:10:08,825 - lava_callback - INFO - Received callback for node 68d3cd14cd36afa834e0f5d7 INFO: 172.20.0.1:57470 - "POST /node/68d3cd14cd36afa834e0f5d7 HTTP/1.0" 202 Accepted 2025-09-26 11:10:08,839 - lava_callback - INFO - Starting async job submit for node 68d3cd14cd36afa834e0f5d7 2025-09-26 11:10:08,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:08,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cd14cd36afa834e0f5d7 HTTP/1.1" 200 None 2025-09-26 11:10:08,914 - lava_callback - DEBUG - Processing node 68d3cd14cd36afa834e0f5d7: ltp-sched 2025-09-26 11:10:09,362 - lava_callback - ERROR - Error processing callback for node 68d3cd14cd36afa834e0f5d7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:10:10,314 - lava_callback - INFO - Received callback for node 68d3d184cd36afa834e0ff5c INFO: 172.20.0.1:34784 - "POST /node/68d3d184cd36afa834e0ff5c HTTP/1.0" 202 Accepted 2025-09-26 11:10:10,321 - lava_callback - INFO - Starting async job submit for node 68d3d184cd36afa834e0ff5c 2025-09-26 11:10:10,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:10,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d184cd36afa834e0ff5c HTTP/1.1" 200 None 2025-09-26 11:10:10,336 - lava_callback - DEBUG - Processing node 68d3d184cd36afa834e0ff5c: baseline-arm-broonie 2025-09-26 11:10:10,336 - lava_callback - ERROR - Error processing callback for node 68d3d184cd36afa834e0ff5c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:10:12,539 - lava_callback - INFO - Received callback for node 68d674412f83206171a91066 INFO: 172.20.0.1:34786 - "POST /node/68d674412f83206171a91066 HTTP/1.0" 202 Accepted 2025-09-26 11:10:12,545 - lava_callback - INFO - Starting async job submit for node 68d674412f83206171a91066 2025-09-26 11:10:12,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:12,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674412f83206171a91066 HTTP/1.1" 200 None 2025-09-26 11:10:12,580 - lava_callback - DEBUG - Processing node 68d674412f83206171a91066: baseline-arm64 2025-09-26 11:10:12,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:13,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:13,588 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674412f83206171a91066/log.txt.gz 2025-09-26 11:10:13,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:13,724 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:13,725 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674412f83206171a91066/lava_callback.json.gz 2025-09-26 11:10:13,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:13,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674412f83206171a91066 HTTP/1.1" 200 None 2025-09-26 11:10:13,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:13,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:10:13,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:13,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674412f83206171a91066 HTTP/1.1" 200 None 2025-09-26 11:10:13,853 - lava_callback - INFO - Completed processing callback for node 68d674412f83206171a91066 INFO: 172.20.0.1:34792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34794 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:10:16,594 - lava_callback - INFO - Received callback for node 68d673c22f83206171a90f1f INFO: 172.20.0.1:34804 - "POST /node/68d673c22f83206171a90f1f HTTP/1.0" 202 Accepted 2025-09-26 11:10:16,602 - lava_callback - INFO - Starting async job submit for node 68d673c22f83206171a90f1f 2025-09-26 11:10:16,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:16,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673c22f83206171a90f1f HTTP/1.1" 200 None 2025-09-26 11:10:16,646 - lava_callback - DEBUG - Processing node 68d673c22f83206171a90f1f: baseline-arm64 2025-09-26 11:10:16,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:18,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:18,865 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673c22f83206171a90f1f/log.txt.gz 2025-09-26 11:10:18,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:19,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:19,033 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673c22f83206171a90f1f/lava_callback.json.gz 2025-09-26 11:10:19,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:19,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673c22f83206171a90f1f HTTP/1.1" 200 None 2025-09-26 11:10:19,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:19,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:10:19,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:19,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673c22f83206171a90f1f HTTP/1.1" 200 None 2025-09-26 11:10:19,166 - lava_callback - INFO - Completed processing callback for node 68d673c22f83206171a90f1f INFO: 172.20.0.1:43412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43416 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:10:25,070 - lava_callback - INFO - Received callback for node 68d6737e2f83206171a90e89 INFO: 172.20.0.1:43426 - "POST /node/68d6737e2f83206171a90e89 HTTP/1.0" 202 Accepted 2025-09-26 11:10:25,077 - lava_callback - INFO - Starting async job submit for node 68d6737e2f83206171a90e89 2025-09-26 11:10:25,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:25,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6737e2f83206171a90e89 HTTP/1.1" 200 None 2025-09-26 11:10:25,126 - lava_callback - DEBUG - Processing node 68d6737e2f83206171a90e89: baseline-arm64 2025-09-26 11:10:25,458 - lava_callback - INFO - Received callback for node 68d674092f83206171a90fdf INFO: 172.20.0.1:43438 - "POST /node/68d674092f83206171a90fdf HTTP/1.0" 202 Accepted 2025-09-26 11:10:25,492 - lava_callback - INFO - Starting async job submit for node 68d674092f83206171a90fdf 2025-09-26 11:10:25,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:25,562 - lava_callback - INFO - Received callback for node 68d674432f83206171a91075 INFO: 172.20.0.1:43448 - "POST /node/68d674432f83206171a91075 HTTP/1.0" 202 Accepted 2025-09-26 11:10:25,582 - lava_callback - INFO - Starting async job submit for node 68d674432f83206171a91075 2025-09-26 11:10:25,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:25,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674092f83206171a90fdf HTTP/1.1" 200 None 2025-09-26 11:10:25,674 - lava_callback - DEBUG - Processing node 68d674092f83206171a90fdf: baseline-arm64 2025-09-26 11:10:25,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674432f83206171a91075 HTTP/1.1" 200 None 2025-09-26 11:10:25,769 - lava_callback - DEBUG - Processing node 68d674432f83206171a91075: baseline-arm64 2025-09-26 11:10:25,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:26,216 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:26,217 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6737e2f83206171a90e89/log.txt.gz 2025-09-26 11:10:26,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:43462 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:10:26,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:26,771 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6737e2f83206171a90e89/lava_callback.json.gz 2025-09-26 11:10:26,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:26,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:26,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:26,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6737e2f83206171a90e89 HTTP/1.1" 200 None 2025-09-26 11:10:26,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:26,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:10:26,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:26,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6737e2f83206171a90e89 HTTP/1.1" 200 None 2025-09-26 11:10:26,957 - lava_callback - INFO - Completed processing callback for node 68d6737e2f83206171a90e89 2025-09-26 11:10:27,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:27,097 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674432f83206171a91075/log.txt.gz 2025-09-26 11:10:27,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:27,100 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674092f83206171a90fdf/log.txt.gz 2025-09-26 11:10:27,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:27,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:29,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:29,571 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674432f83206171a91075/lava_callback.json.gz 2025-09-26 11:10:29,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:29,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:29,607 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674092f83206171a90fdf/lava_callback.json.gz 2025-09-26 11:10:29,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:29,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674432f83206171a91075 HTTP/1.1" 200 None 2025-09-26 11:10:29,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:29,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674092f83206171a90fdf HTTP/1.1" 200 None 2025-09-26 11:10:29,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:29,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:10:29,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:29,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:10:29,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:29,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674432f83206171a91075 HTTP/1.1" 200 None 2025-09-26 11:10:29,706 - lava_callback - INFO - Completed processing callback for node 68d674432f83206171a91075 2025-09-26 11:10:29,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674092f83206171a90fdf HTTP/1.1" 200 None 2025-09-26 11:10:29,777 - lava_callback - INFO - Completed processing callback for node 68d674092f83206171a90fdf 2025-09-26 11:10:33,062 - lava_callback - INFO - Received callback for node 68d673de2f83206171a90f61 INFO: 172.20.0.1:54674 - "POST /node/68d673de2f83206171a90f61 HTTP/1.0" 202 Accepted 2025-09-26 11:10:33,068 - lava_callback - INFO - Starting async job submit for node 68d673de2f83206171a90f61 2025-09-26 11:10:33,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:33,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673de2f83206171a90f61 HTTP/1.1" 200 None 2025-09-26 11:10:33,104 - lava_callback - DEBUG - Processing node 68d673de2f83206171a90f61: baseline-arm64 2025-09-26 11:10:33,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:34,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:34,674 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673de2f83206171a90f61/log.txt.gz 2025-09-26 11:10:34,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:34,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:34,832 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673de2f83206171a90f61/lava_callback.json.gz 2025-09-26 11:10:34,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:34,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673de2f83206171a90f61 HTTP/1.1" 200 None 2025-09-26 11:10:34,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:34,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:10:34,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:34,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673de2f83206171a90f61 HTTP/1.1" 200 None 2025-09-26 11:10:34,965 - lava_callback - INFO - Completed processing callback for node 68d673de2f83206171a90f61 INFO: 172.20.0.1:54676 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:10:36,778 - lava_callback - INFO - Received callback for node 68d3d1a9cd36afa834e0ffa5 INFO: 172.20.0.1:54680 - "POST /node/68d3d1a9cd36afa834e0ffa5 HTTP/1.0" 202 Accepted 2025-09-26 11:10:36,784 - lava_callback - INFO - Starting async job submit for node 68d3d1a9cd36afa834e0ffa5 2025-09-26 11:10:36,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:36,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d1a9cd36afa834e0ffa5 HTTP/1.1" 200 None 2025-09-26 11:10:36,799 - lava_callback - DEBUG - Processing node 68d3d1a9cd36afa834e0ffa5: baseline-arm 2025-09-26 11:10:36,799 - lava_callback - ERROR - Error processing callback for node 68d3d1a9cd36afa834e0ffa5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:10:37,485 - lava_callback - INFO - Received callback for node 68d3d1a9cd36afa834e0ffa8 INFO: 172.20.0.1:54686 - "POST /node/68d3d1a9cd36afa834e0ffa8 HTTP/1.0" 202 Accepted 2025-09-26 11:10:37,493 - lava_callback - INFO - Starting async job submit for node 68d3d1a9cd36afa834e0ffa8 2025-09-26 11:10:37,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:37,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d1a9cd36afa834e0ffa8 HTTP/1.1" 200 None 2025-09-26 11:10:37,507 - lava_callback - DEBUG - Processing node 68d3d1a9cd36afa834e0ffa8: baseline-arm 2025-09-26 11:10:37,507 - lava_callback - ERROR - Error processing callback for node 68d3d1a9cd36afa834e0ffa8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:10:38,259 - lava_callback - INFO - Received callback for node 68d674042f83206171a90fd1 INFO: 172.20.0.1:54700 - "POST /node/68d674042f83206171a90fd1 HTTP/1.0" 202 Accepted 2025-09-26 11:10:38,265 - lava_callback - INFO - Starting async job submit for node 68d674042f83206171a90fd1 2025-09-26 11:10:38,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:38,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674042f83206171a90fd1 HTTP/1.1" 200 None 2025-09-26 11:10:38,298 - lava_callback - DEBUG - Processing node 68d674042f83206171a90fd1: baseline-arm64 2025-09-26 11:10:38,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:39,296 - lava_callback - INFO - Received callback for node 68d6738f2f83206171a90ec0 INFO: 172.20.0.1:54712 - "POST /node/68d6738f2f83206171a90ec0 HTTP/1.0" 202 Accepted 2025-09-26 11:10:39,306 - lava_callback - INFO - Starting async job submit for node 68d6738f2f83206171a90ec0 2025-09-26 11:10:39,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:39,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6738f2f83206171a90ec0 HTTP/1.1" 200 None 2025-09-26 11:10:39,340 - lava_callback - DEBUG - Processing node 68d6738f2f83206171a90ec0: baseline-arm64 2025-09-26 11:10:39,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:39,656 - lava_callback - INFO - Received callback for node 68d674072f83206171a90fdc INFO: 172.20.0.1:57706 - "POST /node/68d674072f83206171a90fdc HTTP/1.0" 202 Accepted 2025-09-26 11:10:39,666 - lava_callback - INFO - Starting async job submit for node 68d674072f83206171a90fdc 2025-09-26 11:10:39,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:39,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674072f83206171a90fdc HTTP/1.1" 200 None 2025-09-26 11:10:39,716 - lava_callback - DEBUG - Processing node 68d674072f83206171a90fdc: baseline-arm64 2025-09-26 11:10:39,944 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:39,957 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6738f2f83206171a90ec0/log.txt.gz 2025-09-26 11:10:39,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:40,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:40,038 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674042f83206171a90fd1/log.txt.gz 2025-09-26 11:10:40,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:40,186 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:40,198 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6738f2f83206171a90ec0/lava_callback.json.gz 2025-09-26 11:10:40,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:40,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:40,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6738f2f83206171a90ec0 HTTP/1.1" 200 None 2025-09-26 11:10:40,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:40,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:10:40,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:40,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:40,344 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674042f83206171a90fd1/lava_callback.json.gz 2025-09-26 11:10:40,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6738f2f83206171a90ec0 HTTP/1.1" 200 None 2025-09-26 11:10:40,370 - lava_callback - INFO - Completed processing callback for node 68d6738f2f83206171a90ec0 2025-09-26 11:10:40,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:40,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674042f83206171a90fd1 HTTP/1.1" 200 None 2025-09-26 11:10:40,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:40,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:10:40,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:40,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674042f83206171a90fd1 HTTP/1.1" 200 None 2025-09-26 11:10:40,483 - lava_callback - INFO - Completed processing callback for node 68d674042f83206171a90fd1 2025-09-26 11:10:40,506 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:40,507 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674072f83206171a90fdc/log.txt.gz 2025-09-26 11:10:40,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:40,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:40,787 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674072f83206171a90fdc/lava_callback.json.gz 2025-09-26 11:10:40,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:40,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674072f83206171a90fdc HTTP/1.1" 200 None 2025-09-26 11:10:40,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:40,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:10:40,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:40,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674072f83206171a90fdc HTTP/1.1" 200 None 2025-09-26 11:10:40,877 - lava_callback - INFO - Completed processing callback for node 68d674072f83206171a90fdc 2025-09-26 11:10:42,667 - lava_callback - INFO - Received callback for node 68d673db2f83206171a90f5a INFO: 172.20.0.1:57714 - "POST /node/68d673db2f83206171a90f5a HTTP/1.0" 202 Accepted 2025-09-26 11:10:42,676 - lava_callback - INFO - Starting async job submit for node 68d673db2f83206171a90f5a 2025-09-26 11:10:42,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:42,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673db2f83206171a90f5a HTTP/1.1" 200 None 2025-09-26 11:10:42,723 - lava_callback - DEBUG - Processing node 68d673db2f83206171a90f5a: baseline-arm64 2025-09-26 11:10:43,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:43,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:43,170 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673db2f83206171a90f5a/log.txt.gz 2025-09-26 11:10:43,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:43,314 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:43,315 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673db2f83206171a90f5a/lava_callback.json.gz 2025-09-26 11:10:43,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:43,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673db2f83206171a90f5a HTTP/1.1" 200 None 2025-09-26 11:10:43,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:43,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:10:43,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:43,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673db2f83206171a90f5a HTTP/1.1" 200 None 2025-09-26 11:10:43,411 - lava_callback - INFO - Completed processing callback for node 68d673db2f83206171a90f5a INFO: 172.20.0.1:57730 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:10:47,076 - lava_callback - INFO - Received callback for node 68d674482f83206171a91080 INFO: 172.20.0.1:57738 - "POST /node/68d674482f83206171a91080 HTTP/1.0" 202 Accepted 2025-09-26 11:10:47,086 - lava_callback - INFO - Starting async job submit for node 68d674482f83206171a91080 2025-09-26 11:10:47,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:47,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674482f83206171a91080 HTTP/1.1" 200 None 2025-09-26 11:10:47,167 - lava_callback - DEBUG - Processing node 68d674482f83206171a91080: baseline-arm64 2025-09-26 11:10:47,996 - lava_callback - INFO - Received callback for node 68d673922f83206171a90ec3 INFO: 172.20.0.1:57740 - "POST /node/68d673922f83206171a90ec3 HTTP/1.0" 202 Accepted 2025-09-26 11:10:48,016 - lava_callback - INFO - Starting async job submit for node 68d673922f83206171a90ec3 2025-09-26 11:10:48,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:48,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:48,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673922f83206171a90ec3 HTTP/1.1" 200 None 2025-09-26 11:10:48,103 - lava_callback - DEBUG - Processing node 68d673922f83206171a90ec3: baseline-arm64 2025-09-26 11:10:48,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:49,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:49,087 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674482f83206171a91080/log.txt.gz 2025-09-26 11:10:49,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:49,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:49,138 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673922f83206171a90ec3/log.txt.gz 2025-09-26 11:10:49,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:10:49,294 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:49,295 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674482f83206171a91080/lava_callback.json.gz 2025-09-26 11:10:49,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:49,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674482f83206171a91080 HTTP/1.1" 200 None 2025-09-26 11:10:49,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:49,344 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:10:49,345 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673922f83206171a90ec3/lava_callback.json.gz 2025-09-26 11:10:49,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:49,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:10:49,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:49,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673922f83206171a90ec3 HTTP/1.1" 200 None 2025-09-26 11:10:49,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:49,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674482f83206171a91080 HTTP/1.1" 200 None 2025-09-26 11:10:49,440 - lava_callback - INFO - Completed processing callback for node 68d674482f83206171a91080 2025-09-26 11:10:49,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:10:49,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:49,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673922f83206171a90ec3 HTTP/1.1" 200 None 2025-09-26 11:10:49,498 - lava_callback - INFO - Completed processing callback for node 68d673922f83206171a90ec3 2025-09-26 11:10:55,927 - lava_callback - INFO - Received callback for node 68d3d1abcd36afa834e0ffab INFO: 172.20.0.1:36848 - "POST /node/68d3d1abcd36afa834e0ffab HTTP/1.0" 202 Accepted 2025-09-26 11:10:55,934 - lava_callback - INFO - Starting async job submit for node 68d3d1abcd36afa834e0ffab 2025-09-26 11:10:55,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:55,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d1abcd36afa834e0ffab HTTP/1.1" 200 None 2025-09-26 11:10:55,954 - lava_callback - DEBUG - Processing node 68d3d1abcd36afa834e0ffab: baseline-arm 2025-09-26 11:10:55,954 - lava_callback - ERROR - Error processing callback for node 68d3d1abcd36afa834e0ffab: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:36852 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:10:56,631 - lava_callback - INFO - Received callback for node 68d3d1adcd36afa834e0ffae INFO: 172.20.0.1:36866 - "POST /node/68d3d1adcd36afa834e0ffae HTTP/1.0" 202 Accepted 2025-09-26 11:10:56,638 - lava_callback - INFO - Starting async job submit for node 68d3d1adcd36afa834e0ffae 2025-09-26 11:10:56,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:56,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d1adcd36afa834e0ffae HTTP/1.1" 200 None 2025-09-26 11:10:56,653 - lava_callback - DEBUG - Processing node 68d3d1adcd36afa834e0ffae: baseline-arm 2025-09-26 11:10:56,654 - lava_callback - ERROR - Error processing callback for node 68d3d1adcd36afa834e0ffae: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:10:57,347 - lava_callback - INFO - Received callback for node 68d3d1aecd36afa834e0ffb1 INFO: 172.20.0.1:36870 - "POST /node/68d3d1aecd36afa834e0ffb1 HTTP/1.0" 202 Accepted 2025-09-26 11:10:57,356 - lava_callback - INFO - Starting async job submit for node 68d3d1aecd36afa834e0ffb1 2025-09-26 11:10:57,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:57,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d1aecd36afa834e0ffb1 HTTP/1.1" 200 None 2025-09-26 11:10:57,372 - lava_callback - DEBUG - Processing node 68d3d1aecd36afa834e0ffb1: baseline-arm 2025-09-26 11:10:57,372 - lava_callback - ERROR - Error processing callback for node 68d3d1aecd36afa834e0ffb1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:10:58,045 - lava_callback - INFO - Received callback for node 68d3d1afcd36afa834e0ffb4 INFO: 172.20.0.1:36876 - "POST /node/68d3d1afcd36afa834e0ffb4 HTTP/1.0" 202 Accepted 2025-09-26 11:10:58,051 - lava_callback - INFO - Starting async job submit for node 68d3d1afcd36afa834e0ffb4 2025-09-26 11:10:58,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:58,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d1afcd36afa834e0ffb4 HTTP/1.1" 200 None 2025-09-26 11:10:58,074 - lava_callback - DEBUG - Processing node 68d3d1afcd36afa834e0ffb4: baseline-arm 2025-09-26 11:10:58,074 - lava_callback - ERROR - Error processing callback for node 68d3d1afcd36afa834e0ffb4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:10:58,746 - lava_callback - INFO - Received callback for node 68d3d1b1cd36afa834e0ffb7 INFO: 172.20.0.1:36882 - "POST /node/68d3d1b1cd36afa834e0ffb7 HTTP/1.0" 202 Accepted 2025-09-26 11:10:58,751 - lava_callback - INFO - Starting async job submit for node 68d3d1b1cd36afa834e0ffb7 2025-09-26 11:10:58,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:58,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d1b1cd36afa834e0ffb7 HTTP/1.1" 200 None 2025-09-26 11:10:58,765 - lava_callback - DEBUG - Processing node 68d3d1b1cd36afa834e0ffb7: baseline-arm 2025-09-26 11:10:58,765 - lava_callback - ERROR - Error processing callback for node 68d3d1b1cd36afa834e0ffb7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:10:59,439 - lava_callback - INFO - Received callback for node 68d3d1b1cd36afa834e0ffba INFO: 172.20.0.1:52120 - "POST /node/68d3d1b1cd36afa834e0ffba HTTP/1.0" 202 Accepted 2025-09-26 11:10:59,445 - lava_callback - INFO - Starting async job submit for node 68d3d1b1cd36afa834e0ffba 2025-09-26 11:10:59,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:10:59,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d1b1cd36afa834e0ffba HTTP/1.1" 200 None 2025-09-26 11:10:59,460 - lava_callback - DEBUG - Processing node 68d3d1b1cd36afa834e0ffba: baseline-arm 2025-09-26 11:10:59,460 - lava_callback - ERROR - Error processing callback for node 68d3d1b1cd36afa834e0ffba: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:11:03,558 - lava_callback - INFO - Received callback for node 68d674802f83206171a9111b INFO: 172.20.0.1:52122 - "POST /node/68d674802f83206171a9111b HTTP/1.0" 202 Accepted 2025-09-26 11:11:03,564 - lava_callback - INFO - Starting async job submit for node 68d674802f83206171a9111b 2025-09-26 11:11:03,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:03,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674802f83206171a9111b HTTP/1.1" 200 None 2025-09-26 11:11:03,598 - lava_callback - DEBUG - Processing node 68d674802f83206171a9111b: baseline-arm64 2025-09-26 11:11:03,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:11:04,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:04,420 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674802f83206171a9111b/log.txt.gz 2025-09-26 11:11:04,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:11:04,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:04,598 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674802f83206171a9111b/lava_callback.json.gz 2025-09-26 11:11:04,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:04,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674802f83206171a9111b HTTP/1.1" 200 None 2025-09-26 11:11:04,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:04,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:11:04,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:04,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674802f83206171a9111b HTTP/1.1" 200 None 2025-09-26 11:11:04,710 - lava_callback - INFO - Completed processing callback for node 68d674802f83206171a9111b INFO: 172.20.0.1:52128 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:11:08,960 - lava_callback - INFO - Received callback for node 68d6747b2f83206171a91115 INFO: 172.20.0.1:52138 - "POST /node/68d6747b2f83206171a91115 HTTP/1.0" 202 Accepted 2025-09-26 11:11:08,966 - lava_callback - INFO - Starting async job submit for node 68d6747b2f83206171a91115 2025-09-26 11:11:08,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:09,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6747b2f83206171a91115 HTTP/1.1" 200 None 2025-09-26 11:11:09,002 - lava_callback - DEBUG - Processing node 68d6747b2f83206171a91115: baseline-arm64 2025-09-26 11:11:09,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:11:09,654 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:09,655 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6747b2f83206171a91115/log.txt.gz 2025-09-26 11:11:09,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:11:09,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:09,773 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6747b2f83206171a91115/lava_callback.json.gz 2025-09-26 11:11:09,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:09,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6747b2f83206171a91115 HTTP/1.1" 200 None 2025-09-26 11:11:09,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:09,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:11:09,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:09,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6747b2f83206171a91115 HTTP/1.1" 200 None 2025-09-26 11:11:09,871 - lava_callback - INFO - Completed processing callback for node 68d6747b2f83206171a91115 2025-09-26 11:11:10,530 - lava_callback - INFO - Received callback for node 68d674372f83206171a9102d INFO: 172.20.0.1:43428 - "POST /node/68d674372f83206171a9102d HTTP/1.0" 202 Accepted 2025-09-26 11:11:10,540 - lava_callback - INFO - Starting async job submit for node 68d674372f83206171a9102d 2025-09-26 11:11:10,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:10,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674372f83206171a9102d HTTP/1.1" 200 None 2025-09-26 11:11:10,591 - lava_callback - DEBUG - Processing node 68d674372f83206171a9102d: baseline-arm64 2025-09-26 11:11:11,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:11:11,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:11,442 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674372f83206171a9102d/log.txt.gz 2025-09-26 11:11:11,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:11:11,537 - lava_callback - INFO - Received callback for node 68d674722f83206171a910e1 INFO: 172.20.0.1:43434 - "POST /node/68d674722f83206171a910e1 HTTP/1.0" 202 Accepted 2025-09-26 11:11:11,549 - lava_callback - INFO - Starting async job submit for node 68d674722f83206171a910e1 2025-09-26 11:11:11,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:11,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674722f83206171a910e1 HTTP/1.1" 200 None 2025-09-26 11:11:11,601 - lava_callback - DEBUG - Processing node 68d674722f83206171a910e1: baseline-arm64 2025-09-26 11:11:11,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:11,664 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674372f83206171a9102d/lava_callback.json.gz 2025-09-26 11:11:11,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:11,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674372f83206171a9102d HTTP/1.1" 200 None 2025-09-26 11:11:11,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:11,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:11:11,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:12,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674372f83206171a9102d HTTP/1.1" 200 None 2025-09-26 11:11:12,008 - lava_callback - INFO - Completed processing callback for node 68d674372f83206171a9102d 2025-09-26 11:11:12,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:11:12,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:12,327 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674722f83206171a910e1/log.txt.gz 2025-09-26 11:11:12,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:11:12,520 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:12,521 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674722f83206171a910e1/lava_callback.json.gz 2025-09-26 11:11:12,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:12,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674722f83206171a910e1 HTTP/1.1" 200 None 2025-09-26 11:11:12,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:12,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:11:12,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:12,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674722f83206171a910e1 HTTP/1.1" 200 None 2025-09-26 11:11:12,604 - lava_callback - INFO - Completed processing callback for node 68d674722f83206171a910e1 INFO: 172.20.0.1:43450 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 11:11:15,877 - lava_callback - INFO - Received callback for node 68d3d1cdcd36afa834e0ffe5 INFO: 172.20.0.1:43466 - "POST /node/68d3d1cdcd36afa834e0ffe5 HTTP/1.0" 202 Accepted 2025-09-26 11:11:15,886 - lava_callback - INFO - Starting async job submit for node 68d3d1cdcd36afa834e0ffe5 2025-09-26 11:11:15,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:15,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d1cdcd36afa834e0ffe5 HTTP/1.1" 200 None 2025-09-26 11:11:15,903 - lava_callback - DEBUG - Processing node 68d3d1cdcd36afa834e0ffe5: baseline-arm 2025-09-26 11:11:15,903 - lava_callback - ERROR - Error processing callback for node 68d3d1cdcd36afa834e0ffe5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:11:16,261 - lava_callback - INFO - Received callback for node 68d673c62f83206171a90f2a INFO: 172.20.0.1:43472 - "POST /node/68d673c62f83206171a90f2a HTTP/1.0" 202 Accepted 2025-09-26 11:11:16,269 - lava_callback - INFO - Starting async job submit for node 68d673c62f83206171a90f2a 2025-09-26 11:11:16,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:16,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673c62f83206171a90f2a HTTP/1.1" 200 None 2025-09-26 11:11:16,328 - lava_callback - DEBUG - Processing node 68d673c62f83206171a90f2a: baseline-arm64 INFO: 172.20.0.1:43484 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:11:16,590 - lava_callback - INFO - Received callback for node 68d3d1cfcd36afa834e0ffe8 INFO: 172.20.0.1:43494 - "POST /node/68d3d1cfcd36afa834e0ffe8 HTTP/1.0" 202 Accepted 2025-09-26 11:11:16,609 - lava_callback - INFO - Starting async job submit for node 68d3d1cfcd36afa834e0ffe8 2025-09-26 11:11:16,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:16,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d1cfcd36afa834e0ffe8 HTTP/1.1" 200 None 2025-09-26 11:11:16,695 - lava_callback - DEBUG - Processing node 68d3d1cfcd36afa834e0ffe8: baseline-arm 2025-09-26 11:11:16,695 - lava_callback - ERROR - Error processing callback for node 68d3d1cfcd36afa834e0ffe8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:11:16,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:11:16,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:16,893 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673c62f83206171a90f2a/log.txt.gz 2025-09-26 11:11:16,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:11:17,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:17,077 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673c62f83206171a90f2a/lava_callback.json.gz 2025-09-26 11:11:17,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:17,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673c62f83206171a90f2a HTTP/1.1" 200 None 2025-09-26 11:11:17,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:17,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:11:17,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:17,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673c62f83206171a90f2a HTTP/1.1" 200 None 2025-09-26 11:11:17,177 - lava_callback - INFO - Completed processing callback for node 68d673c62f83206171a90f2a 2025-09-26 11:11:19,028 - lava_callback - INFO - Received callback for node 68d674772f83206171a910e4 INFO: 172.20.0.1:43510 - "POST /node/68d674772f83206171a910e4 HTTP/1.0" 202 Accepted 2025-09-26 11:11:19,036 - lava_callback - INFO - Starting async job submit for node 68d674772f83206171a910e4 2025-09-26 11:11:19,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:19,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674772f83206171a910e4 HTTP/1.1" 200 None 2025-09-26 11:11:19,083 - lava_callback - DEBUG - Processing node 68d674772f83206171a910e4: baseline-arm64 2025-09-26 11:11:19,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:53768 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:11:21,007 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:21,008 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674772f83206171a910e4/log.txt.gz 2025-09-26 11:11:21,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:11:21,101 - lava_callback - INFO - Received callback for node 68d6747e2f83206171a91118 INFO: 172.20.0.1:53772 - "POST /node/68d6747e2f83206171a91118 HTTP/1.0" 202 Accepted 2025-09-26 11:11:21,114 - lava_callback - INFO - Starting async job submit for node 68d6747e2f83206171a91118 2025-09-26 11:11:21,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:21,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6747e2f83206171a91118 HTTP/1.1" 200 None 2025-09-26 11:11:21,195 - lava_callback - DEBUG - Processing node 68d6747e2f83206171a91118: baseline-arm64 2025-09-26 11:11:21,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:21,283 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674772f83206171a910e4/lava_callback.json.gz 2025-09-26 11:11:21,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:21,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674772f83206171a910e4 HTTP/1.1" 200 None 2025-09-26 11:11:21,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:21,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:11:21,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:21,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674772f83206171a910e4 HTTP/1.1" 200 None 2025-09-26 11:11:21,595 - lava_callback - INFO - Completed processing callback for node 68d674772f83206171a910e4 2025-09-26 11:11:21,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:11:22,106 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:22,107 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6747e2f83206171a91118/log.txt.gz 2025-09-26 11:11:22,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:11:22,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:22,229 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6747e2f83206171a91118/lava_callback.json.gz 2025-09-26 11:11:22,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:22,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6747e2f83206171a91118 HTTP/1.1" 200 None 2025-09-26 11:11:22,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:22,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:11:22,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:22,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6747e2f83206171a91118 HTTP/1.1" 200 None 2025-09-26 11:11:22,370 - lava_callback - INFO - Completed processing callback for node 68d6747e2f83206171a91118 INFO: 172.20.0.1:53778 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:11:24,408 - lava_callback - INFO - Received callback for node 68d674862f83206171a91121 INFO: 172.20.0.1:53786 - "POST /node/68d674862f83206171a91121 HTTP/1.0" 202 Accepted 2025-09-26 11:11:24,416 - lava_callback - INFO - Starting async job submit for node 68d674862f83206171a91121 2025-09-26 11:11:24,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:24,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674862f83206171a91121 HTTP/1.1" 200 None 2025-09-26 11:11:24,454 - lava_callback - DEBUG - Processing node 68d674862f83206171a91121: baseline-arm64 2025-09-26 11:11:24,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:11:26,468 - lava_callback - INFO - Received callback for node 68d674702f83206171a910de INFO: 172.20.0.1:53798 - "POST /node/68d674702f83206171a910de HTTP/1.0" 202 Accepted 2025-09-26 11:11:26,474 - lava_callback - INFO - Starting async job submit for node 68d674702f83206171a910de 2025-09-26 11:11:26,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:53810 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:11:26,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674702f83206171a910de HTTP/1.1" 200 None 2025-09-26 11:11:26,526 - lava_callback - DEBUG - Processing node 68d674702f83206171a910de: baseline-arm64 2025-09-26 11:11:26,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:26,776 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674862f83206171a91121/log.txt.gz 2025-09-26 11:11:26,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:11:27,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:27,091 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674862f83206171a91121/lava_callback.json.gz 2025-09-26 11:11:27,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:11:27,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:27,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674862f83206171a91121 HTTP/1.1" 200 None 2025-09-26 11:11:27,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:27,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:11:27,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:27,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674862f83206171a91121 HTTP/1.1" 200 None 2025-09-26 11:11:27,302 - lava_callback - INFO - Completed processing callback for node 68d674862f83206171a91121 2025-09-26 11:11:27,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:27,425 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674702f83206171a910de/log.txt.gz 2025-09-26 11:11:27,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:11:27,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:27,680 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674702f83206171a910de/lava_callback.json.gz 2025-09-26 11:11:27,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:27,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674702f83206171a910de HTTP/1.1" 200 None 2025-09-26 11:11:27,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:27,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:11:27,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:27,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674702f83206171a910de HTTP/1.1" 200 None 2025-09-26 11:11:27,808 - lava_callback - INFO - Completed processing callback for node 68d674702f83206171a910de 2025-09-26 11:11:35,903 - lava_callback - INFO - Received callback for node 68d674492f83206171a9108b INFO: 172.20.0.1:51838 - "POST /node/68d674492f83206171a9108b HTTP/1.0" 202 Accepted 2025-09-26 11:11:35,909 - lava_callback - INFO - Starting async job submit for node 68d674492f83206171a9108b 2025-09-26 11:11:35,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:35,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674492f83206171a9108b HTTP/1.1" 200 None 2025-09-26 11:11:35,959 - lava_callback - DEBUG - Processing node 68d674492f83206171a9108b: baseline-arm64 2025-09-26 11:11:36,190 - lava_callback - INFO - Received callback for node 68d3d1d4cd36afa834e0ffee INFO: 172.20.0.1:51842 - "POST /node/68d3d1d4cd36afa834e0ffee HTTP/1.0" 202 Accepted 2025-09-26 11:11:36,208 - lava_callback - INFO - Starting async job submit for node 68d3d1d4cd36afa834e0ffee 2025-09-26 11:11:36,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:36,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d1d4cd36afa834e0ffee HTTP/1.1" 200 None 2025-09-26 11:11:36,288 - lava_callback - DEBUG - Processing node 68d3d1d4cd36afa834e0ffee: baseline-arm 2025-09-26 11:11:36,288 - lava_callback - ERROR - Error processing callback for node 68d3d1d4cd36afa834e0ffee: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:11:36,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:51852 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:11:36,670 - lava_callback - INFO - Received callback for node 68d673c82f83206171a90f35 INFO: 172.20.0.1:51856 - "POST /node/68d673c82f83206171a90f35 HTTP/1.0" 202 Accepted 2025-09-26 11:11:36,676 - lava_callback - INFO - Starting async job submit for node 68d673c82f83206171a90f35 2025-09-26 11:11:36,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:36,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673c82f83206171a90f35 HTTP/1.1" 200 None 2025-09-26 11:11:36,724 - lava_callback - DEBUG - Processing node 68d673c82f83206171a90f35: baseline-arm64 2025-09-26 11:11:36,935 - lava_callback - INFO - Received callback for node 68d3d1d7cd36afa834e0fff1 INFO: 172.20.0.1:51858 - "POST /node/68d3d1d7cd36afa834e0fff1 HTTP/1.0" 202 Accepted 2025-09-26 11:11:36,959 - lava_callback - INFO - Starting async job submit for node 68d3d1d7cd36afa834e0fff1 2025-09-26 11:11:36,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:37,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:11:37,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d1d7cd36afa834e0fff1 HTTP/1.1" 200 None 2025-09-26 11:11:37,012 - lava_callback - DEBUG - Processing node 68d3d1d7cd36afa834e0fff1: baseline-arm 2025-09-26 11:11:37,012 - lava_callback - ERROR - Error processing callback for node 68d3d1d7cd36afa834e0fff1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:11:37,662 - lava_callback - INFO - Received callback for node 68d3d1dfcd36afa834e1001b INFO: 172.20.0.1:51864 - "POST /node/68d3d1dfcd36afa834e1001b HTTP/1.0" 202 Accepted 2025-09-26 11:11:37,668 - lava_callback - INFO - Starting async job submit for node 68d3d1dfcd36afa834e1001b 2025-09-26 11:11:37,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:37,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d1dfcd36afa834e1001b HTTP/1.1" 200 None 2025-09-26 11:11:37,684 - lava_callback - DEBUG - Processing node 68d3d1dfcd36afa834e1001b: baseline-arm 2025-09-26 11:11:37,684 - lava_callback - ERROR - Error processing callback for node 68d3d1dfcd36afa834e1001b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:11:38,005 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:38,006 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674492f83206171a9108b/log.txt.gz 2025-09-26 11:11:38,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:11:38,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:38,033 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673c82f83206171a90f35/log.txt.gz 2025-09-26 11:11:38,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:11:38,074 - lava_callback - INFO - Received callback for node 68d674832f83206171a9111e INFO: 172.20.0.1:51868 - "POST /node/68d674832f83206171a9111e HTTP/1.0" 202 Accepted 2025-09-26 11:11:38,085 - lava_callback - INFO - Starting async job submit for node 68d674832f83206171a9111e 2025-09-26 11:11:38,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:38,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674832f83206171a9111e HTTP/1.1" 200 None 2025-09-26 11:11:38,152 - lava_callback - DEBUG - Processing node 68d674832f83206171a9111e: baseline-arm64 2025-09-26 11:11:38,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:38,266 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674492f83206171a9108b/lava_callback.json.gz 2025-09-26 11:11:38,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:38,313 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673c82f83206171a90f35/lava_callback.json.gz 2025-09-26 11:11:38,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:38,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:38,407 - lava_callback - INFO - Received callback for node 68d3d1e2cd36afa834e1001e INFO: 172.20.0.1:51874 - "POST /node/68d3d1e2cd36afa834e1001e HTTP/1.0" 202 Accepted 2025-09-26 11:11:38,427 - lava_callback - INFO - Starting async job submit for node 68d3d1e2cd36afa834e1001e 2025-09-26 11:11:38,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:38,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674492f83206171a9108b HTTP/1.1" 200 None 2025-09-26 11:11:38,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:38,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d1e2cd36afa834e1001e HTTP/1.1" 200 None 2025-09-26 11:11:38,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673c82f83206171a90f35 HTTP/1.1" 200 None 2025-09-26 11:11:38,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:38,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:11:38,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:38,523 - lava_callback - DEBUG - Processing node 68d3d1e2cd36afa834e1001e: baseline-arm 2025-09-26 11:11:38,524 - lava_callback - ERROR - Error processing callback for node 68d3d1e2cd36afa834e1001e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:11:38,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:11:38,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:38,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674492f83206171a9108b HTTP/1.1" 200 None 2025-09-26 11:11:38,620 - lava_callback - INFO - Completed processing callback for node 68d674492f83206171a9108b 2025-09-26 11:11:38,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673c82f83206171a90f35 HTTP/1.1" 200 None 2025-09-26 11:11:38,714 - lava_callback - INFO - Completed processing callback for node 68d673c82f83206171a90f35 2025-09-26 11:11:38,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:11:38,987 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:38,988 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674832f83206171a9111e/log.txt.gz 2025-09-26 11:11:38,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:11:39,154 - lava_callback - INFO - Received callback for node 68d3d1e4cd36afa834e10021 INFO: 172.20.0.1:51890 - "POST /node/68d3d1e4cd36afa834e10021 HTTP/1.0" 202 Accepted 2025-09-26 11:11:39,164 - lava_callback - INFO - Starting async job submit for node 68d3d1e4cd36afa834e10021 2025-09-26 11:11:39,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:39,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:39,167 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674832f83206171a9111e/lava_callback.json.gz 2025-09-26 11:11:39,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:39,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d1e4cd36afa834e10021 HTTP/1.1" 200 None 2025-09-26 11:11:39,216 - lava_callback - DEBUG - Processing node 68d3d1e4cd36afa834e10021: baseline-arm 2025-09-26 11:11:39,216 - lava_callback - ERROR - Error processing callback for node 68d3d1e4cd36afa834e10021: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:11:39,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674832f83206171a9111e HTTP/1.1" 200 None 2025-09-26 11:11:39,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:39,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:11:39,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:39,287 - lava_callback - INFO - Received callback for node 68d40a41cd36afa834e16f18 INFO: 172.20.0.1:51896 - "POST /node/68d40a41cd36afa834e16f18 HTTP/1.0" 202 Accepted 2025-09-26 11:11:39,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674832f83206171a9111e HTTP/1.1" 200 None 2025-09-26 11:11:39,300 - lava_callback - INFO - Completed processing callback for node 68d674832f83206171a9111e 2025-09-26 11:11:39,300 - lava_callback - INFO - Starting async job submit for node 68d40a41cd36afa834e16f18 2025-09-26 11:11:39,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:39,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a41cd36afa834e16f18 HTTP/1.1" 200 None 2025-09-26 11:11:39,380 - lava_callback - DEBUG - Processing node 68d40a41cd36afa834e16f18: baseline-arm 2025-09-26 11:11:39,793 - lava_callback - ERROR - Error processing callback for node 68d40a41cd36afa834e16f18: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:45774 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:11:54,824 - lava_callback - INFO - Received callback for node 68d6744e2f83206171a9109d INFO: 172.20.0.1:58862 - "POST /node/68d6744e2f83206171a9109d HTTP/1.0" 202 Accepted 2025-09-26 11:11:54,835 - lava_callback - INFO - Starting async job submit for node 68d6744e2f83206171a9109d 2025-09-26 11:11:54,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:54,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6744e2f83206171a9109d HTTP/1.1" 200 None 2025-09-26 11:11:54,915 - lava_callback - DEBUG - Processing node 68d6744e2f83206171a9109d: baseline-arm64 2025-09-26 11:11:55,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:11:55,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:55,548 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6744e2f83206171a9109d/log.txt.gz 2025-09-26 11:11:55,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:11:55,735 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:11:55,736 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6744e2f83206171a9109d/lava_callback.json.gz 2025-09-26 11:11:55,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:55,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6744e2f83206171a9109d HTTP/1.1" 200 None 2025-09-26 11:11:55,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:55,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:11:55,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:55,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6744e2f83206171a9109d HTTP/1.1" 200 None 2025-09-26 11:11:55,837 - lava_callback - INFO - Completed processing callback for node 68d6744e2f83206171a9109d INFO: 172.20.0.1:58868 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:11:56,651 - lava_callback - INFO - Received callback for node 68d3d1e6cd36afa834e10024 INFO: 172.20.0.1:58878 - "POST /node/68d3d1e6cd36afa834e10024 HTTP/1.0" 202 Accepted 2025-09-26 11:11:56,660 - lava_callback - INFO - Starting async job submit for node 68d3d1e6cd36afa834e10024 2025-09-26 11:11:56,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:56,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d1e6cd36afa834e10024 HTTP/1.1" 200 None 2025-09-26 11:11:56,676 - lava_callback - DEBUG - Processing node 68d3d1e6cd36afa834e10024: baseline-arm 2025-09-26 11:11:56,676 - lava_callback - ERROR - Error processing callback for node 68d3d1e6cd36afa834e10024: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:11:59,439 - lava_callback - INFO - Received callback for node 68d6744c2f83206171a91096 INFO: 172.20.0.1:41600 - "POST /node/68d6744c2f83206171a91096 HTTP/1.0" 202 Accepted 2025-09-26 11:11:59,445 - lava_callback - INFO - Starting async job submit for node 68d6744c2f83206171a91096 2025-09-26 11:11:59,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:11:59,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6744c2f83206171a91096 HTTP/1.1" 200 None 2025-09-26 11:11:59,490 - lava_callback - DEBUG - Processing node 68d6744c2f83206171a91096: baseline-arm64 2025-09-26 11:11:59,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:12:00,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:12:00,103 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6744c2f83206171a91096/log.txt.gz 2025-09-26 11:12:00,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:12:00,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:12:00,293 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6744c2f83206171a91096/lava_callback.json.gz 2025-09-26 11:12:00,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:00,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6744c2f83206171a91096 HTTP/1.1" 200 None 2025-09-26 11:12:00,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:00,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:12:00,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:00,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6744c2f83206171a91096 HTTP/1.1" 200 None 2025-09-26 11:12:00,388 - lava_callback - INFO - Completed processing callback for node 68d6744c2f83206171a91096 INFO: 172.20.0.1:41604 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:12:10,246 - lava_callback - INFO - Received callback for node 68d3d1fdcd36afa834e1003f INFO: 172.20.0.1:39670 - "POST /node/68d3d1fdcd36afa834e1003f HTTP/1.0" 202 Accepted 2025-09-26 11:12:10,252 - lava_callback - INFO - Starting async job submit for node 68d3d1fdcd36afa834e1003f 2025-09-26 11:12:10,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:10,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d1fdcd36afa834e1003f HTTP/1.1" 200 None 2025-09-26 11:12:10,272 - lava_callback - DEBUG - Processing node 68d3d1fdcd36afa834e1003f: baseline-arm-broonie 2025-09-26 11:12:10,272 - lava_callback - ERROR - Error processing callback for node 68d3d1fdcd36afa834e1003f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:12:11,164 - lava_callback - INFO - Received callback for node 68d674342f83206171a91022 INFO: 172.20.0.1:39684 - "POST /node/68d674342f83206171a91022 HTTP/1.0" 202 Accepted 2025-09-26 11:12:11,173 - lava_callback - INFO - Starting async job submit for node 68d674342f83206171a91022 2025-09-26 11:12:11,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:11,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674342f83206171a91022 HTTP/1.1" 200 None 2025-09-26 11:12:11,220 - lava_callback - DEBUG - Processing node 68d674342f83206171a91022: baseline-arm64 2025-09-26 11:12:11,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:12:12,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:12:12,737 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674342f83206171a91022/log.txt.gz 2025-09-26 11:12:12,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:12:15,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:12:15,145 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674342f83206171a91022/lava_callback.json.gz INFO: 172.20.0.1:39700 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 11:12:15,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:15,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674342f83206171a91022 HTTP/1.1" 200 None 2025-09-26 11:12:15,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:15,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:12:15,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:15,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674342f83206171a91022 HTTP/1.1" 200 None 2025-09-26 11:12:15,270 - lava_callback - INFO - Completed processing callback for node 68d674342f83206171a91022 INFO: 172.20.0.1:39702 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:12:17,836 - lava_callback - INFO - Received callback for node 68d673942f83206171a90ec6 INFO: 172.20.0.1:39708 - "POST /node/68d673942f83206171a90ec6 HTTP/1.0" 202 Accepted 2025-09-26 11:12:17,847 - lava_callback - INFO - Starting async job submit for node 68d673942f83206171a90ec6 2025-09-26 11:12:17,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:17,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673942f83206171a90ec6 HTTP/1.1" 200 None 2025-09-26 11:12:17,896 - lava_callback - DEBUG - Processing node 68d673942f83206171a90ec6: baseline-arm64 2025-09-26 11:12:18,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:12:20,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:12:20,280 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673942f83206171a90ec6/log.txt.gz 2025-09-26 11:12:20,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:37728 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:12:22,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:12:22,845 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673942f83206171a90ec6/lava_callback.json.gz 2025-09-26 11:12:22,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:22,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673942f83206171a90ec6 HTTP/1.1" 200 None 2025-09-26 11:12:22,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:22,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:12:22,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:22,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673942f83206171a90ec6 HTTP/1.1" 200 None 2025-09-26 11:12:22,938 - lava_callback - INFO - Completed processing callback for node 68d673942f83206171a90ec6 INFO: 172.20.0.1:37736 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:12:23,839 - lava_callback - INFO - Received callback for node 68d674522f83206171a910b0 INFO: 172.20.0.1:37738 - "POST /node/68d674522f83206171a910b0 HTTP/1.0" 202 Accepted 2025-09-26 11:12:23,845 - lava_callback - INFO - Starting async job submit for node 68d674522f83206171a910b0 2025-09-26 11:12:23,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:23,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674522f83206171a910b0 HTTP/1.1" 200 None 2025-09-26 11:12:23,884 - lava_callback - DEBUG - Processing node 68d674522f83206171a910b0: baseline-arm64 2025-09-26 11:12:24,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:12:25,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:12:25,268 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674522f83206171a910b0/log.txt.gz 2025-09-26 11:12:25,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:37752 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:12:27,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:12:27,852 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674522f83206171a910b0/lava_callback.json.gz 2025-09-26 11:12:27,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:27,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674522f83206171a910b0 HTTP/1.1" 200 None 2025-09-26 11:12:27,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:27,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:12:27,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:27,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674522f83206171a910b0 HTTP/1.1" 200 None 2025-09-26 11:12:27,958 - lava_callback - INFO - Completed processing callback for node 68d674522f83206171a910b0 2025-09-26 11:12:27,986 - lava_callback - INFO - Received callback for node 68d674572f83206171a910c2 INFO: 172.20.0.1:37758 - "POST /node/68d674572f83206171a910c2 HTTP/1.0" 202 Accepted 2025-09-26 11:12:27,997 - lava_callback - INFO - Starting async job submit for node 68d674572f83206171a910c2 2025-09-26 11:12:28,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:28,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674572f83206171a910c2 HTTP/1.1" 200 None 2025-09-26 11:12:28,057 - lava_callback - DEBUG - Processing node 68d674572f83206171a910c2: baseline-arm64 2025-09-26 11:12:28,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:12:28,675 - lava_callback - INFO - Received callback for node 68d6743d2f83206171a9105b INFO: 172.20.0.1:37762 - "POST /node/68d6743d2f83206171a9105b HTTP/1.0" 202 Accepted 2025-09-26 11:12:28,682 - lava_callback - INFO - Starting async job submit for node 68d6743d2f83206171a9105b 2025-09-26 11:12:28,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:28,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6743d2f83206171a9105b HTTP/1.1" 200 None 2025-09-26 11:12:28,729 - lava_callback - DEBUG - Processing node 68d6743d2f83206171a9105b: baseline-arm64 2025-09-26 11:12:29,032 - lava_callback - INFO - Received callback for node 68d3d1eacd36afa834e10027 INFO: 172.20.0.1:37772 - "POST /node/68d3d1eacd36afa834e10027 HTTP/1.0" 202 Accepted 2025-09-26 11:12:29,056 - lava_callback - INFO - Starting async job submit for node 68d3d1eacd36afa834e10027 2025-09-26 11:12:29,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:29,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d1eacd36afa834e10027 HTTP/1.1" 200 None 2025-09-26 11:12:29,194 - lava_callback - DEBUG - Processing node 68d3d1eacd36afa834e10027: baseline-arm-broonie 2025-09-26 11:12:29,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:12:29,421 - lava_callback - ERROR - Error processing callback for node 68d3d1eacd36afa834e10027: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:12:30,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:12:30,462 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:12:30,463 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674572f83206171a910c2/log.txt.gz 2025-09-26 11:12:30,466 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6743d2f83206171a9105b/log.txt.gz 2025-09-26 11:12:30,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:12:30,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:12:30,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:12:30,651 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6743d2f83206171a9105b/lava_callback.json.gz 2025-09-26 11:12:30,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:12:30,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:30,678 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674572f83206171a910c2/lava_callback.json.gz 2025-09-26 11:12:30,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:30,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674572f83206171a910c2 HTTP/1.1" 200 None 2025-09-26 11:12:30,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:30,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6743d2f83206171a9105b HTTP/1.1" 200 None 2025-09-26 11:12:30,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:30,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:12:30,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:30,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:12:30,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:30,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674572f83206171a910c2 HTTP/1.1" 200 None 2025-09-26 11:12:30,779 - lava_callback - INFO - Completed processing callback for node 68d674572f83206171a910c2 2025-09-26 11:12:30,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6743d2f83206171a9105b HTTP/1.1" 200 None 2025-09-26 11:12:30,796 - lava_callback - INFO - Completed processing callback for node 68d6743d2f83206171a9105b 2025-09-26 11:12:33,945 - lava_callback - INFO - Received callback for node 68d3d1f5cd36afa834e10036 INFO: 172.20.0.1:54598 - "POST /node/68d3d1f5cd36afa834e10036 HTTP/1.0" 202 Accepted 2025-09-26 11:12:33,954 - lava_callback - INFO - Starting async job submit for node 68d3d1f5cd36afa834e10036 2025-09-26 11:12:33,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:34,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d1f5cd36afa834e10036 HTTP/1.1" 200 None 2025-09-26 11:12:34,004 - lava_callback - DEBUG - Processing node 68d3d1f5cd36afa834e10036: baseline-arm-broonie 2025-09-26 11:12:34,256 - lava_callback - ERROR - Error processing callback for node 68d3d1f5cd36afa834e10036: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:54602 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:12:45,646 - lava_callback - INFO - Received callback for node 68d674a32f83206171a91157 INFO: 172.20.0.1:41074 - "POST /node/68d674a32f83206171a91157 HTTP/1.0" 202 Accepted 2025-09-26 11:12:45,654 - lava_callback - INFO - Starting async job submit for node 68d674a32f83206171a91157 2025-09-26 11:12:45,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:45,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674a32f83206171a91157 HTTP/1.1" 200 None 2025-09-26 11:12:45,692 - lava_callback - DEBUG - Processing node 68d674a32f83206171a91157: baseline-arm64-baylibre 2025-09-26 11:12:46,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:12:46,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:12:46,334 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d674a32f83206171a91157/log.txt.gz 2025-09-26 11:12:46,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:12:46,504 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:12:46,505 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d674a32f83206171a91157/lava_callback.json.gz INFO: 172.20.0.1:41084 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:12:46,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:46,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674a32f83206171a91157 HTTP/1.1" 200 None 2025-09-26 11:12:46,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:46,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:12:46,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:46,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674a32f83206171a91157 HTTP/1.1" 200 None 2025-09-26 11:12:46,613 - lava_callback - INFO - Completed processing callback for node 68d674a32f83206171a91157 2025-09-26 11:12:55,107 - lava_callback - INFO - Received callback for node 68d674cb2f83206171a911bb INFO: 172.20.0.1:50934 - "POST /node/68d674cb2f83206171a911bb HTTP/1.0" 202 Accepted 2025-09-26 11:12:55,114 - lava_callback - INFO - Starting async job submit for node 68d674cb2f83206171a911bb 2025-09-26 11:12:55,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:55,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674cb2f83206171a911bb HTTP/1.1" 200 None 2025-09-26 11:12:55,155 - lava_callback - DEBUG - Processing node 68d674cb2f83206171a911bb: baseline-arm64-broonie 2025-09-26 11:12:55,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:12:56,437 - lava_callback - INFO - Received callback for node 68d3d226cd36afa834e10096 INFO: 172.20.0.1:50944 - "POST /node/68d3d226cd36afa834e10096 HTTP/1.0" 202 Accepted 2025-09-26 11:12:56,443 - lava_callback - INFO - Starting async job submit for node 68d3d226cd36afa834e10096 2025-09-26 11:12:56,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:56,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d226cd36afa834e10096 HTTP/1.1" 200 None 2025-09-26 11:12:56,456 - lava_callback - DEBUG - Processing node 68d3d226cd36afa834e10096: baseline-arm 2025-09-26 11:12:56,456 - lava_callback - ERROR - Error processing callback for node 68d3d226cd36afa834e10096: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:50958 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:12:56,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:12:56,972 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d674cb2f83206171a911bb/log.txt.gz 2025-09-26 11:12:56,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:12:57,152 - lava_callback - INFO - Received callback for node 68d3d228cd36afa834e10099 INFO: 172.20.0.1:50962 - "POST /node/68d3d228cd36afa834e10099 HTTP/1.0" 202 Accepted 2025-09-26 11:12:57,158 - lava_callback - INFO - Starting async job submit for node 68d3d228cd36afa834e10099 2025-09-26 11:12:57,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:57,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d228cd36afa834e10099 HTTP/1.1" 200 None 2025-09-26 11:12:57,174 - lava_callback - DEBUG - Processing node 68d3d228cd36afa834e10099: baseline-arm 2025-09-26 11:12:57,174 - lava_callback - ERROR - Error processing callback for node 68d3d228cd36afa834e10099: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:12:57,872 - lava_callback - INFO - Received callback for node 68d3d22ecd36afa834e1009f INFO: 172.20.0.1:50968 - "POST /node/68d3d22ecd36afa834e1009f HTTP/1.0" 202 Accepted 2025-09-26 11:12:57,879 - lava_callback - INFO - Starting async job submit for node 68d3d22ecd36afa834e1009f 2025-09-26 11:12:57,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:57,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d22ecd36afa834e1009f HTTP/1.1" 200 None 2025-09-26 11:12:57,904 - lava_callback - DEBUG - Processing node 68d3d22ecd36afa834e1009f: baseline-arm 2025-09-26 11:12:57,904 - lava_callback - ERROR - Error processing callback for node 68d3d22ecd36afa834e1009f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:12:58,588 - lava_callback - INFO - Received callback for node 68d3d22fcd36afa834e100a2 INFO: 172.20.0.1:50978 - "POST /node/68d3d22fcd36afa834e100a2 HTTP/1.0" 202 Accepted 2025-09-26 11:12:58,596 - lava_callback - INFO - Starting async job submit for node 68d3d22fcd36afa834e100a2 2025-09-26 11:12:58,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:58,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d22fcd36afa834e100a2 HTTP/1.1" 200 None 2025-09-26 11:12:58,611 - lava_callback - DEBUG - Processing node 68d3d22fcd36afa834e100a2: baseline-arm 2025-09-26 11:12:58,611 - lava_callback - ERROR - Error processing callback for node 68d3d22fcd36afa834e100a2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:12:59,132 - lava_callback - INFO - Received callback for node 68d674882f83206171a91124 INFO: 172.20.0.1:50992 - "POST /node/68d674882f83206171a91124 HTTP/1.0" 202 Accepted 2025-09-26 11:12:59,142 - lava_callback - INFO - Starting async job submit for node 68d674882f83206171a91124 2025-09-26 11:12:59,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:59,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674882f83206171a91124 HTTP/1.1" 200 None 2025-09-26 11:12:59,187 - lava_callback - DEBUG - Processing node 68d674882f83206171a91124: baseline-arm64 2025-09-26 11:12:59,330 - lava_callback - INFO - Received callback for node 68d3d231cd36afa834e100a5 INFO: 172.20.0.1:40410 - "POST /node/68d3d231cd36afa834e100a5 HTTP/1.0" 202 Accepted 2025-09-26 11:12:59,367 - lava_callback - INFO - Starting async job submit for node 68d3d231cd36afa834e100a5 2025-09-26 11:12:59,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:59,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d231cd36afa834e100a5 HTTP/1.1" 200 None 2025-09-26 11:12:59,464 - lava_callback - DEBUG - Processing node 68d3d231cd36afa834e100a5: baseline-arm 2025-09-26 11:12:59,470 - lava_callback - ERROR - Error processing callback for node 68d3d231cd36afa834e100a5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:12:59,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:12:59,685 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:12:59,686 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d674cb2f83206171a911bb/lava_callback.json.gz 2025-09-26 11:12:59,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:59,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674cb2f83206171a911bb HTTP/1.1" 200 None 2025-09-26 11:12:59,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:59,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:12:59,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:12:59,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:12:59,766 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674882f83206171a91124/log.txt.gz 2025-09-26 11:12:59,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:12:59,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674cb2f83206171a911bb HTTP/1.1" 200 None 2025-09-26 11:12:59,801 - lava_callback - INFO - Completed processing callback for node 68d674cb2f83206171a911bb 2025-09-26 11:13:00,025 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:13:00,026 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674882f83206171a91124/lava_callback.json.gz 2025-09-26 11:13:00,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:00,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674882f83206171a91124 HTTP/1.1" 200 None 2025-09-26 11:13:00,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:00,081 - lava_callback - INFO - Received callback for node 68d3d233cd36afa834e100a8 INFO: 172.20.0.1:40412 - "POST /node/68d3d233cd36afa834e100a8 HTTP/1.0" 202 Accepted 2025-09-26 11:13:00,089 - lava_callback - INFO - Starting async job submit for node 68d3d233cd36afa834e100a8 2025-09-26 11:13:00,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:00,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:13:00,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:00,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d233cd36afa834e100a8 HTTP/1.1" 200 None 2025-09-26 11:13:00,104 - lava_callback - DEBUG - Processing node 68d3d233cd36afa834e100a8: baseline-arm 2025-09-26 11:13:00,104 - lava_callback - ERROR - Error processing callback for node 68d3d233cd36afa834e100a8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:13:00,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674882f83206171a91124 HTTP/1.1" 200 None 2025-09-26 11:13:00,129 - lava_callback - INFO - Completed processing callback for node 68d674882f83206171a91124 INFO: 172.20.0.1:40426 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:13:09,072 - lava_callback - INFO - Received callback for node 68d674dc2f83206171a911df INFO: 172.20.0.1:40434 - "POST /node/68d674dc2f83206171a911df HTTP/1.0" 202 Accepted 2025-09-26 11:13:09,078 - lava_callback - INFO - Starting async job submit for node 68d674dc2f83206171a911df 2025-09-26 11:13:09,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:09,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674dc2f83206171a911df HTTP/1.1" 200 None 2025-09-26 11:13:09,125 - lava_callback - DEBUG - Processing node 68d674dc2f83206171a911df: baseline-arm64-broonie 2025-09-26 11:13:09,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:13:10,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:13:10,015 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d674dc2f83206171a911df/log.txt.gz 2025-09-26 11:13:10,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:13:10,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:13:10,180 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d674dc2f83206171a911df/lava_callback.json.gz 2025-09-26 11:13:10,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:10,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674dc2f83206171a911df HTTP/1.1" 200 None 2025-09-26 11:13:10,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:10,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:13:10,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:10,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674dc2f83206171a911df HTTP/1.1" 200 None 2025-09-26 11:13:10,297 - lava_callback - INFO - Completed processing callback for node 68d674dc2f83206171a911df INFO: 172.20.0.1:60938 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 11:13:16,120 - lava_callback - INFO - Received callback for node 68d3d239cd36afa834e100b2 INFO: 172.20.0.1:60948 - "POST /node/68d3d239cd36afa834e100b2 HTTP/1.0" 202 Accepted 2025-09-26 11:13:16,126 - lava_callback - INFO - Starting async job submit for node 68d3d239cd36afa834e100b2 2025-09-26 11:13:16,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:16,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d239cd36afa834e100b2 HTTP/1.1" 200 None 2025-09-26 11:13:16,145 - lava_callback - DEBUG - Processing node 68d3d239cd36afa834e100b2: baseline-arm 2025-09-26 11:13:16,145 - lava_callback - ERROR - Error processing callback for node 68d3d239cd36afa834e100b2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60952 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:13:16,802 - lava_callback - INFO - Received callback for node 68d3d23ccd36afa834e100b5 INFO: 172.20.0.1:60958 - "POST /node/68d3d23ccd36afa834e100b5 HTTP/1.0" 202 Accepted 2025-09-26 11:13:16,808 - lava_callback - INFO - Starting async job submit for node 68d3d23ccd36afa834e100b5 2025-09-26 11:13:16,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:16,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d23ccd36afa834e100b5 HTTP/1.1" 200 None 2025-09-26 11:13:16,825 - lava_callback - DEBUG - Processing node 68d3d23ccd36afa834e100b5: baseline-arm 2025-09-26 11:13:16,825 - lava_callback - ERROR - Error processing callback for node 68d3d23ccd36afa834e100b5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:13:18,342 - lava_callback - INFO - Received callback for node 68d674542f83206171a910bf INFO: 172.20.0.1:60968 - "POST /node/68d674542f83206171a910bf HTTP/1.0" 202 Accepted 2025-09-26 11:13:18,348 - lava_callback - INFO - Starting async job submit for node 68d674542f83206171a910bf 2025-09-26 11:13:18,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:18,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674542f83206171a910bf HTTP/1.1" 200 None 2025-09-26 11:13:18,380 - lava_callback - DEBUG - Processing node 68d674542f83206171a910bf: baseline-arm64 2025-09-26 11:13:18,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:13:19,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:13:19,551 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674542f83206171a910bf/log.txt.gz 2025-09-26 11:13:19,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:13:19,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:13:19,700 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674542f83206171a910bf/lava_callback.json.gz 2025-09-26 11:13:19,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:19,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674542f83206171a910bf HTTP/1.1" 200 None 2025-09-26 11:13:19,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:19,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:13:19,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:19,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674542f83206171a910bf HTTP/1.1" 200 None 2025-09-26 11:13:19,789 - lava_callback - INFO - Completed processing callback for node 68d674542f83206171a910bf INFO: 172.20.0.1:45702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45728 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:13:28,835 - lava_callback - INFO - Received callback for node 68d674d92f83206171a911d8 INFO: 172.20.0.1:45744 - "POST /node/68d674d92f83206171a911d8 HTTP/1.0" 202 Accepted 2025-09-26 11:13:28,841 - lava_callback - INFO - Starting async job submit for node 68d674d92f83206171a911d8 2025-09-26 11:13:28,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:28,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674d92f83206171a911d8 HTTP/1.1" 200 None 2025-09-26 11:13:28,875 - lava_callback - DEBUG - Processing node 68d674d92f83206171a911d8: baseline-arm64-broonie 2025-09-26 11:13:29,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:13:29,283 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:13:29,283 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d674d92f83206171a911d8/log.txt.gz 2025-09-26 11:13:29,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:13:29,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:13:29,440 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d674d92f83206171a911d8/lava_callback.json.gz 2025-09-26 11:13:29,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:29,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674d92f83206171a911d8 HTTP/1.1" 200 None 2025-09-26 11:13:29,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:29,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:13:29,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:29,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674d92f83206171a911d8 HTTP/1.1" 200 None 2025-09-26 11:13:29,550 - lava_callback - INFO - Completed processing callback for node 68d674d92f83206171a911d8 2025-09-26 11:13:30,436 - lava_callback - INFO - Received callback for node 68d3d254cd36afa834e100e0 INFO: 172.20.0.1:51152 - "POST /node/68d3d254cd36afa834e100e0 HTTP/1.0" 202 Accepted 2025-09-26 11:13:30,443 - lava_callback - INFO - Starting async job submit for node 68d3d254cd36afa834e100e0 2025-09-26 11:13:30,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:30,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d254cd36afa834e100e0 HTTP/1.1" 200 None 2025-09-26 11:13:30,458 - lava_callback - DEBUG - Processing node 68d3d254cd36afa834e100e0: ltp-cap-bounds 2025-09-26 11:13:30,458 - lava_callback - ERROR - Error processing callback for node 68d3d254cd36afa834e100e0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:13:34,557 - lava_callback - INFO - Received callback for node 68d674e72f83206171a911ed INFO: 172.20.0.1:51162 - "POST /node/68d674e72f83206171a911ed HTTP/1.0" 202 Accepted 2025-09-26 11:13:34,563 - lava_callback - INFO - Starting async job submit for node 68d674e72f83206171a911ed 2025-09-26 11:13:34,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:34,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674e72f83206171a911ed HTTP/1.1" 200 None 2025-09-26 11:13:34,603 - lava_callback - DEBUG - Processing node 68d674e72f83206171a911ed: baseline-arm64-broonie 2025-09-26 11:13:34,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:13:36,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:13:36,016 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d674e72f83206171a911ed/log.txt.gz 2025-09-26 11:13:36,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:51174 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:13:37,546 - lava_callback - INFO - Received callback for node 68d674f82f83206171a91217 INFO: 172.20.0.1:51188 - "POST /node/68d674f82f83206171a91217 HTTP/1.0" 202 Accepted 2025-09-26 11:13:37,552 - lava_callback - INFO - Starting async job submit for node 68d674f82f83206171a91217 2025-09-26 11:13:37,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:37,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674f82f83206171a91217 HTTP/1.1" 200 None 2025-09-26 11:13:37,587 - lava_callback - DEBUG - Processing node 68d674f82f83206171a91217: baseline-arm64-broonie 2025-09-26 11:13:37,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:13:38,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:13:38,383 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d674f82f83206171a91217/log.txt.gz 2025-09-26 11:13:38,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:13:38,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:13:38,394 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d674e72f83206171a911ed/lava_callback.json.gz 2025-09-26 11:13:38,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:38,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674e72f83206171a911ed HTTP/1.1" 200 None 2025-09-26 11:13:38,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:38,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:13:38,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:38,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674e72f83206171a911ed HTTP/1.1" 200 None 2025-09-26 11:13:38,515 - lava_callback - INFO - Completed processing callback for node 68d674e72f83206171a911ed 2025-09-26 11:13:40,779 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:13:40,780 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d674f82f83206171a91217/lava_callback.json.gz 2025-09-26 11:13:40,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:40,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674f82f83206171a91217 HTTP/1.1" 200 None 2025-09-26 11:13:40,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:40,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:13:40,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:40,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674f82f83206171a91217 HTTP/1.1" 200 None 2025-09-26 11:13:40,866 - lava_callback - INFO - Completed processing callback for node 68d674f82f83206171a91217 2025-09-26 11:13:45,734 - lava_callback - INFO - Received callback for node 68d675312f83206171a9125b INFO: 172.20.0.1:57282 - "POST /node/68d675312f83206171a9125b HTTP/1.0" 202 Accepted 2025-09-26 11:13:45,739 - lava_callback - INFO - Starting async job submit for node 68d675312f83206171a9125b 2025-09-26 11:13:45,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:45,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d675312f83206171a9125b HTTP/1.1" 200 None 2025-09-26 11:13:45,779 - lava_callback - DEBUG - Processing node 68d675312f83206171a9125b: baseline-arm64-pengutronix 2025-09-26 11:13:45,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:57284 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:13:47,692 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:13:47,693 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d675312f83206171a9125b/log.txt.gz 2025-09-26 11:13:47,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:13:49,002 - lava_callback - INFO - Received callback for node 68d674f22f83206171a911ff INFO: 172.20.0.1:57286 - "POST /node/68d674f22f83206171a911ff HTTP/1.0" 202 Accepted 2025-09-26 11:13:49,012 - lava_callback - INFO - Starting async job submit for node 68d674f22f83206171a911ff 2025-09-26 11:13:49,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:49,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674f22f83206171a911ff HTTP/1.1" 200 None 2025-09-26 11:13:49,074 - lava_callback - DEBUG - Processing node 68d674f22f83206171a911ff: baseline-arm64-broonie 2025-09-26 11:13:49,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:13:50,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:13:50,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:13:50,032 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d674f22f83206171a911ff/log.txt.gz 2025-09-26 11:13:50,033 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d675312f83206171a9125b/lava_callback.json.gz 2025-09-26 11:13:50,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:50,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:13:50,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d675312f83206171a9125b HTTP/1.1" 200 None 2025-09-26 11:13:50,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:50,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:13:50,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:50,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d675312f83206171a9125b HTTP/1.1" 200 None 2025-09-26 11:13:50,124 - lava_callback - INFO - Completed processing callback for node 68d675312f83206171a9125b 2025-09-26 11:13:50,309 - lava_callback - INFO - Received callback for node 68d3d25bcd36afa834e1010a INFO: 172.20.0.1:56898 - "POST /node/68d3d25bcd36afa834e1010a HTTP/1.0" 202 Accepted 2025-09-26 11:13:50,315 - lava_callback - INFO - Starting async job submit for node 68d3d25bcd36afa834e1010a 2025-09-26 11:13:50,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:50,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d25bcd36afa834e1010a HTTP/1.1" 200 None 2025-09-26 11:13:50,332 - lava_callback - DEBUG - Processing node 68d3d25bcd36afa834e1010a: ltp-cap-bounds 2025-09-26 11:13:50,332 - lava_callback - ERROR - Error processing callback for node 68d3d25bcd36afa834e1010a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:13:50,467 - lava_callback - INFO - Received callback for node 68d675032f83206171a91225 INFO: 172.20.0.1:56906 - "POST /node/68d675032f83206171a91225 HTTP/1.0" 202 Accepted 2025-09-26 11:13:50,473 - lava_callback - INFO - Starting async job submit for node 68d675032f83206171a91225 2025-09-26 11:13:50,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:50,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d675032f83206171a91225 HTTP/1.1" 200 None 2025-09-26 11:13:50,509 - lava_callback - DEBUG - Processing node 68d675032f83206171a91225: baseline-arm64-broonie 2025-09-26 11:13:50,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:13:52,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:13:52,403 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d674f22f83206171a911ff/lava_callback.json.gz 2025-09-26 11:13:52,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:13:52,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:52,426 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d675032f83206171a91225/log.txt.gz 2025-09-26 11:13:52,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:13:52,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674f22f83206171a911ff HTTP/1.1" 200 None 2025-09-26 11:13:52,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:52,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:13:52,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:52,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674f22f83206171a911ff HTTP/1.1" 200 None 2025-09-26 11:13:52,491 - lava_callback - INFO - Completed processing callback for node 68d674f22f83206171a911ff 2025-09-26 11:13:54,441 - lava_callback - INFO - Received callback for node 68d40a43cd36afa834e16f1b INFO: 172.20.0.1:56910 - "POST /node/68d40a43cd36afa834e16f1b HTTP/1.0" 202 Accepted 2025-09-26 11:13:54,447 - lava_callback - INFO - Starting async job submit for node 68d40a43cd36afa834e16f1b 2025-09-26 11:13:54,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:54,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a43cd36afa834e16f1b HTTP/1.1" 200 None 2025-09-26 11:13:54,488 - lava_callback - DEBUG - Processing node 68d40a43cd36afa834e16f1b: baseline-arm 2025-09-26 11:13:54,582 - lava_callback - INFO - Received callback for node 68d675372f83206171a91269 INFO: 172.20.0.1:56912 - "POST /node/68d675372f83206171a91269 HTTP/1.0" 202 Accepted 2025-09-26 11:13:54,603 - lava_callback - INFO - Starting async job submit for node 68d675372f83206171a91269 2025-09-26 11:13:54,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:54,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d675372f83206171a91269 HTTP/1.1" 200 None 2025-09-26 11:13:54,738 - lava_callback - DEBUG - Processing node 68d675372f83206171a91269: baseline-arm64-pengutronix 2025-09-26 11:13:54,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:13:54,909 - lava_callback - ERROR - Error processing callback for node 68d40a43cd36afa834e16f1b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:13:54,915 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d675032f83206171a91225/lava_callback.json.gz 2025-09-26 11:13:54,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:55,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d675032f83206171a91225 HTTP/1.1" 200 None 2025-09-26 11:13:55,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:55,090 - lava_callback - INFO - Received callback for node 68d674d12f83206171a911ca INFO: 172.20.0.1:56924 - "POST /node/68d674d12f83206171a911ca HTTP/1.0" 202 Accepted 2025-09-26 11:13:55,107 - lava_callback - INFO - Starting async job submit for node 68d674d12f83206171a911ca 2025-09-26 11:13:55,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:13:55,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:55,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:55,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:13:55,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674d12f83206171a911ca HTTP/1.1" 200 None 2025-09-26 11:13:55,210 - lava_callback - DEBUG - Processing node 68d674d12f83206171a911ca: baseline-arm64-broonie 2025-09-26 11:13:55,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d675032f83206171a91225 HTTP/1.1" 200 None 2025-09-26 11:13:55,248 - lava_callback - INFO - Completed processing callback for node 68d675032f83206171a91225 2025-09-26 11:13:55,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:56932 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:13:57,230 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:13:57,231 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d674d12f83206171a911ca/log.txt.gz 2025-09-26 11:13:57,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:13:57,236 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d675372f83206171a91269/log.txt.gz 2025-09-26 11:13:57,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:13:57,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:13:57,401 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:13:57,402 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d675372f83206171a91269/lava_callback.json.gz 2025-09-26 11:13:57,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:57,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:13:57,425 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d674d12f83206171a911ca/lava_callback.json.gz 2025-09-26 11:13:57,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:57,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d675372f83206171a91269 HTTP/1.1" 200 None 2025-09-26 11:13:57,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:57,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674d12f83206171a911ca HTTP/1.1" 200 None 2025-09-26 11:13:57,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:57,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:13:57,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:13:57,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:57,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:57,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674d12f83206171a911ca HTTP/1.1" 200 None 2025-09-26 11:13:57,510 - lava_callback - INFO - Completed processing callback for node 68d674d12f83206171a911ca 2025-09-26 11:13:57,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d675372f83206171a91269 HTTP/1.1" 200 None 2025-09-26 11:13:57,555 - lava_callback - INFO - Completed processing callback for node 68d675372f83206171a91269 2025-09-26 11:13:57,730 - lava_callback - INFO - Received callback for node 68d674fd2f83206171a9121e INFO: 172.20.0.1:56940 - "POST /node/68d674fd2f83206171a9121e HTTP/1.0" 202 Accepted 2025-09-26 11:13:57,736 - lava_callback - INFO - Starting async job submit for node 68d674fd2f83206171a9121e 2025-09-26 11:13:57,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:57,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674fd2f83206171a9121e HTTP/1.1" 200 None 2025-09-26 11:13:57,772 - lava_callback - DEBUG - Processing node 68d674fd2f83206171a9121e: baseline-arm64-broonie 2025-09-26 11:13:58,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:13:58,191 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:13:58,191 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d674fd2f83206171a9121e/log.txt.gz 2025-09-26 11:13:58,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:13:58,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:13:58,344 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d674fd2f83206171a9121e/lava_callback.json.gz 2025-09-26 11:13:58,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:58,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674fd2f83206171a9121e HTTP/1.1" 200 None 2025-09-26 11:13:58,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:58,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:13:58,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:58,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674fd2f83206171a9121e HTTP/1.1" 200 None 2025-09-26 11:13:58,450 - lava_callback - INFO - Completed processing callback for node 68d674fd2f83206171a9121e 2025-09-26 11:13:59,046 - lava_callback - INFO - Received callback for node 68d674ad2f83206171a91169 INFO: 172.20.0.1:56950 - "POST /node/68d674ad2f83206171a91169 HTTP/1.0" 202 Accepted 2025-09-26 11:13:59,052 - lava_callback - INFO - Starting async job submit for node 68d674ad2f83206171a91169 2025-09-26 11:13:59,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:59,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674ad2f83206171a91169 HTTP/1.1" 200 None 2025-09-26 11:13:59,087 - lava_callback - DEBUG - Processing node 68d674ad2f83206171a91169: baseline-arm64-baylibre 2025-09-26 11:13:59,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:13:59,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:13:59,505 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d674ad2f83206171a91169/log.txt.gz 2025-09-26 11:13:59,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:13:59,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:13:59,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d674ad2f83206171a91169/lava_callback.json.gz 2025-09-26 11:13:59,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:59,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674ad2f83206171a91169 HTTP/1.1" 200 None 2025-09-26 11:13:59,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:59,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:13:59,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:13:59,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674ad2f83206171a91169 HTTP/1.1" 200 None 2025-09-26 11:13:59,695 - lava_callback - INFO - Completed processing callback for node 68d674ad2f83206171a91169 2025-09-26 11:14:00,132 - lava_callback - INFO - Received callback for node 68d6753f2f83206171a91277 INFO: 172.20.0.1:43404 - "POST /node/68d6753f2f83206171a91277 HTTP/1.0" 202 Accepted 2025-09-26 11:14:00,142 - lava_callback - INFO - Starting async job submit for node 68d6753f2f83206171a91277 2025-09-26 11:14:00,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:00,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6753f2f83206171a91277 HTTP/1.1" 200 None 2025-09-26 11:14:00,192 - lava_callback - DEBUG - Processing node 68d6753f2f83206171a91277: baseline-arm64-foundriesio 2025-09-26 11:14:00,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:14:02,079 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:14:02,080 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6753f2f83206171a91277/log.txt.gz 2025-09-26 11:14:02,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:14:02,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:14:02,227 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6753f2f83206171a91277/lava_callback.json.gz 2025-09-26 11:14:02,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:02,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6753f2f83206171a91277 HTTP/1.1" 200 None 2025-09-26 11:14:02,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:02,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:14:02,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:02,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6753f2f83206171a91277 HTTP/1.1" 200 None 2025-09-26 11:14:02,330 - lava_callback - INFO - Completed processing callback for node 68d6753f2f83206171a91277 2025-09-26 11:14:02,439 - lava_callback - INFO - Received callback for node 68d6745e2f83206171a910c8 INFO: 172.20.0.1:43406 - "POST /node/68d6745e2f83206171a910c8 HTTP/1.0" 202 Accepted 2025-09-26 11:14:02,445 - lava_callback - INFO - Starting async job submit for node 68d6745e2f83206171a910c8 2025-09-26 11:14:02,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:02,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6745e2f83206171a910c8 HTTP/1.1" 200 None 2025-09-26 11:14:02,497 - lava_callback - DEBUG - Processing node 68d6745e2f83206171a910c8: baseline-arm64 2025-09-26 11:14:02,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:14:02,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:14:02,955 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6745e2f83206171a910c8/log.txt.gz 2025-09-26 11:14:02,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:14:03,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:14:03,085 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6745e2f83206171a910c8/lava_callback.json.gz 2025-09-26 11:14:03,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:03,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6745e2f83206171a910c8 HTTP/1.1" 200 None 2025-09-26 11:14:03,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:03,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:14:03,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:03,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6745e2f83206171a910c8 HTTP/1.1" 200 None 2025-09-26 11:14:03,158 - lava_callback - INFO - Completed processing callback for node 68d6745e2f83206171a910c8 2025-09-26 11:14:03,805 - lava_callback - INFO - Received callback for node 68d675132f83206171a91232 INFO: 172.20.0.1:43422 - "POST /node/68d675132f83206171a91232 HTTP/1.0" 202 Accepted 2025-09-26 11:14:03,815 - lava_callback - INFO - Starting async job submit for node 68d675132f83206171a91232 2025-09-26 11:14:03,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:03,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d675132f83206171a91232 HTTP/1.1" 200 None 2025-09-26 11:14:03,849 - lava_callback - DEBUG - Processing node 68d675132f83206171a91232: baseline-arm64-clabbe 2025-09-26 11:14:04,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:14:04,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:14:04,310 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d675132f83206171a91232/log.txt.gz 2025-09-26 11:14:04,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:14:04,438 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:14:04,439 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d675132f83206171a91232/lava_callback.json.gz 2025-09-26 11:14:04,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:04,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d675132f83206171a91232 HTTP/1.1" 200 None 2025-09-26 11:14:04,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:04,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:14:04,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:04,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d675132f83206171a91232 HTTP/1.1" 200 None 2025-09-26 11:14:04,513 - lava_callback - INFO - Completed processing callback for node 68d675132f83206171a91232 2025-09-26 11:14:04,529 - lava_callback - INFO - Received callback for node 68d6753b2f83206171a91270 INFO: 172.20.0.1:43426 - "POST /node/68d6753b2f83206171a91270 HTTP/1.0" 202 Accepted 2025-09-26 11:14:04,542 - lava_callback - INFO - Starting async job submit for node 68d6753b2f83206171a91270 2025-09-26 11:14:04,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:04,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6753b2f83206171a91270 HTTP/1.1" 200 None 2025-09-26 11:14:04,587 - lava_callback - DEBUG - Processing node 68d6753b2f83206171a91270: baseline-arm64-foundriesio 2025-09-26 11:14:04,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:14:05,829 - lava_callback - INFO - Received callback for node 68d673832f83206171a90ea1 INFO: 172.20.0.1:43436 - "POST /node/68d673832f83206171a90ea1 HTTP/1.0" 202 Accepted 2025-09-26 11:14:05,835 - lava_callback - INFO - Starting async job submit for node 68d673832f83206171a90ea1 2025-09-26 11:14:05,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:05,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673832f83206171a90ea1 HTTP/1.1" 200 None 2025-09-26 11:14:05,888 - lava_callback - DEBUG - Processing node 68d673832f83206171a90ea1: baseline-arm64 2025-09-26 11:14:06,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:43440 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:14:06,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:14:06,962 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6753b2f83206171a91270/log.txt.gz 2025-09-26 11:14:06,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:14:06,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:14:06,977 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673832f83206171a90ea1/log.txt.gz 2025-09-26 11:14:06,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:14:07,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:14:07,133 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6753b2f83206171a91270/lava_callback.json.gz 2025-09-26 11:14:07,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:07,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:14:07,177 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673832f83206171a90ea1/lava_callback.json.gz 2025-09-26 11:14:07,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6753b2f83206171a91270 HTTP/1.1" 200 None 2025-09-26 11:14:07,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:07,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:07,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:14:07,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673832f83206171a90ea1 HTTP/1.1" 200 None 2025-09-26 11:14:07,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:07,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:07,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:14:07,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:07,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6753b2f83206171a91270 HTTP/1.1" 200 None 2025-09-26 11:14:07,275 - lava_callback - INFO - Completed processing callback for node 68d6753b2f83206171a91270 2025-09-26 11:14:07,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673832f83206171a90ea1 HTTP/1.1" 200 None 2025-09-26 11:14:07,294 - lava_callback - INFO - Completed processing callback for node 68d673832f83206171a90ea1 2025-09-26 11:14:10,378 - lava_callback - INFO - Received callback for node 68d3d27bcd36afa834e10146 INFO: 172.20.0.1:51482 - "POST /node/68d3d27bcd36afa834e10146 HTTP/1.0" 202 Accepted 2025-09-26 11:14:10,388 - lava_callback - INFO - Starting async job submit for node 68d3d27bcd36afa834e10146 2025-09-26 11:14:10,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:10,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d27bcd36afa834e10146 HTTP/1.1" 200 None 2025-09-26 11:14:10,412 - lava_callback - DEBUG - Processing node 68d3d27bcd36afa834e10146: ltp-controllers 2025-09-26 11:14:10,412 - lava_callback - ERROR - Error processing callback for node 68d3d27bcd36afa834e10146: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:14:10,963 - lava_callback - INFO - Received callback for node 68d674592f83206171a910c5 INFO: 172.20.0.1:51494 - "POST /node/68d674592f83206171a910c5 HTTP/1.0" 202 Accepted 2025-09-26 11:14:10,973 - lava_callback - INFO - Starting async job submit for node 68d674592f83206171a910c5 2025-09-26 11:14:10,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:11,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674592f83206171a910c5 HTTP/1.1" 200 None 2025-09-26 11:14:11,010 - lava_callback - DEBUG - Processing node 68d674592f83206171a910c5: baseline-arm64 2025-09-26 11:14:11,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:14:11,761 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:14:11,762 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674592f83206171a910c5/log.txt.gz 2025-09-26 11:14:11,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:14:11,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:14:11,911 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674592f83206171a910c5/lava_callback.json.gz 2025-09-26 11:14:11,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:11,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674592f83206171a910c5 HTTP/1.1" 200 None 2025-09-26 11:14:11,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:11,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:14:11,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:11,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674592f83206171a910c5 HTTP/1.1" 200 None 2025-09-26 11:14:11,992 - lava_callback - INFO - Completed processing callback for node 68d674592f83206171a910c5 INFO: 172.20.0.1:51506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51514 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:14:18,442 - lava_callback - INFO - Received callback for node 68d6748e2f83206171a91132 INFO: 172.20.0.1:51526 - "POST /node/68d6748e2f83206171a91132 HTTP/1.0" 202 Accepted 2025-09-26 11:14:18,451 - lava_callback - INFO - Starting async job submit for node 68d6748e2f83206171a91132 2025-09-26 11:14:18,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:18,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6748e2f83206171a91132 HTTP/1.1" 200 None 2025-09-26 11:14:18,489 - lava_callback - DEBUG - Processing node 68d6748e2f83206171a91132: baseline-arm64 2025-09-26 11:14:18,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:14:18,878 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:14:18,878 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6748e2f83206171a91132/log.txt.gz 2025-09-26 11:14:18,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:55710 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:14:21,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:14:21,179 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6748e2f83206171a91132/lava_callback.json.gz 2025-09-26 11:14:21,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:21,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6748e2f83206171a91132 HTTP/1.1" 200 None 2025-09-26 11:14:21,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:21,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:14:21,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:21,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6748e2f83206171a91132 HTTP/1.1" 200 None 2025-09-26 11:14:21,275 - lava_callback - INFO - Completed processing callback for node 68d6748e2f83206171a91132 2025-09-26 11:14:21,708 - lava_callback - INFO - Received callback for node 68d6752e2f83206171a91258 INFO: 172.20.0.1:55722 - "POST /node/68d6752e2f83206171a91258 HTTP/1.0" 202 Accepted 2025-09-26 11:14:21,714 - lava_callback - INFO - Starting async job submit for node 68d6752e2f83206171a91258 2025-09-26 11:14:21,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:21,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6752e2f83206171a91258 HTTP/1.1" 200 None 2025-09-26 11:14:21,748 - lava_callback - DEBUG - Processing node 68d6752e2f83206171a91258: baseline-arm64-clabbe 2025-09-26 11:14:21,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:14:23,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:14:23,593 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d6752e2f83206171a91258/log.txt.gz 2025-09-26 11:14:23,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:55730 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:14:23,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:14:23,713 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d6752e2f83206171a91258/lava_callback.json.gz 2025-09-26 11:14:23,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:23,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6752e2f83206171a91258 HTTP/1.1" 200 None 2025-09-26 11:14:23,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:23,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:14:23,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:23,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6752e2f83206171a91258 HTTP/1.1" 200 None 2025-09-26 11:14:23,805 - lava_callback - INFO - Completed processing callback for node 68d6752e2f83206171a91258 INFO: 172.20.0.1:55736 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:14:36,161 - lava_callback - INFO - Received callback for node 68d3d291cd36afa834e1016d INFO: 172.20.0.1:37260 - "POST /node/68d3d291cd36afa834e1016d HTTP/1.0" 202 Accepted 2025-09-26 11:14:36,170 - lava_callback - INFO - Starting async job submit for node 68d3d291cd36afa834e1016d 2025-09-26 11:14:36,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:36,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d291cd36afa834e1016d HTTP/1.1" 200 None 2025-09-26 11:14:36,185 - lava_callback - DEBUG - Processing node 68d3d291cd36afa834e1016d: baseline-arm 2025-09-26 11:14:36,185 - lava_callback - ERROR - Error processing callback for node 68d3d291cd36afa834e1016d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:37270 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:14:36,852 - lava_callback - INFO - Received callback for node 68d3d293cd36afa834e10175 INFO: 172.20.0.1:37284 - "POST /node/68d3d293cd36afa834e10175 HTTP/1.0" 202 Accepted 2025-09-26 11:14:36,858 - lava_callback - INFO - Starting async job submit for node 68d3d293cd36afa834e10175 2025-09-26 11:14:36,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:36,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d293cd36afa834e10175 HTTP/1.1" 200 None 2025-09-26 11:14:36,873 - lava_callback - DEBUG - Processing node 68d3d293cd36afa834e10175: baseline-arm 2025-09-26 11:14:36,873 - lava_callback - ERROR - Error processing callback for node 68d3d293cd36afa834e10175: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:14:37,560 - lava_callback - INFO - Received callback for node 68d3d297cd36afa834e10195 INFO: 172.20.0.1:37296 - "POST /node/68d3d297cd36afa834e10195 HTTP/1.0" 202 Accepted 2025-09-26 11:14:37,565 - lava_callback - INFO - Starting async job submit for node 68d3d297cd36afa834e10195 2025-09-26 11:14:37,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:37,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d297cd36afa834e10195 HTTP/1.1" 200 None 2025-09-26 11:14:37,582 - lava_callback - DEBUG - Processing node 68d3d297cd36afa834e10195: baseline-arm 2025-09-26 11:14:37,582 - lava_callback - ERROR - Error processing callback for node 68d3d297cd36afa834e10195: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:14:38,265 - lava_callback - INFO - Received callback for node 68d3d297cd36afa834e10198 INFO: 172.20.0.1:37300 - "POST /node/68d3d297cd36afa834e10198 HTTP/1.0" 202 Accepted 2025-09-26 11:14:38,271 - lava_callback - INFO - Starting async job submit for node 68d3d297cd36afa834e10198 2025-09-26 11:14:38,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:38,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d297cd36afa834e10198 HTTP/1.1" 200 None 2025-09-26 11:14:38,294 - lava_callback - DEBUG - Processing node 68d3d297cd36afa834e10198: baseline-arm 2025-09-26 11:14:38,294 - lava_callback - ERROR - Error processing callback for node 68d3d297cd36afa834e10198: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:14:38,960 - lava_callback - INFO - Received callback for node 68d3d299cd36afa834e1019b INFO: 172.20.0.1:37308 - "POST /node/68d3d299cd36afa834e1019b HTTP/1.0" 202 Accepted 2025-09-26 11:14:38,965 - lava_callback - INFO - Starting async job submit for node 68d3d299cd36afa834e1019b 2025-09-26 11:14:38,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:38,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d299cd36afa834e1019b HTTP/1.1" 200 None 2025-09-26 11:14:38,981 - lava_callback - DEBUG - Processing node 68d3d299cd36afa834e1019b: baseline-arm 2025-09-26 11:14:38,981 - lava_callback - ERROR - Error processing callback for node 68d3d299cd36afa834e1019b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:14:38,996 - lava_callback - INFO - Received callback for node 68d674b32f83206171a9117c INFO: 172.20.0.1:37322 - "POST /node/68d674b32f83206171a9117c HTTP/1.0" 202 Accepted 2025-09-26 11:14:39,001 - lava_callback - INFO - Starting async job submit for node 68d674b32f83206171a9117c 2025-09-26 11:14:39,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:39,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674b32f83206171a9117c HTTP/1.1" 200 None 2025-09-26 11:14:39,034 - lava_callback - DEBUG - Processing node 68d674b32f83206171a9117c: baseline-arm64-baylibre 2025-09-26 11:14:39,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:14:39,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:14:39,917 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d674b32f83206171a9117c/log.txt.gz 2025-09-26 11:14:39,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:14:40,079 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:14:40,080 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d674b32f83206171a9117c/lava_callback.json.gz 2025-09-26 11:14:40,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:40,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674b32f83206171a9117c HTTP/1.1" 200 None 2025-09-26 11:14:40,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:40,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:14:40,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:40,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674b32f83206171a9117c HTTP/1.1" 200 None 2025-09-26 11:14:40,163 - lava_callback - INFO - Completed processing callback for node 68d674b32f83206171a9117c 2025-09-26 11:14:41,817 - lava_callback - INFO - Received callback for node 68d674c12f83206171a911b1 INFO: 172.20.0.1:48438 - "POST /node/68d674c12f83206171a911b1 HTTP/1.0" 202 Accepted 2025-09-26 11:14:41,823 - lava_callback - INFO - Starting async job submit for node 68d674c12f83206171a911b1 2025-09-26 11:14:41,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:41,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674c12f83206171a911b1 HTTP/1.1" 200 None 2025-09-26 11:14:41,878 - lava_callback - DEBUG - Processing node 68d674c12f83206171a911b1: baseline-arm64-baylibre 2025-09-26 11:14:42,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:14:42,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:14:42,312 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d674c12f83206171a911b1/log.txt.gz 2025-09-26 11:14:42,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:14:44,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:14:44,695 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d674c12f83206171a911b1/lava_callback.json.gz 2025-09-26 11:14:44,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:44,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674c12f83206171a911b1 HTTP/1.1" 200 None 2025-09-26 11:14:44,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:44,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:14:44,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:44,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674c12f83206171a911b1 HTTP/1.1" 200 None 2025-09-26 11:14:44,809 - lava_callback - INFO - Completed processing callback for node 68d674c12f83206171a911b1 INFO: 172.20.0.1:48440 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:14:56,389 - lava_callback - INFO - Received callback for node 68d3d29acd36afa834e1019e INFO: 172.20.0.1:32978 - "POST /node/68d3d29acd36afa834e1019e HTTP/1.0" 202 Accepted 2025-09-26 11:14:56,394 - lava_callback - INFO - Starting async job submit for node 68d3d29acd36afa834e1019e 2025-09-26 11:14:56,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:56,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d29acd36afa834e1019e HTTP/1.1" 200 None 2025-09-26 11:14:56,409 - lava_callback - DEBUG - Processing node 68d3d29acd36afa834e1019e: baseline-arm 2025-09-26 11:14:56,409 - lava_callback - ERROR - Error processing callback for node 68d3d29acd36afa834e1019e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:14:56,507 - lava_callback - INFO - Received callback for node 68d674b72f83206171a9118d INFO: 172.20.0.1:32990 - "POST /node/68d674b72f83206171a9118d HTTP/1.0" 202 Accepted 2025-09-26 11:14:56,513 - lava_callback - INFO - Starting async job submit for node 68d674b72f83206171a9118d INFO: 172.20.0.1:33000 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:14:56,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:56,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674b72f83206171a9118d HTTP/1.1" 200 None 2025-09-26 11:14:56,555 - lava_callback - DEBUG - Processing node 68d674b72f83206171a9118d: baseline-arm64-baylibre 2025-09-26 11:14:56,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:14:57,084 - lava_callback - INFO - Received callback for node 68d3d29dcd36afa834e101a1 INFO: 172.20.0.1:33006 - "POST /node/68d3d29dcd36afa834e101a1 HTTP/1.0" 202 Accepted 2025-09-26 11:14:57,093 - lava_callback - INFO - Starting async job submit for node 68d3d29dcd36afa834e101a1 2025-09-26 11:14:57,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:57,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d29dcd36afa834e101a1 HTTP/1.1" 200 None 2025-09-26 11:14:57,107 - lava_callback - DEBUG - Processing node 68d3d29dcd36afa834e101a1: baseline-arm 2025-09-26 11:14:57,107 - lava_callback - ERROR - Error processing callback for node 68d3d29dcd36afa834e101a1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:14:57,792 - lava_callback - INFO - Received callback for node 68d3d2a0cd36afa834e101a4 INFO: 172.20.0.1:33018 - "POST /node/68d3d2a0cd36afa834e101a4 HTTP/1.0" 202 Accepted 2025-09-26 11:14:57,797 - lava_callback - INFO - Starting async job submit for node 68d3d2a0cd36afa834e101a4 2025-09-26 11:14:57,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:57,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d2a0cd36afa834e101a4 HTTP/1.1" 200 None 2025-09-26 11:14:57,812 - lava_callback - DEBUG - Processing node 68d3d2a0cd36afa834e101a4: baseline-arm 2025-09-26 11:14:57,812 - lava_callback - ERROR - Error processing callback for node 68d3d2a0cd36afa834e101a4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:14:58,530 - lava_callback - INFO - Received callback for node 68d3d2a1cd36afa834e101a7 INFO: 172.20.0.1:33028 - "POST /node/68d3d2a1cd36afa834e101a7 HTTP/1.0" 202 Accepted 2025-09-26 11:14:58,535 - lava_callback - INFO - Starting async job submit for node 68d3d2a1cd36afa834e101a7 2025-09-26 11:14:58,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:58,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d2a1cd36afa834e101a7 HTTP/1.1" 200 None 2025-09-26 11:14:58,551 - lava_callback - DEBUG - Processing node 68d3d2a1cd36afa834e101a7: baseline-arm 2025-09-26 11:14:58,552 - lava_callback - ERROR - Error processing callback for node 68d3d2a1cd36afa834e101a7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:14:58,723 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:14:58,724 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d674b72f83206171a9118d/log.txt.gz 2025-09-26 11:14:58,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:14:58,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:14:58,863 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d674b72f83206171a9118d/lava_callback.json.gz 2025-09-26 11:14:58,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:58,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674b72f83206171a9118d HTTP/1.1" 200 None 2025-09-26 11:14:58,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:58,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:14:58,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:58,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674b72f83206171a9118d HTTP/1.1" 200 None 2025-09-26 11:14:58,953 - lava_callback - INFO - Completed processing callback for node 68d674b72f83206171a9118d 2025-09-26 11:14:59,244 - lava_callback - INFO - Received callback for node 68d3d2a2cd36afa834e101aa INFO: 172.20.0.1:33040 - "POST /node/68d3d2a2cd36afa834e101aa HTTP/1.0" 202 Accepted 2025-09-26 11:14:59,249 - lava_callback - INFO - Starting async job submit for node 68d3d2a2cd36afa834e101aa 2025-09-26 11:14:59,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:59,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d2a2cd36afa834e101aa HTTP/1.1" 200 None 2025-09-26 11:14:59,263 - lava_callback - DEBUG - Processing node 68d3d2a2cd36afa834e101aa: baseline-arm 2025-09-26 11:14:59,263 - lava_callback - ERROR - Error processing callback for node 68d3d2a2cd36afa834e101aa: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:14:59,961 - lava_callback - INFO - Received callback for node 68d3d2a3cd36afa834e101ad INFO: 172.20.0.1:45720 - "POST /node/68d3d2a3cd36afa834e101ad HTTP/1.0" 202 Accepted 2025-09-26 11:14:59,966 - lava_callback - INFO - Starting async job submit for node 68d3d2a3cd36afa834e101ad 2025-09-26 11:14:59,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:14:59,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d2a3cd36afa834e101ad HTTP/1.1" 200 None 2025-09-26 11:14:59,980 - lava_callback - DEBUG - Processing node 68d3d2a3cd36afa834e101ad: baseline-arm 2025-09-26 11:14:59,980 - lava_callback - ERROR - Error processing callback for node 68d3d2a3cd36afa834e101ad: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:15:00,695 - lava_callback - INFO - Received callback for node 68d3d2a5cd36afa834e101b0 INFO: 172.20.0.1:45730 - "POST /node/68d3d2a5cd36afa834e101b0 HTTP/1.0" 202 Accepted 2025-09-26 11:15:00,700 - lava_callback - INFO - Starting async job submit for node 68d3d2a5cd36afa834e101b0 2025-09-26 11:15:00,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:00,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d2a5cd36afa834e101b0 HTTP/1.1" 200 None 2025-09-26 11:15:00,717 - lava_callback - DEBUG - Processing node 68d3d2a5cd36afa834e101b0: baseline-arm 2025-09-26 11:15:00,717 - lava_callback - ERROR - Error processing callback for node 68d3d2a5cd36afa834e101b0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:45746 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:15:08,840 - lava_callback - INFO - Received callback for node 68d675082f83206171a91228 INFO: 172.20.0.1:45754 - "POST /node/68d675082f83206171a91228 HTTP/1.0" 202 Accepted 2025-09-26 11:15:08,846 - lava_callback - INFO - Starting async job submit for node 68d675082f83206171a91228 2025-09-26 11:15:08,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:08,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d675082f83206171a91228 HTTP/1.1" 200 None 2025-09-26 11:15:08,891 - lava_callback - DEBUG - Processing node 68d675082f83206171a91228: baseline-arm64-broonie 2025-09-26 11:15:09,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:15:09,357 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:15:09,358 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d675082f83206171a91228/log.txt.gz 2025-09-26 11:15:09,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:15:09,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:15:09,538 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d675082f83206171a91228/lava_callback.json.gz 2025-09-26 11:15:09,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:09,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d675082f83206171a91228 HTTP/1.1" 200 None 2025-09-26 11:15:09,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:09,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:15:09,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:09,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d675082f83206171a91228 HTTP/1.1" 200 None 2025-09-26 11:15:09,669 - lava_callback - INFO - Completed processing callback for node 68d675082f83206171a91228 INFO: 172.20.0.1:53402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60964 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:15:20,500 - lava_callback - INFO - Received callback for node 68d674bc2f83206171a911ae INFO: 172.20.0.1:60972 - "POST /node/68d674bc2f83206171a911ae HTTP/1.0" 202 Accepted 2025-09-26 11:15:20,506 - lava_callback - INFO - Starting async job submit for node 68d674bc2f83206171a911ae 2025-09-26 11:15:20,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:20,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674bc2f83206171a911ae HTTP/1.1" 200 None 2025-09-26 11:15:20,542 - lava_callback - DEBUG - Processing node 68d674bc2f83206171a911ae: baseline-arm64-baylibre 2025-09-26 11:15:20,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:15:22,178 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:15:22,179 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d674bc2f83206171a911ae/log.txt.gz 2025-09-26 11:15:22,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:15:22,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:15:22,442 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d674bc2f83206171a911ae/lava_callback.json.gz 2025-09-26 11:15:22,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:22,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674bc2f83206171a911ae HTTP/1.1" 200 None 2025-09-26 11:15:22,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:22,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:15:22,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:22,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674bc2f83206171a911ae HTTP/1.1" 200 None 2025-09-26 11:15:22,548 - lava_callback - INFO - Completed processing callback for node 68d674bc2f83206171a911ae INFO: 172.20.0.1:60986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60988 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:15:30,631 - lava_callback - INFO - Received callback for node 68d3d2cfcd36afa834e101e0 INFO: 172.20.0.1:48094 - "POST /node/68d3d2cfcd36afa834e101e0 HTTP/1.0" 202 Accepted 2025-09-26 11:15:30,637 - lava_callback - INFO - Starting async job submit for node 68d3d2cfcd36afa834e101e0 2025-09-26 11:15:30,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:30,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d2cfcd36afa834e101e0 HTTP/1.1" 200 None 2025-09-26 11:15:30,651 - lava_callback - DEBUG - Processing node 68d3d2cfcd36afa834e101e0: ltp-containers 2025-09-26 11:15:30,651 - lava_callback - ERROR - Error processing callback for node 68d3d2cfcd36afa834e101e0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:15:34,756 - lava_callback - INFO - Received callback for node 68d674e22f83206171a911ea INFO: 172.20.0.1:48100 - "POST /node/68d674e22f83206171a911ea HTTP/1.0" 202 Accepted 2025-09-26 11:15:34,762 - lava_callback - INFO - Starting async job submit for node 68d674e22f83206171a911ea 2025-09-26 11:15:34,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:34,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674e22f83206171a911ea HTTP/1.1" 200 None 2025-09-26 11:15:34,805 - lava_callback - DEBUG - Processing node 68d674e22f83206171a911ea: baseline-arm64-broonie 2025-09-26 11:15:35,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:15:36,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:15:36,386 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d674e22f83206171a911ea/log.txt.gz 2025-09-26 11:15:36,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:48114 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:15:38,412 - lava_callback - INFO - Received callback for node 68d674902f83206171a91139 INFO: 172.20.0.1:48116 - "POST /node/68d674902f83206171a91139 HTTP/1.0" 202 Accepted 2025-09-26 11:15:38,421 - lava_callback - INFO - Starting async job submit for node 68d674902f83206171a91139 2025-09-26 11:15:38,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:38,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674902f83206171a91139 HTTP/1.1" 200 None 2025-09-26 11:15:38,469 - lava_callback - DEBUG - Processing node 68d674902f83206171a91139: baseline-arm64 2025-09-26 11:15:38,694 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:15:38,731 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d674e22f83206171a911ea/lava_callback.json.gz 2025-09-26 11:15:38,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:38,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:15:38,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674e22f83206171a911ea HTTP/1.1" 200 None 2025-09-26 11:15:38,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:38,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:15:38,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:38,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674e22f83206171a911ea HTTP/1.1" 200 None 2025-09-26 11:15:38,859 - lava_callback - INFO - Completed processing callback for node 68d674e22f83206171a911ea 2025-09-26 11:15:41,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:15:41,045 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674902f83206171a91139/log.txt.gz 2025-09-26 11:15:41,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:15:41,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:15:41,207 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674902f83206171a91139/lava_callback.json.gz 2025-09-26 11:15:41,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:41,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674902f83206171a91139 HTTP/1.1" 200 None 2025-09-26 11:15:41,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:41,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:15:41,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:41,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674902f83206171a91139 HTTP/1.1" 200 None 2025-09-26 11:15:41,286 - lava_callback - INFO - Completed processing callback for node 68d674902f83206171a91139 2025-09-26 11:15:42,433 - lava_callback - INFO - Received callback for node 68d674662f83206171a910d2 INFO: 172.20.0.1:41374 - "POST /node/68d674662f83206171a910d2 HTTP/1.0" 202 Accepted 2025-09-26 11:15:42,443 - lava_callback - INFO - Starting async job submit for node 68d674662f83206171a910d2 2025-09-26 11:15:42,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:42,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674662f83206171a910d2 HTTP/1.1" 200 None 2025-09-26 11:15:42,493 - lava_callback - DEBUG - Processing node 68d674662f83206171a910d2: baseline-arm64 2025-09-26 11:15:42,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:15:43,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:15:43,010 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674662f83206171a910d2/log.txt.gz 2025-09-26 11:15:43,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:15:43,145 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:15:43,146 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674662f83206171a910d2/lava_callback.json.gz 2025-09-26 11:15:43,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:43,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674662f83206171a910d2 HTTP/1.1" 200 None 2025-09-26 11:15:43,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:43,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:15:43,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:43,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674662f83206171a910d2 HTTP/1.1" 200 None 2025-09-26 11:15:43,219 - lava_callback - INFO - Completed processing callback for node 68d674662f83206171a910d2 2025-09-26 11:15:46,365 - lava_callback - INFO - Received callback for node 68d674682f83206171a910d5 INFO: 172.20.0.1:41378 - "POST /node/68d674682f83206171a910d5 HTTP/1.0" 202 Accepted 2025-09-26 11:15:46,371 - lava_callback - INFO - Starting async job submit for node 68d674682f83206171a910d5 2025-09-26 11:15:46,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:46,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674682f83206171a910d5 HTTP/1.1" 200 None 2025-09-26 11:15:46,417 - lava_callback - DEBUG - Processing node 68d674682f83206171a910d5: baseline-arm64 INFO: 172.20.0.1:41386 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:15:46,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:15:46,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:15:46,838 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674682f83206171a910d5/log.txt.gz 2025-09-26 11:15:46,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:15:46,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:15:46,969 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674682f83206171a910d5/lava_callback.json.gz 2025-09-26 11:15:46,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:47,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674682f83206171a910d5 HTTP/1.1" 200 None 2025-09-26 11:15:47,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:47,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:15:47,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:15:47,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674682f83206171a910d5 HTTP/1.1" 200 None 2025-09-26 11:15:47,053 - lava_callback - INFO - Completed processing callback for node 68d674682f83206171a910d5 INFO: 172.20.0.1:44974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38680 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:16:07,593 - lava_callback - INFO - Received callback for node 68d40a45cd36afa834e16f1e INFO: 172.20.0.1:38682 - "POST /node/68d40a45cd36afa834e16f1e HTTP/1.0" 202 Accepted 2025-09-26 11:16:07,598 - lava_callback - INFO - Starting async job submit for node 68d40a45cd36afa834e16f1e 2025-09-26 11:16:07,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:16:07,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a45cd36afa834e16f1e HTTP/1.1" 200 None 2025-09-26 11:16:07,643 - lava_callback - DEBUG - Processing node 68d40a45cd36afa834e16f1e: baseline-arm 2025-09-26 11:16:07,875 - lava_callback - ERROR - Error processing callback for node 68d40a45cd36afa834e16f1e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:16:09,054 - lava_callback - INFO - Received callback for node 68d3da79cd36afa834e116a3 INFO: 172.20.0.1:38690 - "POST /node/68d3da79cd36afa834e116a3 HTTP/1.0" 202 Accepted 2025-09-26 11:16:09,060 - lava_callback - INFO - Starting async job submit for node 68d3da79cd36afa834e116a3 2025-09-26 11:16:09,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:16:09,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3da79cd36afa834e116a3 HTTP/1.1" 200 None 2025-09-26 11:16:09,108 - lava_callback - DEBUG - Processing node 68d3da79cd36afa834e116a3: baseline-arm64 2025-09-26 11:16:09,424 - lava_callback - ERROR - Error processing callback for node 68d3da79cd36afa834e116a3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:16:10,601 - lava_callback - INFO - Received callback for node 68d3d2e4cd36afa834e10227 INFO: 172.20.0.1:48666 - "POST /node/68d3d2e4cd36afa834e10227 HTTP/1.0" 202 Accepted 2025-09-26 11:16:10,607 - lava_callback - INFO - Starting async job submit for node 68d3d2e4cd36afa834e10227 2025-09-26 11:16:10,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:16:10,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d2e4cd36afa834e10227 HTTP/1.1" 200 None 2025-09-26 11:16:10,634 - lava_callback - DEBUG - Processing node 68d3d2e4cd36afa834e10227: baseline-arm-broonie 2025-09-26 11:16:10,635 - lava_callback - ERROR - Error processing callback for node 68d3d2e4cd36afa834e10227: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:48674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41180 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:16:30,868 - lava_callback - INFO - Received callback for node 68d3d303cd36afa834e1025b INFO: 172.20.0.1:57292 - "POST /node/68d3d303cd36afa834e1025b HTTP/1.0" 202 Accepted 2025-09-26 11:16:30,873 - lava_callback - INFO - Starting async job submit for node 68d3d303cd36afa834e1025b 2025-09-26 11:16:30,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:16:30,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d303cd36afa834e1025b HTTP/1.1" 200 None 2025-09-26 11:16:30,910 - lava_callback - DEBUG - Processing node 68d3d303cd36afa834e1025b: baseline-arm-broonie 2025-09-26 11:16:30,910 - lava_callback - ERROR - Error processing callback for node 68d3d303cd36afa834e1025b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:57294 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:16:41,367 - lava_callback - INFO - Received callback for node 68d6742a2f83206171a9100e INFO: 172.20.0.1:44570 - "POST /node/68d6742a2f83206171a9100e HTTP/1.0" 202 Accepted 2025-09-26 11:16:41,374 - lava_callback - INFO - Starting async job submit for node 68d6742a2f83206171a9100e 2025-09-26 11:16:41,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:16:41,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6742a2f83206171a9100e HTTP/1.1" 200 None 2025-09-26 11:16:41,437 - lava_callback - DEBUG - Processing node 68d6742a2f83206171a9100e: baseline-arm64 2025-09-26 11:16:42,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:16:43,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:16:43,375 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6742a2f83206171a9100e/log.txt.gz 2025-09-26 11:16:43,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:16:45,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:16:45,670 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6742a2f83206171a9100e/lava_callback.json.gz DEBUG: 68d6742a2f83206171a9100e Transitting job node result: pass -> incomplete 2025-09-26 11:16:45,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:16:45,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6742a2f83206171a9100e HTTP/1.1" 200 None 2025-09-26 11:16:45,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:16:45,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:16:45,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:16:45,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6742a2f83206171a9100e HTTP/1.1" 200 None 2025-09-26 11:16:45,793 - lava_callback - INFO - Completed processing callback for node 68d6742a2f83206171a9100e INFO: 172.20.0.1:44576 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:16:50,415 - lava_callback - INFO - Received callback for node 68d673d62f83206171a90f50 INFO: 172.20.0.1:57228 - "POST /node/68d673d62f83206171a90f50 HTTP/1.0" 202 Accepted 2025-09-26 11:16:50,424 - lava_callback - INFO - Starting async job submit for node 68d673d62f83206171a90f50 2025-09-26 11:16:50,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:16:50,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673d62f83206171a90f50 HTTP/1.1" 200 None 2025-09-26 11:16:50,464 - lava_callback - DEBUG - Processing node 68d673d62f83206171a90f50: baseline-arm64 2025-09-26 11:16:50,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:16:52,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:16:52,661 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673d62f83206171a90f50/log.txt.gz 2025-09-26 11:16:52,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:16:54,740 - lava_callback - INFO - Received callback for node 68d3d236cd36afa834e100af INFO: 172.20.0.1:57242 - "POST /node/68d3d236cd36afa834e100af HTTP/1.0" 202 Accepted 2025-09-26 11:16:54,751 - lava_callback - INFO - Starting async job submit for node 68d3d236cd36afa834e100af 2025-09-26 11:16:54,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:16:54,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d236cd36afa834e100af HTTP/1.1" 200 None 2025-09-26 11:16:54,790 - lava_callback - DEBUG - Processing node 68d3d236cd36afa834e100af: ltp-cap-bounds 2025-09-26 11:16:54,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:16:55,069 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673d62f83206171a90f50/lava_callback.json.gz 2025-09-26 11:16:55,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:16:55,180 - lava_callback - ERROR - Error processing callback for node 68d3d236cd36afa834e100af: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:16:55,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673d62f83206171a90f50 HTTP/1.1" 200 None 2025-09-26 11:16:55,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:16:55,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:16:55,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:16:55,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673d62f83206171a90f50 HTTP/1.1" 200 None 2025-09-26 11:16:55,253 - lava_callback - INFO - Completed processing callback for node 68d673d62f83206171a90f50 2025-09-26 11:16:56,447 - lava_callback - INFO - Received callback for node 68d3d314cd36afa834e1029b INFO: 172.20.0.1:57248 - "POST /node/68d3d314cd36afa834e1029b HTTP/1.0" 202 Accepted 2025-09-26 11:16:56,452 - lava_callback - INFO - Starting async job submit for node 68d3d314cd36afa834e1029b 2025-09-26 11:16:56,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:16:56,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d314cd36afa834e1029b HTTP/1.1" 200 None 2025-09-26 11:16:56,467 - lava_callback - DEBUG - Processing node 68d3d314cd36afa834e1029b: baseline-arm 2025-09-26 11:16:56,467 - lava_callback - ERROR - Error processing callback for node 68d3d314cd36afa834e1029b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:57250 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:16:57,147 - lava_callback - INFO - Received callback for node 68d3d317cd36afa834e1029e INFO: 172.20.0.1:57264 - "POST /node/68d3d317cd36afa834e1029e HTTP/1.0" 202 Accepted 2025-09-26 11:16:57,153 - lava_callback - INFO - Starting async job submit for node 68d3d317cd36afa834e1029e 2025-09-26 11:16:57,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:16:57,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d317cd36afa834e1029e HTTP/1.1" 200 None 2025-09-26 11:16:57,166 - lava_callback - DEBUG - Processing node 68d3d317cd36afa834e1029e: baseline-arm 2025-09-26 11:16:57,166 - lava_callback - ERROR - Error processing callback for node 68d3d317cd36afa834e1029e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:16:57,835 - lava_callback - INFO - Received callback for node 68d3d31ccd36afa834e102a4 INFO: 172.20.0.1:57276 - "POST /node/68d3d31ccd36afa834e102a4 HTTP/1.0" 202 Accepted 2025-09-26 11:16:57,840 - lava_callback - INFO - Starting async job submit for node 68d3d31ccd36afa834e102a4 2025-09-26 11:16:57,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:16:57,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d31ccd36afa834e102a4 HTTP/1.1" 200 None 2025-09-26 11:16:57,853 - lava_callback - DEBUG - Processing node 68d3d31ccd36afa834e102a4: baseline-arm 2025-09-26 11:16:57,853 - lava_callback - ERROR - Error processing callback for node 68d3d31ccd36afa834e102a4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:16:58,518 - lava_callback - INFO - Received callback for node 68d3d31dcd36afa834e102a7 INFO: 172.20.0.1:57278 - "POST /node/68d3d31dcd36afa834e102a7 HTTP/1.0" 202 Accepted 2025-09-26 11:16:58,523 - lava_callback - INFO - Starting async job submit for node 68d3d31dcd36afa834e102a7 2025-09-26 11:16:58,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:16:58,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d31dcd36afa834e102a7 HTTP/1.1" 200 None 2025-09-26 11:16:58,538 - lava_callback - DEBUG - Processing node 68d3d31dcd36afa834e102a7: baseline-arm 2025-09-26 11:16:58,539 - lava_callback - ERROR - Error processing callback for node 68d3d31dcd36afa834e102a7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:16:59,194 - lava_callback - INFO - Received callback for node 68d3d321cd36afa834e102aa INFO: 172.20.0.1:57282 - "POST /node/68d3d321cd36afa834e102aa HTTP/1.0" 202 Accepted 2025-09-26 11:16:59,199 - lava_callback - INFO - Starting async job submit for node 68d3d321cd36afa834e102aa 2025-09-26 11:16:59,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:16:59,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d321cd36afa834e102aa HTTP/1.1" 200 None 2025-09-26 11:16:59,218 - lava_callback - DEBUG - Processing node 68d3d321cd36afa834e102aa: baseline-arm 2025-09-26 11:16:59,218 - lava_callback - ERROR - Error processing callback for node 68d3d321cd36afa834e102aa: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:16:59,922 - lava_callback - INFO - Received callback for node 68d3d322cd36afa834e102ad INFO: 172.20.0.1:48628 - "POST /node/68d3d322cd36afa834e102ad HTTP/1.0" 202 Accepted 2025-09-26 11:16:59,927 - lava_callback - INFO - Starting async job submit for node 68d3d322cd36afa834e102ad 2025-09-26 11:16:59,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:16:59,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d322cd36afa834e102ad HTTP/1.1" 200 None 2025-09-26 11:16:59,941 - lava_callback - DEBUG - Processing node 68d3d322cd36afa834e102ad: baseline-arm 2025-09-26 11:16:59,941 - lava_callback - ERROR - Error processing callback for node 68d3d322cd36afa834e102ad: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:17:01,060 - lava_callback - INFO - Received callback for node 68d674932f83206171a9113c INFO: 172.20.0.1:48644 - "POST /node/68d674932f83206171a9113c HTTP/1.0" 202 Accepted 2025-09-26 11:17:01,066 - lava_callback - INFO - Starting async job submit for node 68d674932f83206171a9113c 2025-09-26 11:17:01,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:17:01,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674932f83206171a9113c HTTP/1.1" 200 None 2025-09-26 11:17:01,102 - lava_callback - DEBUG - Processing node 68d674932f83206171a9113c: baseline-arm64 2025-09-26 11:17:01,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:17:01,955 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:17:01,956 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674932f83206171a9113c/log.txt.gz 2025-09-26 11:17:01,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:17:04,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:17:04,285 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674932f83206171a9113c/lava_callback.json.gz 2025-09-26 11:17:04,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:17:04,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674932f83206171a9113c HTTP/1.1" 200 None 2025-09-26 11:17:04,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:17:04,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:17:04,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:17:04,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674932f83206171a9113c HTTP/1.1" 200 None 2025-09-26 11:17:04,375 - lava_callback - INFO - Completed processing callback for node 68d674932f83206171a9113c INFO: 172.20.0.1:48656 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:17:12,102 - lava_callback - INFO - Received callback for node 68d673d82f83206171a90f53 INFO: 172.20.0.1:50484 - "POST /node/68d673d82f83206171a90f53 HTTP/1.0" 202 Accepted 2025-09-26 11:17:12,108 - lava_callback - INFO - Starting async job submit for node 68d673d82f83206171a90f53 2025-09-26 11:17:12,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:17:12,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673d82f83206171a90f53 HTTP/1.1" 200 None 2025-09-26 11:17:12,169 - lava_callback - DEBUG - Processing node 68d673d82f83206171a90f53: baseline-arm64 2025-09-26 11:17:12,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:17:13,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:17:13,474 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673d82f83206171a90f53/log.txt.gz 2025-09-26 11:17:13,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:50496 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 11:17:15,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:17:15,789 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d673d82f83206171a90f53/lava_callback.json.gz 2025-09-26 11:17:15,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:17:15,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d673d82f83206171a90f53 HTTP/1.1" 200 None 2025-09-26 11:17:15,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:17:15,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:17:15,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:17:15,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d673d82f83206171a90f53 HTTP/1.1" 200 None 2025-09-26 11:17:15,891 - lava_callback - INFO - Completed processing callback for node 68d673d82f83206171a90f53 INFO: 172.20.0.1:50508 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:17:17,076 - lava_callback - INFO - Received callback for node 68d3d327cd36afa834e102b3 INFO: 172.20.0.1:50512 - "POST /node/68d3d327cd36afa834e102b3 HTTP/1.0" 202 Accepted 2025-09-26 11:17:17,085 - lava_callback - INFO - Starting async job submit for node 68d3d327cd36afa834e102b3 2025-09-26 11:17:17,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:17:17,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d327cd36afa834e102b3 HTTP/1.1" 200 None 2025-09-26 11:17:17,100 - lava_callback - DEBUG - Processing node 68d3d327cd36afa834e102b3: baseline-arm 2025-09-26 11:17:17,101 - lava_callback - ERROR - Error processing callback for node 68d3d327cd36afa834e102b3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:17:17,805 - lava_callback - INFO - Received callback for node 68d3d328cd36afa834e102b6 INFO: 172.20.0.1:50518 - "POST /node/68d3d328cd36afa834e102b6 HTTP/1.0" 202 Accepted 2025-09-26 11:17:17,810 - lava_callback - INFO - Starting async job submit for node 68d3d328cd36afa834e102b6 2025-09-26 11:17:17,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:17:17,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d328cd36afa834e102b6 HTTP/1.1" 200 None 2025-09-26 11:17:17,825 - lava_callback - DEBUG - Processing node 68d3d328cd36afa834e102b6: baseline-arm 2025-09-26 11:17:17,825 - lava_callback - ERROR - Error processing callback for node 68d3d328cd36afa834e102b6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:17:18,506 - lava_callback - INFO - Received callback for node 68d3d32fcd36afa834e102bc INFO: 172.20.0.1:50534 - "POST /node/68d3d32fcd36afa834e102bc HTTP/1.0" 202 Accepted 2025-09-26 11:17:18,512 - lava_callback - INFO - Starting async job submit for node 68d3d32fcd36afa834e102bc 2025-09-26 11:17:18,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:17:18,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d32fcd36afa834e102bc HTTP/1.1" 200 None 2025-09-26 11:17:18,527 - lava_callback - DEBUG - Processing node 68d3d32fcd36afa834e102bc: baseline-arm 2025-09-26 11:17:18,527 - lava_callback - ERROR - Error processing callback for node 68d3d32fcd36afa834e102bc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:17:19,214 - lava_callback - INFO - Received callback for node 68d3d330cd36afa834e102bf INFO: 172.20.0.1:50550 - "POST /node/68d3d330cd36afa834e102bf HTTP/1.0" 202 Accepted 2025-09-26 11:17:19,222 - lava_callback - INFO - Starting async job submit for node 68d3d330cd36afa834e102bf 2025-09-26 11:17:19,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:17:19,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d330cd36afa834e102bf HTTP/1.1" 200 None 2025-09-26 11:17:19,239 - lava_callback - DEBUG - Processing node 68d3d330cd36afa834e102bf: baseline-arm 2025-09-26 11:17:19,239 - lava_callback - ERROR - Error processing callback for node 68d3d330cd36afa834e102bf: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:17:19,946 - lava_callback - INFO - Received callback for node 68d3d334cd36afa834e102c2 INFO: 172.20.0.1:53536 - "POST /node/68d3d334cd36afa834e102c2 HTTP/1.0" 202 Accepted 2025-09-26 11:17:19,951 - lava_callback - INFO - Starting async job submit for node 68d3d334cd36afa834e102c2 2025-09-26 11:17:19,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:17:19,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d334cd36afa834e102c2 HTTP/1.1" 200 None 2025-09-26 11:17:19,969 - lava_callback - DEBUG - Processing node 68d3d334cd36afa834e102c2: baseline-arm 2025-09-26 11:17:19,969 - lava_callback - ERROR - Error processing callback for node 68d3d334cd36afa834e102c2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:53550 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:17:20,676 - lava_callback - INFO - Received callback for node 68d3d335cd36afa834e102c5 INFO: 172.20.0.1:53564 - "POST /node/68d3d335cd36afa834e102c5 HTTP/1.0" 202 Accepted 2025-09-26 11:17:20,681 - lava_callback - INFO - Starting async job submit for node 68d3d335cd36afa834e102c5 2025-09-26 11:17:20,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:17:20,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d335cd36afa834e102c5 HTTP/1.1" 200 None 2025-09-26 11:17:20,695 - lava_callback - DEBUG - Processing node 68d3d335cd36afa834e102c5: baseline-arm 2025-09-26 11:17:20,695 - lava_callback - ERROR - Error processing callback for node 68d3d335cd36afa834e102c5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:17:21,896 - lava_callback - INFO - Received callback for node 68d6746d2f83206171a910db INFO: 172.20.0.1:53580 - "POST /node/68d6746d2f83206171a910db HTTP/1.0" 202 Accepted 2025-09-26 11:17:21,902 - lava_callback - INFO - Starting async job submit for node 68d6746d2f83206171a910db 2025-09-26 11:17:21,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:17:21,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6746d2f83206171a910db HTTP/1.1" 200 None 2025-09-26 11:17:21,938 - lava_callback - DEBUG - Processing node 68d6746d2f83206171a910db: baseline-arm64 2025-09-26 11:17:22,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:17:22,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:17:22,829 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6746d2f83206171a910db/log.txt.gz 2025-09-26 11:17:22,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:53582 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:17:25,139 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:17:25,140 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6746d2f83206171a910db/lava_callback.json.gz 2025-09-26 11:17:25,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:17:25,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6746d2f83206171a910db HTTP/1.1" 200 None 2025-09-26 11:17:25,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:17:25,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:17:25,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:17:25,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6746d2f83206171a910db HTTP/1.1" 200 None 2025-09-26 11:17:25,216 - lava_callback - INFO - Completed processing callback for node 68d6746d2f83206171a910db INFO: 172.20.0.1:53586 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:17:31,523 - lava_callback - INFO - Received callback for node 68d6746d2f83206171a910d8 INFO: 172.20.0.1:55494 - "POST /node/68d6746d2f83206171a910d8 HTTP/1.0" 202 Accepted 2025-09-26 11:17:31,530 - lava_callback - INFO - Starting async job submit for node 68d6746d2f83206171a910d8 2025-09-26 11:17:31,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:17:31,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6746d2f83206171a910d8 HTTP/1.1" 200 None 2025-09-26 11:17:31,580 - lava_callback - DEBUG - Processing node 68d6746d2f83206171a910d8: baseline-arm64 2025-09-26 11:17:31,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:17:32,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:17:32,081 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6746d2f83206171a910d8/log.txt.gz 2025-09-26 11:17:32,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:17:32,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:17:32,221 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6746d2f83206171a910d8/lava_callback.json.gz 2025-09-26 11:17:32,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:17:32,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6746d2f83206171a910d8 HTTP/1.1" 200 None 2025-09-26 11:17:32,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:17:32,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:17:32,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:17:32,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6746d2f83206171a910d8 HTTP/1.1" 200 None 2025-09-26 11:17:32,316 - lava_callback - INFO - Completed processing callback for node 68d6746d2f83206171a910d8 2025-09-26 11:17:33,362 - lava_callback - INFO - Received callback for node 68d3da7acd36afa834e116a6 INFO: 172.20.0.1:55498 - "POST /node/68d3da7acd36afa834e116a6 HTTP/1.0" 202 Accepted 2025-09-26 11:17:33,368 - lava_callback - INFO - Starting async job submit for node 68d3da7acd36afa834e116a6 2025-09-26 11:17:33,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:17:33,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3da7acd36afa834e116a6 HTTP/1.1" 200 None 2025-09-26 11:17:33,418 - lava_callback - DEBUG - Processing node 68d3da7acd36afa834e116a6: baseline-arm64 2025-09-26 11:17:33,760 - lava_callback - ERROR - Error processing callback for node 68d3da7acd36afa834e116a6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:55504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58426 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:18:10,758 - lava_callback - INFO - Received callback for node 68d3d368cd36afa834e1039e INFO: 172.20.0.1:43146 - "POST /node/68d3d368cd36afa834e1039e HTTP/1.0" 202 Accepted 2025-09-26 11:18:10,767 - lava_callback - INFO - Starting async job submit for node 68d3d368cd36afa834e1039e 2025-09-26 11:18:10,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:18:10,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d368cd36afa834e1039e HTTP/1.1" 200 None 2025-09-26 11:18:10,782 - lava_callback - DEBUG - Processing node 68d3d368cd36afa834e1039e: baseline-arm-broonie 2025-09-26 11:18:10,782 - lava_callback - ERROR - Error processing callback for node 68d3d368cd36afa834e1039e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:18:11,187 - lava_callback - INFO - Received callback for node 68d40a45cd36afa834e16f21 INFO: 172.20.0.1:43156 - "POST /node/68d40a45cd36afa834e16f21 HTTP/1.0" 202 Accepted 2025-09-26 11:18:11,196 - lava_callback - INFO - Starting async job submit for node 68d40a45cd36afa834e16f21 2025-09-26 11:18:11,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:18:11,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a45cd36afa834e16f21 HTTP/1.1" 200 None 2025-09-26 11:18:11,234 - lava_callback - DEBUG - Processing node 68d40a45cd36afa834e16f21: baseline-arm 2025-09-26 11:18:11,455 - lava_callback - ERROR - Error processing callback for node 68d40a45cd36afa834e16f21: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:43164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43168 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:18:19,507 - lava_callback - INFO - Received callback for node 68d674962f83206171a91143 INFO: 172.20.0.1:44326 - "POST /node/68d674962f83206171a91143 HTTP/1.0" 202 Accepted 2025-09-26 11:18:19,516 - lava_callback - INFO - Starting async job submit for node 68d674962f83206171a91143 2025-09-26 11:18:19,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:18:19,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674962f83206171a91143 HTTP/1.1" 200 None 2025-09-26 11:18:19,584 - lava_callback - DEBUG - Processing node 68d674962f83206171a91143: baseline-arm64 2025-09-26 11:18:19,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:44334 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:18:20,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:18:20,835 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674962f83206171a91143/log.txt.gz 2025-09-26 11:18:20,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:18:23,114 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:18:23,115 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674962f83206171a91143/lava_callback.json.gz 2025-09-26 11:18:23,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:18:23,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674962f83206171a91143 HTTP/1.1" 200 None 2025-09-26 11:18:23,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:18:23,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:18:23,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:18:23,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674962f83206171a91143 HTTP/1.1" 200 None 2025-09-26 11:18:23,205 - lava_callback - INFO - Completed processing callback for node 68d674962f83206171a91143 INFO: 172.20.0.1:44346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38198 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:18:42,202 - lava_callback - INFO - Received callback for node 68d674ed2f83206171a911fc INFO: 172.20.0.1:48400 - "POST /node/68d674ed2f83206171a911fc HTTP/1.0" 202 Accepted 2025-09-26 11:18:42,216 - lava_callback - INFO - Starting async job submit for node 68d674ed2f83206171a911fc 2025-09-26 11:18:42,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:18:42,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674ed2f83206171a911fc HTTP/1.1" 200 None 2025-09-26 11:18:42,292 - lava_callback - DEBUG - Processing node 68d674ed2f83206171a911fc: baseline-arm64-broonie 2025-09-26 11:18:42,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:18:43,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:18:43,901 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d674ed2f83206171a911fc/log.txt.gz 2025-09-26 11:18:43,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:18:46,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:18:46,203 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d674ed2f83206171a911fc/lava_callback.json.gz 2025-09-26 11:18:46,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:18:46,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674ed2f83206171a911fc HTTP/1.1" 200 None 2025-09-26 11:18:46,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:18:46,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:18:46,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:18:46,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674ed2f83206171a911fc HTTP/1.1" 200 None 2025-09-26 11:18:46,307 - lava_callback - INFO - Completed processing callback for node 68d674ed2f83206171a911fc INFO: 172.20.0.1:48404 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:18:49,537 - lava_callback - INFO - Received callback for node 68d3d252cd36afa834e100dd INFO: 172.20.0.1:47946 - "POST /node/68d3d252cd36afa834e100dd HTTP/1.0" 202 Accepted 2025-09-26 11:18:49,545 - lava_callback - INFO - Starting async job submit for node 68d3d252cd36afa834e100dd 2025-09-26 11:18:49,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:18:49,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d252cd36afa834e100dd HTTP/1.1" 200 None 2025-09-26 11:18:49,676 - lava_callback - DEBUG - Processing node 68d3d252cd36afa834e100dd: ltp-containers 2025-09-26 11:18:50,453 - lava_callback - ERROR - Error processing callback for node 68d3d252cd36afa834e100dd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:18:54,628 - lava_callback - INFO - Received callback for node 68d3d3a6cd36afa834e103f7 INFO: 172.20.0.1:47954 - "POST /node/68d3d3a6cd36afa834e103f7 HTTP/1.0" 202 Accepted 2025-09-26 11:18:54,637 - lava_callback - INFO - Starting async job submit for node 68d3d3a6cd36afa834e103f7 2025-09-26 11:18:54,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:18:54,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d3a6cd36afa834e103f7 HTTP/1.1" 200 None 2025-09-26 11:18:54,673 - lava_callback - DEBUG - Processing node 68d3d3a6cd36afa834e103f7: baseline-arm-broonie 2025-09-26 11:18:54,868 - lava_callback - ERROR - Error processing callback for node 68d3d3a6cd36afa834e103f7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:47958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41848 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:19:21,204 - lava_callback - INFO - Received callback for node 68d3da7dcd36afa834e116a9 INFO: 172.20.0.1:41860 - "POST /node/68d3da7dcd36afa834e116a9 HTTP/1.0" 202 Accepted 2025-09-26 11:19:21,211 - lava_callback - INFO - Starting async job submit for node 68d3da7dcd36afa834e116a9 2025-09-26 11:19:21,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:19:21,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3da7dcd36afa834e116a9 HTTP/1.1" 200 None 2025-09-26 11:19:21,309 - lava_callback - DEBUG - Processing node 68d3da7dcd36afa834e116a9: baseline-arm64 2025-09-26 11:19:21,786 - lava_callback - ERROR - Error processing callback for node 68d3da7dcd36afa834e116a9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:41874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49094 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:19:40,149 - lava_callback - INFO - Received callback for node 68d674992f83206171a91146 INFO: 172.20.0.1:35392 - "POST /node/68d674992f83206171a91146 HTTP/1.0" 202 Accepted 2025-09-26 11:19:40,155 - lava_callback - INFO - Starting async job submit for node 68d674992f83206171a91146 2025-09-26 11:19:40,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:19:40,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674992f83206171a91146 HTTP/1.1" 200 None 2025-09-26 11:19:40,201 - lava_callback - DEBUG - Processing node 68d674992f83206171a91146: baseline-arm64 2025-09-26 11:19:40,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:19:41,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:19:41,487 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674992f83206171a91146/log.txt.gz 2025-09-26 11:19:41,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:19:43,797 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:19:43,798 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674992f83206171a91146/lava_callback.json.gz 2025-09-26 11:19:43,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:19:43,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674992f83206171a91146 HTTP/1.1" 200 None 2025-09-26 11:19:43,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:19:43,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:19:43,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:19:43,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674992f83206171a91146 HTTP/1.1" 200 None 2025-09-26 11:19:43,895 - lava_callback - INFO - Completed processing callback for node 68d674992f83206171a91146 INFO: 172.20.0.1:35400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56578 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:20:09,059 - lava_callback - INFO - Received callback for node 68d3d3b4cd36afa834e10407 INFO: 172.20.0.1:56580 - "POST /node/68d3d3b4cd36afa834e10407 HTTP/1.0" 202 Accepted 2025-09-26 11:20:09,067 - lava_callback - INFO - Starting async job submit for node 68d3d3b4cd36afa834e10407 2025-09-26 11:20:09,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:20:09,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d3b4cd36afa834e10407 HTTP/1.1" 200 None 2025-09-26 11:20:09,260 - lava_callback - DEBUG - Processing node 68d3d3b4cd36afa834e10407: baseline-arm-broonie 2025-09-26 11:20:09,483 - lava_callback - ERROR - Error processing callback for node 68d3d3b4cd36afa834e10407: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:20:10,877 - lava_callback - INFO - Received callback for node 68d3d3dccd36afa834e10458 INFO: 172.20.0.1:36316 - "POST /node/68d3d3dccd36afa834e10458 HTTP/1.0" 202 Accepted 2025-09-26 11:20:10,883 - lava_callback - INFO - Starting async job submit for node 68d3d3dccd36afa834e10458 2025-09-26 11:20:10,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:20:10,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d3dccd36afa834e10458 HTTP/1.1" 200 None 2025-09-26 11:20:10,897 - lava_callback - DEBUG - Processing node 68d3d3dccd36afa834e10458: baseline-arm-broonie 2025-09-26 11:20:10,897 - lava_callback - ERROR - Error processing callback for node 68d3d3dccd36afa834e10458: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:20:11,662 - lava_callback - INFO - Received callback for node 68d3d3e0cd36afa834e1045e INFO: 172.20.0.1:36324 - "POST /node/68d3d3e0cd36afa834e1045e HTTP/1.0" 202 Accepted 2025-09-26 11:20:11,671 - lava_callback - INFO - Starting async job submit for node 68d3d3e0cd36afa834e1045e 2025-09-26 11:20:11,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:20:11,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d3e0cd36afa834e1045e HTTP/1.1" 200 None 2025-09-26 11:20:11,686 - lava_callback - DEBUG - Processing node 68d3d3e0cd36afa834e1045e: baseline-arm-broonie 2025-09-26 11:20:11,686 - lava_callback - ERROR - Error processing callback for node 68d3d3e0cd36afa834e1045e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:20:12,479 - lava_callback - INFO - Received callback for node 68d3d3e7cd36afa834e10467 INFO: 172.20.0.1:36336 - "POST /node/68d3d3e7cd36afa834e10467 HTTP/1.0" 202 Accepted 2025-09-26 11:20:12,485 - lava_callback - INFO - Starting async job submit for node 68d3d3e7cd36afa834e10467 2025-09-26 11:20:12,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:20:12,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d3e7cd36afa834e10467 HTTP/1.1" 200 None 2025-09-26 11:20:12,500 - lava_callback - DEBUG - Processing node 68d3d3e7cd36afa834e10467: baseline-arm-broonie 2025-09-26 11:20:12,500 - lava_callback - ERROR - Error processing callback for node 68d3d3e7cd36afa834e10467: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:36348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36364 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:20:18,708 - lava_callback - INFO - Received callback for node 68d6748b2f83206171a9112f INFO: 172.20.0.1:36376 - "POST /node/68d6748b2f83206171a9112f HTTP/1.0" 202 Accepted 2025-09-26 11:20:18,714 - lava_callback - INFO - Starting async job submit for node 68d6748b2f83206171a9112f 2025-09-26 11:20:18,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:20:18,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6748b2f83206171a9112f HTTP/1.1" 200 None 2025-09-26 11:20:18,776 - lava_callback - DEBUG - Processing node 68d6748b2f83206171a9112f: baseline-arm64 2025-09-26 11:20:19,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:20:20,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:20:20,473 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6748b2f83206171a9112f/log.txt.gz 2025-09-26 11:20:20,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:53598 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:20:22,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:20:22,815 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6748b2f83206171a9112f/lava_callback.json.gz 2025-09-26 11:20:22,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:20:22,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6748b2f83206171a9112f HTTP/1.1" 200 None 2025-09-26 11:20:22,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:20:22,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:20:22,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:20:22,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6748b2f83206171a9112f HTTP/1.1" 200 None 2025-09-26 11:20:22,905 - lava_callback - INFO - Completed processing callback for node 68d6748b2f83206171a9112f INFO: 172.20.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43378 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:20:37,115 - lava_callback - INFO - Received callback for node 68d3da7ecd36afa834e116ac INFO: 172.20.0.1:43388 - "POST /node/68d3da7ecd36afa834e116ac HTTP/1.0" 202 Accepted 2025-09-26 11:20:37,121 - lava_callback - INFO - Starting async job submit for node 68d3da7ecd36afa834e116ac 2025-09-26 11:20:37,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:20:37,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3da7ecd36afa834e116ac HTTP/1.1" 200 None 2025-09-26 11:20:37,170 - lava_callback - DEBUG - Processing node 68d3da7ecd36afa834e116ac: baseline-arm64 2025-09-26 11:20:37,475 - lava_callback - ERROR - Error processing callback for node 68d3da7ecd36afa834e116ac: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:44718 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:20:53,670 - lava_callback - INFO - Received callback for node 68d3da81cd36afa834e116b0 INFO: 172.20.0.1:40692 - "POST /node/68d3da81cd36afa834e116b0 HTTP/1.0" 202 Accepted 2025-09-26 11:20:53,679 - lava_callback - INFO - Starting async job submit for node 68d3da81cd36afa834e116b0 2025-09-26 11:20:53,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:20:53,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3da81cd36afa834e116b0 HTTP/1.1" 200 None 2025-09-26 11:20:53,730 - lava_callback - DEBUG - Processing node 68d3da81cd36afa834e116b0: baseline-arm64 2025-09-26 11:20:54,059 - lava_callback - ERROR - Error processing callback for node 68d3da81cd36afa834e116b0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:20:54,921 - lava_callback - INFO - Received callback for node 68d3d3b8cd36afa834e1040a INFO: 172.20.0.1:40704 - "POST /node/68d3d3b8cd36afa834e1040a HTTP/1.0" 202 Accepted 2025-09-26 11:20:54,929 - lava_callback - INFO - Starting async job submit for node 68d3d3b8cd36afa834e1040a 2025-09-26 11:20:54,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:20:54,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d3b8cd36afa834e1040a HTTP/1.1" 200 None 2025-09-26 11:20:54,970 - lava_callback - DEBUG - Processing node 68d3d3b8cd36afa834e1040a: baseline-arm-broonie 2025-09-26 11:20:55,161 - lava_callback - ERROR - Error processing callback for node 68d3d3b8cd36afa834e1040a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:40708 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:21:00,481 - lava_callback - INFO - Received callback for node 68d6749b2f83206171a9114d INFO: 172.20.0.1:58828 - "POST /node/68d6749b2f83206171a9114d HTTP/1.0" 202 Accepted 2025-09-26 11:21:00,487 - lava_callback - INFO - Starting async job submit for node 68d6749b2f83206171a9114d 2025-09-26 11:21:00,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:21:00,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6749b2f83206171a9114d HTTP/1.1" 200 None 2025-09-26 11:21:00,534 - lava_callback - DEBUG - Processing node 68d6749b2f83206171a9114d: baseline-arm64 2025-09-26 11:21:00,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:21:01,796 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:21:01,796 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6749b2f83206171a9114d/log.txt.gz 2025-09-26 11:21:01,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:21:04,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:21:04,100 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6749b2f83206171a9114d/lava_callback.json.gz 2025-09-26 11:21:04,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:21:04,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6749b2f83206171a9114d HTTP/1.1" 200 None 2025-09-26 11:21:04,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:21:04,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:21:04,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:21:04,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6749b2f83206171a9114d HTTP/1.1" 200 None 2025-09-26 11:21:04,183 - lava_callback - INFO - Completed processing callback for node 68d6749b2f83206171a9114d INFO: 172.20.0.1:58844 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:21:10,924 - lava_callback - INFO - Received callback for node 68d3d41ecd36afa834e104c3 INFO: 172.20.0.1:35098 - "POST /node/68d3d41ecd36afa834e104c3 HTTP/1.0" 202 Accepted 2025-09-26 11:21:10,930 - lava_callback - INFO - Starting async job submit for node 68d3d41ecd36afa834e104c3 2025-09-26 11:21:10,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:21:10,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d41ecd36afa834e104c3 HTTP/1.1" 200 None 2025-09-26 11:21:10,948 - lava_callback - DEBUG - Processing node 68d3d41ecd36afa834e104c3: ltp-containers 2025-09-26 11:21:10,948 - lava_callback - ERROR - Error processing callback for node 68d3d41ecd36afa834e104c3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:21:11,719 - lava_callback - INFO - Received callback for node 68d3d420cd36afa834e104c6 INFO: 172.20.0.1:35108 - "POST /node/68d3d420cd36afa834e104c6 HTTP/1.0" 202 Accepted 2025-09-26 11:21:11,728 - lava_callback - INFO - Starting async job submit for node 68d3d420cd36afa834e104c6 2025-09-26 11:21:11,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:21:11,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d420cd36afa834e104c6 HTTP/1.1" 200 None 2025-09-26 11:21:11,742 - lava_callback - DEBUG - Processing node 68d3d420cd36afa834e104c6: ltp-cap-bounds 2025-09-26 11:21:11,742 - lava_callback - ERROR - Error processing callback for node 68d3d420cd36afa834e104c6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:21:12,492 - lava_callback - INFO - Received callback for node 68d3d423cd36afa834e10628 INFO: 172.20.0.1:35110 - "POST /node/68d3d423cd36afa834e10628 HTTP/1.0" 202 Accepted 2025-09-26 11:21:12,498 - lava_callback - INFO - Starting async job submit for node 68d3d423cd36afa834e10628 2025-09-26 11:21:12,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:21:12,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d423cd36afa834e10628 HTTP/1.1" 200 None 2025-09-26 11:21:12,511 - lava_callback - DEBUG - Processing node 68d3d423cd36afa834e10628: ltp-cap-bounds 2025-09-26 11:21:12,512 - lava_callback - ERROR - Error processing callback for node 68d3d423cd36afa834e10628: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:35124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33738 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:21:34,592 - lava_callback - INFO - Received callback for node 68d66fcc2f83206171a90c3b INFO: 172.20.0.1:42946 - "POST /node/68d66fcc2f83206171a90c3b HTTP/1.0" 202 Accepted 2025-09-26 11:21:34,599 - lava_callback - INFO - Starting async job submit for node 68d66fcc2f83206171a90c3b 2025-09-26 11:21:34,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:21:34,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66fcc2f83206171a90c3b HTTP/1.1" 200 None 2025-09-26 11:21:34,680 - lava_callback - DEBUG - Processing node 68d66fcc2f83206171a90c3b: ltp-smoketest 2025-09-26 11:21:35,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:21:36,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:21:36,162 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d66fcc2f83206171a90c3b/log.txt.gz 2025-09-26 11:21:36,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:42950 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:21:38,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:21:38,432 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d66fcc2f83206171a90c3b/lava_callback.json.gz 2025-09-26 11:21:38,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:21:38,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d66fcc2f83206171a90c3b HTTP/1.1" 200 None 2025-09-26 11:21:38,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:21:38,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c1b2be2da4660698f4e HTTP/1.1" 200 None 2025-09-26 11:21:38,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:21:38,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d66fcc2f83206171a90c3b HTTP/1.1" 200 None 2025-09-26 11:21:38,603 - lava_callback - INFO - Completed processing callback for node 68d66fcc2f83206171a90c3b INFO: 172.20.0.1:39976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49770 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:22:09,100 - lava_callback - INFO - Received callback for node 68d3d411cd36afa834e104b7 INFO: 172.20.0.1:49780 - "POST /node/68d3d411cd36afa834e104b7 HTTP/1.0" 202 Accepted 2025-09-26 11:22:09,106 - lava_callback - INFO - Starting async job submit for node 68d3d411cd36afa834e104b7 2025-09-26 11:22:09,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:22:09,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d411cd36afa834e104b7 HTTP/1.1" 200 None 2025-09-26 11:22:09,146 - lava_callback - DEBUG - Processing node 68d3d411cd36afa834e104b7: baseline-arm-broonie 2025-09-26 11:22:09,356 - lava_callback - ERROR - Error processing callback for node 68d3d411cd36afa834e104b7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:22:11,034 - lava_callback - INFO - Received callback for node 68d3d459cd36afa834e10698 INFO: 172.20.0.1:53890 - "POST /node/68d3d459cd36afa834e10698 HTTP/1.0" 202 Accepted 2025-09-26 11:22:11,042 - lava_callback - INFO - Starting async job submit for node 68d3d459cd36afa834e10698 2025-09-26 11:22:11,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:22:11,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d459cd36afa834e10698 HTTP/1.1" 200 None 2025-09-26 11:22:11,057 - lava_callback - DEBUG - Processing node 68d3d459cd36afa834e10698: baseline-arm-broonie 2025-09-26 11:22:11,057 - lava_callback - ERROR - Error processing callback for node 68d3d459cd36afa834e10698: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:53906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53914 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:22:19,305 - lava_callback - INFO - Received callback for node 68d3da83cd36afa834e116b3 INFO: 172.20.0.1:34502 - "POST /node/68d3da83cd36afa834e116b3 HTTP/1.0" 202 Accepted 2025-09-26 11:22:19,311 - lava_callback - INFO - Starting async job submit for node 68d3da83cd36afa834e116b3 2025-09-26 11:22:19,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:22:19,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3da83cd36afa834e116b3 HTTP/1.1" 200 None 2025-09-26 11:22:19,344 - lava_callback - DEBUG - Processing node 68d3da83cd36afa834e116b3: baseline-arm64 2025-09-26 11:22:19,655 - lava_callback - ERROR - Error processing callback for node 68d3da83cd36afa834e116b3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:22:20,537 - lava_callback - INFO - Received callback for node 68d3da86cd36afa834e116b6 INFO: 172.20.0.1:34512 - "POST /node/68d3da86cd36afa834e116b6 HTTP/1.0" 202 Accepted 2025-09-26 11:22:20,543 - lava_callback - INFO - Starting async job submit for node 68d3da86cd36afa834e116b6 2025-09-26 11:22:20,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:34526 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:22:20,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3da86cd36afa834e116b6 HTTP/1.1" 200 None 2025-09-26 11:22:20,584 - lava_callback - DEBUG - Processing node 68d3da86cd36afa834e116b6: baseline-arm64 2025-09-26 11:22:20,878 - lava_callback - ERROR - Error processing callback for node 68d3da86cd36afa834e116b6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:34536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34542 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:22:26,734 - lava_callback - INFO - Received callback for node 68d674612f83206171a910cb INFO: 172.20.0.1:34548 - "POST /node/68d674612f83206171a910cb HTTP/1.0" 202 Accepted 2025-09-26 11:22:26,740 - lava_callback - INFO - Starting async job submit for node 68d674612f83206171a910cb 2025-09-26 11:22:26,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:22:26,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674612f83206171a910cb HTTP/1.1" 200 None 2025-09-26 11:22:26,779 - lava_callback - DEBUG - Processing node 68d674612f83206171a910cb: baseline-arm64 2025-09-26 11:22:27,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:22:29,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:22:29,378 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674612f83206171a910cb/log.txt.gz 2025-09-26 11:22:29,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:22:31,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:22:31,692 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d674612f83206171a910cb/lava_callback.json.gz 2025-09-26 11:22:31,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:22:31,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d674612f83206171a910cb HTTP/1.1" 200 None 2025-09-26 11:22:31,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:22:31,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:22:31,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:22:31,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d674612f83206171a910cb HTTP/1.1" 200 None 2025-09-26 11:22:31,786 - lava_callback - INFO - Completed processing callback for node 68d674612f83206171a910cb INFO: 172.20.0.1:35762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48082 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:22:54,921 - lava_callback - INFO - Received callback for node 68d3d41acd36afa834e104c0 INFO: 172.20.0.1:46412 - "POST /node/68d3d41acd36afa834e104c0 HTTP/1.0" 202 Accepted 2025-09-26 11:22:54,930 - lava_callback - INFO - Starting async job submit for node 68d3d41acd36afa834e104c0 2025-09-26 11:22:54,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:22:54,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d41acd36afa834e104c0 HTTP/1.1" 200 None 2025-09-26 11:22:54,967 - lava_callback - DEBUG - Processing node 68d3d41acd36afa834e104c0: baseline-arm-broonie 2025-09-26 11:22:55,195 - lava_callback - ERROR - Error processing callback for node 68d3d41acd36afa834e104c0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:22:56,476 - lava_callback - INFO - Received callback for node 68d3d47ccd36afa834e106c8 INFO: 172.20.0.1:46428 - "POST /node/68d3d47ccd36afa834e106c8 HTTP/1.0" 202 Accepted 2025-09-26 11:22:56,481 - lava_callback - INFO - Starting async job submit for node 68d3d47ccd36afa834e106c8 2025-09-26 11:22:56,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:22:56,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d47ccd36afa834e106c8 HTTP/1.1" 200 None 2025-09-26 11:22:56,500 - lava_callback - DEBUG - Processing node 68d3d47ccd36afa834e106c8: baseline-arm 2025-09-26 11:22:56,500 - lava_callback - ERROR - Error processing callback for node 68d3d47ccd36afa834e106c8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:46442 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:22:57,159 - lava_callback - INFO - Received callback for node 68d3d47ecd36afa834e106cb INFO: 172.20.0.1:46454 - "POST /node/68d3d47ecd36afa834e106cb HTTP/1.0" 202 Accepted 2025-09-26 11:22:57,164 - lava_callback - INFO - Starting async job submit for node 68d3d47ecd36afa834e106cb 2025-09-26 11:22:57,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:22:57,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d47ecd36afa834e106cb HTTP/1.1" 200 None 2025-09-26 11:22:57,182 - lava_callback - DEBUG - Processing node 68d3d47ecd36afa834e106cb: baseline-arm 2025-09-26 11:22:57,182 - lava_callback - ERROR - Error processing callback for node 68d3d47ecd36afa834e106cb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:22:57,880 - lava_callback - INFO - Received callback for node 68d3d47fcd36afa834e106ce INFO: 172.20.0.1:46466 - "POST /node/68d3d47fcd36afa834e106ce HTTP/1.0" 202 Accepted 2025-09-26 11:22:57,885 - lava_callback - INFO - Starting async job submit for node 68d3d47fcd36afa834e106ce 2025-09-26 11:22:57,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:22:57,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d47fcd36afa834e106ce HTTP/1.1" 200 None 2025-09-26 11:22:57,902 - lava_callback - DEBUG - Processing node 68d3d47fcd36afa834e106ce: baseline-arm 2025-09-26 11:22:57,902 - lava_callback - ERROR - Error processing callback for node 68d3d47fcd36afa834e106ce: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:22:58,602 - lava_callback - INFO - Received callback for node 68d3d480cd36afa834e106d1 INFO: 172.20.0.1:46476 - "POST /node/68d3d480cd36afa834e106d1 HTTP/1.0" 202 Accepted 2025-09-26 11:22:58,607 - lava_callback - INFO - Starting async job submit for node 68d3d480cd36afa834e106d1 2025-09-26 11:22:58,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:22:58,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d480cd36afa834e106d1 HTTP/1.1" 200 None 2025-09-26 11:22:58,621 - lava_callback - DEBUG - Processing node 68d3d480cd36afa834e106d1: baseline-arm 2025-09-26 11:22:58,621 - lava_callback - ERROR - Error processing callback for node 68d3d480cd36afa834e106d1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:22:59,301 - lava_callback - INFO - Received callback for node 68d3d484cd36afa834e106d7 INFO: 172.20.0.1:46486 - "POST /node/68d3d484cd36afa834e106d7 HTTP/1.0" 202 Accepted 2025-09-26 11:22:59,307 - lava_callback - INFO - Starting async job submit for node 68d3d484cd36afa834e106d7 2025-09-26 11:22:59,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:22:59,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d484cd36afa834e106d7 HTTP/1.1" 200 None 2025-09-26 11:22:59,322 - lava_callback - DEBUG - Processing node 68d3d484cd36afa834e106d7: baseline-arm 2025-09-26 11:22:59,322 - lava_callback - ERROR - Error processing callback for node 68d3d484cd36afa834e106d7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:23:00,027 - lava_callback - INFO - Received callback for node 68d3d485cd36afa834e106da INFO: 172.20.0.1:52702 - "POST /node/68d3d485cd36afa834e106da HTTP/1.0" 202 Accepted 2025-09-26 11:23:00,033 - lava_callback - INFO - Starting async job submit for node 68d3d485cd36afa834e106da 2025-09-26 11:23:00,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:23:00,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d485cd36afa834e106da HTTP/1.1" 200 None 2025-09-26 11:23:00,046 - lava_callback - DEBUG - Processing node 68d3d485cd36afa834e106da: baseline-arm 2025-09-26 11:23:00,046 - lava_callback - ERROR - Error processing callback for node 68d3d485cd36afa834e106da: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:23:00,772 - lava_callback - INFO - Received callback for node 68d3d48acd36afa834e106e0 INFO: 172.20.0.1:52718 - "POST /node/68d3d48acd36afa834e106e0 HTTP/1.0" 202 Accepted 2025-09-26 11:23:00,777 - lava_callback - INFO - Starting async job submit for node 68d3d48acd36afa834e106e0 2025-09-26 11:23:00,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:23:00,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d48acd36afa834e106e0 HTTP/1.1" 200 None 2025-09-26 11:23:00,791 - lava_callback - DEBUG - Processing node 68d3d48acd36afa834e106e0: baseline-arm 2025-09-26 11:23:00,791 - lava_callback - ERROR - Error processing callback for node 68d3d48acd36afa834e106e0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:23:01,525 - lava_callback - INFO - Received callback for node 68d3d48dcd36afa834e106ff INFO: 172.20.0.1:52724 - "POST /node/68d3d48dcd36afa834e106ff HTTP/1.0" 202 Accepted 2025-09-26 11:23:01,531 - lava_callback - INFO - Starting async job submit for node 68d3d48dcd36afa834e106ff 2025-09-26 11:23:01,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:23:01,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d48dcd36afa834e106ff HTTP/1.1" 200 None 2025-09-26 11:23:01,570 - lava_callback - DEBUG - Processing node 68d3d48dcd36afa834e106ff: baseline-arm 2025-09-26 11:23:01,570 - lava_callback - ERROR - Error processing callback for node 68d3d48dcd36afa834e106ff: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:52736 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:23:11,566 - lava_callback - INFO - Received callback for node 68d3d49ccd36afa834e10723 INFO: 172.20.0.1:52240 - "POST /node/68d3d49ccd36afa834e10723 HTTP/1.0" 202 Accepted 2025-09-26 11:23:11,572 - lava_callback - INFO - Starting async job submit for node 68d3d49ccd36afa834e10723 2025-09-26 11:23:11,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:23:11,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d49ccd36afa834e10723 HTTP/1.1" 200 None 2025-09-26 11:23:11,586 - lava_callback - DEBUG - Processing node 68d3d49ccd36afa834e10723: ltp-cap-bounds 2025-09-26 11:23:11,586 - lava_callback - ERROR - Error processing callback for node 68d3d49ccd36afa834e10723: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:52254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52264 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:23:16,869 - lava_callback - INFO - Received callback for node 68d3d494cd36afa834e10717 INFO: 172.20.0.1:52280 - "POST /node/68d3d494cd36afa834e10717 HTTP/1.0" 202 Accepted 2025-09-26 11:23:16,874 - lava_callback - INFO - Starting async job submit for node 68d3d494cd36afa834e10717 2025-09-26 11:23:16,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:23:16,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d494cd36afa834e10717 HTTP/1.1" 200 None 2025-09-26 11:23:16,890 - lava_callback - DEBUG - Processing node 68d3d494cd36afa834e10717: baseline-arm 2025-09-26 11:23:16,890 - lava_callback - ERROR - Error processing callback for node 68d3d494cd36afa834e10717: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:23:17,590 - lava_callback - INFO - Received callback for node 68d3d496cd36afa834e1071a INFO: 172.20.0.1:52296 - "POST /node/68d3d496cd36afa834e1071a HTTP/1.0" 202 Accepted 2025-09-26 11:23:17,595 - lava_callback - INFO - Starting async job submit for node 68d3d496cd36afa834e1071a 2025-09-26 11:23:17,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:23:17,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d496cd36afa834e1071a HTTP/1.1" 200 None 2025-09-26 11:23:17,612 - lava_callback - DEBUG - Processing node 68d3d496cd36afa834e1071a: baseline-arm 2025-09-26 11:23:17,612 - lava_callback - ERROR - Error processing callback for node 68d3d496cd36afa834e1071a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:23:18,334 - lava_callback - INFO - Received callback for node 68d3d498cd36afa834e1071d INFO: 172.20.0.1:52300 - "POST /node/68d3d498cd36afa834e1071d HTTP/1.0" 202 Accepted 2025-09-26 11:23:18,342 - lava_callback - INFO - Starting async job submit for node 68d3d498cd36afa834e1071d 2025-09-26 11:23:18,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:23:18,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d498cd36afa834e1071d HTTP/1.1" 200 None 2025-09-26 11:23:18,356 - lava_callback - DEBUG - Processing node 68d3d498cd36afa834e1071d: baseline-arm 2025-09-26 11:23:18,356 - lava_callback - ERROR - Error processing callback for node 68d3d498cd36afa834e1071d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:23:19,042 - lava_callback - INFO - Received callback for node 68d3d499cd36afa834e10720 INFO: 172.20.0.1:52316 - "POST /node/68d3d499cd36afa834e10720 HTTP/1.0" 202 Accepted 2025-09-26 11:23:19,050 - lava_callback - INFO - Starting async job submit for node 68d3d499cd36afa834e10720 2025-09-26 11:23:19,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:23:19,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d499cd36afa834e10720 HTTP/1.1" 200 None 2025-09-26 11:23:19,065 - lava_callback - DEBUG - Processing node 68d3d499cd36afa834e10720: baseline-arm 2025-09-26 11:23:19,065 - lava_callback - ERROR - Error processing callback for node 68d3d499cd36afa834e10720: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:54846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54854 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:23:29,390 - lava_callback - INFO - Received callback for node 68d3d405cd36afa834e10482 INFO: 172.20.0.1:50258 - "POST /node/68d3d405cd36afa834e10482 HTTP/1.0" 202 Accepted 2025-09-26 11:23:29,396 - lava_callback - INFO - Starting async job submit for node 68d3d405cd36afa834e10482 2025-09-26 11:23:29,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:23:29,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d405cd36afa834e10482 HTTP/1.1" 200 None 2025-09-26 11:23:29,452 - lava_callback - DEBUG - Processing node 68d3d405cd36afa834e10482: ltp-cap-bounds 2025-09-26 11:23:29,769 - lava_callback - ERROR - Error processing callback for node 68d3d405cd36afa834e10482: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:50266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33026 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:23:50,987 - lava_callback - INFO - Received callback for node 68d3d4b7cd36afa834e1074a INFO: 172.20.0.1:53064 - "POST /node/68d3d4b7cd36afa834e1074a HTTP/1.0" 202 Accepted 2025-09-26 11:23:50,993 - lava_callback - INFO - Starting async job submit for node 68d3d4b7cd36afa834e1074a 2025-09-26 11:23:50,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:23:51,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d4b7cd36afa834e1074a HTTP/1.1" 200 None 2025-09-26 11:23:51,030 - lava_callback - DEBUG - Processing node 68d3d4b7cd36afa834e1074a: ltp-containers 2025-09-26 11:23:51,030 - lava_callback - ERROR - Error processing callback for node 68d3d4b7cd36afa834e1074a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:23:51,765 - lava_callback - INFO - Received callback for node 68d3d4bccd36afa834e10756 INFO: 172.20.0.1:53072 - "POST /node/68d3d4bccd36afa834e10756 HTTP/1.0" 202 Accepted 2025-09-26 11:23:51,771 - lava_callback - INFO - Starting async job submit for node 68d3d4bccd36afa834e10756 2025-09-26 11:23:51,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:23:51,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d4bccd36afa834e10756 HTTP/1.1" 200 None 2025-09-26 11:23:51,798 - lava_callback - DEBUG - Processing node 68d3d4bccd36afa834e10756: ltp-controllers 2025-09-26 11:23:51,798 - lava_callback - ERROR - Error processing callback for node 68d3d4bccd36afa834e10756: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:23:52,569 - lava_callback - INFO - Received callback for node 68d3d4bfcd36afa834e10759 INFO: 172.20.0.1:53084 - "POST /node/68d3d4bfcd36afa834e10759 HTTP/1.0" 202 Accepted 2025-09-26 11:23:52,575 - lava_callback - INFO - Starting async job submit for node 68d3d4bfcd36afa834e10759 2025-09-26 11:23:52,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:23:52,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d4bfcd36afa834e10759 HTTP/1.1" 200 None 2025-09-26 11:23:52,590 - lava_callback - DEBUG - Processing node 68d3d4bfcd36afa834e10759: ltp-containers 2025-09-26 11:23:52,590 - lava_callback - ERROR - Error processing callback for node 68d3d4bfcd36afa834e10759: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:23:53,352 - lava_callback - INFO - Received callback for node 68d3d4c4cd36afa834e10762 INFO: 172.20.0.1:53096 - "POST /node/68d3d4c4cd36afa834e10762 HTTP/1.0" 202 Accepted 2025-09-26 11:23:53,358 - lava_callback - INFO - Starting async job submit for node 68d3d4c4cd36afa834e10762 2025-09-26 11:23:53,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:23:53,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d4c4cd36afa834e10762 HTTP/1.1" 200 None 2025-09-26 11:23:53,374 - lava_callback - DEBUG - Processing node 68d3d4c4cd36afa834e10762: ltp-controllers 2025-09-26 11:23:53,374 - lava_callback - ERROR - Error processing callback for node 68d3d4c4cd36afa834e10762: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:53108 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:23:57,562 - lava_callback - INFO - Received callback for node 68d3da88cd36afa834e116b9 INFO: 172.20.0.1:53118 - "POST /node/68d3da88cd36afa834e116b9 HTTP/1.0" 202 Accepted 2025-09-26 11:23:57,568 - lava_callback - INFO - Starting async job submit for node 68d3da88cd36afa834e116b9 2025-09-26 11:23:57,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:23:57,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3da88cd36afa834e116b9 HTTP/1.1" 200 None 2025-09-26 11:23:57,603 - lava_callback - DEBUG - Processing node 68d3da88cd36afa834e116b9: baseline-arm64 2025-09-26 11:23:57,924 - lava_callback - ERROR - Error processing callback for node 68d3da88cd36afa834e116b9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:23:58,835 - lava_callback - INFO - Received callback for node 68d3da8ccd36afa834e116bc INFO: 172.20.0.1:53126 - "POST /node/68d3da8ccd36afa834e116bc HTTP/1.0" 202 Accepted 2025-09-26 11:23:58,841 - lava_callback - INFO - Starting async job submit for node 68d3da8ccd36afa834e116bc 2025-09-26 11:23:58,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:23:58,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3da8ccd36afa834e116bc HTTP/1.1" 200 None 2025-09-26 11:23:58,874 - lava_callback - DEBUG - Processing node 68d3da8ccd36afa834e116bc: baseline-arm64 2025-09-26 11:23:59,184 - lava_callback - ERROR - Error processing callback for node 68d3da8ccd36afa834e116bc: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:48484 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:24:11,086 - lava_callback - INFO - Received callback for node 68d3d4cacd36afa834e1076b INFO: 172.20.0.1:39726 - "POST /node/68d3d4cacd36afa834e1076b HTTP/1.0" 202 Accepted 2025-09-26 11:24:11,092 - lava_callback - INFO - Starting async job submit for node 68d3d4cacd36afa834e1076b 2025-09-26 11:24:11,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:24:11,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d4cacd36afa834e1076b HTTP/1.1" 200 None 2025-09-26 11:24:11,106 - lava_callback - DEBUG - Processing node 68d3d4cacd36afa834e1076b: ltp-cve 2025-09-26 11:24:11,106 - lava_callback - ERROR - Error processing callback for node 68d3d4cacd36afa834e1076b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:24:11,847 - lava_callback - INFO - Received callback for node 68d3d4d6cd36afa834e1079b INFO: 172.20.0.1:39736 - "POST /node/68d3d4d6cd36afa834e1079b HTTP/1.0" 202 Accepted 2025-09-26 11:24:11,852 - lava_callback - INFO - Starting async job submit for node 68d3d4d6cd36afa834e1079b 2025-09-26 11:24:11,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:24:11,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d4d6cd36afa834e1079b HTTP/1.1" 200 None 2025-09-26 11:24:11,868 - lava_callback - DEBUG - Processing node 68d3d4d6cd36afa834e1079b: ltp-cve 2025-09-26 11:24:11,868 - lava_callback - ERROR - Error processing callback for node 68d3d4d6cd36afa834e1079b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:39748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45056 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:24:31,068 - lava_callback - INFO - Received callback for node 68d3d4dfcd36afa834e107aa INFO: 172.20.0.1:37732 - "POST /node/68d3d4dfcd36afa834e107aa HTTP/1.0" 202 Accepted 2025-09-26 11:24:31,074 - lava_callback - INFO - Starting async job submit for node 68d3d4dfcd36afa834e107aa 2025-09-26 11:24:31,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:24:31,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d4dfcd36afa834e107aa HTTP/1.1" 200 None 2025-09-26 11:24:31,088 - lava_callback - DEBUG - Processing node 68d3d4dfcd36afa834e107aa: ltp-cap-bounds 2025-09-26 11:24:31,088 - lava_callback - ERROR - Error processing callback for node 68d3d4dfcd36afa834e107aa: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:37748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58806 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:24:50,966 - lava_callback - INFO - Received callback for node 68d3d4fbcd36afa834e107d7 INFO: 172.20.0.1:51616 - "POST /node/68d3d4fbcd36afa834e107d7 HTTP/1.0" 202 Accepted 2025-09-26 11:24:50,972 - lava_callback - INFO - Starting async job submit for node 68d3d4fbcd36afa834e107d7 2025-09-26 11:24:50,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:24:50,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d4fbcd36afa834e107d7 HTTP/1.1" 200 None 2025-09-26 11:24:50,986 - lava_callback - DEBUG - Processing node 68d3d4fbcd36afa834e107d7: ltp-containers 2025-09-26 11:24:50,986 - lava_callback - ERROR - Error processing callback for node 68d3d4fbcd36afa834e107d7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:51626 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:24:56,590 - lava_callback - INFO - Received callback for node 68d3d4fccd36afa834e107da INFO: 172.20.0.1:51636 - "POST /node/68d3d4fccd36afa834e107da HTTP/1.0" 202 Accepted 2025-09-26 11:24:56,595 - lava_callback - INFO - Starting async job submit for node 68d3d4fccd36afa834e107da 2025-09-26 11:24:56,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:24:56,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d4fccd36afa834e107da HTTP/1.1" 200 None 2025-09-26 11:24:56,614 - lava_callback - DEBUG - Processing node 68d3d4fccd36afa834e107da: baseline-arm 2025-09-26 11:24:56,614 - lava_callback - ERROR - Error processing callback for node 68d3d4fccd36afa834e107da: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:24:57,271 - lava_callback - INFO - Received callback for node 68d3d4fecd36afa834e107dd INFO: 172.20.0.1:51646 - "POST /node/68d3d4fecd36afa834e107dd HTTP/1.0" 202 Accepted 2025-09-26 11:24:57,276 - lava_callback - INFO - Starting async job submit for node 68d3d4fecd36afa834e107dd 2025-09-26 11:24:57,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:24:57,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d4fecd36afa834e107dd HTTP/1.1" 200 None 2025-09-26 11:24:57,291 - lava_callback - DEBUG - Processing node 68d3d4fecd36afa834e107dd: baseline-arm 2025-09-26 11:24:57,291 - lava_callback - ERROR - Error processing callback for node 68d3d4fecd36afa834e107dd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:24:57,973 - lava_callback - INFO - Received callback for node 68d3d504cd36afa834e107e3 INFO: 172.20.0.1:51662 - "POST /node/68d3d504cd36afa834e107e3 HTTP/1.0" 202 Accepted 2025-09-26 11:24:57,978 - lava_callback - INFO - Starting async job submit for node 68d3d504cd36afa834e107e3 2025-09-26 11:24:57,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:24:58,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d504cd36afa834e107e3 HTTP/1.1" 200 None 2025-09-26 11:24:58,027 - lava_callback - DEBUG - Processing node 68d3d504cd36afa834e107e3: baseline-arm 2025-09-26 11:24:58,027 - lava_callback - ERROR - Error processing callback for node 68d3d504cd36afa834e107e3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:24:58,682 - lava_callback - INFO - Received callback for node 68d3d504cd36afa834e107e6 INFO: 172.20.0.1:51670 - "POST /node/68d3d504cd36afa834e107e6 HTTP/1.0" 202 Accepted 2025-09-26 11:24:58,691 - lava_callback - INFO - Starting async job submit for node 68d3d504cd36afa834e107e6 2025-09-26 11:24:58,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:24:58,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d504cd36afa834e107e6 HTTP/1.1" 200 None 2025-09-26 11:24:58,705 - lava_callback - DEBUG - Processing node 68d3d504cd36afa834e107e6: baseline-arm 2025-09-26 11:24:58,705 - lava_callback - ERROR - Error processing callback for node 68d3d504cd36afa834e107e6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:37916 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:25:11,156 - lava_callback - INFO - Received callback for node 68d3d503cd36afa834e107e0 INFO: 172.20.0.1:36004 - "POST /node/68d3d503cd36afa834e107e0 HTTP/1.0" 202 Accepted 2025-09-26 11:25:11,162 - lava_callback - INFO - Starting async job submit for node 68d3d503cd36afa834e107e0 2025-09-26 11:25:11,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:25:11,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d503cd36afa834e107e0 HTTP/1.1" 200 None 2025-09-26 11:25:11,185 - lava_callback - DEBUG - Processing node 68d3d503cd36afa834e107e0: ltp-fs-bind 2025-09-26 11:25:11,185 - lava_callback - ERROR - Error processing callback for node 68d3d503cd36afa834e107e0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:25:11,924 - lava_callback - INFO - Received callback for node 68d3d507cd36afa834e107e9 INFO: 172.20.0.1:36010 - "POST /node/68d3d507cd36afa834e107e9 HTTP/1.0" 202 Accepted 2025-09-26 11:25:11,930 - lava_callback - INFO - Starting async job submit for node 68d3d507cd36afa834e107e9 2025-09-26 11:25:11,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:25:11,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d507cd36afa834e107e9 HTTP/1.1" 200 None 2025-09-26 11:25:11,944 - lava_callback - DEBUG - Processing node 68d3d507cd36afa834e107e9: ltp-fs-bind 2025-09-26 11:25:11,944 - lava_callback - ERROR - Error processing callback for node 68d3d507cd36afa834e107e9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:25:12,671 - lava_callback - INFO - Received callback for node 68d3d511cd36afa834e1082f INFO: 172.20.0.1:36012 - "POST /node/68d3d511cd36afa834e1082f HTTP/1.0" 202 Accepted 2025-09-26 11:25:12,677 - lava_callback - INFO - Starting async job submit for node 68d3d511cd36afa834e1082f 2025-09-26 11:25:12,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:25:12,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d511cd36afa834e1082f HTTP/1.1" 200 None 2025-09-26 11:25:12,711 - lava_callback - DEBUG - Processing node 68d3d511cd36afa834e1082f: ltp-controllers 2025-09-26 11:25:12,711 - lava_callback - ERROR - Error processing callback for node 68d3d511cd36afa834e1082f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:25:13,427 - lava_callback - INFO - Received callback for node 68d3d516cd36afa834e10838 INFO: 172.20.0.1:36020 - "POST /node/68d3d516cd36afa834e10838 HTTP/1.0" 202 Accepted 2025-09-26 11:25:13,433 - lava_callback - INFO - Starting async job submit for node 68d3d516cd36afa834e10838 2025-09-26 11:25:13,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:25:13,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d516cd36afa834e10838 HTTP/1.1" 200 None 2025-09-26 11:25:13,466 - lava_callback - DEBUG - Processing node 68d3d516cd36afa834e10838: ltp-fsx 2025-09-26 11:25:13,466 - lava_callback - ERROR - Error processing callback for node 68d3d516cd36afa834e10838: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:36028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36032 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:25:16,856 - lava_callback - INFO - Received callback for node 68d3d508cd36afa834e107ec INFO: 172.20.0.1:36046 - "POST /node/68d3d508cd36afa834e107ec HTTP/1.0" 202 Accepted 2025-09-26 11:25:16,864 - lava_callback - INFO - Starting async job submit for node 68d3d508cd36afa834e107ec 2025-09-26 11:25:16,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:25:16,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d508cd36afa834e107ec HTTP/1.1" 200 None 2025-09-26 11:25:16,878 - lava_callback - DEBUG - Processing node 68d3d508cd36afa834e107ec: baseline-arm 2025-09-26 11:25:16,878 - lava_callback - ERROR - Error processing callback for node 68d3d508cd36afa834e107ec: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:25:17,539 - lava_callback - INFO - Received callback for node 68d3d509cd36afa834e107f2 INFO: 172.20.0.1:36062 - "POST /node/68d3d509cd36afa834e107f2 HTTP/1.0" 202 Accepted 2025-09-26 11:25:17,544 - lava_callback - INFO - Starting async job submit for node 68d3d509cd36afa834e107f2 2025-09-26 11:25:17,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:25:17,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d509cd36afa834e107f2 HTTP/1.1" 200 None 2025-09-26 11:25:17,558 - lava_callback - DEBUG - Processing node 68d3d509cd36afa834e107f2: baseline-arm 2025-09-26 11:25:17,558 - lava_callback - ERROR - Error processing callback for node 68d3d509cd36afa834e107f2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:25:18,239 - lava_callback - INFO - Received callback for node 68d3d50dcd36afa834e1081a INFO: 172.20.0.1:36074 - "POST /node/68d3d50dcd36afa834e1081a HTTP/1.0" 202 Accepted 2025-09-26 11:25:18,244 - lava_callback - INFO - Starting async job submit for node 68d3d50dcd36afa834e1081a 2025-09-26 11:25:18,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:25:18,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d50dcd36afa834e1081a HTTP/1.1" 200 None 2025-09-26 11:25:18,258 - lava_callback - DEBUG - Processing node 68d3d50dcd36afa834e1081a: baseline-arm 2025-09-26 11:25:18,258 - lava_callback - ERROR - Error processing callback for node 68d3d50dcd36afa834e1081a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:25:18,922 - lava_callback - INFO - Received callback for node 68d3d50ecd36afa834e10828 INFO: 172.20.0.1:36082 - "POST /node/68d3d50ecd36afa834e10828 HTTP/1.0" 202 Accepted 2025-09-26 11:25:18,928 - lava_callback - INFO - Starting async job submit for node 68d3d50ecd36afa834e10828 2025-09-26 11:25:18,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:25:18,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d50ecd36afa834e10828 HTTP/1.1" 200 None 2025-09-26 11:25:18,952 - lava_callback - DEBUG - Processing node 68d3d50ecd36afa834e10828: baseline-arm 2025-09-26 11:25:18,952 - lava_callback - ERROR - Error processing callback for node 68d3d50ecd36afa834e10828: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:25:19,652 - lava_callback - INFO - Received callback for node 68d3d513cd36afa834e10832 INFO: 172.20.0.1:42672 - "POST /node/68d3d513cd36afa834e10832 HTTP/1.0" 202 Accepted 2025-09-26 11:25:19,657 - lava_callback - INFO - Starting async job submit for node 68d3d513cd36afa834e10832 2025-09-26 11:25:19,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:25:19,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d513cd36afa834e10832 HTTP/1.1" 200 None 2025-09-26 11:25:19,671 - lava_callback - DEBUG - Processing node 68d3d513cd36afa834e10832: baseline-arm 2025-09-26 11:25:19,671 - lava_callback - ERROR - Error processing callback for node 68d3d513cd36afa834e10832: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:25:20,384 - lava_callback - INFO - Received callback for node 68d3d513cd36afa834e10835 INFO: 172.20.0.1:42686 - "POST /node/68d3d513cd36afa834e10835 HTTP/1.0" 202 Accepted 2025-09-26 11:25:20,389 - lava_callback - INFO - Starting async job submit for node 68d3d513cd36afa834e10835 2025-09-26 11:25:20,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:25:20,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d513cd36afa834e10835 HTTP/1.1" 200 None 2025-09-26 11:25:20,406 - lava_callback - DEBUG - Processing node 68d3d513cd36afa834e10835: baseline-arm 2025-09-26 11:25:20,406 - lava_callback - ERROR - Error processing callback for node 68d3d513cd36afa834e10835: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:42688 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:25:21,066 - lava_callback - INFO - Received callback for node 68d3d518cd36afa834e1083b INFO: 172.20.0.1:42702 - "POST /node/68d3d518cd36afa834e1083b HTTP/1.0" 202 Accepted 2025-09-26 11:25:21,071 - lava_callback - INFO - Starting async job submit for node 68d3d518cd36afa834e1083b 2025-09-26 11:25:21,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:25:21,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d518cd36afa834e1083b HTTP/1.1" 200 None 2025-09-26 11:25:21,084 - lava_callback - DEBUG - Processing node 68d3d518cd36afa834e1083b: baseline-arm 2025-09-26 11:25:21,085 - lava_callback - ERROR - Error processing callback for node 68d3d518cd36afa834e1083b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:25:21,782 - lava_callback - INFO - Received callback for node 68d3d519cd36afa834e1083e INFO: 172.20.0.1:42706 - "POST /node/68d3d519cd36afa834e1083e HTTP/1.0" 202 Accepted 2025-09-26 11:25:21,787 - lava_callback - INFO - Starting async job submit for node 68d3d519cd36afa834e1083e 2025-09-26 11:25:21,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:25:21,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d519cd36afa834e1083e HTTP/1.1" 200 None 2025-09-26 11:25:21,823 - lava_callback - DEBUG - Processing node 68d3d519cd36afa834e1083e: baseline-arm 2025-09-26 11:25:21,824 - lava_callback - ERROR - Error processing callback for node 68d3d519cd36afa834e1083e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:42718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42720 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:25:30,630 - lava_callback - INFO - Received callback for node 68d3da99cd36afa834e116c8 INFO: 172.20.0.1:48304 - "POST /node/68d3da99cd36afa834e116c8 HTTP/1.0" 202 Accepted 2025-09-26 11:25:30,636 - lava_callback - INFO - Starting async job submit for node 68d3da99cd36afa834e116c8 2025-09-26 11:25:30,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:25:30,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3da99cd36afa834e116c8 HTTP/1.1" 200 None 2025-09-26 11:25:30,685 - lava_callback - DEBUG - Processing node 68d3da99cd36afa834e116c8: baseline-arm64 2025-09-26 11:25:30,975 - lava_callback - ERROR - Error processing callback for node 68d3da99cd36afa834e116c8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:25:31,023 - lava_callback - INFO - Received callback for node 68d3d51ccd36afa834e10841 INFO: 172.20.0.1:48312 - "POST /node/68d3d51ccd36afa834e10841 HTTP/1.0" 202 Accepted 2025-09-26 11:25:31,029 - lava_callback - INFO - Starting async job submit for node 68d3d51ccd36afa834e10841 2025-09-26 11:25:31,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:25:31,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d51ccd36afa834e10841 HTTP/1.1" 200 None 2025-09-26 11:25:31,054 - lava_callback - DEBUG - Processing node 68d3d51ccd36afa834e10841: ltp-fsx 2025-09-26 11:25:31,054 - lava_callback - ERROR - Error processing callback for node 68d3d51ccd36afa834e10841: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:25:31,773 - lava_callback - INFO - Received callback for node 68d3d521cd36afa834e1084a INFO: 172.20.0.1:48322 - "POST /node/68d3d521cd36afa834e1084a HTTP/1.0" 202 Accepted 2025-09-26 11:25:31,779 - lava_callback - INFO - Starting async job submit for node 68d3d521cd36afa834e1084a 2025-09-26 11:25:31,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:25:31,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d521cd36afa834e1084a HTTP/1.1" 200 None 2025-09-26 11:25:31,793 - lava_callback - DEBUG - Processing node 68d3d521cd36afa834e1084a: ltp-cve 2025-09-26 11:25:31,793 - lava_callback - ERROR - Error processing callback for node 68d3d521cd36afa834e1084a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:25:31,977 - lava_callback - INFO - Received callback for node 68d3da8ecd36afa834e116bf INFO: 172.20.0.1:48336 - "POST /node/68d3da8ecd36afa834e116bf HTTP/1.0" 202 Accepted 2025-09-26 11:25:31,983 - lava_callback - INFO - Starting async job submit for node 68d3da8ecd36afa834e116bf 2025-09-26 11:25:32,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:25:32,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3da8ecd36afa834e116bf HTTP/1.1" 200 None 2025-09-26 11:25:32,018 - lava_callback - DEBUG - Processing node 68d3da8ecd36afa834e116bf: baseline-arm64 2025-09-26 11:25:32,341 - lava_callback - ERROR - Error processing callback for node 68d3da8ecd36afa834e116bf: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:25:32,531 - lava_callback - INFO - Received callback for node 68d3d528cd36afa834e10853 INFO: 172.20.0.1:48340 - "POST /node/68d3d528cd36afa834e10853 HTTP/1.0" 202 Accepted 2025-09-26 11:25:32,538 - lava_callback - INFO - Starting async job submit for node 68d3d528cd36afa834e10853 2025-09-26 11:25:32,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:25:32,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d528cd36afa834e10853 HTTP/1.1" 200 None 2025-09-26 11:25:32,551 - lava_callback - DEBUG - Processing node 68d3d528cd36afa834e10853: ltp-input 2025-09-26 11:25:32,551 - lava_callback - ERROR - Error processing callback for node 68d3d528cd36afa834e10853: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:48348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53972 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:25:51,060 - lava_callback - INFO - Received callback for node 68d3d52dcd36afa834e1085c INFO: 172.20.0.1:47434 - "POST /node/68d3d52dcd36afa834e1085c HTTP/1.0" 202 Accepted 2025-09-26 11:25:51,066 - lava_callback - INFO - Starting async job submit for node 68d3d52dcd36afa834e1085c 2025-09-26 11:25:51,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:25:51,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d52dcd36afa834e1085c HTTP/1.1" 200 None 2025-09-26 11:25:51,083 - lava_callback - DEBUG - Processing node 68d3d52dcd36afa834e1085c: ltp-input 2025-09-26 11:25:51,083 - lava_callback - ERROR - Error processing callback for node 68d3d52dcd36afa834e1085c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:47436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34648 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:26:11,038 - lava_callback - INFO - Received callback for node 68d3d541cd36afa834e10874 INFO: 172.20.0.1:40348 - "POST /node/68d3d541cd36afa834e10874 HTTP/1.0" 202 Accepted 2025-09-26 11:26:11,044 - lava_callback - INFO - Starting async job submit for node 68d3d541cd36afa834e10874 2025-09-26 11:26:11,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:26:11,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d541cd36afa834e10874 HTTP/1.1" 200 None 2025-09-26 11:26:11,068 - lava_callback - DEBUG - Processing node 68d3d541cd36afa834e10874: ltp-ipc 2025-09-26 11:26:11,068 - lava_callback - ERROR - Error processing callback for node 68d3d541cd36afa834e10874: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:26:12,413 - lava_callback - INFO - Received callback for node 68d3d549cd36afa834e10888 INFO: 172.20.0.1:40354 - "POST /node/68d3d549cd36afa834e10888 HTTP/1.0" 202 Accepted 2025-09-26 11:26:12,419 - lava_callback - INFO - Starting async job submit for node 68d3d549cd36afa834e10888 2025-09-26 11:26:12,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:26:12,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d549cd36afa834e10888 HTTP/1.1" 200 None 2025-09-26 11:26:12,435 - lava_callback - DEBUG - Processing node 68d3d549cd36afa834e10888: ltp-ipc 2025-09-26 11:26:12,435 - lava_callback - ERROR - Error processing callback for node 68d3d549cd36afa834e10888: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:26:13,763 - lava_callback - INFO - Received callback for node 68d3d550cd36afa834e108a4 INFO: 172.20.0.1:40370 - "POST /node/68d3d550cd36afa834e108a4 HTTP/1.0" 202 Accepted 2025-09-26 11:26:13,769 - lava_callback - INFO - Starting async job submit for node 68d3d550cd36afa834e108a4 2025-09-26 11:26:13,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:26:13,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d550cd36afa834e108a4 HTTP/1.1" 200 None 2025-09-26 11:26:13,783 - lava_callback - DEBUG - Processing node 68d3d550cd36afa834e108a4: ltp-fs-bind 2025-09-26 11:26:13,783 - lava_callback - ERROR - Error processing callback for node 68d3d550cd36afa834e108a4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:40386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40388 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:26:19,905 - lava_callback - INFO - Received callback for node 68d3d0c7cd36afa834e0fe27 INFO: 172.20.0.1:33006 - "POST /node/68d3d0c7cd36afa834e0fe27 HTTP/1.0" 202 Accepted 2025-09-26 11:26:19,911 - lava_callback - INFO - Starting async job submit for node 68d3d0c7cd36afa834e0fe27 2025-09-26 11:26:19,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:26:19,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d0c7cd36afa834e0fe27 HTTP/1.1" 200 None 2025-09-26 11:26:19,955 - lava_callback - DEBUG - Processing node 68d3d0c7cd36afa834e0fe27: baseline-arm 2025-09-26 11:26:20,208 - lava_callback - ERROR - Error processing callback for node 68d3d0c7cd36afa834e0fe27: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:33010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33028 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:26:31,649 - lava_callback - INFO - Received callback for node 68d3d556cd36afa834e108aa INFO: 172.20.0.1:53564 - "POST /node/68d3d556cd36afa834e108aa HTTP/1.0" 202 Accepted 2025-09-26 11:26:31,655 - lava_callback - INFO - Starting async job submit for node 68d3d556cd36afa834e108aa 2025-09-26 11:26:31,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:26:31,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d556cd36afa834e108aa HTTP/1.1" 200 None 2025-09-26 11:26:31,685 - lava_callback - DEBUG - Processing node 68d3d556cd36afa834e108aa: ltp-pty 2025-09-26 11:26:31,685 - lava_callback - ERROR - Error processing callback for node 68d3d556cd36afa834e108aa: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:26:33,051 - lava_callback - INFO - Received callback for node 68d3d559cd36afa834e108ad INFO: 172.20.0.1:53566 - "POST /node/68d3d559cd36afa834e108ad HTTP/1.0" 202 Accepted 2025-09-26 11:26:33,057 - lava_callback - INFO - Starting async job submit for node 68d3d559cd36afa834e108ad 2025-09-26 11:26:33,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:26:33,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d559cd36afa834e108ad HTTP/1.1" 200 None 2025-09-26 11:26:33,085 - lava_callback - DEBUG - Processing node 68d3d559cd36afa834e108ad: ltp-pty 2025-09-26 11:26:33,085 - lava_callback - ERROR - Error processing callback for node 68d3d559cd36afa834e108ad: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:53576 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:26:39,762 - lava_callback - INFO - Received callback for node 68d3d562cd36afa834e108b6 INFO: 172.20.0.1:39664 - "POST /node/68d3d562cd36afa834e108b6 HTTP/1.0" 202 Accepted 2025-09-26 11:26:39,768 - lava_callback - INFO - Starting async job submit for node 68d3d562cd36afa834e108b6 2025-09-26 11:26:39,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:26:39,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d562cd36afa834e108b6 HTTP/1.1" 200 None 2025-09-26 11:26:39,800 - lava_callback - DEBUG - Processing node 68d3d562cd36afa834e108b6: ltp-fsx 2025-09-26 11:26:39,800 - lava_callback - ERROR - Error processing callback for node 68d3d562cd36afa834e108b6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:26:41,100 - lava_callback - INFO - Received callback for node 68d3d566cd36afa834e108bc INFO: 172.20.0.1:39668 - "POST /node/68d3d566cd36afa834e108bc HTTP/1.0" 202 Accepted 2025-09-26 11:26:41,106 - lava_callback - INFO - Starting async job submit for node 68d3d566cd36afa834e108bc 2025-09-26 11:26:41,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:26:41,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d566cd36afa834e108bc HTTP/1.1" 200 None 2025-09-26 11:26:41,123 - lava_callback - DEBUG - Processing node 68d3d566cd36afa834e108bc: ltp-input 2025-09-26 11:26:41,123 - lava_callback - ERROR - Error processing callback for node 68d3d566cd36afa834e108bc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:26:42,010 - lava_callback - INFO - Received callback for node 68d3d56dcd36afa834e108c2 INFO: 172.20.0.1:39676 - "POST /node/68d3d56dcd36afa834e108c2 HTTP/1.0" 202 Accepted 2025-09-26 11:26:42,016 - lava_callback - INFO - Starting async job submit for node 68d3d56dcd36afa834e108c2 2025-09-26 11:26:42,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:26:42,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d56dcd36afa834e108c2 HTTP/1.1" 200 None 2025-09-26 11:26:42,037 - lava_callback - DEBUG - Processing node 68d3d56dcd36afa834e108c2: ltp-sched 2025-09-26 11:26:42,037 - lava_callback - ERROR - Error processing callback for node 68d3d56dcd36afa834e108c2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:39690 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:26:51,060 - lava_callback - INFO - Received callback for node 68d3d572cd36afa834e108c5 INFO: 172.20.0.1:57148 - "POST /node/68d3d572cd36afa834e108c5 HTTP/1.0" 202 Accepted 2025-09-26 11:26:51,070 - lava_callback - INFO - Starting async job submit for node 68d3d572cd36afa834e108c5 2025-09-26 11:26:51,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:26:51,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d572cd36afa834e108c5 HTTP/1.1" 200 None 2025-09-26 11:26:51,088 - lava_callback - DEBUG - Processing node 68d3d572cd36afa834e108c5: ltp-sched 2025-09-26 11:26:51,088 - lava_callback - ERROR - Error processing callback for node 68d3d572cd36afa834e108c5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:26:51,877 - lava_callback - INFO - Received callback for node 68d3d577cd36afa834e108cb INFO: 172.20.0.1:57154 - "POST /node/68d3d577cd36afa834e108cb HTTP/1.0" 202 Accepted 2025-09-26 11:26:51,883 - lava_callback - INFO - Starting async job submit for node 68d3d577cd36afa834e108cb 2025-09-26 11:26:51,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:26:51,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d577cd36afa834e108cb HTTP/1.1" 200 None 2025-09-26 11:26:51,899 - lava_callback - DEBUG - Processing node 68d3d577cd36afa834e108cb: ltp-ipc 2025-09-26 11:26:51,899 - lava_callback - ERROR - Error processing callback for node 68d3d577cd36afa834e108cb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:57160 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:26:56,646 - lava_callback - INFO - Received callback for node 68d3da9ccd36afa834e116cb INFO: 172.20.0.1:57168 - "POST /node/68d3da9ccd36afa834e116cb HTTP/1.0" 202 Accepted 2025-09-26 11:26:56,653 - lava_callback - INFO - Starting async job submit for node 68d3da9ccd36afa834e116cb 2025-09-26 11:26:56,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:26:56,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3da9ccd36afa834e116cb HTTP/1.1" 200 None 2025-09-26 11:26:56,686 - lava_callback - DEBUG - Processing node 68d3da9ccd36afa834e116cb: baseline-arm64 2025-09-26 11:26:56,988 - lava_callback - ERROR - Error processing callback for node 68d3da9ccd36afa834e116cb: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:26:57,756 - lava_callback - INFO - Received callback for node 68d41687cd36afa834e1872d INFO: 172.20.0.1:57178 - "POST /node/68d41687cd36afa834e1872d HTTP/1.0" 202 Accepted 2025-09-26 11:26:57,762 - lava_callback - INFO - Starting async job submit for node 68d41687cd36afa834e1872d 2025-09-26 11:26:57,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:26:57,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41687cd36afa834e1872d HTTP/1.1" 200 None 2025-09-26 11:26:57,797 - lava_callback - DEBUG - Processing node 68d41687cd36afa834e1872d: baseline-arm 2025-09-26 11:26:58,043 - lava_callback - ERROR - Error processing callback for node 68d41687cd36afa834e1872d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:27:00,918 - lava_callback - INFO - Received callback for node 68d3daa6cd36afa834e116d4 INFO: 172.20.0.1:41616 - "POST /node/68d3daa6cd36afa834e116d4 HTTP/1.0" 202 Accepted 2025-09-26 11:27:00,924 - lava_callback - INFO - Starting async job submit for node 68d3daa6cd36afa834e116d4 2025-09-26 11:27:00,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:27:00,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3daa6cd36afa834e116d4 HTTP/1.1" 200 None 2025-09-26 11:27:00,965 - lava_callback - DEBUG - Processing node 68d3daa6cd36afa834e116d4: baseline-arm64 2025-09-26 11:27:01,249 - lava_callback - ERROR - Error processing callback for node 68d3daa6cd36afa834e116d4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:41620 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:27:11,064 - lava_callback - INFO - Received callback for node 68d3d57ecd36afa834e108d1 INFO: 172.20.0.1:58500 - "POST /node/68d3d57ecd36afa834e108d1 HTTP/1.0" 202 Accepted 2025-09-26 11:27:11,070 - lava_callback - INFO - Starting async job submit for node 68d3d57ecd36afa834e108d1 2025-09-26 11:27:11,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:27:11,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d57ecd36afa834e108d1 HTTP/1.1" 200 None 2025-09-26 11:27:11,085 - lava_callback - DEBUG - Processing node 68d3d57ecd36afa834e108d1: ltp-smoketest 2025-09-26 11:27:11,085 - lava_callback - ERROR - Error processing callback for node 68d3d57ecd36afa834e108d1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:27:11,949 - lava_callback - INFO - Received callback for node 68d3d586cd36afa834e108da INFO: 172.20.0.1:58502 - "POST /node/68d3d586cd36afa834e108da HTTP/1.0" 202 Accepted 2025-09-26 11:27:11,955 - lava_callback - INFO - Starting async job submit for node 68d3d586cd36afa834e108da 2025-09-26 11:27:11,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:27:11,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d586cd36afa834e108da HTTP/1.1" 200 None 2025-09-26 11:27:11,973 - lava_callback - DEBUG - Processing node 68d3d586cd36afa834e108da: ltp-smoketest 2025-09-26 11:27:11,973 - lava_callback - ERROR - Error processing callback for node 68d3d586cd36afa834e108da: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:27:12,733 - lava_callback - INFO - Received callback for node 68d3d58dcd36afa834e10907 INFO: 172.20.0.1:58516 - "POST /node/68d3d58dcd36afa834e10907 HTTP/1.0" 202 Accepted 2025-09-26 11:27:12,739 - lava_callback - INFO - Starting async job submit for node 68d3d58dcd36afa834e10907 2025-09-26 11:27:12,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:27:12,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d58dcd36afa834e10907 HTTP/1.1" 200 None 2025-09-26 11:27:12,754 - lava_callback - DEBUG - Processing node 68d3d58dcd36afa834e10907: ltp-pty 2025-09-26 11:27:12,754 - lava_callback - ERROR - Error processing callback for node 68d3d58dcd36afa834e10907: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:27:14,799 - lava_callback - INFO - Received callback for node 68d3d492cd36afa834e10714 INFO: 172.20.0.1:58530 - "POST /node/68d3d492cd36afa834e10714 HTTP/1.0" 202 Accepted 2025-09-26 11:27:14,806 - lava_callback - INFO - Starting async job submit for node 68d3d492cd36afa834e10714 2025-09-26 11:27:14,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:27:14,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d492cd36afa834e10714 HTTP/1.1" 200 None 2025-09-26 11:27:14,865 - lava_callback - DEBUG - Processing node 68d3d492cd36afa834e10714: ltp-cap-bounds INFO: 172.20.0.1:58536 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 11:27:15,260 - lava_callback - ERROR - Error processing callback for node 68d3d492cd36afa834e10714: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:58538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53648 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:27:31,279 - lava_callback - INFO - Received callback for node 68d3d592cd36afa834e1090d INFO: 172.20.0.1:42940 - "POST /node/68d3d592cd36afa834e1090d HTTP/1.0" 202 Accepted 2025-09-26 11:27:31,285 - lava_callback - INFO - Starting async job submit for node 68d3d592cd36afa834e1090d 2025-09-26 11:27:31,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:27:31,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d592cd36afa834e1090d HTTP/1.1" 200 None 2025-09-26 11:27:31,306 - lava_callback - DEBUG - Processing node 68d3d592cd36afa834e1090d: ltp-syscalls 2025-09-26 11:27:31,306 - lava_callback - ERROR - Error processing callback for node 68d3d592cd36afa834e1090d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:27:32,047 - lava_callback - INFO - Received callback for node 68d3d596cd36afa834e10910 INFO: 172.20.0.1:42944 - "POST /node/68d3d596cd36afa834e10910 HTTP/1.0" 202 Accepted 2025-09-26 11:27:32,053 - lava_callback - INFO - Starting async job submit for node 68d3d596cd36afa834e10910 2025-09-26 11:27:32,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:27:32,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d596cd36afa834e10910 HTTP/1.1" 200 None 2025-09-26 11:27:32,088 - lava_callback - DEBUG - Processing node 68d3d596cd36afa834e10910: ltp-syscalls 2025-09-26 11:27:32,088 - lava_callback - ERROR - Error processing callback for node 68d3d596cd36afa834e10910: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:27:32,804 - lava_callback - INFO - Received callback for node 68d3d5a0cd36afa834e1091f INFO: 172.20.0.1:42954 - "POST /node/68d3d5a0cd36afa834e1091f HTTP/1.0" 202 Accepted 2025-09-26 11:27:32,810 - lava_callback - INFO - Starting async job submit for node 68d3d5a0cd36afa834e1091f 2025-09-26 11:27:32,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:27:32,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d5a0cd36afa834e1091f HTTP/1.1" 200 None 2025-09-26 11:27:32,823 - lava_callback - DEBUG - Processing node 68d3d5a0cd36afa834e1091f: ltp-syscalls-ipc 2025-09-26 11:27:32,823 - lava_callback - ERROR - Error processing callback for node 68d3d5a0cd36afa834e1091f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:42968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35498 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:27:51,238 - lava_callback - INFO - Received callback for node 68d3d5a8cd36afa834e10925 INFO: 172.20.0.1:50516 - "POST /node/68d3d5a8cd36afa834e10925 HTTP/1.0" 202 Accepted 2025-09-26 11:27:51,244 - lava_callback - INFO - Starting async job submit for node 68d3d5a8cd36afa834e10925 2025-09-26 11:27:51,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:27:51,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d5a8cd36afa834e10925 HTTP/1.1" 200 None 2025-09-26 11:27:51,258 - lava_callback - DEBUG - Processing node 68d3d5a8cd36afa834e10925: ltp-syscalls-ipc 2025-09-26 11:27:51,258 - lava_callback - ERROR - Error processing callback for node 68d3d5a8cd36afa834e10925: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:27:52,038 - lava_callback - INFO - Received callback for node 68d3d5aacd36afa834e10928 INFO: 172.20.0.1:50532 - "POST /node/68d3d5aacd36afa834e10928 HTTP/1.0" 202 Accepted 2025-09-26 11:27:52,048 - lava_callback - INFO - Starting async job submit for node 68d3d5aacd36afa834e10928 2025-09-26 11:27:52,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:27:52,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d5aacd36afa834e10928 HTTP/1.1" 200 None 2025-09-26 11:27:52,066 - lava_callback - DEBUG - Processing node 68d3d5aacd36afa834e10928: ltp-smoketest 2025-09-26 11:27:52,066 - lava_callback - ERROR - Error processing callback for node 68d3d5aacd36afa834e10928: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:27:52,804 - lava_callback - INFO - Received callback for node 68d3d5aacd36afa834e1092b INFO: 172.20.0.1:50544 - "POST /node/68d3d5aacd36afa834e1092b HTTP/1.0" 202 Accepted 2025-09-26 11:27:52,812 - lava_callback - INFO - Starting async job submit for node 68d3d5aacd36afa834e1092b 2025-09-26 11:27:52,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:27:52,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d5aacd36afa834e1092b HTTP/1.1" 200 None 2025-09-26 11:27:52,828 - lava_callback - DEBUG - Processing node 68d3d5aacd36afa834e1092b: baseline-arm-broonie 2025-09-26 11:27:52,828 - lava_callback - ERROR - Error processing callback for node 68d3d5aacd36afa834e1092b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:27:53,609 - lava_callback - INFO - Received callback for node 68d3d5afcd36afa834e1092e INFO: 172.20.0.1:50548 - "POST /node/68d3d5afcd36afa834e1092e HTTP/1.0" 202 Accepted 2025-09-26 11:27:53,615 - lava_callback - INFO - Starting async job submit for node 68d3d5afcd36afa834e1092e 2025-09-26 11:27:53,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:27:53,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d5afcd36afa834e1092e HTTP/1.1" 200 None 2025-09-26 11:27:53,631 - lava_callback - DEBUG - Processing node 68d3d5afcd36afa834e1092e: ltp-timers 2025-09-26 11:27:53,631 - lava_callback - ERROR - Error processing callback for node 68d3d5afcd36afa834e1092e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:27:54,407 - lava_callback - INFO - Received callback for node 68d3d5b5cd36afa834e10934 INFO: 172.20.0.1:50562 - "POST /node/68d3d5b5cd36afa834e10934 HTTP/1.0" 202 Accepted 2025-09-26 11:27:54,413 - lava_callback - INFO - Starting async job submit for node 68d3d5b5cd36afa834e10934 2025-09-26 11:27:54,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:27:54,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d5b5cd36afa834e10934 HTTP/1.1" 200 None 2025-09-26 11:27:54,427 - lava_callback - DEBUG - Processing node 68d3d5b5cd36afa834e10934: ltp-syscalls 2025-09-26 11:27:54,427 - lava_callback - ERROR - Error processing callback for node 68d3d5b5cd36afa834e10934: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:50570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34468 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:28:10,726 - lava_callback - INFO - Received callback for node 68d3cb17cd36afa834e0f1aa INFO: 172.20.0.1:35092 - "POST /node/68d3cb17cd36afa834e0f1aa HTTP/1.0" 202 Accepted 2025-09-26 11:28:10,744 - lava_callback - INFO - Starting async job submit for node 68d3cb17cd36afa834e0f1aa 2025-09-26 11:28:11,301 - lava_callback - INFO - Received callback for node 68d3d5bbcd36afa834e1093a INFO: 172.20.0.1:35098 - "POST /node/68d3d5bbcd36afa834e1093a HTTP/1.0" 202 Accepted 2025-09-26 11:28:11,330 - lava_callback - INFO - Starting async job submit for node 68d3d5bbcd36afa834e1093a 2025-09-26 11:28:11,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:28:11,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d5bbcd36afa834e1093a HTTP/1.1" 200 None 2025-09-26 11:28:11,461 - lava_callback - DEBUG - Processing node 68d3d5bbcd36afa834e1093a: ltp-timers 2025-09-26 11:28:11,461 - lava_callback - ERROR - Error processing callback for node 68d3d5bbcd36afa834e1093a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:28:12,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:28:12,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3cb17cd36afa834e0f1aa HTTP/1.1" 200 None 2025-09-26 11:28:12,067 - lava_callback - DEBUG - Processing node 68d3cb17cd36afa834e0f1aa: ltp-syscalls 2025-09-26 11:28:12,123 - lava_callback - INFO - Received callback for node 68d3d5bfcd36afa834e1093d INFO: 172.20.0.1:35114 - "POST /node/68d3d5bfcd36afa834e1093d HTTP/1.0" 202 Accepted 2025-09-26 11:28:12,139 - lava_callback - INFO - Starting async job submit for node 68d3d5bfcd36afa834e1093d 2025-09-26 11:28:12,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:28:12,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d5bfcd36afa834e1093d HTTP/1.1" 200 None 2025-09-26 11:28:12,235 - lava_callback - DEBUG - Processing node 68d3d5bfcd36afa834e1093d: ltp-watchqueue 2025-09-26 11:28:12,236 - lava_callback - ERROR - Error processing callback for node 68d3d5bfcd36afa834e1093d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:28:12,977 - lava_callback - INFO - Received callback for node 68d3d5c0cd36afa834e10940 INFO: 172.20.0.1:35116 - "POST /node/68d3d5c0cd36afa834e10940 HTTP/1.0" 202 Accepted 2025-09-26 11:28:13,001 - lava_callback - INFO - Starting async job submit for node 68d3d5c0cd36afa834e10940 2025-09-26 11:28:13,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:28:13,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d5c0cd36afa834e10940 HTTP/1.1" 200 None 2025-09-26 11:28:13,098 - lava_callback - DEBUG - Processing node 68d3d5c0cd36afa834e10940: baseline-arm-broonie 2025-09-26 11:28:13,098 - lava_callback - ERROR - Error processing callback for node 68d3d5c0cd36afa834e10940: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:28:13,820 - lava_callback - INFO - Received callback for node 68d3d5c3cd36afa834e10943 INFO: 172.20.0.1:35124 - "POST /node/68d3d5c3cd36afa834e10943 HTTP/1.0" 202 Accepted 2025-09-26 11:28:13,831 - lava_callback - INFO - Starting async job submit for node 68d3d5c3cd36afa834e10943 2025-09-26 11:28:13,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:28:13,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d5c3cd36afa834e10943 HTTP/1.1" 200 None 2025-09-26 11:28:13,920 - lava_callback - DEBUG - Processing node 68d3d5c3cd36afa834e10943: ltp-syscalls-ipc 2025-09-26 11:28:13,920 - lava_callback - ERROR - Error processing callback for node 68d3d5c3cd36afa834e10943: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:28:14,595 - lava_callback - INFO - Received callback for node 68d3d5c4cd36afa834e10946 INFO: 172.20.0.1:35134 - "POST /node/68d3d5c4cd36afa834e10946 HTTP/1.0" 202 Accepted 2025-09-26 11:28:14,611 - lava_callback - INFO - Starting async job submit for node 68d3d5c4cd36afa834e10946 2025-09-26 11:28:14,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:28:14,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d5c4cd36afa834e10946 HTTP/1.1" 200 None 2025-09-26 11:28:14,826 - lava_callback - DEBUG - Processing node 68d3d5c4cd36afa834e10946: baseline-arm-broonie 2025-09-26 11:28:14,826 - lava_callback - ERROR - Error processing callback for node 68d3d5c4cd36afa834e10946: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:35138 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 11:28:15,432 - lava_callback - INFO - Received callback for node 68d3d5cbcd36afa834e10965 INFO: 172.20.0.1:35152 - "POST /node/68d3d5cbcd36afa834e10965 HTTP/1.0" 202 Accepted 2025-09-26 11:28:15,449 - lava_callback - INFO - Starting async job submit for node 68d3d5cbcd36afa834e10965 2025-09-26 11:28:15,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:28:15,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d5cbcd36afa834e10965 HTTP/1.1" 200 None 2025-09-26 11:28:15,700 - lava_callback - DEBUG - Processing node 68d3d5cbcd36afa834e10965: ltp-watchqueue 2025-09-26 11:28:15,700 - lava_callback - ERROR - Error processing callback for node 68d3d5cbcd36afa834e10965: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:35154 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:28:18,885 - lava_callback - ERROR - Error processing callback for node 68d3cb17cd36afa834e0f1aa: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:34530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34538 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:28:31,151 - lava_callback - INFO - Received callback for node 68d3d5cecd36afa834e10968 INFO: 172.20.0.1:42660 - "POST /node/68d3d5cecd36afa834e10968 HTTP/1.0" 202 Accepted 2025-09-26 11:28:31,157 - lava_callback - INFO - Starting async job submit for node 68d3d5cecd36afa834e10968 2025-09-26 11:28:31,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:28:31,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d5cecd36afa834e10968 HTTP/1.1" 200 None 2025-09-26 11:28:31,170 - lava_callback - DEBUG - Processing node 68d3d5cecd36afa834e10968: ltp-timers 2025-09-26 11:28:31,170 - lava_callback - ERROR - Error processing callback for node 68d3d5cecd36afa834e10968: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:28:31,909 - lava_callback - INFO - Received callback for node 68d3d5d5cd36afa834e10971 INFO: 172.20.0.1:42662 - "POST /node/68d3d5d5cd36afa834e10971 HTTP/1.0" 202 Accepted 2025-09-26 11:28:31,915 - lava_callback - INFO - Starting async job submit for node 68d3d5d5cd36afa834e10971 2025-09-26 11:28:31,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:28:31,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d5d5cd36afa834e10971 HTTP/1.1" 200 None 2025-09-26 11:28:31,929 - lava_callback - DEBUG - Processing node 68d3d5d5cd36afa834e10971: ltp-watchqueue 2025-09-26 11:28:31,929 - lava_callback - ERROR - Error processing callback for node 68d3d5d5cd36afa834e10971: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:28:32,701 - lava_callback - INFO - Received callback for node 68d3d5d7cd36afa834e10974 INFO: 172.20.0.1:42664 - "POST /node/68d3d5d7cd36afa834e10974 HTTP/1.0" 202 Accepted 2025-09-26 11:28:32,710 - lava_callback - INFO - Starting async job submit for node 68d3d5d7cd36afa834e10974 2025-09-26 11:28:32,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:28:32,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d5d7cd36afa834e10974 HTTP/1.1" 200 None 2025-09-26 11:28:32,726 - lava_callback - DEBUG - Processing node 68d3d5d7cd36afa834e10974: ltp-containers 2025-09-26 11:28:32,726 - lava_callback - ERROR - Error processing callback for node 68d3d5d7cd36afa834e10974: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:28:33,510 - lava_callback - INFO - Received callback for node 68d3d5dbcd36afa834e1097a INFO: 172.20.0.1:42670 - "POST /node/68d3d5dbcd36afa834e1097a HTTP/1.0" 202 Accepted 2025-09-26 11:28:33,516 - lava_callback - INFO - Starting async job submit for node 68d3d5dbcd36afa834e1097a 2025-09-26 11:28:33,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:28:33,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d5dbcd36afa834e1097a HTTP/1.1" 200 None 2025-09-26 11:28:33,536 - lava_callback - DEBUG - Processing node 68d3d5dbcd36afa834e1097a: ltp-cve 2025-09-26 11:28:33,536 - lava_callback - ERROR - Error processing callback for node 68d3d5dbcd36afa834e1097a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:42684 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:28:39,845 - lava_callback - INFO - Received callback for node 68d3daaacd36afa834e116e4 INFO: 172.20.0.1:55382 - "POST /node/68d3daaacd36afa834e116e4 HTTP/1.0" 202 Accepted 2025-09-26 11:28:39,851 - lava_callback - INFO - Starting async job submit for node 68d3daaacd36afa834e116e4 2025-09-26 11:28:39,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:28:39,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3daaacd36afa834e116e4 HTTP/1.1" 200 None 2025-09-26 11:28:39,889 - lava_callback - DEBUG - Processing node 68d3daaacd36afa834e116e4: baseline-arm64 2025-09-26 11:28:40,177 - lava_callback - ERROR - Error processing callback for node 68d3daaacd36afa834e116e4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:28:41,039 - lava_callback - INFO - Received callback for node 68d3dab1cd36afa834e116f2 INFO: 172.20.0.1:55398 - "POST /node/68d3dab1cd36afa834e116f2 HTTP/1.0" 202 Accepted 2025-09-26 11:28:41,048 - lava_callback - INFO - Starting async job submit for node 68d3dab1cd36afa834e116f2 2025-09-26 11:28:41,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:28:41,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dab1cd36afa834e116f2 HTTP/1.1" 200 None 2025-09-26 11:28:41,103 - lava_callback - DEBUG - Processing node 68d3dab1cd36afa834e116f2: baseline-arm64 2025-09-26 11:28:41,401 - lava_callback - ERROR - Error processing callback for node 68d3dab1cd36afa834e116f2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:55400 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:28:51,304 - lava_callback - INFO - Received callback for node 68d3d5e4cd36afa834e10986 INFO: 172.20.0.1:41846 - "POST /node/68d3d5e4cd36afa834e10986 HTTP/1.0" 202 Accepted 2025-09-26 11:28:51,310 - lava_callback - INFO - Starting async job submit for node 68d3d5e4cd36afa834e10986 2025-09-26 11:28:51,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:28:51,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d5e4cd36afa834e10986 HTTP/1.1" 200 None 2025-09-26 11:28:51,324 - lava_callback - DEBUG - Processing node 68d3d5e4cd36afa834e10986: ltp-controllers 2025-09-26 11:28:51,325 - lava_callback - ERROR - Error processing callback for node 68d3d5e4cd36afa834e10986: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:28:52,089 - lava_callback - INFO - Received callback for node 68d3d5edcd36afa834e10992 INFO: 172.20.0.1:41854 - "POST /node/68d3d5edcd36afa834e10992 HTTP/1.0" 202 Accepted 2025-09-26 11:28:52,095 - lava_callback - INFO - Starting async job submit for node 68d3d5edcd36afa834e10992 2025-09-26 11:28:52,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:28:52,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d5edcd36afa834e10992 HTTP/1.1" 200 None 2025-09-26 11:28:52,111 - lava_callback - DEBUG - Processing node 68d3d5edcd36afa834e10992: ltp-controllers 2025-09-26 11:28:52,111 - lava_callback - ERROR - Error processing callback for node 68d3d5edcd36afa834e10992: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:41856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36428 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:29:09,709 - lava_callback - INFO - Received callback for node 68d3d4a5cd36afa834e10732 INFO: 172.20.0.1:36130 - "POST /node/68d3d4a5cd36afa834e10732 HTTP/1.0" 202 Accepted 2025-09-26 11:29:09,717 - lava_callback - INFO - Starting async job submit for node 68d3d4a5cd36afa834e10732 2025-09-26 11:29:09,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:29:09,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d4a5cd36afa834e10732 HTTP/1.1" 200 None 2025-09-26 11:29:09,828 - lava_callback - DEBUG - Processing node 68d3d4a5cd36afa834e10732: ltp-containers 2025-09-26 11:29:10,631 - lava_callback - ERROR - Error processing callback for node 68d3d4a5cd36afa834e10732: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:29:11,189 - lava_callback - INFO - Received callback for node 68d3d5f4cd36afa834e1099b INFO: 172.20.0.1:36142 - "POST /node/68d3d5f4cd36afa834e1099b HTTP/1.0" 202 Accepted 2025-09-26 11:29:11,194 - lava_callback - INFO - Starting async job submit for node 68d3d5f4cd36afa834e1099b 2025-09-26 11:29:11,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:29:11,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d5f4cd36afa834e1099b HTTP/1.1" 200 None 2025-09-26 11:29:11,221 - lava_callback - DEBUG - Processing node 68d3d5f4cd36afa834e1099b: ltp-cve 2025-09-26 11:29:11,221 - lava_callback - ERROR - Error processing callback for node 68d3d5f4cd36afa834e1099b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:29:11,981 - lava_callback - INFO - Received callback for node 68d3d5f6cd36afa834e1099e INFO: 172.20.0.1:36144 - "POST /node/68d3d5f6cd36afa834e1099e HTTP/1.0" 202 Accepted 2025-09-26 11:29:11,986 - lava_callback - INFO - Starting async job submit for node 68d3d5f6cd36afa834e1099e 2025-09-26 11:29:11,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:29:12,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d5f6cd36afa834e1099e HTTP/1.1" 200 None 2025-09-26 11:29:12,002 - lava_callback - DEBUG - Processing node 68d3d5f6cd36afa834e1099e: baseline-arm-broonie 2025-09-26 11:29:12,002 - lava_callback - ERROR - Error processing callback for node 68d3d5f6cd36afa834e1099e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:29:12,801 - lava_callback - INFO - Received callback for node 68d3d5fdcd36afa834e109a7 INFO: 172.20.0.1:36148 - "POST /node/68d3d5fdcd36afa834e109a7 HTTP/1.0" 202 Accepted 2025-09-26 11:29:12,811 - lava_callback - INFO - Starting async job submit for node 68d3d5fdcd36afa834e109a7 2025-09-26 11:29:12,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:29:12,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d5fdcd36afa834e109a7 HTTP/1.1" 200 None 2025-09-26 11:29:12,824 - lava_callback - DEBUG - Processing node 68d3d5fdcd36afa834e109a7: ltp-cve 2025-09-26 11:29:12,824 - lava_callback - ERROR - Error processing callback for node 68d3d5fdcd36afa834e109a7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:29:13,591 - lava_callback - INFO - Received callback for node 68d3d602cd36afa834e109ad INFO: 172.20.0.1:36152 - "POST /node/68d3d602cd36afa834e109ad HTTP/1.0" 202 Accepted 2025-09-26 11:29:13,598 - lava_callback - INFO - Starting async job submit for node 68d3d602cd36afa834e109ad 2025-09-26 11:29:13,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:29:13,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d602cd36afa834e109ad HTTP/1.1" 200 None 2025-09-26 11:29:13,612 - lava_callback - DEBUG - Processing node 68d3d602cd36afa834e109ad: baseline-arm-broonie 2025-09-26 11:29:13,612 - lava_callback - ERROR - Error processing callback for node 68d3d602cd36afa834e109ad: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:29:14,363 - lava_callback - INFO - Received callback for node 68d3d604cd36afa834e109b2 INFO: 172.20.0.1:36154 - "POST /node/68d3d604cd36afa834e109b2 HTTP/1.0" 202 Accepted 2025-09-26 11:29:14,369 - lava_callback - INFO - Starting async job submit for node 68d3d604cd36afa834e109b2 2025-09-26 11:29:14,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:29:14,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d604cd36afa834e109b2 HTTP/1.1" 200 None 2025-09-26 11:29:14,382 - lava_callback - DEBUG - Processing node 68d3d604cd36afa834e109b2: baseline-arm-broonie 2025-09-26 11:29:14,382 - lava_callback - ERROR - Error processing callback for node 68d3d604cd36afa834e109b2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:36166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42604 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:29:22,762 - lava_callback - INFO - Received callback for node 68d4168acd36afa834e1873c INFO: 172.20.0.1:42620 - "POST /node/68d4168acd36afa834e1873c HTTP/1.0" 202 Accepted 2025-09-26 11:29:22,768 - lava_callback - INFO - Starting async job submit for node 68d4168acd36afa834e1873c 2025-09-26 11:29:22,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:29:22,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4168acd36afa834e1873c HTTP/1.1" 200 None 2025-09-26 11:29:22,804 - lava_callback - DEBUG - Processing node 68d4168acd36afa834e1873c: baseline-arm 2025-09-26 11:29:23,027 - lava_callback - ERROR - Error processing callback for node 68d4168acd36afa834e1873c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:42628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35828 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:29:49,570 - lava_callback - INFO - Received callback for node 68d3d5eecd36afa834e10995 INFO: 172.20.0.1:55186 - "POST /node/68d3d5eecd36afa834e10995 HTTP/1.0" 202 Accepted 2025-09-26 11:29:49,580 - lava_callback - INFO - Starting async job submit for node 68d3d5eecd36afa834e10995 2025-09-26 11:29:49,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:29:49,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d5eecd36afa834e10995 HTTP/1.1" 200 None 2025-09-26 11:29:49,632 - lava_callback - DEBUG - Processing node 68d3d5eecd36afa834e10995: baseline-arm-broonie 2025-09-26 11:29:49,942 - lava_callback - ERROR - Error processing callback for node 68d3d5eecd36afa834e10995: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:29:56,527 - lava_callback - INFO - Received callback for node 68d3d679cd36afa834e10a74 INFO: 172.20.0.1:55192 - "POST /node/68d3d679cd36afa834e10a74 HTTP/1.0" 202 Accepted 2025-09-26 11:29:56,539 - lava_callback - INFO - Starting async job submit for node 68d3d679cd36afa834e10a74 INFO: 172.20.0.1:55198 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:29:56,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:29:56,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d679cd36afa834e10a74 HTTP/1.1" 200 None 2025-09-26 11:29:56,619 - lava_callback - DEBUG - Processing node 68d3d679cd36afa834e10a74: baseline-arm64 2025-09-26 11:29:57,604 - lava_callback - ERROR - Error processing callback for node 68d3d679cd36afa834e10a74: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:30:04,178 - lava_callback - INFO - Received callback for node 68d3d678cd36afa834e10a71 INFO: 172.20.0.1:54506 - "POST /node/68d3d678cd36afa834e10a71 HTTP/1.0" 202 Accepted 2025-09-26 11:30:04,190 - lava_callback - INFO - Starting async job submit for node 68d3d678cd36afa834e10a71 2025-09-26 11:30:04,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:30:04,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d678cd36afa834e10a71 HTTP/1.1" 200 None 2025-09-26 11:30:04,272 - lava_callback - DEBUG - Processing node 68d3d678cd36afa834e10a71: baseline-arm64 2025-09-26 11:30:05,456 - lava_callback - ERROR - Error processing callback for node 68d3d678cd36afa834e10a71: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:54518 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:30:10,937 - lava_callback - INFO - Received callback for node 68d3dabbcd36afa834e116fb INFO: 172.20.0.1:48902 - "POST /node/68d3dabbcd36afa834e116fb HTTP/1.0" 202 Accepted 2025-09-26 11:30:10,944 - lava_callback - INFO - Starting async job submit for node 68d3dabbcd36afa834e116fb 2025-09-26 11:30:10,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:30:10,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dabbcd36afa834e116fb HTTP/1.1" 200 None 2025-09-26 11:30:10,987 - lava_callback - DEBUG - Processing node 68d3dabbcd36afa834e116fb: baseline-arm64 2025-09-26 11:30:11,102 - lava_callback - INFO - Received callback for node 68d3d63acd36afa834e10a08 INFO: 172.20.0.1:48908 - "POST /node/68d3d63acd36afa834e10a08 HTTP/1.0" 202 Accepted 2025-09-26 11:30:11,112 - lava_callback - INFO - Starting async job submit for node 68d3d63acd36afa834e10a08 2025-09-26 11:30:11,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:30:11,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d63acd36afa834e10a08 HTTP/1.1" 200 None 2025-09-26 11:30:11,214 - lava_callback - DEBUG - Processing node 68d3d63acd36afa834e10a08: baseline-arm-broonie 2025-09-26 11:30:11,219 - lava_callback - ERROR - Error processing callback for node 68d3d63acd36afa834e10a08: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:30:11,337 - lava_callback - ERROR - Error processing callback for node 68d3dabbcd36afa834e116fb: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:30:12,234 - lava_callback - INFO - Received callback for node 68d3dab3cd36afa834e116f5 INFO: 172.20.0.1:48922 - "POST /node/68d3dab3cd36afa834e116f5 HTTP/1.0" 202 Accepted 2025-09-26 11:30:12,243 - lava_callback - INFO - Starting async job submit for node 68d3dab3cd36afa834e116f5 2025-09-26 11:30:12,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:30:12,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dab3cd36afa834e116f5 HTTP/1.1" 200 None 2025-09-26 11:30:12,299 - lava_callback - DEBUG - Processing node 68d3dab3cd36afa834e116f5: baseline-arm64 2025-09-26 11:30:12,743 - lava_callback - ERROR - Error processing callback for node 68d3dab3cd36afa834e116f5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:48936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48466 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:30:31,281 - lava_callback - INFO - Received callback for node 68d3d64ccd36afa834e10a38 INFO: 172.20.0.1:52698 - "POST /node/68d3d64ccd36afa834e10a38 HTTP/1.0" 202 Accepted 2025-09-26 11:30:31,287 - lava_callback - INFO - Starting async job submit for node 68d3d64ccd36afa834e10a38 2025-09-26 11:30:31,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:30:31,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d64ccd36afa834e10a38 HTTP/1.1" 200 None 2025-09-26 11:30:31,302 - lava_callback - DEBUG - Processing node 68d3d64ccd36afa834e10a38: baseline-arm-broonie 2025-09-26 11:30:31,302 - lava_callback - ERROR - Error processing callback for node 68d3d64ccd36afa834e10a38: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:30:32,057 - lava_callback - INFO - Received callback for node 68d3d650cd36afa834e10a3b INFO: 172.20.0.1:52710 - "POST /node/68d3d650cd36afa834e10a3b HTTP/1.0" 202 Accepted 2025-09-26 11:30:32,063 - lava_callback - INFO - Starting async job submit for node 68d3d650cd36afa834e10a3b 2025-09-26 11:30:32,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:30:32,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d650cd36afa834e10a3b HTTP/1.1" 200 None 2025-09-26 11:30:32,079 - lava_callback - DEBUG - Processing node 68d3d650cd36afa834e10a3b: ltp-fs-bind 2025-09-26 11:30:32,079 - lava_callback - ERROR - Error processing callback for node 68d3d650cd36afa834e10a3b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:52718 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:30:45,611 - lava_callback - INFO - Received callback for node 68d6743b2f83206171a91054 INFO: 172.20.0.1:37842 - "POST /node/68d6743b2f83206171a91054 HTTP/1.0" 202 Accepted 2025-09-26 11:30:45,618 - lava_callback - INFO - Starting async job submit for node 68d6743b2f83206171a91054 2025-09-26 11:30:45,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:30:45,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6743b2f83206171a91054 HTTP/1.1" 200 None 2025-09-26 11:30:45,672 - lava_callback - DEBUG - Processing node 68d6743b2f83206171a91054: baseline-arm64 INFO: 172.20.0.1:37856 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:30:46,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:30:48,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:30:48,631 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6743b2f83206171a91054/log.txt.gz 2025-09-26 11:30:48,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 11:30:50,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 11:30:50,932 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6743b2f83206171a91054/lava_callback.json.gz DEBUG: Setup failed for 68d6743b2f83206171a91054. Transitting job node result: incomplete -> fail 2025-09-26 11:30:51,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:30:51,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6743b2f83206171a91054 HTTP/1.1" 200 None 2025-09-26 11:30:51,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:30:51,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d56c282be2da4660698f77 HTTP/1.1" 200 None 2025-09-26 11:30:51,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:30:51,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6743b2f83206171a91054 HTTP/1.1" 200 None 2025-09-26 11:30:51,080 - lava_callback - INFO - Completed processing callback for node 68d6743b2f83206171a91054 2025-09-26 11:30:51,360 - lava_callback - INFO - Received callback for node 68d3d65fcd36afa834e10a50 INFO: 172.20.0.1:47964 - "POST /node/68d3d65fcd36afa834e10a50 HTTP/1.0" 202 Accepted 2025-09-26 11:30:51,367 - lava_callback - INFO - Starting async job submit for node 68d3d65fcd36afa834e10a50 2025-09-26 11:30:51,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:30:51,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d65fcd36afa834e10a50 HTTP/1.1" 200 None 2025-09-26 11:30:51,401 - lava_callback - DEBUG - Processing node 68d3d65fcd36afa834e10a50: ltp-fsx 2025-09-26 11:30:51,401 - lava_callback - ERROR - Error processing callback for node 68d3d65fcd36afa834e10a50: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:30:52,124 - lava_callback - INFO - Received callback for node 68d3d667cd36afa834e10a5a INFO: 172.20.0.1:47974 - "POST /node/68d3d667cd36afa834e10a5a HTTP/1.0" 202 Accepted 2025-09-26 11:30:52,133 - lava_callback - INFO - Starting async job submit for node 68d3d667cd36afa834e10a5a 2025-09-26 11:30:52,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:30:52,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d667cd36afa834e10a5a HTTP/1.1" 200 None 2025-09-26 11:30:52,150 - lava_callback - DEBUG - Processing node 68d3d667cd36afa834e10a5a: ltp-fs-bind 2025-09-26 11:30:52,150 - lava_callback - ERROR - Error processing callback for node 68d3d667cd36afa834e10a5a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:30:52,877 - lava_callback - INFO - Received callback for node 68d3d668cd36afa834e10a5f INFO: 172.20.0.1:47990 - "POST /node/68d3d668cd36afa834e10a5f HTTP/1.0" 202 Accepted 2025-09-26 11:30:52,883 - lava_callback - INFO - Starting async job submit for node 68d3d668cd36afa834e10a5f 2025-09-26 11:30:52,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:30:52,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d668cd36afa834e10a5f HTTP/1.1" 200 None 2025-09-26 11:30:52,898 - lava_callback - DEBUG - Processing node 68d3d668cd36afa834e10a5f: ltp-fs-bind 2025-09-26 11:30:52,898 - lava_callback - ERROR - Error processing callback for node 68d3d668cd36afa834e10a5f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:48002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56210 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:31:11,275 - lava_callback - INFO - Received callback for node 68d3d66bcd36afa834e10a62 INFO: 172.20.0.1:49876 - "POST /node/68d3d66bcd36afa834e10a62 HTTP/1.0" 202 Accepted 2025-09-26 11:31:11,280 - lava_callback - INFO - Starting async job submit for node 68d3d66bcd36afa834e10a62 2025-09-26 11:31:11,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:31:11,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d66bcd36afa834e10a62 HTTP/1.1" 200 None 2025-09-26 11:31:11,294 - lava_callback - DEBUG - Processing node 68d3d66bcd36afa834e10a62: ltp-cap-bounds 2025-09-26 11:31:11,294 - lava_callback - ERROR - Error processing callback for node 68d3d66bcd36afa834e10a62: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:31:12,034 - lava_callback - INFO - Received callback for node 68d3d66ecd36afa834e10a65 INFO: 172.20.0.1:49882 - "POST /node/68d3d66ecd36afa834e10a65 HTTP/1.0" 202 Accepted 2025-09-26 11:31:12,043 - lava_callback - INFO - Starting async job submit for node 68d3d66ecd36afa834e10a65 2025-09-26 11:31:12,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:31:12,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d66ecd36afa834e10a65 HTTP/1.1" 200 None 2025-09-26 11:31:12,057 - lava_callback - DEBUG - Processing node 68d3d66ecd36afa834e10a65: ltp-input 2025-09-26 11:31:12,057 - lava_callback - ERROR - Error processing callback for node 68d3d66ecd36afa834e10a65: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:31:12,814 - lava_callback - INFO - Received callback for node 68d3d670cd36afa834e10a68 INFO: 172.20.0.1:49886 - "POST /node/68d3d670cd36afa834e10a68 HTTP/1.0" 202 Accepted 2025-09-26 11:31:12,820 - lava_callback - INFO - Starting async job submit for node 68d3d670cd36afa834e10a68 2025-09-26 11:31:12,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:31:12,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d670cd36afa834e10a68 HTTP/1.1" 200 None 2025-09-26 11:31:12,835 - lava_callback - DEBUG - Processing node 68d3d670cd36afa834e10a68: ltp-cap-bounds 2025-09-26 11:31:12,835 - lava_callback - ERROR - Error processing callback for node 68d3d670cd36afa834e10a68: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:31:13,593 - lava_callback - INFO - Received callback for node 68d3d674cd36afa834e10a6b INFO: 172.20.0.1:49902 - "POST /node/68d3d674cd36afa834e10a6b HTTP/1.0" 202 Accepted 2025-09-26 11:31:13,599 - lava_callback - INFO - Starting async job submit for node 68d3d674cd36afa834e10a6b 2025-09-26 11:31:13,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:31:13,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d674cd36afa834e10a6b HTTP/1.1" 200 None 2025-09-26 11:31:13,617 - lava_callback - DEBUG - Processing node 68d3d674cd36afa834e10a6b: ltp-fsx 2025-09-26 11:31:13,617 - lava_callback - ERROR - Error processing callback for node 68d3d674cd36afa834e10a6b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:31:14,342 - lava_callback - INFO - Received callback for node 68d3d676cd36afa834e10a6e INFO: 172.20.0.1:49910 - "POST /node/68d3d676cd36afa834e10a6e HTTP/1.0" 202 Accepted 2025-09-26 11:31:14,349 - lava_callback - INFO - Starting async job submit for node 68d3d676cd36afa834e10a6e 2025-09-26 11:31:14,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:31:14,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d676cd36afa834e10a6e HTTP/1.1" 200 None 2025-09-26 11:31:14,365 - lava_callback - DEBUG - Processing node 68d3d676cd36afa834e10a6e: ltp-containers 2025-09-26 11:31:14,365 - lava_callback - ERROR - Error processing callback for node 68d3d676cd36afa834e10a6e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:31:14,434 - lava_callback - INFO - Received callback for node 68d3d626cd36afa834e109f6 INFO: 172.20.0.1:49920 - "POST /node/68d3d626cd36afa834e109f6 HTTP/1.0" 202 Accepted 2025-09-26 11:31:14,443 - lava_callback - INFO - Starting async job submit for node 68d3d626cd36afa834e109f6 2025-09-26 11:31:14,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:31:14,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d626cd36afa834e109f6 HTTP/1.1" 200 None 2025-09-26 11:31:14,480 - lava_callback - DEBUG - Processing node 68d3d626cd36afa834e109f6: baseline-arm-broonie 2025-09-26 11:31:14,698 - lava_callback - ERROR - Error processing callback for node 68d3d626cd36afa834e109f6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:31:15,084 - lava_callback - INFO - Received callback for node 68d3d680cd36afa834e10a7a INFO: 172.20.0.1:49922 - "POST /node/68d3d680cd36afa834e10a7a HTTP/1.0" 202 Accepted 2025-09-26 11:31:15,093 - lava_callback - INFO - Starting async job submit for node 68d3d680cd36afa834e10a7a 2025-09-26 11:31:15,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:31:15,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d680cd36afa834e10a7a HTTP/1.1" 200 None 2025-09-26 11:31:15,108 - lava_callback - DEBUG - Processing node 68d3d680cd36afa834e10a7a: ltp-fsx 2025-09-26 11:31:15,108 - lava_callback - ERROR - Error processing callback for node 68d3d680cd36afa834e10a7a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:49928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49932 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:31:19,122 - lava_callback - INFO - Received callback for node 68d3dacbcd36afa834e11710 INFO: 172.20.0.1:49944 - "POST /node/68d3dacbcd36afa834e11710 HTTP/1.0" 202 Accepted 2025-09-26 11:31:19,128 - lava_callback - INFO - Starting async job submit for node 68d3dacbcd36afa834e11710 2025-09-26 11:31:19,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:31:19,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dacbcd36afa834e11710 HTTP/1.1" 200 None 2025-09-26 11:31:19,162 - lava_callback - DEBUG - Processing node 68d3dacbcd36afa834e11710: baseline-arm64 2025-09-26 11:31:19,495 - lava_callback - ERROR - Error processing callback for node 68d3dacbcd36afa834e11710: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:42162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42170 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:31:29,511 - lava_callback - INFO - Received callback for node 68d3d633cd36afa834e10a02 INFO: 172.20.0.1:55442 - "POST /node/68d3d633cd36afa834e10a02 HTTP/1.0" 202 Accepted 2025-09-26 11:31:29,517 - lava_callback - INFO - Starting async job submit for node 68d3d633cd36afa834e10a02 2025-09-26 11:31:29,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:31:29,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d633cd36afa834e10a02 HTTP/1.1" 200 None 2025-09-26 11:31:29,573 - lava_callback - DEBUG - Processing node 68d3d633cd36afa834e10a02: baseline-arm-broonie 2025-09-26 11:31:29,783 - lava_callback - ERROR - Error processing callback for node 68d3d633cd36afa834e10a02: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:31:31,458 - lava_callback - INFO - Received callback for node 68d3d688cd36afa834e10a98 INFO: 172.20.0.1:55448 - "POST /node/68d3d688cd36afa834e10a98 HTTP/1.0" 202 Accepted 2025-09-26 11:31:31,467 - lava_callback - INFO - Starting async job submit for node 68d3d688cd36afa834e10a98 2025-09-26 11:31:31,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:31:31,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d688cd36afa834e10a98 HTTP/1.1" 200 None 2025-09-26 11:31:31,490 - lava_callback - DEBUG - Processing node 68d3d688cd36afa834e10a98: ltp-controllers 2025-09-26 11:31:31,490 - lava_callback - ERROR - Error processing callback for node 68d3d688cd36afa834e10a98: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:31:32,256 - lava_callback - INFO - Received callback for node 68d3d691cd36afa834e10aa1 INFO: 172.20.0.1:55452 - "POST /node/68d3d691cd36afa834e10aa1 HTTP/1.0" 202 Accepted 2025-09-26 11:31:32,265 - lava_callback - INFO - Starting async job submit for node 68d3d691cd36afa834e10aa1 2025-09-26 11:31:32,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:31:32,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d691cd36afa834e10aa1 HTTP/1.1" 200 None 2025-09-26 11:31:32,281 - lava_callback - DEBUG - Processing node 68d3d691cd36afa834e10aa1: ltp-controllers 2025-09-26 11:31:32,281 - lava_callback - ERROR - Error processing callback for node 68d3d691cd36afa834e10aa1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:31:33,211 - lava_callback - INFO - Received callback for node 68d3dabfcd36afa834e11701 INFO: 172.20.0.1:55464 - "POST /node/68d3dabfcd36afa834e11701 HTTP/1.0" 202 Accepted 2025-09-26 11:31:33,217 - lava_callback - INFO - Starting async job submit for node 68d3dabfcd36afa834e11701 2025-09-26 11:31:33,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:31:33,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dabfcd36afa834e11701 HTTP/1.1" 200 None 2025-09-26 11:31:33,265 - lava_callback - DEBUG - Processing node 68d3dabfcd36afa834e11701: baseline-arm64 2025-09-26 11:31:33,554 - lava_callback - ERROR - Error processing callback for node 68d3dabfcd36afa834e11701: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:55470 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:31:40,278 - lava_callback - INFO - Received callback for node 68d3dac1cd36afa834e11704 INFO: 172.20.0.1:41380 - "POST /node/68d3dac1cd36afa834e11704 HTTP/1.0" 202 Accepted 2025-09-26 11:31:40,284 - lava_callback - INFO - Starting async job submit for node 68d3dac1cd36afa834e11704 2025-09-26 11:31:40,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:31:40,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dac1cd36afa834e11704 HTTP/1.1" 200 None 2025-09-26 11:31:40,317 - lava_callback - DEBUG - Processing node 68d3dac1cd36afa834e11704: baseline-arm64 2025-09-26 11:31:40,620 - lava_callback - ERROR - Error processing callback for node 68d3dac1cd36afa834e11704: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:31:41,547 - lava_callback - INFO - Received callback for node 68d3dabccd36afa834e116fe INFO: 172.20.0.1:41388 - "POST /node/68d3dabccd36afa834e116fe HTTP/1.0" 202 Accepted 2025-09-26 11:31:41,553 - lava_callback - INFO - Starting async job submit for node 68d3dabccd36afa834e116fe 2025-09-26 11:31:41,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:31:41,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dabccd36afa834e116fe HTTP/1.1" 200 None 2025-09-26 11:31:41,607 - lava_callback - DEBUG - Processing node 68d3dabccd36afa834e116fe: baseline-arm64 2025-09-26 11:31:41,903 - lava_callback - ERROR - Error processing callback for node 68d3dabccd36afa834e116fe: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:41404 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:31:51,356 - lava_callback - INFO - Received callback for node 68d3d697cd36afa834e10aa7 INFO: 172.20.0.1:39454 - "POST /node/68d3d697cd36afa834e10aa7 HTTP/1.0" 202 Accepted 2025-09-26 11:31:51,362 - lava_callback - INFO - Starting async job submit for node 68d3d697cd36afa834e10aa7 2025-09-26 11:31:51,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:31:51,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d697cd36afa834e10aa7 HTTP/1.1" 200 None 2025-09-26 11:31:51,377 - lava_callback - DEBUG - Processing node 68d3d697cd36afa834e10aa7: ltp-cve 2025-09-26 11:31:51,377 - lava_callback - ERROR - Error processing callback for node 68d3d697cd36afa834e10aa7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:31:52,111 - lava_callback - INFO - Received callback for node 68d3d69ecd36afa834e10aad INFO: 172.20.0.1:39460 - "POST /node/68d3d69ecd36afa834e10aad HTTP/1.0" 202 Accepted 2025-09-26 11:31:52,117 - lava_callback - INFO - Starting async job submit for node 68d3d69ecd36afa834e10aad 2025-09-26 11:31:52,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:31:52,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d69ecd36afa834e10aad HTTP/1.1" 200 None 2025-09-26 11:31:52,131 - lava_callback - DEBUG - Processing node 68d3d69ecd36afa834e10aad: ltp-cve 2025-09-26 11:31:52,131 - lava_callback - ERROR - Error processing callback for node 68d3d69ecd36afa834e10aad: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:31:52,909 - lava_callback - INFO - Received callback for node 68d3d6a1cd36afa834e10ab0 INFO: 172.20.0.1:39474 - "POST /node/68d3d6a1cd36afa834e10ab0 HTTP/1.0" 202 Accepted 2025-09-26 11:31:52,915 - lava_callback - INFO - Starting async job submit for node 68d3d6a1cd36afa834e10ab0 2025-09-26 11:31:52,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:31:52,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d6a1cd36afa834e10ab0 HTTP/1.1" 200 None 2025-09-26 11:31:52,939 - lava_callback - DEBUG - Processing node 68d3d6a1cd36afa834e10ab0: ltp-ipc 2025-09-26 11:31:52,939 - lava_callback - ERROR - Error processing callback for node 68d3d6a1cd36afa834e10ab0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:31:53,799 - lava_callback - INFO - Received callback for node 68d3d6a3cd36afa834e10ab3 INFO: 172.20.0.1:39488 - "POST /node/68d3d6a3cd36afa834e10ab3 HTTP/1.0" 202 Accepted 2025-09-26 11:31:53,805 - lava_callback - INFO - Starting async job submit for node 68d3d6a3cd36afa834e10ab3 2025-09-26 11:31:53,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:31:53,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d6a3cd36afa834e10ab3 HTTP/1.1" 200 None 2025-09-26 11:31:53,839 - lava_callback - DEBUG - Processing node 68d3d6a3cd36afa834e10ab3: ltp-cap-bounds 2025-09-26 11:31:53,839 - lava_callback - ERROR - Error processing callback for node 68d3d6a3cd36afa834e10ab3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:39496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43778 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:32:11,368 - lava_callback - INFO - Received callback for node 68d3d6accd36afa834e10abc INFO: 172.20.0.1:34012 - "POST /node/68d3d6accd36afa834e10abc HTTP/1.0" 202 Accepted 2025-09-26 11:32:11,374 - lava_callback - INFO - Starting async job submit for node 68d3d6accd36afa834e10abc 2025-09-26 11:32:11,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:32:11,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d6accd36afa834e10abc HTTP/1.1" 200 None 2025-09-26 11:32:11,409 - lava_callback - DEBUG - Processing node 68d3d6accd36afa834e10abc: ltp-input 2025-09-26 11:32:11,409 - lava_callback - ERROR - Error processing callback for node 68d3d6accd36afa834e10abc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:32:12,106 - lava_callback - INFO - Received callback for node 68d3d6b6cd36afa834e10ac5 INFO: 172.20.0.1:34014 - "POST /node/68d3d6b6cd36afa834e10ac5 HTTP/1.0" 202 Accepted 2025-09-26 11:32:12,112 - lava_callback - INFO - Starting async job submit for node 68d3d6b6cd36afa834e10ac5 2025-09-26 11:32:12,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:32:12,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d6b6cd36afa834e10ac5 HTTP/1.1" 200 None 2025-09-26 11:32:12,127 - lava_callback - DEBUG - Processing node 68d3d6b6cd36afa834e10ac5: ltp-input 2025-09-26 11:32:12,127 - lava_callback - ERROR - Error processing callback for node 68d3d6b6cd36afa834e10ac5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:32:12,894 - lava_callback - INFO - Received callback for node 68d3d6b8cd36afa834e10ac8 INFO: 172.20.0.1:34016 - "POST /node/68d3d6b8cd36afa834e10ac8 HTTP/1.0" 202 Accepted 2025-09-26 11:32:12,901 - lava_callback - INFO - Starting async job submit for node 68d3d6b8cd36afa834e10ac8 2025-09-26 11:32:12,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:32:12,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d6b8cd36afa834e10ac8 HTTP/1.1" 200 None 2025-09-26 11:32:12,915 - lava_callback - DEBUG - Processing node 68d3d6b8cd36afa834e10ac8: ltp-containers 2025-09-26 11:32:12,915 - lava_callback - ERROR - Error processing callback for node 68d3d6b8cd36afa834e10ac8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:34026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41124 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:32:31,362 - lava_callback - INFO - Received callback for node 68d3d6bdcd36afa834e10ace INFO: 172.20.0.1:44838 - "POST /node/68d3d6bdcd36afa834e10ace HTTP/1.0" 202 Accepted 2025-09-26 11:32:31,368 - lava_callback - INFO - Starting async job submit for node 68d3d6bdcd36afa834e10ace 2025-09-26 11:32:31,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:32:31,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d6bdcd36afa834e10ace HTTP/1.1" 200 None 2025-09-26 11:32:31,395 - lava_callback - DEBUG - Processing node 68d3d6bdcd36afa834e10ace: ltp-fs-bind 2025-09-26 11:32:31,395 - lava_callback - ERROR - Error processing callback for node 68d3d6bdcd36afa834e10ace: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:32:32,120 - lava_callback - INFO - Received callback for node 68d3d6c5cd36afa834e10af5 INFO: 172.20.0.1:44854 - "POST /node/68d3d6c5cd36afa834e10af5 HTTP/1.0" 202 Accepted 2025-09-26 11:32:32,126 - lava_callback - INFO - Starting async job submit for node 68d3d6c5cd36afa834e10af5 2025-09-26 11:32:32,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:32:32,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d6c5cd36afa834e10af5 HTTP/1.1" 200 None 2025-09-26 11:32:32,139 - lava_callback - DEBUG - Processing node 68d3d6c5cd36afa834e10af5: ltp-fs-bind 2025-09-26 11:32:32,139 - lava_callback - ERROR - Error processing callback for node 68d3d6c5cd36afa834e10af5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:32:32,892 - lava_callback - INFO - Received callback for node 68d3d6c9cd36afa834e10af8 INFO: 172.20.0.1:44858 - "POST /node/68d3d6c9cd36afa834e10af8 HTTP/1.0" 202 Accepted 2025-09-26 11:32:32,902 - lava_callback - INFO - Starting async job submit for node 68d3d6c9cd36afa834e10af8 2025-09-26 11:32:32,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:32:32,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d6c9cd36afa834e10af8 HTTP/1.1" 200 None 2025-09-26 11:32:32,919 - lava_callback - DEBUG - Processing node 68d3d6c9cd36afa834e10af8: ltp-pty 2025-09-26 11:32:32,919 - lava_callback - ERROR - Error processing callback for node 68d3d6c9cd36afa834e10af8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:32:33,662 - lava_callback - INFO - Received callback for node 68d3d6cccd36afa834e10afb INFO: 172.20.0.1:44860 - "POST /node/68d3d6cccd36afa834e10afb HTTP/1.0" 202 Accepted 2025-09-26 11:32:33,668 - lava_callback - INFO - Starting async job submit for node 68d3d6cccd36afa834e10afb 2025-09-26 11:32:33,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:32:33,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d6cccd36afa834e10afb HTTP/1.1" 200 None 2025-09-26 11:32:33,683 - lava_callback - DEBUG - Processing node 68d3d6cccd36afa834e10afb: ltp-controllers 2025-09-26 11:32:33,683 - lava_callback - ERROR - Error processing callback for node 68d3d6cccd36afa834e10afb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:44868 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:32:40,335 - lava_callback - INFO - Received callback for node 68d3dacccd36afa834e11713 INFO: 172.20.0.1:60474 - "POST /node/68d3dacccd36afa834e11713 HTTP/1.0" 202 Accepted 2025-09-26 11:32:40,341 - lava_callback - INFO - Starting async job submit for node 68d3dacccd36afa834e11713 2025-09-26 11:32:40,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:32:40,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dacccd36afa834e11713 HTTP/1.1" 200 None 2025-09-26 11:32:40,376 - lava_callback - DEBUG - Processing node 68d3dacccd36afa834e11713: baseline-arm64 2025-09-26 11:32:40,702 - lava_callback - ERROR - Error processing callback for node 68d3dacccd36afa834e11713: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:60480 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:32:49,478 - lava_callback - INFO - Received callback for node 68d3d6adcd36afa834e10abf INFO: 172.20.0.1:58426 - "POST /node/68d3d6adcd36afa834e10abf HTTP/1.0" 202 Accepted 2025-09-26 11:32:49,484 - lava_callback - INFO - Starting async job submit for node 68d3d6adcd36afa834e10abf 2025-09-26 11:32:49,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:32:49,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d6adcd36afa834e10abf HTTP/1.1" 200 None 2025-09-26 11:32:49,518 - lava_callback - DEBUG - Processing node 68d3d6adcd36afa834e10abf: baseline-arm-broonie 2025-09-26 11:32:49,737 - lava_callback - ERROR - Error processing callback for node 68d3d6adcd36afa834e10abf: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:32:51,365 - lava_callback - INFO - Received callback for node 68d3d6dacd36afa834e10b0d INFO: 172.20.0.1:58436 - "POST /node/68d3d6dacd36afa834e10b0d HTTP/1.0" 202 Accepted 2025-09-26 11:32:51,371 - lava_callback - INFO - Starting async job submit for node 68d3d6dacd36afa834e10b0d 2025-09-26 11:32:51,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:32:51,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d6dacd36afa834e10b0d HTTP/1.1" 200 None 2025-09-26 11:32:51,384 - lava_callback - DEBUG - Processing node 68d3d6dacd36afa834e10b0d: ltp-cve 2025-09-26 11:32:51,384 - lava_callback - ERROR - Error processing callback for node 68d3d6dacd36afa834e10b0d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:32:52,154 - lava_callback - INFO - Received callback for node 68d3d6decd36afa834e10b13 INFO: 172.20.0.1:58448 - "POST /node/68d3d6decd36afa834e10b13 HTTP/1.0" 202 Accepted 2025-09-26 11:32:52,160 - lava_callback - INFO - Starting async job submit for node 68d3d6decd36afa834e10b13 2025-09-26 11:32:52,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:32:52,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d6decd36afa834e10b13 HTTP/1.1" 200 None 2025-09-26 11:32:52,196 - lava_callback - DEBUG - Processing node 68d3d6decd36afa834e10b13: ltp-input 2025-09-26 11:32:52,196 - lava_callback - ERROR - Error processing callback for node 68d3d6decd36afa834e10b13: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:32:52,926 - lava_callback - INFO - Received callback for node 68d3d6d3cd36afa834e10b04 INFO: 172.20.0.1:58456 - "POST /node/68d3d6d3cd36afa834e10b04 HTTP/1.0" 202 Accepted 2025-09-26 11:32:52,932 - lava_callback - INFO - Starting async job submit for node 68d3d6d3cd36afa834e10b04 2025-09-26 11:32:52,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:32:52,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d6d3cd36afa834e10b04 HTTP/1.1" 200 None 2025-09-26 11:32:52,949 - lava_callback - DEBUG - Processing node 68d3d6d3cd36afa834e10b04: ltp-fsx 2025-09-26 11:32:52,949 - lava_callback - ERROR - Error processing callback for node 68d3d6d3cd36afa834e10b04: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:32:53,658 - lava_callback - INFO - Received callback for node 68d3d6d5cd36afa834e10b07 INFO: 172.20.0.1:58464 - "POST /node/68d3d6d5cd36afa834e10b07 HTTP/1.0" 202 Accepted 2025-09-26 11:32:53,664 - lava_callback - INFO - Starting async job submit for node 68d3d6d5cd36afa834e10b07 2025-09-26 11:32:53,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:32:53,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d6d5cd36afa834e10b07 HTTP/1.1" 200 None 2025-09-26 11:32:53,699 - lava_callback - DEBUG - Processing node 68d3d6d5cd36afa834e10b07: ltp-fsx 2025-09-26 11:32:53,699 - lava_callback - ERROR - Error processing callback for node 68d3d6d5cd36afa834e10b07: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:32:54,405 - lava_callback - INFO - Received callback for node 68d3d6d8cd36afa834e10b0a INFO: 172.20.0.1:58476 - "POST /node/68d3d6d8cd36afa834e10b0a HTTP/1.0" 202 Accepted 2025-09-26 11:32:54,411 - lava_callback - INFO - Starting async job submit for node 68d3d6d8cd36afa834e10b0a 2025-09-26 11:32:54,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:32:54,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d6d8cd36afa834e10b0a HTTP/1.1" 200 None 2025-09-26 11:32:54,449 - lava_callback - DEBUG - Processing node 68d3d6d8cd36afa834e10b0a: ltp-ipc 2025-09-26 11:32:54,449 - lava_callback - ERROR - Error processing callback for node 68d3d6d8cd36afa834e10b0a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:32:55,213 - lava_callback - INFO - Received callback for node 68d3d6e0cd36afa834e10b16 INFO: 172.20.0.1:58484 - "POST /node/68d3d6e0cd36afa834e10b16 HTTP/1.0" 202 Accepted 2025-09-26 11:32:55,223 - lava_callback - INFO - Starting async job submit for node 68d3d6e0cd36afa834e10b16 2025-09-26 11:32:55,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:32:55,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d6e0cd36afa834e10b16 HTTP/1.1" 200 None 2025-09-26 11:32:55,236 - lava_callback - DEBUG - Processing node 68d3d6e0cd36afa834e10b16: ltp-ipc 2025-09-26 11:32:55,236 - lava_callback - ERROR - Error processing callback for node 68d3d6e0cd36afa834e10b16: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:32:56,027 - lava_callback - INFO - Received callback for node 68d3d6e3cd36afa834e10b19 INFO: 172.20.0.1:58488 - "POST /node/68d3d6e3cd36afa834e10b19 HTTP/1.0" 202 Accepted 2025-09-26 11:32:56,033 - lava_callback - INFO - Starting async job submit for node 68d3d6e3cd36afa834e10b19 2025-09-26 11:32:56,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:32:56,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d6e3cd36afa834e10b19 HTTP/1.1" 200 None 2025-09-26 11:32:56,047 - lava_callback - DEBUG - Processing node 68d3d6e3cd36afa834e10b19: ltp-input 2025-09-26 11:32:56,047 - lava_callback - ERROR - Error processing callback for node 68d3d6e3cd36afa834e10b19: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:58502 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:32:56,842 - lava_callback - INFO - Received callback for node 68d3d6e6cd36afa834e10b1c INFO: 172.20.0.1:58518 - "POST /node/68d3d6e6cd36afa834e10b1c HTTP/1.0" 202 Accepted 2025-09-26 11:32:56,848 - lava_callback - INFO - Starting async job submit for node 68d3d6e6cd36afa834e10b1c 2025-09-26 11:32:56,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:32:56,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d6e6cd36afa834e10b1c HTTP/1.1" 200 None 2025-09-26 11:32:56,871 - lava_callback - DEBUG - Processing node 68d3d6e6cd36afa834e10b1c: ltp-sched 2025-09-26 11:32:56,871 - lava_callback - ERROR - Error processing callback for node 68d3d6e6cd36afa834e10b1c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:49694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49702 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:33:11,356 - lava_callback - INFO - Received callback for node 68d3d6ebcd36afa834e10b22 INFO: 172.20.0.1:49852 - "POST /node/68d3d6ebcd36afa834e10b22 HTTP/1.0" 202 Accepted 2025-09-26 11:33:11,362 - lava_callback - INFO - Starting async job submit for node 68d3d6ebcd36afa834e10b22 2025-09-26 11:33:11,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:33:11,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d6ebcd36afa834e10b22 HTTP/1.1" 200 None 2025-09-26 11:33:11,377 - lava_callback - DEBUG - Processing node 68d3d6ebcd36afa834e10b22: ltp-cap-bounds 2025-09-26 11:33:11,377 - lava_callback - ERROR - Error processing callback for node 68d3d6ebcd36afa834e10b22: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:33:12,123 - lava_callback - INFO - Received callback for node 68d3d6eecd36afa834e10b25 INFO: 172.20.0.1:49858 - "POST /node/68d3d6eecd36afa834e10b25 HTTP/1.0" 202 Accepted 2025-09-26 11:33:12,129 - lava_callback - INFO - Starting async job submit for node 68d3d6eecd36afa834e10b25 2025-09-26 11:33:12,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:33:12,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d6eecd36afa834e10b25 HTTP/1.1" 200 None 2025-09-26 11:33:12,142 - lava_callback - DEBUG - Processing node 68d3d6eecd36afa834e10b25: ltp-ipc 2025-09-26 11:33:12,143 - lava_callback - ERROR - Error processing callback for node 68d3d6eecd36afa834e10b25: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:33:12,904 - lava_callback - INFO - Received callback for node 68d3d6f4cd36afa834e10b2b INFO: 172.20.0.1:49862 - "POST /node/68d3d6f4cd36afa834e10b2b HTTP/1.0" 202 Accepted 2025-09-26 11:33:12,910 - lava_callback - INFO - Starting async job submit for node 68d3d6f4cd36afa834e10b2b 2025-09-26 11:33:12,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:33:12,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d6f4cd36afa834e10b2b HTTP/1.1" 200 None 2025-09-26 11:33:12,945 - lava_callback - DEBUG - Processing node 68d3d6f4cd36afa834e10b2b: ltp-ipc 2025-09-26 11:33:12,945 - lava_callback - ERROR - Error processing callback for node 68d3d6f4cd36afa834e10b2b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:33:14,591 - lava_callback - INFO - Received callback for node 68d3dad7cd36afa834e1171f INFO: 172.20.0.1:49864 - "POST /node/68d3dad7cd36afa834e1171f HTTP/1.0" 202 Accepted 2025-09-26 11:33:14,597 - lava_callback - INFO - Starting async job submit for node 68d3dad7cd36afa834e1171f 2025-09-26 11:33:14,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:33:14,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dad7cd36afa834e1171f HTTP/1.1" 200 None 2025-09-26 11:33:14,655 - lava_callback - DEBUG - Processing node 68d3dad7cd36afa834e1171f: baseline-arm64 2025-09-26 11:33:14,951 - lava_callback - ERROR - Error processing callback for node 68d3dad7cd36afa834e1171f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:49872 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 11:33:15,805 - lava_callback - INFO - Received callback for node 68d3dad7cd36afa834e1171c INFO: 172.20.0.1:49880 - "POST /node/68d3dad7cd36afa834e1171c HTTP/1.0" 202 Accepted 2025-09-26 11:33:15,812 - lava_callback - INFO - Starting async job submit for node 68d3dad7cd36afa834e1171c 2025-09-26 11:33:15,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:33:15,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dad7cd36afa834e1171c HTTP/1.1" 200 None 2025-09-26 11:33:15,846 - lava_callback - DEBUG - Processing node 68d3dad7cd36afa834e1171c: baseline-arm64 2025-09-26 11:33:16,164 - lava_callback - ERROR - Error processing callback for node 68d3dad7cd36afa834e1171c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:49882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60510 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:33:31,297 - lava_callback - INFO - Received callback for node 68d3d6f8cd36afa834e10b2e INFO: 172.20.0.1:34622 - "POST /node/68d3d6f8cd36afa834e10b2e HTTP/1.0" 202 Accepted 2025-09-26 11:33:31,302 - lava_callback - INFO - Starting async job submit for node 68d3d6f8cd36afa834e10b2e 2025-09-26 11:33:31,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:33:31,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d6f8cd36afa834e10b2e HTTP/1.1" 200 None 2025-09-26 11:33:31,316 - lava_callback - DEBUG - Processing node 68d3d6f8cd36afa834e10b2e: ltp-pty 2025-09-26 11:33:31,316 - lava_callback - ERROR - Error processing callback for node 68d3d6f8cd36afa834e10b2e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:33:32,050 - lava_callback - INFO - Received callback for node 68d3d6fdcd36afa834e10b34 INFO: 172.20.0.1:34630 - "POST /node/68d3d6fdcd36afa834e10b34 HTTP/1.0" 202 Accepted 2025-09-26 11:33:32,057 - lava_callback - INFO - Starting async job submit for node 68d3d6fdcd36afa834e10b34 2025-09-26 11:33:32,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:33:32,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d6fdcd36afa834e10b34 HTTP/1.1" 200 None 2025-09-26 11:33:32,071 - lava_callback - DEBUG - Processing node 68d3d6fdcd36afa834e10b34: ltp-fs-bind 2025-09-26 11:33:32,071 - lava_callback - ERROR - Error processing callback for node 68d3d6fdcd36afa834e10b34: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:33:32,858 - lava_callback - INFO - Received callback for node 68d3d703cd36afa834e10b50 INFO: 172.20.0.1:34634 - "POST /node/68d3d703cd36afa834e10b50 HTTP/1.0" 202 Accepted 2025-09-26 11:33:32,864 - lava_callback - INFO - Starting async job submit for node 68d3d703cd36afa834e10b50 2025-09-26 11:33:32,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:33:32,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d703cd36afa834e10b50 HTTP/1.1" 200 None 2025-09-26 11:33:32,881 - lava_callback - DEBUG - Processing node 68d3d703cd36afa834e10b50: ltp-pty 2025-09-26 11:33:32,881 - lava_callback - ERROR - Error processing callback for node 68d3d703cd36afa834e10b50: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:33:33,607 - lava_callback - INFO - Received callback for node 68d3d70acd36afa834e10b56 INFO: 172.20.0.1:34648 - "POST /node/68d3d70acd36afa834e10b56 HTTP/1.0" 202 Accepted 2025-09-26 11:33:33,613 - lava_callback - INFO - Starting async job submit for node 68d3d70acd36afa834e10b56 2025-09-26 11:33:33,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:33:33,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d70acd36afa834e10b56 HTTP/1.1" 200 None 2025-09-26 11:33:33,626 - lava_callback - DEBUG - Processing node 68d3d70acd36afa834e10b56: ltp-pty 2025-09-26 11:33:33,627 - lava_callback - ERROR - Error processing callback for node 68d3d70acd36afa834e10b56: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:34650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54836 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.20.0.1:54844 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:33:51,338 - lava_callback - INFO - Received callback for node 68d3d70ccd36afa834e10b59 INFO: 172.20.0.1:41838 - "POST /node/68d3d70ccd36afa834e10b59 HTTP/1.0" 202 Accepted 2025-09-26 11:33:51,344 - lava_callback - INFO - Starting async job submit for node 68d3d70ccd36afa834e10b59 2025-09-26 11:33:51,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:33:51,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d70ccd36afa834e10b59 HTTP/1.1" 200 None 2025-09-26 11:33:51,359 - lava_callback - DEBUG - Processing node 68d3d70ccd36afa834e10b59: ltp-fsx 2025-09-26 11:33:51,359 - lava_callback - ERROR - Error processing callback for node 68d3d70ccd36afa834e10b59: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:33:52,089 - lava_callback - INFO - Received callback for node 68d3d70fcd36afa834e10b5c INFO: 172.20.0.1:41854 - "POST /node/68d3d70fcd36afa834e10b5c HTTP/1.0" 202 Accepted 2025-09-26 11:33:52,098 - lava_callback - INFO - Starting async job submit for node 68d3d70fcd36afa834e10b5c 2025-09-26 11:33:52,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:33:52,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d70fcd36afa834e10b5c HTTP/1.1" 200 None 2025-09-26 11:33:52,112 - lava_callback - DEBUG - Processing node 68d3d70fcd36afa834e10b5c: ltp-containers 2025-09-26 11:33:52,112 - lava_callback - ERROR - Error processing callback for node 68d3d70fcd36afa834e10b5c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:33:52,892 - lava_callback - INFO - Received callback for node 68d3d712cd36afa834e10b5f INFO: 172.20.0.1:41870 - "POST /node/68d3d712cd36afa834e10b5f HTTP/1.0" 202 Accepted 2025-09-26 11:33:52,901 - lava_callback - INFO - Starting async job submit for node 68d3d712cd36afa834e10b5f 2025-09-26 11:33:52,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:33:52,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d712cd36afa834e10b5f HTTP/1.1" 200 None 2025-09-26 11:33:52,916 - lava_callback - DEBUG - Processing node 68d3d712cd36afa834e10b5f: ltp-input 2025-09-26 11:33:52,916 - lava_callback - ERROR - Error processing callback for node 68d3d712cd36afa834e10b5f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:33:53,655 - lava_callback - INFO - Received callback for node 68d3d714cd36afa834e10b62 INFO: 172.20.0.1:41886 - "POST /node/68d3d714cd36afa834e10b62 HTTP/1.0" 202 Accepted 2025-09-26 11:33:53,661 - lava_callback - INFO - Starting async job submit for node 68d3d714cd36afa834e10b62 2025-09-26 11:33:53,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:33:53,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d714cd36afa834e10b62 HTTP/1.1" 200 None 2025-09-26 11:33:53,678 - lava_callback - DEBUG - Processing node 68d3d714cd36afa834e10b62: ltp-cap-bounds 2025-09-26 11:33:53,678 - lava_callback - ERROR - Error processing callback for node 68d3d714cd36afa834e10b62: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:33:54,413 - lava_callback - INFO - Received callback for node 68d3d719cd36afa834e10b65 INFO: 172.20.0.1:41892 - "POST /node/68d3d719cd36afa834e10b65 HTTP/1.0" 202 Accepted 2025-09-26 11:33:54,419 - lava_callback - INFO - Starting async job submit for node 68d3d719cd36afa834e10b65 2025-09-26 11:33:54,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:33:54,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d719cd36afa834e10b65 HTTP/1.1" 200 None 2025-09-26 11:33:54,434 - lava_callback - DEBUG - Processing node 68d3d719cd36afa834e10b65: ltp-sched 2025-09-26 11:33:54,434 - lava_callback - ERROR - Error processing callback for node 68d3d719cd36afa834e10b65: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:33:55,172 - lava_callback - INFO - Received callback for node 68d3d71bcd36afa834e10b68 INFO: 172.20.0.1:41894 - "POST /node/68d3d71bcd36afa834e10b68 HTTP/1.0" 202 Accepted 2025-09-26 11:33:55,182 - lava_callback - INFO - Starting async job submit for node 68d3d71bcd36afa834e10b68 2025-09-26 11:33:55,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:33:55,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d71bcd36afa834e10b68 HTTP/1.1" 200 None 2025-09-26 11:33:55,197 - lava_callback - DEBUG - Processing node 68d3d71bcd36afa834e10b68: ltp-sched 2025-09-26 11:33:55,197 - lava_callback - ERROR - Error processing callback for node 68d3d71bcd36afa834e10b68: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:33:55,989 - lava_callback - INFO - Received callback for node 68d3d71ecd36afa834e10b6b INFO: 172.20.0.1:41898 - "POST /node/68d3d71ecd36afa834e10b6b HTTP/1.0" 202 Accepted 2025-09-26 11:33:55,995 - lava_callback - INFO - Starting async job submit for node 68d3d71ecd36afa834e10b6b 2025-09-26 11:33:55,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:33:56,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d71ecd36afa834e10b6b HTTP/1.1" 200 None 2025-09-26 11:33:56,020 - lava_callback - DEBUG - Processing node 68d3d71ecd36afa834e10b6b: ltp-cap-bounds 2025-09-26 11:33:56,020 - lava_callback - ERROR - Error processing callback for node 68d3d71ecd36afa834e10b6b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:41906 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:33:56,756 - lava_callback - INFO - Received callback for node 68d3d720cd36afa834e10b6e INFO: 172.20.0.1:41922 - "POST /node/68d3d720cd36afa834e10b6e HTTP/1.0" 202 Accepted 2025-09-26 11:33:56,765 - lava_callback - INFO - Starting async job submit for node 68d3d720cd36afa834e10b6e 2025-09-26 11:33:56,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:33:56,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d720cd36afa834e10b6e HTTP/1.1" 200 None 2025-09-26 11:33:56,779 - lava_callback - DEBUG - Processing node 68d3d720cd36afa834e10b6e: ltp-ipc 2025-09-26 11:33:56,779 - lava_callback - ERROR - Error processing callback for node 68d3d720cd36afa834e10b6e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60930 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:34:11,496 - lava_callback - INFO - Received callback for node 68d3d723cd36afa834e10b71 INFO: 172.20.0.1:46952 - "POST /node/68d3d723cd36afa834e10b71 HTTP/1.0" 202 Accepted 2025-09-26 11:34:11,502 - lava_callback - INFO - Starting async job submit for node 68d3d723cd36afa834e10b71 2025-09-26 11:34:11,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:34:11,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d723cd36afa834e10b71 HTTP/1.1" 200 None 2025-09-26 11:34:11,517 - lava_callback - DEBUG - Processing node 68d3d723cd36afa834e10b71: ltp-pty 2025-09-26 11:34:11,517 - lava_callback - ERROR - Error processing callback for node 68d3d723cd36afa834e10b71: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:34:12,282 - lava_callback - INFO - Received callback for node 68d3d726cd36afa834e10b74 INFO: 172.20.0.1:46954 - "POST /node/68d3d726cd36afa834e10b74 HTTP/1.0" 202 Accepted 2025-09-26 11:34:12,288 - lava_callback - INFO - Starting async job submit for node 68d3d726cd36afa834e10b74 2025-09-26 11:34:12,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:34:12,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d726cd36afa834e10b74 HTTP/1.1" 200 None 2025-09-26 11:34:12,319 - lava_callback - DEBUG - Processing node 68d3d726cd36afa834e10b74: ltp-controllers 2025-09-26 11:34:12,319 - lava_callback - ERROR - Error processing callback for node 68d3d726cd36afa834e10b74: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:34:13,087 - lava_callback - INFO - Received callback for node 68d3d728cd36afa834e10b77 INFO: 172.20.0.1:46966 - "POST /node/68d3d728cd36afa834e10b77 HTTP/1.0" 202 Accepted 2025-09-26 11:34:13,093 - lava_callback - INFO - Starting async job submit for node 68d3d728cd36afa834e10b77 2025-09-26 11:34:13,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:34:13,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d728cd36afa834e10b77 HTTP/1.1" 200 None 2025-09-26 11:34:13,107 - lava_callback - DEBUG - Processing node 68d3d728cd36afa834e10b77: ltp-smoketest 2025-09-26 11:34:13,107 - lava_callback - ERROR - Error processing callback for node 68d3d728cd36afa834e10b77: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:34:13,838 - lava_callback - INFO - Received callback for node 68d3d72ccd36afa834e10b8f INFO: 172.20.0.1:46978 - "POST /node/68d3d72ccd36afa834e10b8f HTTP/1.0" 202 Accepted 2025-09-26 11:34:13,844 - lava_callback - INFO - Starting async job submit for node 68d3d72ccd36afa834e10b8f 2025-09-26 11:34:13,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:34:13,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d72ccd36afa834e10b8f HTTP/1.1" 200 None 2025-09-26 11:34:13,858 - lava_callback - DEBUG - Processing node 68d3d72ccd36afa834e10b8f: ltp-smoketest 2025-09-26 11:34:13,858 - lava_callback - ERROR - Error processing callback for node 68d3d72ccd36afa834e10b8f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:34:14,591 - lava_callback - INFO - Received callback for node 68d3d72ecd36afa834e10b92 INFO: 172.20.0.1:46984 - "POST /node/68d3d72ecd36afa834e10b92 HTTP/1.0" 202 Accepted 2025-09-26 11:34:14,597 - lava_callback - INFO - Starting async job submit for node 68d3d72ecd36afa834e10b92 2025-09-26 11:34:14,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:34:14,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d72ecd36afa834e10b92 HTTP/1.1" 200 None 2025-09-26 11:34:14,635 - lava_callback - DEBUG - Processing node 68d3d72ecd36afa834e10b92: ltp-smoketest 2025-09-26 11:34:14,635 - lava_callback - ERROR - Error processing callback for node 68d3d72ecd36afa834e10b92: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:46996 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 11:34:15,325 - lava_callback - INFO - Received callback for node 68d3d732cd36afa834e10b95 INFO: 172.20.0.1:47008 - "POST /node/68d3d732cd36afa834e10b95 HTTP/1.0" 202 Accepted 2025-09-26 11:34:15,331 - lava_callback - INFO - Starting async job submit for node 68d3d732cd36afa834e10b95 2025-09-26 11:34:15,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:34:15,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d732cd36afa834e10b95 HTTP/1.1" 200 None 2025-09-26 11:34:15,348 - lava_callback - DEBUG - Processing node 68d3d732cd36afa834e10b95: ltp-containers 2025-09-26 11:34:15,348 - lava_callback - ERROR - Error processing callback for node 68d3d732cd36afa834e10b95: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:34:16,086 - lava_callback - INFO - Received callback for node 68d3d734cd36afa834e10b98 INFO: 172.20.0.1:47014 - "POST /node/68d3d734cd36afa834e10b98 HTTP/1.0" 202 Accepted 2025-09-26 11:34:16,092 - lava_callback - INFO - Starting async job submit for node 68d3d734cd36afa834e10b98 2025-09-26 11:34:16,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:34:16,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d734cd36afa834e10b98 HTTP/1.1" 200 None 2025-09-26 11:34:16,107 - lava_callback - DEBUG - Processing node 68d3d734cd36afa834e10b98: ltp-pty 2025-09-26 11:34:16,107 - lava_callback - ERROR - Error processing callback for node 68d3d734cd36afa834e10b98: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:47026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47828 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:34:31,555 - lava_callback - INFO - Received callback for node 68d3d739cd36afa834e10b9e INFO: 172.20.0.1:42544 - "POST /node/68d3d739cd36afa834e10b9e HTTP/1.0" 202 Accepted 2025-09-26 11:34:31,564 - lava_callback - INFO - Starting async job submit for node 68d3d739cd36afa834e10b9e 2025-09-26 11:34:31,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:34:31,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d739cd36afa834e10b9e HTTP/1.1" 200 None 2025-09-26 11:34:31,578 - lava_callback - DEBUG - Processing node 68d3d739cd36afa834e10b9e: ltp-sched 2025-09-26 11:34:31,579 - lava_callback - ERROR - Error processing callback for node 68d3d739cd36afa834e10b9e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:34:32,312 - lava_callback - INFO - Received callback for node 68d3d73bcd36afa834e10ba1 INFO: 172.20.0.1:42546 - "POST /node/68d3d73bcd36afa834e10ba1 HTTP/1.0" 202 Accepted 2025-09-26 11:34:32,321 - lava_callback - INFO - Starting async job submit for node 68d3d73bcd36afa834e10ba1 2025-09-26 11:34:32,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:34:32,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d73bcd36afa834e10ba1 HTTP/1.1" 200 None 2025-09-26 11:34:32,335 - lava_callback - DEBUG - Processing node 68d3d73bcd36afa834e10ba1: ltp-syscalls 2025-09-26 11:34:32,335 - lava_callback - ERROR - Error processing callback for node 68d3d73bcd36afa834e10ba1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:34:33,112 - lava_callback - INFO - Received callback for node 68d3d73dcd36afa834e10ba4 INFO: 172.20.0.1:42548 - "POST /node/68d3d73dcd36afa834e10ba4 HTTP/1.0" 202 Accepted 2025-09-26 11:34:33,117 - lava_callback - INFO - Starting async job submit for node 68d3d73dcd36afa834e10ba4 2025-09-26 11:34:33,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:34:33,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d73dcd36afa834e10ba4 HTTP/1.1" 200 None 2025-09-26 11:34:33,132 - lava_callback - DEBUG - Processing node 68d3d73dcd36afa834e10ba4: ltp-sched 2025-09-26 11:34:33,132 - lava_callback - ERROR - Error processing callback for node 68d3d73dcd36afa834e10ba4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:34:33,887 - lava_callback - INFO - Received callback for node 68d3d742cd36afa834e10bd1 INFO: 172.20.0.1:42550 - "POST /node/68d3d742cd36afa834e10bd1 HTTP/1.0" 202 Accepted 2025-09-26 11:34:33,892 - lava_callback - INFO - Starting async job submit for node 68d3d742cd36afa834e10bd1 2025-09-26 11:34:33,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:34:33,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d742cd36afa834e10bd1 HTTP/1.1" 200 None 2025-09-26 11:34:33,912 - lava_callback - DEBUG - Processing node 68d3d742cd36afa834e10bd1: ltp-syscalls-ipc 2025-09-26 11:34:33,913 - lava_callback - ERROR - Error processing callback for node 68d3d742cd36afa834e10bd1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:34:34,657 - lava_callback - INFO - Received callback for node 68d3d745cd36afa834e10bd4 INFO: 172.20.0.1:42552 - "POST /node/68d3d745cd36afa834e10bd4 HTTP/1.0" 202 Accepted 2025-09-26 11:34:34,663 - lava_callback - INFO - Starting async job submit for node 68d3d745cd36afa834e10bd4 2025-09-26 11:34:34,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:34:34,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d745cd36afa834e10bd4 HTTP/1.1" 200 None 2025-09-26 11:34:34,680 - lava_callback - DEBUG - Processing node 68d3d745cd36afa834e10bd4: ltp-syscalls-ipc 2025-09-26 11:34:34,680 - lava_callback - ERROR - Error processing callback for node 68d3d745cd36afa834e10bd4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:34:35,418 - lava_callback - INFO - Received callback for node 68d3d748cd36afa834e10bd7 INFO: 172.20.0.1:42564 - "POST /node/68d3d748cd36afa834e10bd7 HTTP/1.0" 202 Accepted 2025-09-26 11:34:35,427 - lava_callback - INFO - Starting async job submit for node 68d3d748cd36afa834e10bd7 2025-09-26 11:34:35,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:34:35,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d748cd36afa834e10bd7 HTTP/1.1" 200 None 2025-09-26 11:34:35,443 - lava_callback - DEBUG - Processing node 68d3d748cd36afa834e10bd7: ltp-smoketest 2025-09-26 11:34:35,443 - lava_callback - ERROR - Error processing callback for node 68d3d748cd36afa834e10bd7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:42574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48214 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:34:51,367 - lava_callback - INFO - Received callback for node 68d3d74acd36afa834e10bda INFO: 172.20.0.1:56494 - "POST /node/68d3d74acd36afa834e10bda HTTP/1.0" 202 Accepted 2025-09-26 11:34:51,373 - lava_callback - INFO - Starting async job submit for node 68d3d74acd36afa834e10bda 2025-09-26 11:34:51,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:34:51,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d74acd36afa834e10bda HTTP/1.1" 200 None 2025-09-26 11:34:51,387 - lava_callback - DEBUG - Processing node 68d3d74acd36afa834e10bda: ltp-timers 2025-09-26 11:34:51,387 - lava_callback - ERROR - Error processing callback for node 68d3d74acd36afa834e10bda: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:34:52,111 - lava_callback - INFO - Received callback for node 68d3d74dcd36afa834e10bdd INFO: 172.20.0.1:56496 - "POST /node/68d3d74dcd36afa834e10bdd HTTP/1.0" 202 Accepted 2025-09-26 11:34:52,120 - lava_callback - INFO - Starting async job submit for node 68d3d74dcd36afa834e10bdd 2025-09-26 11:34:52,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:34:52,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d74dcd36afa834e10bdd HTTP/1.1" 200 None 2025-09-26 11:34:52,134 - lava_callback - DEBUG - Processing node 68d3d74dcd36afa834e10bdd: ltp-syscalls 2025-09-26 11:34:52,134 - lava_callback - ERROR - Error processing callback for node 68d3d74dcd36afa834e10bdd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:34:52,944 - lava_callback - INFO - Received callback for node 68d3d750cd36afa834e10be0 INFO: 172.20.0.1:56498 - "POST /node/68d3d750cd36afa834e10be0 HTTP/1.0" 202 Accepted 2025-09-26 11:34:52,950 - lava_callback - INFO - Starting async job submit for node 68d3d750cd36afa834e10be0 2025-09-26 11:34:52,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:34:52,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d750cd36afa834e10be0 HTTP/1.1" 200 None 2025-09-26 11:34:52,966 - lava_callback - DEBUG - Processing node 68d3d750cd36afa834e10be0: ltp-timers 2025-09-26 11:34:52,966 - lava_callback - ERROR - Error processing callback for node 68d3d750cd36afa834e10be0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:34:53,738 - lava_callback - INFO - Received callback for node 68d3d752cd36afa834e10be3 INFO: 172.20.0.1:56506 - "POST /node/68d3d752cd36afa834e10be3 HTTP/1.0" 202 Accepted 2025-09-26 11:34:53,744 - lava_callback - INFO - Starting async job submit for node 68d3d752cd36afa834e10be3 2025-09-26 11:34:53,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:34:53,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d752cd36afa834e10be3 HTTP/1.1" 200 None 2025-09-26 11:34:53,759 - lava_callback - DEBUG - Processing node 68d3d752cd36afa834e10be3: ltp-watchqueue 2025-09-26 11:34:53,759 - lava_callback - ERROR - Error processing callback for node 68d3d752cd36afa834e10be3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:34:54,491 - lava_callback - INFO - Received callback for node 68d3d755cd36afa834e10be6 INFO: 172.20.0.1:56510 - "POST /node/68d3d755cd36afa834e10be6 HTTP/1.0" 202 Accepted 2025-09-26 11:34:54,501 - lava_callback - INFO - Starting async job submit for node 68d3d755cd36afa834e10be6 2025-09-26 11:34:54,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:34:54,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d755cd36afa834e10be6 HTTP/1.1" 200 None 2025-09-26 11:34:54,518 - lava_callback - DEBUG - Processing node 68d3d755cd36afa834e10be6: ltp-sched 2025-09-26 11:34:54,518 - lava_callback - ERROR - Error processing callback for node 68d3d755cd36afa834e10be6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:34:54,646 - lava_callback - INFO - Received callback for node 68d3dd5dcd36afa834e11b75 INFO: 172.20.0.1:56522 - "POST /node/68d3dd5dcd36afa834e11b75 HTTP/1.0" 202 Accepted 2025-09-26 11:34:54,652 - lava_callback - INFO - Starting async job submit for node 68d3dd5dcd36afa834e11b75 2025-09-26 11:34:54,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:34:54,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd5dcd36afa834e11b75 HTTP/1.1" 200 None 2025-09-26 11:34:54,687 - lava_callback - DEBUG - Processing node 68d3dd5dcd36afa834e11b75: baseline-arm64 2025-09-26 11:34:54,985 - lava_callback - ERROR - Error processing callback for node 68d3dd5dcd36afa834e11b75: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:34:55,251 - lava_callback - INFO - Received callback for node 68d3d758cd36afa834e10be9 INFO: 172.20.0.1:56528 - "POST /node/68d3d758cd36afa834e10be9 HTTP/1.0" 202 Accepted 2025-09-26 11:34:55,257 - lava_callback - INFO - Starting async job submit for node 68d3d758cd36afa834e10be9 2025-09-26 11:34:55,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:34:55,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d758cd36afa834e10be9 HTTP/1.1" 200 None 2025-09-26 11:34:55,298 - lava_callback - DEBUG - Processing node 68d3d758cd36afa834e10be9: ltp-syscalls-ipc 2025-09-26 11:34:55,298 - lava_callback - ERROR - Error processing callback for node 68d3d758cd36afa834e10be9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:34:55,999 - lava_callback - INFO - Received callback for node 68d3d75bcd36afa834e10bec INFO: 172.20.0.1:56532 - "POST /node/68d3d75bcd36afa834e10bec HTTP/1.0" 202 Accepted 2025-09-26 11:34:56,005 - lava_callback - INFO - Starting async job submit for node 68d3d75bcd36afa834e10bec 2025-09-26 11:34:56,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:34:56,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d75bcd36afa834e10bec HTTP/1.1" 200 None 2025-09-26 11:34:56,021 - lava_callback - DEBUG - Processing node 68d3d75bcd36afa834e10bec: ltp-syscalls 2025-09-26 11:34:56,021 - lava_callback - ERROR - Error processing callback for node 68d3d75bcd36afa834e10bec: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:56540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59778 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:35:11,482 - lava_callback - INFO - Received callback for node 68d3d75ecd36afa834e10c4e INFO: 172.20.0.1:39760 - "POST /node/68d3d75ecd36afa834e10c4e HTTP/1.0" 202 Accepted 2025-09-26 11:35:11,491 - lava_callback - INFO - Starting async job submit for node 68d3d75ecd36afa834e10c4e 2025-09-26 11:35:11,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:35:11,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d75ecd36afa834e10c4e HTTP/1.1" 200 None 2025-09-26 11:35:11,507 - lava_callback - DEBUG - Processing node 68d3d75ecd36afa834e10c4e: ltp-watchqueue 2025-09-26 11:35:11,507 - lava_callback - ERROR - Error processing callback for node 68d3d75ecd36afa834e10c4e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:35:12,230 - lava_callback - INFO - Received callback for node 68d3d761cd36afa834e10c51 INFO: 172.20.0.1:39762 - "POST /node/68d3d761cd36afa834e10c51 HTTP/1.0" 202 Accepted 2025-09-26 11:35:12,236 - lava_callback - INFO - Starting async job submit for node 68d3d761cd36afa834e10c51 2025-09-26 11:35:12,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:35:12,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d761cd36afa834e10c51 HTTP/1.1" 200 None 2025-09-26 11:35:12,273 - lava_callback - DEBUG - Processing node 68d3d761cd36afa834e10c51: ltp-smoketest 2025-09-26 11:35:12,273 - lava_callback - ERROR - Error processing callback for node 68d3d761cd36afa834e10c51: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:35:13,229 - lava_callback - INFO - Received callback for node 68d3d763cd36afa834e10c54 INFO: 172.20.0.1:39770 - "POST /node/68d3d763cd36afa834e10c54 HTTP/1.0" 202 Accepted 2025-09-26 11:35:13,239 - lava_callback - INFO - Starting async job submit for node 68d3d763cd36afa834e10c54 2025-09-26 11:35:13,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:35:13,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d763cd36afa834e10c54 HTTP/1.1" 200 None 2025-09-26 11:35:13,252 - lava_callback - DEBUG - Processing node 68d3d763cd36afa834e10c54: ltp-smoketest 2025-09-26 11:35:13,252 - lava_callback - ERROR - Error processing callback for node 68d3d763cd36afa834e10c54: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:35:13,982 - lava_callback - INFO - Received callback for node 68d3d765cd36afa834e10c57 INFO: 172.20.0.1:39772 - "POST /node/68d3d765cd36afa834e10c57 HTTP/1.0" 202 Accepted 2025-09-26 11:35:13,988 - lava_callback - INFO - Starting async job submit for node 68d3d765cd36afa834e10c57 2025-09-26 11:35:13,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:35:14,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d765cd36afa834e10c57 HTTP/1.1" 200 None 2025-09-26 11:35:14,026 - lava_callback - DEBUG - Processing node 68d3d765cd36afa834e10c57: ltp-timers 2025-09-26 11:35:14,026 - lava_callback - ERROR - Error processing callback for node 68d3d765cd36afa834e10c57: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:35:14,760 - lava_callback - INFO - Received callback for node 68d3d766cd36afa834e10c5a INFO: 172.20.0.1:39788 - "POST /node/68d3d766cd36afa834e10c5a HTTP/1.0" 202 Accepted 2025-09-26 11:35:14,766 - lava_callback - INFO - Starting async job submit for node 68d3d766cd36afa834e10c5a 2025-09-26 11:35:14,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:35:14,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d766cd36afa834e10c5a HTTP/1.1" 200 None 2025-09-26 11:35:14,780 - lava_callback - DEBUG - Processing node 68d3d766cd36afa834e10c5a: ltp-watchqueue 2025-09-26 11:35:14,780 - lava_callback - ERROR - Error processing callback for node 68d3d766cd36afa834e10c5a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:39794 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 11:35:15,600 - lava_callback - INFO - Received callback for node 68d3d76acd36afa834e10c5d INFO: 172.20.0.1:39802 - "POST /node/68d3d76acd36afa834e10c5d HTTP/1.0" 202 Accepted 2025-09-26 11:35:15,610 - lava_callback - INFO - Starting async job submit for node 68d3d76acd36afa834e10c5d 2025-09-26 11:35:15,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:35:15,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d76acd36afa834e10c5d HTTP/1.1" 200 None 2025-09-26 11:35:15,627 - lava_callback - DEBUG - Processing node 68d3d76acd36afa834e10c5d: ltp-syscalls-ipc 2025-09-26 11:35:15,627 - lava_callback - ERROR - Error processing callback for node 68d3d76acd36afa834e10c5d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:35:16,358 - lava_callback - INFO - Received callback for node 68d3d76bcd36afa834e10c60 INFO: 172.20.0.1:39810 - "POST /node/68d3d76bcd36afa834e10c60 HTTP/1.0" 202 Accepted 2025-09-26 11:35:16,363 - lava_callback - INFO - Starting async job submit for node 68d3d76bcd36afa834e10c60 2025-09-26 11:35:16,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:35:16,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d76bcd36afa834e10c60 HTTP/1.1" 200 None 2025-09-26 11:35:16,377 - lava_callback - DEBUG - Processing node 68d3d76bcd36afa834e10c60: ltp-containers 2025-09-26 11:35:16,377 - lava_callback - ERROR - Error processing callback for node 68d3d76bcd36afa834e10c60: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:39824 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:35:17,092 - lava_callback - INFO - Received callback for node 68d3d770cd36afa834e10c63 INFO: 172.20.0.1:39836 - "POST /node/68d3d770cd36afa834e10c63 HTTP/1.0" 202 Accepted 2025-09-26 11:35:17,101 - lava_callback - INFO - Starting async job submit for node 68d3d770cd36afa834e10c63 2025-09-26 11:35:17,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:35:17,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d770cd36afa834e10c63 HTTP/1.1" 200 None 2025-09-26 11:35:17,137 - lava_callback - DEBUG - Processing node 68d3d770cd36afa834e10c63: ltp-syscalls 2025-09-26 11:35:17,137 - lava_callback - ERROR - Error processing callback for node 68d3d770cd36afa834e10c63: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:35:17,849 - lava_callback - INFO - Received callback for node 68d3d772cd36afa834e10c66 INFO: 172.20.0.1:39840 - "POST /node/68d3d772cd36afa834e10c66 HTTP/1.0" 202 Accepted 2025-09-26 11:35:17,855 - lava_callback - INFO - Starting async job submit for node 68d3d772cd36afa834e10c66 2025-09-26 11:35:17,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:35:17,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d772cd36afa834e10c66 HTTP/1.1" 200 None 2025-09-26 11:35:17,873 - lava_callback - DEBUG - Processing node 68d3d772cd36afa834e10c66: ltp-syscalls 2025-09-26 11:35:17,874 - lava_callback - ERROR - Error processing callback for node 68d3d772cd36afa834e10c66: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:44904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44928 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:35:31,387 - lava_callback - INFO - Received callback for node 68d3d774cd36afa834e10c69 INFO: 172.20.0.1:60498 - "POST /node/68d3d774cd36afa834e10c69 HTTP/1.0" 202 Accepted 2025-09-26 11:35:31,393 - lava_callback - INFO - Starting async job submit for node 68d3d774cd36afa834e10c69 2025-09-26 11:35:31,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:35:31,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d774cd36afa834e10c69 HTTP/1.1" 200 None 2025-09-26 11:35:31,408 - lava_callback - DEBUG - Processing node 68d3d774cd36afa834e10c69: ltp-cve 2025-09-26 11:35:31,409 - lava_callback - ERROR - Error processing callback for node 68d3d774cd36afa834e10c69: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:35:32,160 - lava_callback - INFO - Received callback for node 68d3d77bcd36afa834e10c6f INFO: 172.20.0.1:60514 - "POST /node/68d3d77bcd36afa834e10c6f HTTP/1.0" 202 Accepted 2025-09-26 11:35:32,166 - lava_callback - INFO - Starting async job submit for node 68d3d77bcd36afa834e10c6f 2025-09-26 11:35:32,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:35:32,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d77bcd36afa834e10c6f HTTP/1.1" 200 None 2025-09-26 11:35:32,216 - lava_callback - DEBUG - Processing node 68d3d77bcd36afa834e10c6f: ltp-timers 2025-09-26 11:35:32,216 - lava_callback - ERROR - Error processing callback for node 68d3d77bcd36afa834e10c6f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:35:32,922 - lava_callback - INFO - Received callback for node 68d3d77fcd36afa834e10c90 INFO: 172.20.0.1:60526 - "POST /node/68d3d77fcd36afa834e10c90 HTTP/1.0" 202 Accepted 2025-09-26 11:35:32,927 - lava_callback - INFO - Starting async job submit for node 68d3d77fcd36afa834e10c90 2025-09-26 11:35:32,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:35:32,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d77fcd36afa834e10c90 HTTP/1.1" 200 None 2025-09-26 11:35:32,951 - lava_callback - DEBUG - Processing node 68d3d77fcd36afa834e10c90: ltp-syscalls-ipc 2025-09-26 11:35:32,951 - lava_callback - ERROR - Error processing callback for node 68d3d77fcd36afa834e10c90: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:35:33,671 - lava_callback - INFO - Received callback for node 68d3d782cd36afa834e10c93 INFO: 172.20.0.1:60536 - "POST /node/68d3d782cd36afa834e10c93 HTTP/1.0" 202 Accepted 2025-09-26 11:35:33,677 - lava_callback - INFO - Starting async job submit for node 68d3d782cd36afa834e10c93 2025-09-26 11:35:33,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:35:33,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d782cd36afa834e10c93 HTTP/1.1" 200 None 2025-09-26 11:35:33,691 - lava_callback - DEBUG - Processing node 68d3d782cd36afa834e10c93: ltp-syscalls-ipc 2025-09-26 11:35:33,691 - lava_callback - ERROR - Error processing callback for node 68d3d782cd36afa834e10c93: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:35:34,421 - lava_callback - INFO - Received callback for node 68d3d784cd36afa834e10c96 INFO: 172.20.0.1:60542 - "POST /node/68d3d784cd36afa834e10c96 HTTP/1.0" 202 Accepted 2025-09-26 11:35:34,427 - lava_callback - INFO - Starting async job submit for node 68d3d784cd36afa834e10c96 2025-09-26 11:35:34,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:35:34,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d784cd36afa834e10c96 HTTP/1.1" 200 None 2025-09-26 11:35:34,462 - lava_callback - DEBUG - Processing node 68d3d784cd36afa834e10c96: ltp-controllers 2025-09-26 11:35:34,462 - lava_callback - ERROR - Error processing callback for node 68d3d784cd36afa834e10c96: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60544 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:35:44,220 - lava_callback - INFO - Received callback for node 68d3dd5ecd36afa834e11b78 INFO: 172.20.0.1:39382 - "POST /node/68d3dd5ecd36afa834e11b78 HTTP/1.0" 202 Accepted 2025-09-26 11:35:44,226 - lava_callback - INFO - Starting async job submit for node 68d3dd5ecd36afa834e11b78 2025-09-26 11:35:44,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:35:44,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd5ecd36afa834e11b78 HTTP/1.1" 200 None 2025-09-26 11:35:44,267 - lava_callback - DEBUG - Processing node 68d3dd5ecd36afa834e11b78: baseline-arm64 2025-09-26 11:35:44,594 - lava_callback - ERROR - Error processing callback for node 68d3dd5ecd36afa834e11b78: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:39392 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:35:51,462 - lava_callback - INFO - Received callback for node 68d3d788cd36afa834e10c9c INFO: 172.20.0.1:50298 - "POST /node/68d3d788cd36afa834e10c9c HTTP/1.0" 202 Accepted 2025-09-26 11:35:51,468 - lava_callback - INFO - Starting async job submit for node 68d3d788cd36afa834e10c9c 2025-09-26 11:35:51,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:35:51,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d788cd36afa834e10c9c HTTP/1.1" 200 None 2025-09-26 11:35:51,485 - lava_callback - DEBUG - Processing node 68d3d788cd36afa834e10c9c: ltp-watchqueue 2025-09-26 11:35:51,485 - lava_callback - ERROR - Error processing callback for node 68d3d788cd36afa834e10c9c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:35:52,215 - lava_callback - INFO - Received callback for node 68d3d78acd36afa834e10c9f INFO: 172.20.0.1:50308 - "POST /node/68d3d78acd36afa834e10c9f HTTP/1.0" 202 Accepted 2025-09-26 11:35:52,224 - lava_callback - INFO - Starting async job submit for node 68d3d78acd36afa834e10c9f 2025-09-26 11:35:52,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:35:52,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d78acd36afa834e10c9f HTTP/1.1" 200 None 2025-09-26 11:35:52,244 - lava_callback - DEBUG - Processing node 68d3d78acd36afa834e10c9f: ltp-controllers 2025-09-26 11:35:52,244 - lava_callback - ERROR - Error processing callback for node 68d3d78acd36afa834e10c9f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:35:52,980 - lava_callback - INFO - Received callback for node 68d3d790cd36afa834e10ca5 INFO: 172.20.0.1:50318 - "POST /node/68d3d790cd36afa834e10ca5 HTTP/1.0" 202 Accepted 2025-09-26 11:35:52,986 - lava_callback - INFO - Starting async job submit for node 68d3d790cd36afa834e10ca5 2025-09-26 11:35:52,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:35:53,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d790cd36afa834e10ca5 HTTP/1.1" 200 None 2025-09-26 11:35:53,003 - lava_callback - DEBUG - Processing node 68d3d790cd36afa834e10ca5: ltp-timers 2025-09-26 11:35:53,003 - lava_callback - ERROR - Error processing callback for node 68d3d790cd36afa834e10ca5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:35:53,764 - lava_callback - INFO - Received callback for node 68d3d792cd36afa834e10ca8 INFO: 172.20.0.1:50322 - "POST /node/68d3d792cd36afa834e10ca8 HTTP/1.0" 202 Accepted 2025-09-26 11:35:53,773 - lava_callback - INFO - Starting async job submit for node 68d3d792cd36afa834e10ca8 2025-09-26 11:35:53,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:35:53,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d792cd36afa834e10ca8 HTTP/1.1" 200 None 2025-09-26 11:35:53,789 - lava_callback - DEBUG - Processing node 68d3d792cd36afa834e10ca8: ltp-cve 2025-09-26 11:35:53,789 - lava_callback - ERROR - Error processing callback for node 68d3d792cd36afa834e10ca8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:35:54,519 - lava_callback - INFO - Received callback for node 68d3d796cd36afa834e10cab INFO: 172.20.0.1:50330 - "POST /node/68d3d796cd36afa834e10cab HTTP/1.0" 202 Accepted 2025-09-26 11:35:54,528 - lava_callback - INFO - Starting async job submit for node 68d3d796cd36afa834e10cab 2025-09-26 11:35:54,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:35:54,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d796cd36afa834e10cab HTTP/1.1" 200 None 2025-09-26 11:35:54,543 - lava_callback - DEBUG - Processing node 68d3d796cd36afa834e10cab: ltp-timers 2025-09-26 11:35:54,543 - lava_callback - ERROR - Error processing callback for node 68d3d796cd36afa834e10cab: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:50344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60864 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:36:11,435 - lava_callback - INFO - Received callback for node 68d3d79ccd36afa834e10cb1 INFO: 172.20.0.1:37514 - "POST /node/68d3d79ccd36afa834e10cb1 HTTP/1.0" 202 Accepted 2025-09-26 11:36:11,441 - lava_callback - INFO - Starting async job submit for node 68d3d79ccd36afa834e10cb1 2025-09-26 11:36:11,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:36:11,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d79ccd36afa834e10cb1 HTTP/1.1" 200 None 2025-09-26 11:36:11,456 - lava_callback - DEBUG - Processing node 68d3d79ccd36afa834e10cb1: ltp-cve 2025-09-26 11:36:11,456 - lava_callback - ERROR - Error processing callback for node 68d3d79ccd36afa834e10cb1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:36:12,210 - lava_callback - INFO - Received callback for node 68d3d7a3cd36afa834e11217 INFO: 172.20.0.1:37530 - "POST /node/68d3d7a3cd36afa834e11217 HTTP/1.0" 202 Accepted 2025-09-26 11:36:12,215 - lava_callback - INFO - Starting async job submit for node 68d3d7a3cd36afa834e11217 2025-09-26 11:36:12,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:36:12,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d7a3cd36afa834e11217 HTTP/1.1" 200 None 2025-09-26 11:36:12,238 - lava_callback - DEBUG - Processing node 68d3d7a3cd36afa834e11217: baseline-arm-broonie 2025-09-26 11:36:12,238 - lava_callback - ERROR - Error processing callback for node 68d3d7a3cd36afa834e11217: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:36:12,516 - lava_callback - INFO - Received callback for node 68d3dd6fcd36afa834e11b87 INFO: 172.20.0.1:37546 - "POST /node/68d3dd6fcd36afa834e11b87 HTTP/1.0" 202 Accepted 2025-09-26 11:36:12,525 - lava_callback - INFO - Starting async job submit for node 68d3dd6fcd36afa834e11b87 2025-09-26 11:36:12,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:36:12,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd6fcd36afa834e11b87 HTTP/1.1" 200 None 2025-09-26 11:36:12,593 - lava_callback - DEBUG - Processing node 68d3dd6fcd36afa834e11b87: baseline-arm64 2025-09-26 11:36:12,922 - lava_callback - ERROR - Error processing callback for node 68d3dd6fcd36afa834e11b87: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:36:12,965 - lava_callback - INFO - Received callback for node 68d3d7aacd36afa834e1121d INFO: 172.20.0.1:37550 - "POST /node/68d3d7aacd36afa834e1121d HTTP/1.0" 202 Accepted 2025-09-26 11:36:12,973 - lava_callback - INFO - Starting async job submit for node 68d3d7aacd36afa834e1121d 2025-09-26 11:36:12,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:36:13,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d7aacd36afa834e1121d HTTP/1.1" 200 None 2025-09-26 11:36:13,011 - lava_callback - DEBUG - Processing node 68d3d7aacd36afa834e1121d: baseline-arm-broonie 2025-09-26 11:36:13,011 - lava_callback - ERROR - Error processing callback for node 68d3d7aacd36afa834e1121d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:36:13,776 - lava_callback - INFO - Received callback for node 68d3dd65cd36afa834e11b7e INFO: 172.20.0.1:37558 - "POST /node/68d3dd65cd36afa834e11b7e HTTP/1.0" 202 Accepted 2025-09-26 11:36:13,782 - lava_callback - INFO - Starting async job submit for node 68d3dd65cd36afa834e11b7e 2025-09-26 11:36:13,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:36:13,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd65cd36afa834e11b7e HTTP/1.1" 200 None 2025-09-26 11:36:13,816 - lava_callback - DEBUG - Processing node 68d3dd65cd36afa834e11b7e: baseline-arm64 2025-09-26 11:36:14,110 - lava_callback - ERROR - Error processing callback for node 68d3dd65cd36afa834e11b7e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:37562 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 11:36:16,245 - lava_callback - INFO - Received callback for node 68d3dd64cd36afa834e11b7b INFO: 172.20.0.1:37570 - "POST /node/68d3dd64cd36afa834e11b7b HTTP/1.0" 202 Accepted 2025-09-26 11:36:16,251 - lava_callback - INFO - Starting async job submit for node 68d3dd64cd36afa834e11b7b 2025-09-26 11:36:16,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:36:16,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd64cd36afa834e11b7b HTTP/1.1" 200 None 2025-09-26 11:36:16,285 - lava_callback - DEBUG - Processing node 68d3dd64cd36afa834e11b7b: baseline-arm64 INFO: 172.20.0.1:37576 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:36:16,583 - lava_callback - ERROR - Error processing callback for node 68d3dd64cd36afa834e11b7b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:56662 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:36:23,044 - lava_callback - INFO - Received callback for node 68d41a59a5c2c05277bc5b2d INFO: 172.20.0.1:56678 - "POST /node/68d41a59a5c2c05277bc5b2d HTTP/1.0" 202 Accepted 2025-09-26 11:36:23,050 - lava_callback - INFO - Starting async job submit for node 68d41a59a5c2c05277bc5b2d 2025-09-26 11:36:23,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:36:23,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41a59a5c2c05277bc5b2d HTTP/1.1" 200 None 2025-09-26 11:36:23,112 - lava_callback - DEBUG - Processing node 68d41a59a5c2c05277bc5b2d: baseline-arm 2025-09-26 11:36:23,350 - lava_callback - ERROR - Error processing callback for node 68d41a59a5c2c05277bc5b2d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:56680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56688 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:36:31,485 - lava_callback - INFO - Received callback for node 68d3d7aecd36afa834e11220 INFO: 172.20.0.1:48264 - "POST /node/68d3d7aecd36afa834e11220 HTTP/1.0" 202 Accepted 2025-09-26 11:36:31,491 - lava_callback - INFO - Starting async job submit for node 68d3d7aecd36afa834e11220 2025-09-26 11:36:31,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:36:31,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d7aecd36afa834e11220 HTTP/1.1" 200 None 2025-09-26 11:36:31,505 - lava_callback - DEBUG - Processing node 68d3d7aecd36afa834e11220: ltp-watchqueue 2025-09-26 11:36:31,505 - lava_callback - ERROR - Error processing callback for node 68d3d7aecd36afa834e11220: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:36:32,300 - lava_callback - INFO - Received callback for node 68d3d7b1cd36afa834e11223 INFO: 172.20.0.1:48270 - "POST /node/68d3d7b1cd36afa834e11223 HTTP/1.0" 202 Accepted 2025-09-26 11:36:32,309 - lava_callback - INFO - Starting async job submit for node 68d3d7b1cd36afa834e11223 2025-09-26 11:36:32,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:36:32,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d7b1cd36afa834e11223 HTTP/1.1" 200 None 2025-09-26 11:36:32,325 - lava_callback - DEBUG - Processing node 68d3d7b1cd36afa834e11223: ltp-watchqueue 2025-09-26 11:36:32,325 - lava_callback - ERROR - Error processing callback for node 68d3d7b1cd36afa834e11223: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:36:33,130 - lava_callback - INFO - Received callback for node 68d3d7b3cd36afa834e11226 INFO: 172.20.0.1:48274 - "POST /node/68d3d7b3cd36afa834e11226 HTTP/1.0" 202 Accepted 2025-09-26 11:36:33,136 - lava_callback - INFO - Starting async job submit for node 68d3d7b3cd36afa834e11226 2025-09-26 11:36:33,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:36:33,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d7b3cd36afa834e11226 HTTP/1.1" 200 None 2025-09-26 11:36:33,152 - lava_callback - DEBUG - Processing node 68d3d7b3cd36afa834e11226: ltp-containers 2025-09-26 11:36:33,152 - lava_callback - ERROR - Error processing callback for node 68d3d7b3cd36afa834e11226: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:48276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36252 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:37:03,807 - lava_callback - INFO - Received callback for node 68d3dd70cd36afa834e11b8a INFO: 172.20.0.1:46390 - "POST /node/68d3dd70cd36afa834e11b8a HTTP/1.0" 202 Accepted 2025-09-26 11:37:03,813 - lava_callback - INFO - Starting async job submit for node 68d3dd70cd36afa834e11b8a 2025-09-26 11:37:03,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:37:03,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd70cd36afa834e11b8a HTTP/1.1" 200 None 2025-09-26 11:37:03,854 - lava_callback - DEBUG - Processing node 68d3dd70cd36afa834e11b8a: baseline-arm64 2025-09-26 11:37:04,149 - lava_callback - ERROR - Error processing callback for node 68d3dd70cd36afa834e11b8a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:46394 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:37:10,019 - lava_callback - INFO - Received callback for node 68d3d681cd36afa834e10a7d INFO: 172.20.0.1:36128 - "POST /node/68d3d681cd36afa834e10a7d HTTP/1.0" 202 Accepted 2025-09-26 11:37:10,027 - lava_callback - INFO - Starting async job submit for node 68d3d681cd36afa834e10a7d 2025-09-26 11:37:10,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:37:10,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d681cd36afa834e10a7d HTTP/1.1" 200 None 2025-09-26 11:37:10,146 - lava_callback - DEBUG - Processing node 68d3d681cd36afa834e10a7d: ltp-containers 2025-09-26 11:37:10,932 - lava_callback - ERROR - Error processing callback for node 68d3d681cd36afa834e10a7d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:37:11,938 - lava_callback - INFO - Received callback for node 68d3d7d4cd36afa834e11267 INFO: 172.20.0.1:36144 - "POST /node/68d3d7d4cd36afa834e11267 HTTP/1.0" 202 Accepted 2025-09-26 11:37:11,944 - lava_callback - INFO - Starting async job submit for node 68d3d7d4cd36afa834e11267 2025-09-26 11:37:11,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:37:11,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d7d4cd36afa834e11267 HTTP/1.1" 200 None 2025-09-26 11:37:11,960 - lava_callback - DEBUG - Processing node 68d3d7d4cd36afa834e11267: ltp-controllers 2025-09-26 11:37:11,960 - lava_callback - ERROR - Error processing callback for node 68d3d7d4cd36afa834e11267: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:37:12,750 - lava_callback - INFO - Received callback for node 68d3d7d8cd36afa834e1126a INFO: 172.20.0.1:36152 - "POST /node/68d3d7d8cd36afa834e1126a HTTP/1.0" 202 Accepted 2025-09-26 11:37:12,756 - lava_callback - INFO - Starting async job submit for node 68d3d7d8cd36afa834e1126a 2025-09-26 11:37:12,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:37:12,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d7d8cd36afa834e1126a HTTP/1.1" 200 None 2025-09-26 11:37:12,771 - lava_callback - DEBUG - Processing node 68d3d7d8cd36afa834e1126a: ltp-controllers 2025-09-26 11:37:12,771 - lava_callback - ERROR - Error processing callback for node 68d3d7d8cd36afa834e1126a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:37:13,555 - lava_callback - INFO - Received callback for node 68d3d7decd36afa834e11272 INFO: 172.20.0.1:36166 - "POST /node/68d3d7decd36afa834e11272 HTTP/1.0" 202 Accepted 2025-09-26 11:37:13,561 - lava_callback - INFO - Starting async job submit for node 68d3d7decd36afa834e11272 2025-09-26 11:37:13,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:37:13,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d7decd36afa834e11272 HTTP/1.1" 200 None 2025-09-26 11:37:13,576 - lava_callback - DEBUG - Processing node 68d3d7decd36afa834e11272: ltp-cve 2025-09-26 11:37:13,576 - lava_callback - ERROR - Error processing callback for node 68d3d7decd36afa834e11272: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:37:14,306 - lava_callback - INFO - Received callback for node 68d3d7e1cd36afa834e11275 INFO: 172.20.0.1:36168 - "POST /node/68d3d7e1cd36afa834e11275 HTTP/1.0" 202 Accepted 2025-09-26 11:37:14,312 - lava_callback - INFO - Starting async job submit for node 68d3d7e1cd36afa834e11275 2025-09-26 11:37:14,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:37:14,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d7e1cd36afa834e11275 HTTP/1.1" 200 None 2025-09-26 11:37:14,329 - lava_callback - DEBUG - Processing node 68d3d7e1cd36afa834e11275: ltp-cve 2025-09-26 11:37:14,329 - lava_callback - ERROR - Error processing callback for node 68d3d7e1cd36afa834e11275: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:37:15,111 - lava_callback - INFO - Received callback for node 68d3d7e9cd36afa834e1127b INFO: 172.20.0.1:36178 - "POST /node/68d3d7e9cd36afa834e1127b HTTP/1.0" 202 Accepted 2025-09-26 11:37:15,117 - lava_callback - INFO - Starting async job submit for node 68d3d7e9cd36afa834e1127b 2025-09-26 11:37:15,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:37:15,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d7e9cd36afa834e1127b HTTP/1.1" 200 None 2025-09-26 11:37:15,151 - lava_callback - DEBUG - Processing node 68d3d7e9cd36afa834e1127b: ltp-fs-bind 2025-09-26 11:37:15,151 - lava_callback - ERROR - Error processing callback for node 68d3d7e9cd36afa834e1127b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:36182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50772 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:37:31,608 - lava_callback - INFO - Received callback for node 68d3d7f3cd36afa834e11288 INFO: 172.20.0.1:50788 - "POST /node/68d3d7f3cd36afa834e11288 HTTP/1.0" 202 Accepted 2025-09-26 11:37:31,615 - lava_callback - INFO - Starting async job submit for node 68d3d7f3cd36afa834e11288 2025-09-26 11:37:31,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:37:31,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d7f3cd36afa834e11288 HTTP/1.1" 200 None 2025-09-26 11:37:31,650 - lava_callback - DEBUG - Processing node 68d3d7f3cd36afa834e11288: ltp-containers 2025-09-26 11:37:31,650 - lava_callback - ERROR - Error processing callback for node 68d3d7f3cd36afa834e11288: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:37:32,380 - lava_callback - INFO - Received callback for node 68d3d7f5cd36afa834e1128b INFO: 172.20.0.1:50800 - "POST /node/68d3d7f5cd36afa834e1128b HTTP/1.0" 202 Accepted 2025-09-26 11:37:32,386 - lava_callback - INFO - Starting async job submit for node 68d3d7f5cd36afa834e1128b 2025-09-26 11:37:32,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:37:32,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d7f5cd36afa834e1128b HTTP/1.1" 200 None 2025-09-26 11:37:32,402 - lava_callback - DEBUG - Processing node 68d3d7f5cd36afa834e1128b: ltp-fsx 2025-09-26 11:37:32,402 - lava_callback - ERROR - Error processing callback for node 68d3d7f5cd36afa834e1128b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:37:33,130 - lava_callback - INFO - Received callback for node 68d3d7f8cd36afa834e1128e INFO: 172.20.0.1:50806 - "POST /node/68d3d7f8cd36afa834e1128e HTTP/1.0" 202 Accepted 2025-09-26 11:37:33,136 - lava_callback - INFO - Starting async job submit for node 68d3d7f8cd36afa834e1128e 2025-09-26 11:37:33,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:37:33,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d7f8cd36afa834e1128e HTTP/1.1" 200 None 2025-09-26 11:37:33,152 - lava_callback - DEBUG - Processing node 68d3d7f8cd36afa834e1128e: ltp-fs-bind 2025-09-26 11:37:33,152 - lava_callback - ERROR - Error processing callback for node 68d3d7f8cd36afa834e1128e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:50818 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:37:41,779 - lava_callback - INFO - Received callback for node 68d3dd79cd36afa834e11b93 INFO: 172.20.0.1:33274 - "POST /node/68d3dd79cd36afa834e11b93 HTTP/1.0" 202 Accepted 2025-09-26 11:37:41,785 - lava_callback - INFO - Starting async job submit for node 68d3dd79cd36afa834e11b93 2025-09-26 11:37:41,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:37:41,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd79cd36afa834e11b93 HTTP/1.1" 200 None 2025-09-26 11:37:41,822 - lava_callback - DEBUG - Processing node 68d3dd79cd36afa834e11b93: baseline-arm64 2025-09-26 11:37:42,163 - lava_callback - ERROR - Error processing callback for node 68d3dd79cd36afa834e11b93: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:33278 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:37:51,614 - lava_callback - INFO - Received callback for node 68d3d7fecd36afa834e112b8 INFO: 172.20.0.1:36580 - "POST /node/68d3d7fecd36afa834e112b8 HTTP/1.0" 202 Accepted 2025-09-26 11:37:51,620 - lava_callback - INFO - Starting async job submit for node 68d3d7fecd36afa834e112b8 2025-09-26 11:37:51,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:37:51,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d7fecd36afa834e112b8 HTTP/1.1" 200 None 2025-09-26 11:37:51,636 - lava_callback - DEBUG - Processing node 68d3d7fecd36afa834e112b8: ltp-fs-bind 2025-09-26 11:37:51,636 - lava_callback - ERROR - Error processing callback for node 68d3d7fecd36afa834e112b8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:37:52,362 - lava_callback - INFO - Received callback for node 68d3d805cd36afa834e112be INFO: 172.20.0.1:36582 - "POST /node/68d3d805cd36afa834e112be HTTP/1.0" 202 Accepted 2025-09-26 11:37:52,371 - lava_callback - INFO - Starting async job submit for node 68d3d805cd36afa834e112be 2025-09-26 11:37:52,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:37:52,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d805cd36afa834e112be HTTP/1.1" 200 None 2025-09-26 11:37:52,386 - lava_callback - DEBUG - Processing node 68d3d805cd36afa834e112be: ltp-fs-bind 2025-09-26 11:37:52,386 - lava_callback - ERROR - Error processing callback for node 68d3d805cd36afa834e112be: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:37:53,162 - lava_callback - INFO - Received callback for node 68d3d80acd36afa834e112c4 INFO: 172.20.0.1:36586 - "POST /node/68d3d80acd36afa834e112c4 HTTP/1.0" 202 Accepted 2025-09-26 11:37:53,168 - lava_callback - INFO - Starting async job submit for node 68d3d80acd36afa834e112c4 2025-09-26 11:37:53,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:37:53,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d80acd36afa834e112c4 HTTP/1.1" 200 None 2025-09-26 11:37:53,184 - lava_callback - DEBUG - Processing node 68d3d80acd36afa834e112c4: ltp-fsx 2025-09-26 11:37:53,184 - lava_callback - ERROR - Error processing callback for node 68d3d80acd36afa834e112c4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:37:53,910 - lava_callback - INFO - Received callback for node 68d3d80fcd36afa834e112c7 INFO: 172.20.0.1:36598 - "POST /node/68d3d80fcd36afa834e112c7 HTTP/1.0" 202 Accepted 2025-09-26 11:37:53,916 - lava_callback - INFO - Starting async job submit for node 68d3d80fcd36afa834e112c7 2025-09-26 11:37:53,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:37:53,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d80fcd36afa834e112c7 HTTP/1.1" 200 None 2025-09-26 11:37:53,931 - lava_callback - DEBUG - Processing node 68d3d80fcd36afa834e112c7: ltp-input 2025-09-26 11:37:53,932 - lava_callback - ERROR - Error processing callback for node 68d3d80fcd36afa834e112c7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:36614 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:37:56,544 - lava_callback - INFO - Received callback for node 68d3dd7fcd36afa834e11b99 INFO: 172.20.0.1:36622 - "POST /node/68d3dd7fcd36afa834e11b99 HTTP/1.0" 202 Accepted 2025-09-26 11:37:56,551 - lava_callback - INFO - Starting async job submit for node 68d3dd7fcd36afa834e11b99 2025-09-26 11:37:56,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:37:56,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd7fcd36afa834e11b99 HTTP/1.1" 200 None 2025-09-26 11:37:56,584 - lava_callback - DEBUG - Processing node 68d3dd7fcd36afa834e11b99: baseline-arm64 2025-09-26 11:37:56,890 - lava_callback - ERROR - Error processing callback for node 68d3dd7fcd36afa834e11b99: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:46012 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:38:11,162 - lava_callback - INFO - Received callback for node 68d3dd7ccd36afa834e11b96 INFO: 172.20.0.1:51206 - "POST /node/68d3dd7ccd36afa834e11b96 HTTP/1.0" 202 Accepted 2025-09-26 11:38:11,168 - lava_callback - INFO - Starting async job submit for node 68d3dd7ccd36afa834e11b96 2025-09-26 11:38:11,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:38:11,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd7ccd36afa834e11b96 HTTP/1.1" 200 None 2025-09-26 11:38:11,224 - lava_callback - DEBUG - Processing node 68d3dd7ccd36afa834e11b96: baseline-arm64 2025-09-26 11:38:11,645 - lava_callback - INFO - Received callback for node 68d3d811cd36afa834e112ca INFO: 172.20.0.1:51208 - "POST /node/68d3d811cd36afa834e112ca HTTP/1.0" 202 Accepted 2025-09-26 11:38:11,656 - lava_callback - INFO - Starting async job submit for node 68d3d811cd36afa834e112ca 2025-09-26 11:38:11,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:38:11,684 - lava_callback - ERROR - Error processing callback for node 68d3dd7ccd36afa834e11b96: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:38:11,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d811cd36afa834e112ca HTTP/1.1" 200 None 2025-09-26 11:38:11,697 - lava_callback - DEBUG - Processing node 68d3d811cd36afa834e112ca: ltp-fs-bind 2025-09-26 11:38:11,697 - lava_callback - ERROR - Error processing callback for node 68d3d811cd36afa834e112ca: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:38:12,464 - lava_callback - INFO - Received callback for node 68d3d814cd36afa834e112cf INFO: 172.20.0.1:51224 - "POST /node/68d3d814cd36afa834e112cf HTTP/1.0" 202 Accepted 2025-09-26 11:38:12,470 - lava_callback - INFO - Starting async job submit for node 68d3d814cd36afa834e112cf 2025-09-26 11:38:12,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:38:12,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d814cd36afa834e112cf HTTP/1.1" 200 None 2025-09-26 11:38:12,485 - lava_callback - DEBUG - Processing node 68d3d814cd36afa834e112cf: ltp-fs-bind 2025-09-26 11:38:12,485 - lava_callback - ERROR - Error processing callback for node 68d3d814cd36afa834e112cf: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:38:13,238 - lava_callback - INFO - Received callback for node 68d3d817cd36afa834e112d2 INFO: 172.20.0.1:51232 - "POST /node/68d3d817cd36afa834e112d2 HTTP/1.0" 202 Accepted 2025-09-26 11:38:13,244 - lava_callback - INFO - Starting async job submit for node 68d3d817cd36afa834e112d2 2025-09-26 11:38:13,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:38:13,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d817cd36afa834e112d2 HTTP/1.1" 200 None 2025-09-26 11:38:13,258 - lava_callback - DEBUG - Processing node 68d3d817cd36afa834e112d2: ltp-fsx 2025-09-26 11:38:13,258 - lava_callback - ERROR - Error processing callback for node 68d3d817cd36afa834e112d2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:38:14,072 - lava_callback - INFO - Received callback for node 68d3d819cd36afa834e112d5 INFO: 172.20.0.1:51246 - "POST /node/68d3d819cd36afa834e112d5 HTTP/1.0" 202 Accepted 2025-09-26 11:38:14,078 - lava_callback - INFO - Starting async job submit for node 68d3d819cd36afa834e112d5 2025-09-26 11:38:14,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:38:14,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d819cd36afa834e112d5 HTTP/1.1" 200 None 2025-09-26 11:38:14,093 - lava_callback - DEBUG - Processing node 68d3d819cd36afa834e112d5: ltp-input 2025-09-26 11:38:14,093 - lava_callback - ERROR - Error processing callback for node 68d3d819cd36afa834e112d5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:38:14,821 - lava_callback - INFO - Received callback for node 68d3d81ccd36afa834e112d8 INFO: 172.20.0.1:51254 - "POST /node/68d3d81ccd36afa834e112d8 HTTP/1.0" 202 Accepted 2025-09-26 11:38:14,827 - lava_callback - INFO - Starting async job submit for node 68d3d81ccd36afa834e112d8 2025-09-26 11:38:14,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:38:14,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d81ccd36afa834e112d8 HTTP/1.1" 200 None 2025-09-26 11:38:14,843 - lava_callback - DEBUG - Processing node 68d3d81ccd36afa834e112d8: ltp-fsx 2025-09-26 11:38:14,843 - lava_callback - ERROR - Error processing callback for node 68d3d81ccd36afa834e112d8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:51264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58620 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:38:29,512 - lava_callback - INFO - Received callback for node 68d3dd81cd36afa834e11b9c INFO: 172.20.0.1:39366 - "POST /node/68d3dd81cd36afa834e11b9c HTTP/1.0" 202 Accepted 2025-09-26 11:38:29,518 - lava_callback - INFO - Starting async job submit for node 68d3dd81cd36afa834e11b9c 2025-09-26 11:38:29,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:38:29,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd81cd36afa834e11b9c HTTP/1.1" 200 None 2025-09-26 11:38:29,550 - lava_callback - DEBUG - Processing node 68d3dd81cd36afa834e11b9c: baseline-arm64 INFO: 172.20.0.1:39372 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:38:29,870 - lava_callback - ERROR - Error processing callback for node 68d3dd81cd36afa834e11b9c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:38:30,365 - lava_callback - INFO - Received callback for node 68d3d458cd36afa834e10695 INFO: 172.20.0.1:39380 - "POST /node/68d3d458cd36afa834e10695 HTTP/1.0" 202 Accepted 2025-09-26 11:38:30,383 - lava_callback - INFO - Starting async job submit for node 68d3d458cd36afa834e10695 2025-09-26 11:38:30,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:38:30,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d458cd36afa834e10695 HTTP/1.1" 200 None 2025-09-26 11:38:30,737 - lava_callback - DEBUG - Processing node 68d3d458cd36afa834e10695: ltp-controllers 2025-09-26 11:38:31,615 - lava_callback - INFO - Received callback for node 68d3d82bcd36afa834e112f0 INFO: 172.20.0.1:39396 - "POST /node/68d3d82bcd36afa834e112f0 HTTP/1.0" 202 Accepted 2025-09-26 11:38:31,634 - lava_callback - INFO - Starting async job submit for node 68d3d82bcd36afa834e112f0 2025-09-26 11:38:31,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:38:31,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d82bcd36afa834e112f0 HTTP/1.1" 200 None 2025-09-26 11:38:31,766 - lava_callback - DEBUG - Processing node 68d3d82bcd36afa834e112f0: ltp-ipc 2025-09-26 11:38:31,766 - lava_callback - ERROR - Error processing callback for node 68d3d82bcd36afa834e112f0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:38:32,453 - lava_callback - INFO - Received callback for node 68d3d82ecd36afa834e112f3 INFO: 172.20.0.1:39398 - "POST /node/68d3d82ecd36afa834e112f3 HTTP/1.0" 202 Accepted 2025-09-26 11:38:32,465 - lava_callback - INFO - Starting async job submit for node 68d3d82ecd36afa834e112f3 2025-09-26 11:38:32,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:38:32,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d82ecd36afa834e112f3 HTTP/1.1" 200 None 2025-09-26 11:38:32,635 - lava_callback - DEBUG - Processing node 68d3d82ecd36afa834e112f3: ltp-fsx 2025-09-26 11:38:32,635 - lava_callback - ERROR - Error processing callback for node 68d3d82ecd36afa834e112f3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:38:33,438 - lava_callback - INFO - Received callback for node 68d3d834cd36afa834e112f9 INFO: 172.20.0.1:39412 - "POST /node/68d3d834cd36afa834e112f9 HTTP/1.0" 202 Accepted 2025-09-26 11:38:33,449 - lava_callback - INFO - Starting async job submit for node 68d3d834cd36afa834e112f9 2025-09-26 11:38:33,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:38:33,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d834cd36afa834e112f9 HTTP/1.1" 200 None 2025-09-26 11:38:33,542 - lava_callback - DEBUG - Processing node 68d3d834cd36afa834e112f9: ltp-fsx 2025-09-26 11:38:33,542 - lava_callback - ERROR - Error processing callback for node 68d3d834cd36afa834e112f9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:38:33,710 - lava_callback - ERROR - Error processing callback for node 68d3d458cd36afa834e10695: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:38:34,255 - lava_callback - INFO - Received callback for node 68d3d836cd36afa834e112fc INFO: 172.20.0.1:39426 - "POST /node/68d3d836cd36afa834e112fc HTTP/1.0" 202 Accepted 2025-09-26 11:38:34,265 - lava_callback - INFO - Starting async job submit for node 68d3d836cd36afa834e112fc 2025-09-26 11:38:34,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:38:34,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d836cd36afa834e112fc HTTP/1.1" 200 None 2025-09-26 11:38:34,287 - lava_callback - DEBUG - Processing node 68d3d836cd36afa834e112fc: ltp-input 2025-09-26 11:38:34,287 - lava_callback - ERROR - Error processing callback for node 68d3d836cd36afa834e112fc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:39430 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:38:43,077 - lava_callback - INFO - Received callback for node 68d41a5ba5c2c05277bc5b30 INFO: 172.20.0.1:56658 - "POST /node/68d41a5ba5c2c05277bc5b30 HTTP/1.0" 202 Accepted 2025-09-26 11:38:43,086 - lava_callback - INFO - Starting async job submit for node 68d41a5ba5c2c05277bc5b30 2025-09-26 11:38:43,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:38:43,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41a5ba5c2c05277bc5b30 HTTP/1.1" 200 None 2025-09-26 11:38:43,128 - lava_callback - DEBUG - Processing node 68d41a5ba5c2c05277bc5b30: baseline-arm 2025-09-26 11:38:43,356 - lava_callback - ERROR - Error processing callback for node 68d41a5ba5c2c05277bc5b30: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:56662 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:38:51,741 - lava_callback - INFO - Received callback for node 68d3d838cd36afa834e112ff INFO: 172.20.0.1:36908 - "POST /node/68d3d838cd36afa834e112ff HTTP/1.0" 202 Accepted 2025-09-26 11:38:51,747 - lava_callback - INFO - Starting async job submit for node 68d3d838cd36afa834e112ff 2025-09-26 11:38:51,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:38:51,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d838cd36afa834e112ff HTTP/1.1" 200 None 2025-09-26 11:38:51,762 - lava_callback - DEBUG - Processing node 68d3d838cd36afa834e112ff: baseline-arm-broonie 2025-09-26 11:38:51,762 - lava_callback - ERROR - Error processing callback for node 68d3d838cd36afa834e112ff: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:38:52,546 - lava_callback - INFO - Received callback for node 68d3d843cd36afa834e11332 INFO: 172.20.0.1:36912 - "POST /node/68d3d843cd36afa834e11332 HTTP/1.0" 202 Accepted 2025-09-26 11:38:52,552 - lava_callback - INFO - Starting async job submit for node 68d3d843cd36afa834e11332 2025-09-26 11:38:52,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:38:52,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d843cd36afa834e11332 HTTP/1.1" 200 None 2025-09-26 11:38:52,566 - lava_callback - DEBUG - Processing node 68d3d843cd36afa834e11332: ltp-input 2025-09-26 11:38:52,566 - lava_callback - ERROR - Error processing callback for node 68d3d843cd36afa834e11332: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:38:53,307 - lava_callback - INFO - Received callback for node 68d3d848cd36afa834e1133c INFO: 172.20.0.1:36922 - "POST /node/68d3d848cd36afa834e1133c HTTP/1.0" 202 Accepted 2025-09-26 11:38:53,313 - lava_callback - INFO - Starting async job submit for node 68d3d848cd36afa834e1133c 2025-09-26 11:38:53,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:38:53,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d848cd36afa834e1133c HTTP/1.1" 200 None 2025-09-26 11:38:53,329 - lava_callback - DEBUG - Processing node 68d3d848cd36afa834e1133c: ltp-input 2025-09-26 11:38:53,329 - lava_callback - ERROR - Error processing callback for node 68d3d848cd36afa834e1133c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:36934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40764 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:39:11,638 - lava_callback - INFO - Received callback for node 68d3d84fcd36afa834e11342 INFO: 172.20.0.1:47662 - "POST /node/68d3d84fcd36afa834e11342 HTTP/1.0" 202 Accepted 2025-09-26 11:39:11,647 - lava_callback - INFO - Starting async job submit for node 68d3d84fcd36afa834e11342 2025-09-26 11:39:11,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:39:11,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d84fcd36afa834e11342 HTTP/1.1" 200 None 2025-09-26 11:39:11,661 - lava_callback - DEBUG - Processing node 68d3d84fcd36afa834e11342: ltp-input 2025-09-26 11:39:11,661 - lava_callback - ERROR - Error processing callback for node 68d3d84fcd36afa834e11342: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:39:12,392 - lava_callback - INFO - Received callback for node 68d3d851cd36afa834e11345 INFO: 172.20.0.1:47668 - "POST /node/68d3d851cd36afa834e11345 HTTP/1.0" 202 Accepted 2025-09-26 11:39:12,401 - lava_callback - INFO - Starting async job submit for node 68d3d851cd36afa834e11345 2025-09-26 11:39:12,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:39:12,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d851cd36afa834e11345 HTTP/1.1" 200 None 2025-09-26 11:39:12,418 - lava_callback - DEBUG - Processing node 68d3d851cd36afa834e11345: ltp-pty 2025-09-26 11:39:12,418 - lava_callback - ERROR - Error processing callback for node 68d3d851cd36afa834e11345: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:39:13,157 - lava_callback - INFO - Received callback for node 68d3d854cd36afa834e11348 INFO: 172.20.0.1:47674 - "POST /node/68d3d854cd36afa834e11348 HTTP/1.0" 202 Accepted 2025-09-26 11:39:13,166 - lava_callback - INFO - Starting async job submit for node 68d3d854cd36afa834e11348 2025-09-26 11:39:13,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:39:13,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d854cd36afa834e11348 HTTP/1.1" 200 None 2025-09-26 11:39:13,240 - lava_callback - DEBUG - Processing node 68d3d854cd36afa834e11348: ltp-pty 2025-09-26 11:39:13,240 - lava_callback - ERROR - Error processing callback for node 68d3d854cd36afa834e11348: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:39:13,923 - lava_callback - INFO - Received callback for node 68d3d85dcd36afa834e11351 INFO: 172.20.0.1:47676 - "POST /node/68d3d85dcd36afa834e11351 HTTP/1.0" 202 Accepted 2025-09-26 11:39:13,929 - lava_callback - INFO - Starting async job submit for node 68d3d85dcd36afa834e11351 2025-09-26 11:39:13,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:39:13,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d85dcd36afa834e11351 HTTP/1.1" 200 None 2025-09-26 11:39:13,946 - lava_callback - DEBUG - Processing node 68d3d85dcd36afa834e11351: ltp-ipc 2025-09-26 11:39:13,946 - lava_callback - ERROR - Error processing callback for node 68d3d85dcd36afa834e11351: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:39:14,677 - lava_callback - INFO - Received callback for node 68d3d85fcd36afa834e11354 INFO: 172.20.0.1:47684 - "POST /node/68d3d85fcd36afa834e11354 HTTP/1.0" 202 Accepted 2025-09-26 11:39:14,683 - lava_callback - INFO - Starting async job submit for node 68d3d85fcd36afa834e11354 2025-09-26 11:39:14,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:39:14,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d85fcd36afa834e11354 HTTP/1.1" 200 None 2025-09-26 11:39:14,701 - lava_callback - DEBUG - Processing node 68d3d85fcd36afa834e11354: ltp-ipc 2025-09-26 11:39:14,701 - lava_callback - ERROR - Error processing callback for node 68d3d85fcd36afa834e11354: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:47700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47706 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:39:19,183 - lava_callback - INFO - Received callback for node 68d3dd8bcd36afa834e11ba5 INFO: 172.20.0.1:47718 - "POST /node/68d3dd8bcd36afa834e11ba5 HTTP/1.0" 202 Accepted 2025-09-26 11:39:19,189 - lava_callback - INFO - Starting async job submit for node 68d3dd8bcd36afa834e11ba5 2025-09-26 11:39:19,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:39:19,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd8bcd36afa834e11ba5 HTTP/1.1" 200 None 2025-09-26 11:39:19,227 - lava_callback - DEBUG - Processing node 68d3dd8bcd36afa834e11ba5: baseline-arm64 2025-09-26 11:39:19,525 - lava_callback - ERROR - Error processing callback for node 68d3dd8bcd36afa834e11ba5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:44900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55138 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:39:31,607 - lava_callback - INFO - Received callback for node 68d3d862cd36afa834e11357 INFO: 172.20.0.1:55146 - "POST /node/68d3d862cd36afa834e11357 HTTP/1.0" 202 Accepted 2025-09-26 11:39:31,613 - lava_callback - INFO - Starting async job submit for node 68d3d862cd36afa834e11357 2025-09-26 11:39:31,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:39:31,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d862cd36afa834e11357 HTTP/1.1" 200 None 2025-09-26 11:39:31,633 - lava_callback - DEBUG - Processing node 68d3d862cd36afa834e11357: ltp-ipc 2025-09-26 11:39:31,633 - lava_callback - ERROR - Error processing callback for node 68d3d862cd36afa834e11357: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:39:32,358 - lava_callback - INFO - Received callback for node 68d3d865cd36afa834e1135b INFO: 172.20.0.1:55150 - "POST /node/68d3d865cd36afa834e1135b HTTP/1.0" 202 Accepted 2025-09-26 11:39:32,364 - lava_callback - INFO - Starting async job submit for node 68d3d865cd36afa834e1135b 2025-09-26 11:39:32,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:39:32,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d865cd36afa834e1135b HTTP/1.1" 200 None 2025-09-26 11:39:32,378 - lava_callback - DEBUG - Processing node 68d3d865cd36afa834e1135b: ltp-sched 2025-09-26 11:39:32,378 - lava_callback - ERROR - Error processing callback for node 68d3d865cd36afa834e1135b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:39:33,108 - lava_callback - INFO - Received callback for node 68d3d868cd36afa834e11361 INFO: 172.20.0.1:55160 - "POST /node/68d3d868cd36afa834e11361 HTTP/1.0" 202 Accepted 2025-09-26 11:39:33,118 - lava_callback - INFO - Starting async job submit for node 68d3d868cd36afa834e11361 2025-09-26 11:39:33,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:39:33,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d868cd36afa834e11361 HTTP/1.1" 200 None 2025-09-26 11:39:33,133 - lava_callback - DEBUG - Processing node 68d3d868cd36afa834e11361: ltp-pty 2025-09-26 11:39:33,133 - lava_callback - ERROR - Error processing callback for node 68d3d868cd36afa834e11361: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:39:33,915 - lava_callback - INFO - Received callback for node 68d3d86acd36afa834e11364 INFO: 172.20.0.1:55164 - "POST /node/68d3d86acd36afa834e11364 HTTP/1.0" 202 Accepted 2025-09-26 11:39:33,921 - lava_callback - INFO - Starting async job submit for node 68d3d86acd36afa834e11364 2025-09-26 11:39:33,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:39:33,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d86acd36afa834e11364 HTTP/1.1" 200 None 2025-09-26 11:39:33,936 - lava_callback - DEBUG - Processing node 68d3d86acd36afa834e11364: ltp-ipc 2025-09-26 11:39:33,936 - lava_callback - ERROR - Error processing callback for node 68d3d86acd36afa834e11364: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:39:34,729 - lava_callback - INFO - Received callback for node 68d3d86fcd36afa834e1136a INFO: 172.20.0.1:55180 - "POST /node/68d3d86fcd36afa834e1136a HTTP/1.0" 202 Accepted 2025-09-26 11:39:34,735 - lava_callback - INFO - Starting async job submit for node 68d3d86fcd36afa834e1136a 2025-09-26 11:39:34,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:39:34,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d86fcd36afa834e1136a HTTP/1.1" 200 None 2025-09-26 11:39:34,748 - lava_callback - DEBUG - Processing node 68d3d86fcd36afa834e1136a: ltp-sched 2025-09-26 11:39:34,748 - lava_callback - ERROR - Error processing callback for node 68d3d86fcd36afa834e1136a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:39:35,499 - lava_callback - INFO - Received callback for node 68d3d872cd36afa834e1136d INFO: 172.20.0.1:55196 - "POST /node/68d3d872cd36afa834e1136d HTTP/1.0" 202 Accepted 2025-09-26 11:39:35,505 - lava_callback - INFO - Starting async job submit for node 68d3d872cd36afa834e1136d 2025-09-26 11:39:35,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:39:35,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d872cd36afa834e1136d HTTP/1.1" 200 None 2025-09-26 11:39:35,520 - lava_callback - DEBUG - Processing node 68d3d872cd36afa834e1136d: ltp-cap-bounds 2025-09-26 11:39:35,520 - lava_callback - ERROR - Error processing callback for node 68d3d872cd36afa834e1136d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:39:35,820 - lava_callback - INFO - Received callback for node 68d3dd9ccd36afa834e11bd4 INFO: 172.20.0.1:55206 - "POST /node/68d3dd9ccd36afa834e11bd4 HTTP/1.0" 202 Accepted 2025-09-26 11:39:35,826 - lava_callback - INFO - Starting async job submit for node 68d3dd9ccd36afa834e11bd4 2025-09-26 11:39:35,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:39:35,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd9ccd36afa834e11bd4 HTTP/1.1" 200 None 2025-09-26 11:39:35,860 - lava_callback - DEBUG - Processing node 68d3dd9ccd36afa834e11bd4: baseline-arm64 2025-09-26 11:39:36,170 - lava_callback - ERROR - Error processing callback for node 68d3dd9ccd36afa834e11bd4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:55208 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:39:42,837 - lava_callback - INFO - Received callback for node 68d3dd9fcd36afa834e11bd7 INFO: 172.20.0.1:39114 - "POST /node/68d3dd9fcd36afa834e11bd7 HTTP/1.0" 202 Accepted 2025-09-26 11:39:42,844 - lava_callback - INFO - Starting async job submit for node 68d3dd9fcd36afa834e11bd7 2025-09-26 11:39:42,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:39:42,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd9fcd36afa834e11bd7 HTTP/1.1" 200 None 2025-09-26 11:39:42,938 - lava_callback - DEBUG - Processing node 68d3dd9fcd36afa834e11bd7: baseline-arm64 2025-09-26 11:39:43,502 - lava_callback - ERROR - Error processing callback for node 68d3dd9fcd36afa834e11bd7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:39:44,408 - lava_callback - INFO - Received callback for node 68d3dd8ecd36afa834e11ba8 INFO: 172.20.0.1:39122 - "POST /node/68d3dd8ecd36afa834e11ba8 HTTP/1.0" 202 Accepted 2025-09-26 11:39:44,415 - lava_callback - INFO - Starting async job submit for node 68d3dd8ecd36afa834e11ba8 2025-09-26 11:39:44,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:39:44,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd8ecd36afa834e11ba8 HTTP/1.1" 200 None 2025-09-26 11:39:44,449 - lava_callback - DEBUG - Processing node 68d3dd8ecd36afa834e11ba8: baseline-arm64 2025-09-26 11:39:45,189 - lava_callback - ERROR - Error processing callback for node 68d3dd8ecd36afa834e11ba8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:39124 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:39:51,575 - lava_callback - INFO - Received callback for node 68d3d879cd36afa834e11373 INFO: 172.20.0.1:52302 - "POST /node/68d3d879cd36afa834e11373 HTTP/1.0" 202 Accepted 2025-09-26 11:39:51,581 - lava_callback - INFO - Starting async job submit for node 68d3d879cd36afa834e11373 2025-09-26 11:39:51,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:39:51,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d879cd36afa834e11373 HTTP/1.1" 200 None 2025-09-26 11:39:51,597 - lava_callback - DEBUG - Processing node 68d3d879cd36afa834e11373: ltp-pty 2025-09-26 11:39:51,597 - lava_callback - ERROR - Error processing callback for node 68d3d879cd36afa834e11373: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:39:52,330 - lava_callback - INFO - Received callback for node 68d3d883cd36afa834e113a2 INFO: 172.20.0.1:52308 - "POST /node/68d3d883cd36afa834e113a2 HTTP/1.0" 202 Accepted 2025-09-26 11:39:52,340 - lava_callback - INFO - Starting async job submit for node 68d3d883cd36afa834e113a2 2025-09-26 11:39:52,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:39:52,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d883cd36afa834e113a2 HTTP/1.1" 200 None 2025-09-26 11:39:52,352 - lava_callback - DEBUG - Processing node 68d3d883cd36afa834e113a2: ltp-containers 2025-09-26 11:39:52,352 - lava_callback - ERROR - Error processing callback for node 68d3d883cd36afa834e113a2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:39:53,096 - lava_callback - INFO - Received callback for node 68d3d885cd36afa834e113a5 INFO: 172.20.0.1:52320 - "POST /node/68d3d885cd36afa834e113a5 HTTP/1.0" 202 Accepted 2025-09-26 11:39:53,102 - lava_callback - INFO - Starting async job submit for node 68d3d885cd36afa834e113a5 2025-09-26 11:39:53,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:39:53,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d885cd36afa834e113a5 HTTP/1.1" 200 None 2025-09-26 11:39:53,116 - lava_callback - DEBUG - Processing node 68d3d885cd36afa834e113a5: ltp-cap-bounds 2025-09-26 11:39:53,117 - lava_callback - ERROR - Error processing callback for node 68d3d885cd36afa834e113a5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:39:53,893 - lava_callback - INFO - Received callback for node 68d3d888cd36afa834e113a8 INFO: 172.20.0.1:52322 - "POST /node/68d3d888cd36afa834e113a8 HTTP/1.0" 202 Accepted 2025-09-26 11:39:53,899 - lava_callback - INFO - Starting async job submit for node 68d3d888cd36afa834e113a8 2025-09-26 11:39:53,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:39:53,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d888cd36afa834e113a8 HTTP/1.1" 200 None 2025-09-26 11:39:53,914 - lava_callback - DEBUG - Processing node 68d3d888cd36afa834e113a8: ltp-cap-bounds 2025-09-26 11:39:53,914 - lava_callback - ERROR - Error processing callback for node 68d3d888cd36afa834e113a8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:52328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60724 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:40:11,647 - lava_callback - INFO - Received callback for node 68d3d88acd36afa834e113ab INFO: 172.20.0.1:35102 - "POST /node/68d3d88acd36afa834e113ab HTTP/1.0" 202 Accepted 2025-09-26 11:40:11,653 - lava_callback - INFO - Starting async job submit for node 68d3d88acd36afa834e113ab 2025-09-26 11:40:11,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:40:11,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d88acd36afa834e113ab HTTP/1.1" 200 None 2025-09-26 11:40:11,670 - lava_callback - DEBUG - Processing node 68d3d88acd36afa834e113ab: ltp-pty 2025-09-26 11:40:11,670 - lava_callback - ERROR - Error processing callback for node 68d3d88acd36afa834e113ab: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:40:12,396 - lava_callback - INFO - Received callback for node 68d3d88dcd36afa834e113ae INFO: 172.20.0.1:35112 - "POST /node/68d3d88dcd36afa834e113ae HTTP/1.0" 202 Accepted 2025-09-26 11:40:12,402 - lava_callback - INFO - Starting async job submit for node 68d3d88dcd36afa834e113ae 2025-09-26 11:40:12,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:40:12,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d88dcd36afa834e113ae HTTP/1.1" 200 None 2025-09-26 11:40:12,416 - lava_callback - DEBUG - Processing node 68d3d88dcd36afa834e113ae: ltp-controllers 2025-09-26 11:40:12,416 - lava_callback - ERROR - Error processing callback for node 68d3d88dcd36afa834e113ae: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:40:13,211 - lava_callback - INFO - Received callback for node 68d3d890cd36afa834e113b1 INFO: 172.20.0.1:35128 - "POST /node/68d3d890cd36afa834e113b1 HTTP/1.0" 202 Accepted 2025-09-26 11:40:13,217 - lava_callback - INFO - Starting async job submit for node 68d3d890cd36afa834e113b1 2025-09-26 11:40:13,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:40:13,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d890cd36afa834e113b1 HTTP/1.1" 200 None 2025-09-26 11:40:13,231 - lava_callback - DEBUG - Processing node 68d3d890cd36afa834e113b1: ltp-smoketest 2025-09-26 11:40:13,231 - lava_callback - ERROR - Error processing callback for node 68d3d890cd36afa834e113b1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:40:13,992 - lava_callback - INFO - Received callback for node 68d3d892cd36afa834e113b4 INFO: 172.20.0.1:35134 - "POST /node/68d3d892cd36afa834e113b4 HTTP/1.0" 202 Accepted 2025-09-26 11:40:14,001 - lava_callback - INFO - Starting async job submit for node 68d3d892cd36afa834e113b4 2025-09-26 11:40:14,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:40:14,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d892cd36afa834e113b4 HTTP/1.1" 200 None 2025-09-26 11:40:14,015 - lava_callback - DEBUG - Processing node 68d3d892cd36afa834e113b4: ltp-containers 2025-09-26 11:40:14,016 - lava_callback - ERROR - Error processing callback for node 68d3d892cd36afa834e113b4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:40:14,762 - lava_callback - INFO - Received callback for node 68d3d896cd36afa834e113b7 INFO: 172.20.0.1:35150 - "POST /node/68d3d896cd36afa834e113b7 HTTP/1.0" 202 Accepted 2025-09-26 11:40:14,768 - lava_callback - INFO - Starting async job submit for node 68d3d896cd36afa834e113b7 2025-09-26 11:40:14,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:40:14,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d896cd36afa834e113b7 HTTP/1.1" 200 None 2025-09-26 11:40:14,782 - lava_callback - DEBUG - Processing node 68d3d896cd36afa834e113b7: ltp-sched 2025-09-26 11:40:14,782 - lava_callback - ERROR - Error processing callback for node 68d3d896cd36afa834e113b7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:35152 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 11:40:15,511 - lava_callback - INFO - Received callback for node 68d3d898cd36afa834e113ba INFO: 172.20.0.1:35158 - "POST /node/68d3d898cd36afa834e113ba HTTP/1.0" 202 Accepted 2025-09-26 11:40:15,519 - lava_callback - INFO - Starting async job submit for node 68d3d898cd36afa834e113ba 2025-09-26 11:40:15,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:40:15,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d898cd36afa834e113ba HTTP/1.1" 200 None 2025-09-26 11:40:15,534 - lava_callback - DEBUG - Processing node 68d3d898cd36afa834e113ba: ltp-pty 2025-09-26 11:40:15,534 - lava_callback - ERROR - Error processing callback for node 68d3d898cd36afa834e113ba: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:40:16,261 - lava_callback - INFO - Received callback for node 68d3d89bcd36afa834e113bd INFO: 172.20.0.1:35174 - "POST /node/68d3d89bcd36afa834e113bd HTTP/1.0" 202 Accepted 2025-09-26 11:40:16,267 - lava_callback - INFO - Starting async job submit for node 68d3d89bcd36afa834e113bd 2025-09-26 11:40:16,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:40:16,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d89bcd36afa834e113bd HTTP/1.1" 200 None 2025-09-26 11:40:16,282 - lava_callback - DEBUG - Processing node 68d3d89bcd36afa834e113bd: ltp-smoketest 2025-09-26 11:40:16,282 - lava_callback - ERROR - Error processing callback for node 68d3d89bcd36afa834e113bd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:35182 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:40:17,045 - lava_callback - INFO - Received callback for node 68d3d89ecd36afa834e113c0 INFO: 172.20.0.1:35198 - "POST /node/68d3d89ecd36afa834e113c0 HTTP/1.0" 202 Accepted 2025-09-26 11:40:17,051 - lava_callback - INFO - Starting async job submit for node 68d3d89ecd36afa834e113c0 2025-09-26 11:40:17,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:40:17,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d89ecd36afa834e113c0 HTTP/1.1" 200 None 2025-09-26 11:40:17,065 - lava_callback - DEBUG - Processing node 68d3d89ecd36afa834e113c0: ltp-sched 2025-09-26 11:40:17,065 - lava_callback - ERROR - Error processing callback for node 68d3d89ecd36afa834e113c0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:44426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51846 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:40:31,598 - lava_callback - INFO - Received callback for node 68d3d8a1cd36afa834e113c3 INFO: 172.20.0.1:51852 - "POST /node/68d3d8a1cd36afa834e113c3 HTTP/1.0" 202 Accepted 2025-09-26 11:40:31,604 - lava_callback - INFO - Starting async job submit for node 68d3d8a1cd36afa834e113c3 2025-09-26 11:40:31,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:40:31,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d8a1cd36afa834e113c3 HTTP/1.1" 200 None 2025-09-26 11:40:31,618 - lava_callback - DEBUG - Processing node 68d3d8a1cd36afa834e113c3: ltp-sched 2025-09-26 11:40:31,618 - lava_callback - ERROR - Error processing callback for node 68d3d8a1cd36afa834e113c3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:40:32,405 - lava_callback - INFO - Received callback for node 68d3d8a5cd36afa834e113c9 INFO: 172.20.0.1:51860 - "POST /node/68d3d8a5cd36afa834e113c9 HTTP/1.0" 202 Accepted 2025-09-26 11:40:32,411 - lava_callback - INFO - Starting async job submit for node 68d3d8a5cd36afa834e113c9 2025-09-26 11:40:32,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:40:32,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d8a5cd36afa834e113c9 HTTP/1.1" 200 None 2025-09-26 11:40:32,427 - lava_callback - DEBUG - Processing node 68d3d8a5cd36afa834e113c9: ltp-sched 2025-09-26 11:40:32,427 - lava_callback - ERROR - Error processing callback for node 68d3d8a5cd36afa834e113c9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:40:33,148 - lava_callback - INFO - Received callback for node 68d3d8a9cd36afa834e113d0 INFO: 172.20.0.1:51872 - "POST /node/68d3d8a9cd36afa834e113d0 HTTP/1.0" 202 Accepted 2025-09-26 11:40:33,154 - lava_callback - INFO - Starting async job submit for node 68d3d8a9cd36afa834e113d0 2025-09-26 11:40:33,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:40:33,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d8a9cd36afa834e113d0 HTTP/1.1" 200 None 2025-09-26 11:40:33,168 - lava_callback - DEBUG - Processing node 68d3d8a9cd36afa834e113d0: ltp-syscalls 2025-09-26 11:40:33,168 - lava_callback - ERROR - Error processing callback for node 68d3d8a9cd36afa834e113d0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:40:33,932 - lava_callback - INFO - Received callback for node 68d3d8abcd36afa834e113d3 INFO: 172.20.0.1:51884 - "POST /node/68d3d8abcd36afa834e113d3 HTTP/1.0" 202 Accepted 2025-09-26 11:40:33,939 - lava_callback - INFO - Starting async job submit for node 68d3d8abcd36afa834e113d3 2025-09-26 11:40:33,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:40:33,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d8abcd36afa834e113d3 HTTP/1.1" 200 None 2025-09-26 11:40:33,953 - lava_callback - DEBUG - Processing node 68d3d8abcd36afa834e113d3: ltp-syscalls 2025-09-26 11:40:33,953 - lava_callback - ERROR - Error processing callback for node 68d3d8abcd36afa834e113d3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:40:34,685 - lava_callback - INFO - Received callback for node 68d3d8afcd36afa834e113d6 INFO: 172.20.0.1:51888 - "POST /node/68d3d8afcd36afa834e113d6 HTTP/1.0" 202 Accepted 2025-09-26 11:40:34,691 - lava_callback - INFO - Starting async job submit for node 68d3d8afcd36afa834e113d6 2025-09-26 11:40:34,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:40:34,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d8afcd36afa834e113d6 HTTP/1.1" 200 None 2025-09-26 11:40:34,708 - lava_callback - DEBUG - Processing node 68d3d8afcd36afa834e113d6: ltp-smoketest 2025-09-26 11:40:34,708 - lava_callback - ERROR - Error processing callback for node 68d3d8afcd36afa834e113d6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:51902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58536 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:40:51,634 - lava_callback - INFO - Received callback for node 68d3d8b5cd36afa834e113df INFO: 172.20.0.1:40314 - "POST /node/68d3d8b5cd36afa834e113df HTTP/1.0" 202 Accepted 2025-09-26 11:40:51,640 - lava_callback - INFO - Starting async job submit for node 68d3d8b5cd36afa834e113df 2025-09-26 11:40:51,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:40:51,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d8b5cd36afa834e113df HTTP/1.1" 200 None 2025-09-26 11:40:51,659 - lava_callback - DEBUG - Processing node 68d3d8b5cd36afa834e113df: ltp-smoketest 2025-09-26 11:40:51,659 - lava_callback - ERROR - Error processing callback for node 68d3d8b5cd36afa834e113df: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:40:52,383 - lava_callback - INFO - Received callback for node 68d3d8c0cd36afa834e1140c INFO: 172.20.0.1:40324 - "POST /node/68d3d8c0cd36afa834e1140c HTTP/1.0" 202 Accepted 2025-09-26 11:40:52,390 - lava_callback - INFO - Starting async job submit for node 68d3d8c0cd36afa834e1140c 2025-09-26 11:40:52,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:40:52,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d8c0cd36afa834e1140c HTTP/1.1" 200 None 2025-09-26 11:40:52,424 - lava_callback - DEBUG - Processing node 68d3d8c0cd36afa834e1140c: ltp-smoketest 2025-09-26 11:40:52,424 - lava_callback - ERROR - Error processing callback for node 68d3d8c0cd36afa834e1140c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:40:53,142 - lava_callback - INFO - Received callback for node 68d3d8c2cd36afa834e1140f INFO: 172.20.0.1:40326 - "POST /node/68d3d8c2cd36afa834e1140f HTTP/1.0" 202 Accepted 2025-09-26 11:40:53,148 - lava_callback - INFO - Starting async job submit for node 68d3d8c2cd36afa834e1140f 2025-09-26 11:40:53,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:40:53,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d8c2cd36afa834e1140f HTTP/1.1" 200 None 2025-09-26 11:40:53,175 - lava_callback - DEBUG - Processing node 68d3d8c2cd36afa834e1140f: ltp-syscalls-ipc 2025-09-26 11:40:53,175 - lava_callback - ERROR - Error processing callback for node 68d3d8c2cd36afa834e1140f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:40342 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:40:56,830 - lava_callback - INFO - Received callback for node 68d3dda9cd36afa834e11be0 INFO: 172.20.0.1:40348 - "POST /node/68d3dda9cd36afa834e11be0 HTTP/1.0" 202 Accepted 2025-09-26 11:40:56,836 - lava_callback - INFO - Starting async job submit for node 68d3dda9cd36afa834e11be0 2025-09-26 11:40:56,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:40:56,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dda9cd36afa834e11be0 HTTP/1.1" 200 None 2025-09-26 11:40:56,873 - lava_callback - DEBUG - Processing node 68d3dda9cd36afa834e11be0: baseline-arm64 2025-09-26 11:40:57,198 - lava_callback - ERROR - Error processing callback for node 68d3dda9cd36afa834e11be0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:40:58,222 - lava_callback - INFO - Received callback for node 68d3ddadcd36afa834e11be3 INFO: 172.20.0.1:40364 - "POST /node/68d3ddadcd36afa834e11be3 HTTP/1.0" 202 Accepted 2025-09-26 11:40:58,228 - lava_callback - INFO - Starting async job submit for node 68d3ddadcd36afa834e11be3 2025-09-26 11:40:58,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:40:58,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ddadcd36afa834e11be3 HTTP/1.1" 200 None 2025-09-26 11:40:58,262 - lava_callback - DEBUG - Processing node 68d3ddadcd36afa834e11be3: baseline-arm64 2025-09-26 11:40:58,567 - lava_callback - ERROR - Error processing callback for node 68d3ddadcd36afa834e11be3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:41:01,948 - lava_callback - INFO - Received callback for node 68d3ddb9cd36afa834e11bef INFO: 172.20.0.1:48616 - "POST /node/68d3ddb9cd36afa834e11bef HTTP/1.0" 202 Accepted 2025-09-26 11:41:01,957 - lava_callback - INFO - Starting async job submit for node 68d3ddb9cd36afa834e11bef 2025-09-26 11:41:01,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:41:01,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ddb9cd36afa834e11bef HTTP/1.1" 200 None 2025-09-26 11:41:01,993 - lava_callback - DEBUG - Processing node 68d3ddb9cd36afa834e11bef: baseline-arm64 2025-09-26 11:41:02,284 - lava_callback - ERROR - Error processing callback for node 68d3ddb9cd36afa834e11bef: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:41:05,659 - lava_callback - INFO - Received callback for node 68d41a6ea5c2c05277bc5b6f INFO: 172.20.0.1:48630 - "POST /node/68d41a6ea5c2c05277bc5b6f HTTP/1.0" 202 Accepted 2025-09-26 11:41:05,665 - lava_callback - INFO - Starting async job submit for node 68d41a6ea5c2c05277bc5b6f 2025-09-26 11:41:05,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:41:05,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41a6ea5c2c05277bc5b6f HTTP/1.1" 200 None 2025-09-26 11:41:05,711 - lava_callback - DEBUG - Processing node 68d41a6ea5c2c05277bc5b6f: baseline-arm 2025-09-26 11:41:05,982 - lava_callback - ERROR - Error processing callback for node 68d41a6ea5c2c05277bc5b6f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:48636 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:41:11,643 - lava_callback - INFO - Received callback for node 68d3d8c4cd36afa834e11412 INFO: 172.20.0.1:46860 - "POST /node/68d3d8c4cd36afa834e11412 HTTP/1.0" 202 Accepted 2025-09-26 11:41:11,649 - lava_callback - INFO - Starting async job submit for node 68d3d8c4cd36afa834e11412 2025-09-26 11:41:11,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:41:11,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d8c4cd36afa834e11412 HTTP/1.1" 200 None 2025-09-26 11:41:11,664 - lava_callback - DEBUG - Processing node 68d3d8c4cd36afa834e11412: ltp-smoketest 2025-09-26 11:41:11,664 - lava_callback - ERROR - Error processing callback for node 68d3d8c4cd36afa834e11412: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:41:12,419 - lava_callback - INFO - Received callback for node 68d3d8c9cd36afa834e11418 INFO: 172.20.0.1:46876 - "POST /node/68d3d8c9cd36afa834e11418 HTTP/1.0" 202 Accepted 2025-09-26 11:41:12,428 - lava_callback - INFO - Starting async job submit for node 68d3d8c9cd36afa834e11418 2025-09-26 11:41:12,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:41:12,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d8c9cd36afa834e11418 HTTP/1.1" 200 None 2025-09-26 11:41:12,446 - lava_callback - DEBUG - Processing node 68d3d8c9cd36afa834e11418: ltp-syscalls 2025-09-26 11:41:12,446 - lava_callback - ERROR - Error processing callback for node 68d3d8c9cd36afa834e11418: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:41:13,177 - lava_callback - INFO - Received callback for node 68d3d8cdcd36afa834e1141b INFO: 172.20.0.1:46882 - "POST /node/68d3d8cdcd36afa834e1141b HTTP/1.0" 202 Accepted 2025-09-26 11:41:13,183 - lava_callback - INFO - Starting async job submit for node 68d3d8cdcd36afa834e1141b 2025-09-26 11:41:13,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:41:13,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d8cdcd36afa834e1141b HTTP/1.1" 200 None 2025-09-26 11:41:13,199 - lava_callback - DEBUG - Processing node 68d3d8cdcd36afa834e1141b: ltp-syscalls 2025-09-26 11:41:13,199 - lava_callback - ERROR - Error processing callback for node 68d3d8cdcd36afa834e1141b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:41:13,270 - lava_callback - INFO - Received callback for node 68d3ddb8cd36afa834e11bec INFO: 172.20.0.1:46890 - "POST /node/68d3ddb8cd36afa834e11bec HTTP/1.0" 202 Accepted 2025-09-26 11:41:13,276 - lava_callback - INFO - Starting async job submit for node 68d3ddb8cd36afa834e11bec 2025-09-26 11:41:13,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:41:13,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ddb8cd36afa834e11bec HTTP/1.1" 200 None 2025-09-26 11:41:13,311 - lava_callback - DEBUG - Processing node 68d3ddb8cd36afa834e11bec: baseline-arm64 2025-09-26 11:41:13,599 - lava_callback - ERROR - Error processing callback for node 68d3ddb8cd36afa834e11bec: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:41:14,001 - lava_callback - INFO - Received callback for node 68d3d8d0cd36afa834e1141e INFO: 172.20.0.1:46900 - "POST /node/68d3d8d0cd36afa834e1141e HTTP/1.0" 202 Accepted 2025-09-26 11:41:14,007 - lava_callback - INFO - Starting async job submit for node 68d3d8d0cd36afa834e1141e 2025-09-26 11:41:14,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:41:14,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d8d0cd36afa834e1141e HTTP/1.1" 200 None 2025-09-26 11:41:14,021 - lava_callback - DEBUG - Processing node 68d3d8d0cd36afa834e1141e: ltp-timers 2025-09-26 11:41:14,021 - lava_callback - ERROR - Error processing callback for node 68d3d8d0cd36afa834e1141e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:41:14,764 - lava_callback - INFO - Received callback for node 68d3d8d2cd36afa834e11421 INFO: 172.20.0.1:46906 - "POST /node/68d3d8d2cd36afa834e11421 HTTP/1.0" 202 Accepted 2025-09-26 11:41:14,770 - lava_callback - INFO - Starting async job submit for node 68d3d8d2cd36afa834e11421 2025-09-26 11:41:14,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:41:14,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d8d2cd36afa834e11421 HTTP/1.1" 200 None 2025-09-26 11:41:14,788 - lava_callback - DEBUG - Processing node 68d3d8d2cd36afa834e11421: ltp-syscalls-ipc 2025-09-26 11:41:14,788 - lava_callback - ERROR - Error processing callback for node 68d3d8d2cd36afa834e11421: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:46920 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 11:41:15,515 - lava_callback - INFO - Received callback for node 68d3d8d5cd36afa834e11424 INFO: 172.20.0.1:46932 - "POST /node/68d3d8d5cd36afa834e11424 HTTP/1.0" 202 Accepted 2025-09-26 11:41:15,521 - lava_callback - INFO - Starting async job submit for node 68d3d8d5cd36afa834e11424 2025-09-26 11:41:15,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:41:15,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d8d5cd36afa834e11424 HTTP/1.1" 200 None 2025-09-26 11:41:15,537 - lava_callback - DEBUG - Processing node 68d3d8d5cd36afa834e11424: ltp-syscalls-ipc 2025-09-26 11:41:15,537 - lava_callback - ERROR - Error processing callback for node 68d3d8d5cd36afa834e11424: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:41:16,321 - lava_callback - INFO - Received callback for node 68d3d8d8cd36afa834e11427 INFO: 172.20.0.1:46936 - "POST /node/68d3d8d8cd36afa834e11427 HTTP/1.0" 202 Accepted 2025-09-26 11:41:16,327 - lava_callback - INFO - Starting async job submit for node 68d3d8d8cd36afa834e11427 2025-09-26 11:41:16,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:41:16,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d8d8cd36afa834e11427 HTTP/1.1" 200 None 2025-09-26 11:41:16,343 - lava_callback - DEBUG - Processing node 68d3d8d8cd36afa834e11427: ltp-watchqueue 2025-09-26 11:41:16,343 - lava_callback - ERROR - Error processing callback for node 68d3d8d8cd36afa834e11427: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:46952 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:41:17,141 - lava_callback - INFO - Received callback for node 68d3d8dacd36afa834e1142a INFO: 172.20.0.1:46962 - "POST /node/68d3d8dacd36afa834e1142a HTTP/1.0" 202 Accepted 2025-09-26 11:41:17,150 - lava_callback - INFO - Starting async job submit for node 68d3d8dacd36afa834e1142a 2025-09-26 11:41:17,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:41:17,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d8dacd36afa834e1142a HTTP/1.1" 200 None 2025-09-26 11:41:17,168 - lava_callback - DEBUG - Processing node 68d3d8dacd36afa834e1142a: ltp-timers 2025-09-26 11:41:17,168 - lava_callback - ERROR - Error processing callback for node 68d3d8dacd36afa834e1142a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36216 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:41:31,650 - lava_callback - INFO - Received callback for node 68d3d8ddcd36afa834e1142e INFO: 172.20.0.1:36218 - "POST /node/68d3d8ddcd36afa834e1142e HTTP/1.0" 202 Accepted 2025-09-26 11:41:31,656 - lava_callback - INFO - Starting async job submit for node 68d3d8ddcd36afa834e1142e 2025-09-26 11:41:31,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:41:31,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d8ddcd36afa834e1142e HTTP/1.1" 200 None 2025-09-26 11:41:31,670 - lava_callback - DEBUG - Processing node 68d3d8ddcd36afa834e1142e: ltp-timers 2025-09-26 11:41:31,670 - lava_callback - ERROR - Error processing callback for node 68d3d8ddcd36afa834e1142e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:36226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48768 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:41:51,694 - lava_callback - INFO - Received callback for node 68d3d8f2cd36afa834e11446 INFO: 172.20.0.1:44122 - "POST /node/68d3d8f2cd36afa834e11446 HTTP/1.0" 202 Accepted 2025-09-26 11:41:51,700 - lava_callback - INFO - Starting async job submit for node 68d3d8f2cd36afa834e11446 2025-09-26 11:41:51,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:41:51,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d8f2cd36afa834e11446 HTTP/1.1" 200 None 2025-09-26 11:41:51,714 - lava_callback - DEBUG - Processing node 68d3d8f2cd36afa834e11446: ltp-watchqueue 2025-09-26 11:41:51,714 - lava_callback - ERROR - Error processing callback for node 68d3d8f2cd36afa834e11446: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:41:52,435 - lava_callback - INFO - Received callback for node 68d3d8f4cd36afa834e11449 INFO: 172.20.0.1:44134 - "POST /node/68d3d8f4cd36afa834e11449 HTTP/1.0" 202 Accepted 2025-09-26 11:41:52,444 - lava_callback - INFO - Starting async job submit for node 68d3d8f4cd36afa834e11449 2025-09-26 11:41:52,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:41:52,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d8f4cd36afa834e11449 HTTP/1.1" 200 None 2025-09-26 11:41:52,464 - lava_callback - DEBUG - Processing node 68d3d8f4cd36afa834e11449: ltp-watchqueue 2025-09-26 11:41:52,464 - lava_callback - ERROR - Error processing callback for node 68d3d8f4cd36afa834e11449: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:41:53,190 - lava_callback - INFO - Received callback for node 68d3d8f7cd36afa834e1144c INFO: 172.20.0.1:44144 - "POST /node/68d3d8f7cd36afa834e1144c HTTP/1.0" 202 Accepted 2025-09-26 11:41:53,196 - lava_callback - INFO - Starting async job submit for node 68d3d8f7cd36afa834e1144c 2025-09-26 11:41:53,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:41:53,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d8f7cd36afa834e1144c HTTP/1.1" 200 None 2025-09-26 11:41:53,213 - lava_callback - DEBUG - Processing node 68d3d8f7cd36afa834e1144c: ltp-syscalls-ipc 2025-09-26 11:41:53,213 - lava_callback - ERROR - Error processing callback for node 68d3d8f7cd36afa834e1144c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:41:53,925 - lava_callback - INFO - Received callback for node 68d3d8fdcd36afa834e1146c INFO: 172.20.0.1:44158 - "POST /node/68d3d8fdcd36afa834e1146c HTTP/1.0" 202 Accepted 2025-09-26 11:41:53,934 - lava_callback - INFO - Starting async job submit for node 68d3d8fdcd36afa834e1146c 2025-09-26 11:41:53,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:41:53,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d8fdcd36afa834e1146c HTTP/1.1" 200 None 2025-09-26 11:41:53,970 - lava_callback - DEBUG - Processing node 68d3d8fdcd36afa834e1146c: ltp-containers 2025-09-26 11:41:53,971 - lava_callback - ERROR - Error processing callback for node 68d3d8fdcd36afa834e1146c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57750 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:42:11,679 - lava_callback - INFO - Received callback for node 68d3d90ecd36afa834e1147b INFO: 172.20.0.1:53518 - "POST /node/68d3d90ecd36afa834e1147b HTTP/1.0" 202 Accepted 2025-09-26 11:42:11,688 - lava_callback - INFO - Starting async job submit for node 68d3d90ecd36afa834e1147b 2025-09-26 11:42:11,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:42:11,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d90ecd36afa834e1147b HTTP/1.1" 200 None 2025-09-26 11:42:11,720 - lava_callback - DEBUG - Processing node 68d3d90ecd36afa834e1147b: ltp-cve 2025-09-26 11:42:11,720 - lava_callback - ERROR - Error processing callback for node 68d3d90ecd36afa834e1147b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:42:12,466 - lava_callback - INFO - Received callback for node 68d3d910cd36afa834e1147e INFO: 172.20.0.1:53528 - "POST /node/68d3d910cd36afa834e1147e HTTP/1.0" 202 Accepted 2025-09-26 11:42:12,472 - lava_callback - INFO - Starting async job submit for node 68d3d910cd36afa834e1147e 2025-09-26 11:42:12,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:42:12,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d910cd36afa834e1147e HTTP/1.1" 200 None 2025-09-26 11:42:12,514 - lava_callback - DEBUG - Processing node 68d3d910cd36afa834e1147e: ltp-controllers 2025-09-26 11:42:12,514 - lava_callback - ERROR - Error processing callback for node 68d3d910cd36afa834e1147e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:42:13,206 - lava_callback - INFO - Received callback for node 68d3d913cd36afa834e11481 INFO: 172.20.0.1:53542 - "POST /node/68d3d913cd36afa834e11481 HTTP/1.0" 202 Accepted 2025-09-26 11:42:13,212 - lava_callback - INFO - Starting async job submit for node 68d3d913cd36afa834e11481 2025-09-26 11:42:13,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:42:13,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d913cd36afa834e11481 HTTP/1.1" 200 None 2025-09-26 11:42:13,226 - lava_callback - DEBUG - Processing node 68d3d913cd36afa834e11481: ltp-controllers 2025-09-26 11:42:13,226 - lava_callback - ERROR - Error processing callback for node 68d3d913cd36afa834e11481: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:53550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53552 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:42:20,510 - lava_callback - INFO - Received callback for node 68d3ddd5cd36afa834e11c1e INFO: 172.20.0.1:45776 - "POST /node/68d3ddd5cd36afa834e11c1e HTTP/1.0" 202 Accepted 2025-09-26 11:42:20,519 - lava_callback - INFO - Starting async job submit for node 68d3ddd5cd36afa834e11c1e 2025-09-26 11:42:20,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:42:20,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ddd5cd36afa834e11c1e HTTP/1.1" 200 None 2025-09-26 11:42:20,555 - lava_callback - DEBUG - Processing node 68d3ddd5cd36afa834e11c1e: baseline-arm64 2025-09-26 11:42:20,912 - lava_callback - ERROR - Error processing callback for node 68d3ddd5cd36afa834e11c1e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:45788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57146 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:42:31,746 - lava_callback - INFO - Received callback for node 68d3d916cd36afa834e11484 INFO: 172.20.0.1:57160 - "POST /node/68d3d916cd36afa834e11484 HTTP/1.0" 202 Accepted 2025-09-26 11:42:31,752 - lava_callback - INFO - Starting async job submit for node 68d3d916cd36afa834e11484 2025-09-26 11:42:31,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:42:31,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d916cd36afa834e11484 HTTP/1.1" 200 None 2025-09-26 11:42:31,768 - lava_callback - DEBUG - Processing node 68d3d916cd36afa834e11484: ltp-syscalls 2025-09-26 11:42:31,768 - lava_callback - ERROR - Error processing callback for node 68d3d916cd36afa834e11484: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:57166 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:42:39,073 - lava_callback - INFO - Received callback for node 68d3ddc6cd36afa834e11bfd INFO: 172.20.0.1:57180 - "POST /node/68d3ddc6cd36afa834e11bfd HTTP/1.0" 202 Accepted 2025-09-26 11:42:39,079 - lava_callback - INFO - Starting async job submit for node 68d3ddc6cd36afa834e11bfd 2025-09-26 11:42:39,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:42:39,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ddc6cd36afa834e11bfd HTTP/1.1" 200 None 2025-09-26 11:42:39,140 - lava_callback - DEBUG - Processing node 68d3ddc6cd36afa834e11bfd: baseline-arm64 2025-09-26 11:42:39,438 - lava_callback - ERROR - Error processing callback for node 68d3ddc6cd36afa834e11bfd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:42:40,356 - lava_callback - INFO - Received callback for node 68d3ddc3cd36afa834e11bfa INFO: 172.20.0.1:47878 - "POST /node/68d3ddc3cd36afa834e11bfa HTTP/1.0" 202 Accepted 2025-09-26 11:42:40,363 - lava_callback - INFO - Starting async job submit for node 68d3ddc3cd36afa834e11bfa 2025-09-26 11:42:40,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:42:40,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ddc3cd36afa834e11bfa HTTP/1.1" 200 None 2025-09-26 11:42:40,399 - lava_callback - DEBUG - Processing node 68d3ddc3cd36afa834e11bfa: baseline-arm64 2025-09-26 11:42:40,696 - lava_callback - ERROR - Error processing callback for node 68d3ddc3cd36afa834e11bfa: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:47892 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:42:51,885 - lava_callback - INFO - Received callback for node 68d3d92acd36afa834e11496 INFO: 172.20.0.1:37708 - "POST /node/68d3d92acd36afa834e11496 HTTP/1.0" 202 Accepted 2025-09-26 11:42:51,894 - lava_callback - INFO - Starting async job submit for node 68d3d92acd36afa834e11496 2025-09-26 11:42:51,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:42:51,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d92acd36afa834e11496 HTTP/1.1" 200 None 2025-09-26 11:42:51,909 - lava_callback - DEBUG - Processing node 68d3d92acd36afa834e11496: ltp-cve 2025-09-26 11:42:51,909 - lava_callback - ERROR - Error processing callback for node 68d3d92acd36afa834e11496: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:42:52,641 - lava_callback - INFO - Received callback for node 68d3d930cd36afa834e1149c INFO: 172.20.0.1:37710 - "POST /node/68d3d930cd36afa834e1149c HTTP/1.0" 202 Accepted 2025-09-26 11:42:52,651 - lava_callback - INFO - Starting async job submit for node 68d3d930cd36afa834e1149c 2025-09-26 11:42:52,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:42:52,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d930cd36afa834e1149c HTTP/1.1" 200 None 2025-09-26 11:42:52,664 - lava_callback - DEBUG - Processing node 68d3d930cd36afa834e1149c: ltp-cve 2025-09-26 11:42:52,664 - lava_callback - ERROR - Error processing callback for node 68d3d930cd36afa834e1149c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:42:53,441 - lava_callback - INFO - Received callback for node 68d3d931cd36afa834e1149f INFO: 172.20.0.1:37714 - "POST /node/68d3d931cd36afa834e1149f HTTP/1.0" 202 Accepted 2025-09-26 11:42:53,447 - lava_callback - INFO - Starting async job submit for node 68d3d931cd36afa834e1149f 2025-09-26 11:42:53,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:42:53,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d931cd36afa834e1149f HTTP/1.1" 200 None 2025-09-26 11:42:53,462 - lava_callback - DEBUG - Processing node 68d3d931cd36afa834e1149f: ltp-syscalls 2025-09-26 11:42:53,462 - lava_callback - ERROR - Error processing callback for node 68d3d931cd36afa834e1149f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:37726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60068 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:43:10,105 - lava_callback - INFO - Received callback for node 68d3d840cd36afa834e1132f INFO: 172.20.0.1:39020 - "POST /node/68d3d840cd36afa834e1132f HTTP/1.0" 202 Accepted 2025-09-26 11:43:10,112 - lava_callback - INFO - Starting async job submit for node 68d3d840cd36afa834e1132f 2025-09-26 11:43:10,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:43:10,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d840cd36afa834e1132f HTTP/1.1" 200 None 2025-09-26 11:43:10,157 - lava_callback - DEBUG - Processing node 68d3d840cd36afa834e1132f: ltp-ipc 2025-09-26 11:43:10,498 - lava_callback - ERROR - Error processing callback for node 68d3d840cd36afa834e1132f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:39030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53078 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:43:22,079 - lava_callback - INFO - Received callback for node 68d41a70a5c2c05277bc5b72 INFO: 172.20.0.1:53090 - "POST /node/68d41a70a5c2c05277bc5b72 HTTP/1.0" 202 Accepted 2025-09-26 11:43:22,085 - lava_callback - INFO - Starting async job submit for node 68d41a70a5c2c05277bc5b72 2025-09-26 11:43:22,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:43:22,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41a70a5c2c05277bc5b72 HTTP/1.1" 200 None 2025-09-26 11:43:22,117 - lava_callback - DEBUG - Processing node 68d41a70a5c2c05277bc5b72: baseline-arm 2025-09-26 11:43:22,334 - lava_callback - ERROR - Error processing callback for node 68d41a70a5c2c05277bc5b72: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:53102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49866 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:43:31,886 - lava_callback - INFO - Received callback for node 68d3d953cd36afa834e114e7 INFO: 172.20.0.1:49872 - "POST /node/68d3d953cd36afa834e114e7 HTTP/1.0" 202 Accepted 2025-09-26 11:43:31,892 - lava_callback - INFO - Starting async job submit for node 68d3d953cd36afa834e114e7 2025-09-26 11:43:31,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:43:31,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d953cd36afa834e114e7 HTTP/1.1" 200 None 2025-09-26 11:43:31,906 - lava_callback - DEBUG - Processing node 68d3d953cd36afa834e114e7: ltp-containers 2025-09-26 11:43:31,906 - lava_callback - ERROR - Error processing callback for node 68d3d953cd36afa834e114e7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:43:32,632 - lava_callback - INFO - Received callback for node 68d3d955cd36afa834e114ea INFO: 172.20.0.1:49876 - "POST /node/68d3d955cd36afa834e114ea HTTP/1.0" 202 Accepted 2025-09-26 11:43:32,637 - lava_callback - INFO - Starting async job submit for node 68d3d955cd36afa834e114ea 2025-09-26 11:43:32,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:43:32,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d955cd36afa834e114ea HTTP/1.1" 200 None 2025-09-26 11:43:32,654 - lava_callback - DEBUG - Processing node 68d3d955cd36afa834e114ea: ltp-syscalls-ipc 2025-09-26 11:43:32,654 - lava_callback - ERROR - Error processing callback for node 68d3d955cd36afa834e114ea: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:43:33,410 - lava_callback - INFO - Received callback for node 68d3d957cd36afa834e114ed INFO: 172.20.0.1:49880 - "POST /node/68d3d957cd36afa834e114ed HTTP/1.0" 202 Accepted 2025-09-26 11:43:33,415 - lava_callback - INFO - Starting async job submit for node 68d3d957cd36afa834e114ed 2025-09-26 11:43:33,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:43:33,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d957cd36afa834e114ed HTTP/1.1" 200 None 2025-09-26 11:43:33,431 - lava_callback - DEBUG - Processing node 68d3d957cd36afa834e114ed: ltp-fs-bind 2025-09-26 11:43:33,431 - lava_callback - ERROR - Error processing callback for node 68d3d957cd36afa834e114ed: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:49892 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:43:40,921 - lava_callback - INFO - Received callback for node 68d3dddacd36afa834e11c24 INFO: 172.20.0.1:48586 - "POST /node/68d3dddacd36afa834e11c24 HTTP/1.0" 202 Accepted 2025-09-26 11:43:40,927 - lava_callback - INFO - Starting async job submit for node 68d3dddacd36afa834e11c24 2025-09-26 11:43:40,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:43:40,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dddacd36afa834e11c24 HTTP/1.1" 200 None 2025-09-26 11:43:40,995 - lava_callback - DEBUG - Processing node 68d3dddacd36afa834e11c24: baseline-arm64 2025-09-26 11:43:41,289 - lava_callback - ERROR - Error processing callback for node 68d3dddacd36afa834e11c24: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:48594 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:43:54,944 - lava_callback - INFO - Received callback for node 68d3ddd6cd36afa834e11c21 INFO: 172.20.0.1:50480 - "POST /node/68d3ddd6cd36afa834e11c21 HTTP/1.0" 202 Accepted 2025-09-26 11:43:54,951 - lava_callback - INFO - Starting async job submit for node 68d3ddd6cd36afa834e11c21 2025-09-26 11:43:54,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:43:55,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ddd6cd36afa834e11c21 HTTP/1.1" 200 None 2025-09-26 11:43:55,007 - lava_callback - DEBUG - Processing node 68d3ddd6cd36afa834e11c21: baseline-arm64 2025-09-26 11:43:55,511 - lava_callback - ERROR - Error processing callback for node 68d3ddd6cd36afa834e11c21: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:50482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56176 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:44:21,100 - lava_callback - INFO - Received callback for node 68d3dddbcd36afa834e11c27 INFO: 172.20.0.1:56192 - "POST /node/68d3dddbcd36afa834e11c27 HTTP/1.0" 202 Accepted 2025-09-26 11:44:21,106 - lava_callback - INFO - Starting async job submit for node 68d3dddbcd36afa834e11c27 2025-09-26 11:44:21,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:44:21,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dddbcd36afa834e11c27 HTTP/1.1" 200 None 2025-09-26 11:44:21,139 - lava_callback - DEBUG - Processing node 68d3dddbcd36afa834e11c27: baseline-arm64 2025-09-26 11:44:21,459 - lava_callback - ERROR - Error processing callback for node 68d3dddbcd36afa834e11c27: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:44:22,326 - lava_callback - INFO - Received callback for node 68d3dddfcd36afa834e11c2a INFO: 172.20.0.1:56194 - "POST /node/68d3dddfcd36afa834e11c2a HTTP/1.0" 202 Accepted 2025-09-26 11:44:22,335 - lava_callback - INFO - Starting async job submit for node 68d3dddfcd36afa834e11c2a 2025-09-26 11:44:22,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:44:22,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dddfcd36afa834e11c2a HTTP/1.1" 200 None 2025-09-26 11:44:22,373 - lava_callback - DEBUG - Processing node 68d3dddfcd36afa834e11c2a: baseline-arm64 2025-09-26 11:44:22,683 - lava_callback - ERROR - Error processing callback for node 68d3dddfcd36afa834e11c2a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:56200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39384 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:44:31,871 - lava_callback - INFO - Received callback for node 68d3d98acd36afa834e1153f INFO: 172.20.0.1:39400 - "POST /node/68d3d98acd36afa834e1153f HTTP/1.0" 202 Accepted 2025-09-26 11:44:31,877 - lava_callback - INFO - Starting async job submit for node 68d3d98acd36afa834e1153f 2025-09-26 11:44:31,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:44:31,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d98acd36afa834e1153f HTTP/1.1" 200 None 2025-09-26 11:44:31,890 - lava_callback - DEBUG - Processing node 68d3d98acd36afa834e1153f: ltp-fsx 2025-09-26 11:44:31,890 - lava_callback - ERROR - Error processing callback for node 68d3d98acd36afa834e1153f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:44:32,617 - lava_callback - INFO - Received callback for node 68d3d98ecd36afa834e11542 INFO: 172.20.0.1:39416 - "POST /node/68d3d98ecd36afa834e11542 HTTP/1.0" 202 Accepted 2025-09-26 11:44:32,623 - lava_callback - INFO - Starting async job submit for node 68d3d98ecd36afa834e11542 2025-09-26 11:44:32,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:44:32,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d98ecd36afa834e11542 HTTP/1.1" 200 None 2025-09-26 11:44:32,659 - lava_callback - DEBUG - Processing node 68d3d98ecd36afa834e11542: ltp-syscalls-ipc 2025-09-26 11:44:32,659 - lava_callback - ERROR - Error processing callback for node 68d3d98ecd36afa834e11542: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:44:33,451 - lava_callback - INFO - Received callback for node 68d3d990cd36afa834e11545 INFO: 172.20.0.1:39428 - "POST /node/68d3d990cd36afa834e11545 HTTP/1.0" 202 Accepted 2025-09-26 11:44:33,457 - lava_callback - INFO - Starting async job submit for node 68d3d990cd36afa834e11545 2025-09-26 11:44:33,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:44:33,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d990cd36afa834e11545 HTTP/1.1" 200 None 2025-09-26 11:44:33,480 - lava_callback - DEBUG - Processing node 68d3d990cd36afa834e11545: ltp-fs-bind 2025-09-26 11:44:33,480 - lava_callback - ERROR - Error processing callback for node 68d3d990cd36afa834e11545: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:44:34,267 - lava_callback - INFO - Received callback for node 68d3d994cd36afa834e11548 INFO: 172.20.0.1:39444 - "POST /node/68d3d994cd36afa834e11548 HTTP/1.0" 202 Accepted 2025-09-26 11:44:34,273 - lava_callback - INFO - Starting async job submit for node 68d3d994cd36afa834e11548 2025-09-26 11:44:34,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:44:34,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d994cd36afa834e11548 HTTP/1.1" 200 None 2025-09-26 11:44:34,287 - lava_callback - DEBUG - Processing node 68d3d994cd36afa834e11548: ltp-watchqueue 2025-09-26 11:44:34,287 - lava_callback - ERROR - Error processing callback for node 68d3d994cd36afa834e11548: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:44:35,053 - lava_callback - INFO - Received callback for node 68d3d9a0cd36afa834e11557 INFO: 172.20.0.1:39454 - "POST /node/68d3d9a0cd36afa834e11557 HTTP/1.0" 202 Accepted 2025-09-26 11:44:35,062 - lava_callback - INFO - Starting async job submit for node 68d3d9a0cd36afa834e11557 2025-09-26 11:44:35,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:44:35,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d9a0cd36afa834e11557 HTTP/1.1" 200 None 2025-09-26 11:44:35,086 - lava_callback - DEBUG - Processing node 68d3d9a0cd36afa834e11557: ltp-fs-bind 2025-09-26 11:44:35,086 - lava_callback - ERROR - Error processing callback for node 68d3d9a0cd36afa834e11557: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:39464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49386 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:44:51,836 - lava_callback - INFO - Received callback for node 68d3d9a2cd36afa834e1155a INFO: 172.20.0.1:48350 - "POST /node/68d3d9a2cd36afa834e1155a HTTP/1.0" 202 Accepted 2025-09-26 11:44:51,841 - lava_callback - INFO - Starting async job submit for node 68d3d9a2cd36afa834e1155a 2025-09-26 11:44:51,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:44:51,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d9a2cd36afa834e1155a HTTP/1.1" 200 None 2025-09-26 11:44:51,861 - lava_callback - DEBUG - Processing node 68d3d9a2cd36afa834e1155a: ltp-input 2025-09-26 11:44:51,861 - lava_callback - ERROR - Error processing callback for node 68d3d9a2cd36afa834e1155a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:44:52,608 - lava_callback - INFO - Received callback for node 68d3d9afcd36afa834e11569 INFO: 172.20.0.1:48364 - "POST /node/68d3d9afcd36afa834e11569 HTTP/1.0" 202 Accepted 2025-09-26 11:44:52,614 - lava_callback - INFO - Starting async job submit for node 68d3d9afcd36afa834e11569 2025-09-26 11:44:52,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:44:52,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d9afcd36afa834e11569 HTTP/1.1" 200 None 2025-09-26 11:44:52,629 - lava_callback - DEBUG - Processing node 68d3d9afcd36afa834e11569: ltp-cap-bounds 2025-09-26 11:44:52,629 - lava_callback - ERROR - Error processing callback for node 68d3d9afcd36afa834e11569: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:48380 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:45:00,240 - lava_callback - INFO - Received callback for node 68d3dde0cd36afa834e11c2d INFO: 172.20.0.1:51732 - "POST /node/68d3dde0cd36afa834e11c2d HTTP/1.0" 202 Accepted 2025-09-26 11:45:00,246 - lava_callback - INFO - Starting async job submit for node 68d3dde0cd36afa834e11c2d 2025-09-26 11:45:00,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:45:00,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dde0cd36afa834e11c2d HTTP/1.1" 200 None 2025-09-26 11:45:00,288 - lava_callback - DEBUG - Processing node 68d3dde0cd36afa834e11c2d: baseline-arm64 2025-09-26 11:45:00,581 - lava_callback - ERROR - Error processing callback for node 68d3dde0cd36afa834e11c2d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:51738 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:45:11,844 - lava_callback - INFO - Received callback for node 68d3d9b6cd36afa834e11587 INFO: 172.20.0.1:50388 - "POST /node/68d3d9b6cd36afa834e11587 HTTP/1.0" 202 Accepted 2025-09-26 11:45:11,850 - lava_callback - INFO - Starting async job submit for node 68d3d9b6cd36afa834e11587 2025-09-26 11:45:11,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:45:11,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d9b6cd36afa834e11587 HTTP/1.1" 200 None 2025-09-26 11:45:11,864 - lava_callback - DEBUG - Processing node 68d3d9b6cd36afa834e11587: ltp-timers 2025-09-26 11:45:11,864 - lava_callback - ERROR - Error processing callback for node 68d3d9b6cd36afa834e11587: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:45:12,592 - lava_callback - INFO - Received callback for node 68d3d9bacd36afa834e1158d INFO: 172.20.0.1:50396 - "POST /node/68d3d9bacd36afa834e1158d HTTP/1.0" 202 Accepted 2025-09-26 11:45:12,602 - lava_callback - INFO - Starting async job submit for node 68d3d9bacd36afa834e1158d 2025-09-26 11:45:12,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:45:12,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d9bacd36afa834e1158d HTTP/1.1" 200 None 2025-09-26 11:45:12,618 - lava_callback - DEBUG - Processing node 68d3d9bacd36afa834e1158d: ltp-fsx 2025-09-26 11:45:12,619 - lava_callback - ERROR - Error processing callback for node 68d3d9bacd36afa834e1158d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:45:13,325 - lava_callback - INFO - Received callback for node 68d3d9bdcd36afa834e11590 INFO: 172.20.0.1:50406 - "POST /node/68d3d9bdcd36afa834e11590 HTTP/1.0" 202 Accepted 2025-09-26 11:45:13,332 - lava_callback - INFO - Starting async job submit for node 68d3d9bdcd36afa834e11590 2025-09-26 11:45:13,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:45:13,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d9bdcd36afa834e11590 HTTP/1.1" 200 None 2025-09-26 11:45:13,345 - lava_callback - DEBUG - Processing node 68d3d9bdcd36afa834e11590: ltp-timers 2025-09-26 11:45:13,345 - lava_callback - ERROR - Error processing callback for node 68d3d9bdcd36afa834e11590: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:45:14,072 - lava_callback - INFO - Received callback for node 68d3d9c3cd36afa834e11596 INFO: 172.20.0.1:50410 - "POST /node/68d3d9c3cd36afa834e11596 HTTP/1.0" 202 Accepted 2025-09-26 11:45:14,078 - lava_callback - INFO - Starting async job submit for node 68d3d9c3cd36afa834e11596 2025-09-26 11:45:14,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:45:14,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d9c3cd36afa834e11596 HTTP/1.1" 200 None 2025-09-26 11:45:14,092 - lava_callback - DEBUG - Processing node 68d3d9c3cd36afa834e11596: ltp-fsx 2025-09-26 11:45:14,092 - lava_callback - ERROR - Error processing callback for node 68d3d9c3cd36afa834e11596: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:45:14,808 - lava_callback - INFO - Received callback for node 68d3d9c5cd36afa834e11599 INFO: 172.20.0.1:50412 - "POST /node/68d3d9c5cd36afa834e11599 HTTP/1.0" 202 Accepted 2025-09-26 11:45:14,814 - lava_callback - INFO - Starting async job submit for node 68d3d9c5cd36afa834e11599 2025-09-26 11:45:14,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:45:14,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d9c5cd36afa834e11599 HTTP/1.1" 200 None 2025-09-26 11:45:14,830 - lava_callback - DEBUG - Processing node 68d3d9c5cd36afa834e11599: ltp-containers 2025-09-26 11:45:14,830 - lava_callback - ERROR - Error processing callback for node 68d3d9c5cd36afa834e11599: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:50414 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 11:45:15,183 - lava_callback - INFO - Received callback for node 68d3dde4cd36afa834e11c30 INFO: 172.20.0.1:50420 - "POST /node/68d3dde4cd36afa834e11c30 HTTP/1.0" 202 Accepted 2025-09-26 11:45:15,189 - lava_callback - INFO - Starting async job submit for node 68d3dde4cd36afa834e11c30 2025-09-26 11:45:15,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:45:15,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dde4cd36afa834e11c30 HTTP/1.1" 200 None 2025-09-26 11:45:15,254 - lava_callback - DEBUG - Processing node 68d3dde4cd36afa834e11c30: baseline-arm64 2025-09-26 11:45:15,578 - lava_callback - ERROR - Error processing callback for node 68d3dde4cd36afa834e11c30: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:45:15,579 - lava_callback - INFO - Received callback for node 68d3d9c8cd36afa834e1159c INFO: 172.20.0.1:50430 - "POST /node/68d3d9c8cd36afa834e1159c HTTP/1.0" 202 Accepted 2025-09-26 11:45:15,585 - lava_callback - INFO - Starting async job submit for node 68d3d9c8cd36afa834e1159c 2025-09-26 11:45:15,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:45:15,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d9c8cd36afa834e1159c HTTP/1.1" 200 None 2025-09-26 11:45:15,626 - lava_callback - DEBUG - Processing node 68d3d9c8cd36afa834e1159c: ltp-ipc 2025-09-26 11:45:15,626 - lava_callback - ERROR - Error processing callback for node 68d3d9c8cd36afa834e1159c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:50446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33666 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:45:31,840 - lava_callback - INFO - Received callback for node 68d3d9cbcd36afa834e1159f INFO: 172.20.0.1:33680 - "POST /node/68d3d9cbcd36afa834e1159f HTTP/1.0" 202 Accepted 2025-09-26 11:45:31,846 - lava_callback - INFO - Starting async job submit for node 68d3d9cbcd36afa834e1159f 2025-09-26 11:45:31,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:45:31,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d9cbcd36afa834e1159f HTTP/1.1" 200 None 2025-09-26 11:45:31,862 - lava_callback - DEBUG - Processing node 68d3d9cbcd36afa834e1159f: ltp-cap-bounds 2025-09-26 11:45:31,862 - lava_callback - ERROR - Error processing callback for node 68d3d9cbcd36afa834e1159f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:45:32,599 - lava_callback - INFO - Received callback for node 68d3d9cecd36afa834e115a2 INFO: 172.20.0.1:33694 - "POST /node/68d3d9cecd36afa834e115a2 HTTP/1.0" 202 Accepted 2025-09-26 11:45:32,605 - lava_callback - INFO - Starting async job submit for node 68d3d9cecd36afa834e115a2 2025-09-26 11:45:32,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:45:32,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d9cecd36afa834e115a2 HTTP/1.1" 200 None 2025-09-26 11:45:32,625 - lava_callback - DEBUG - Processing node 68d3d9cecd36afa834e115a2: ltp-input 2025-09-26 11:45:32,625 - lava_callback - ERROR - Error processing callback for node 68d3d9cecd36afa834e115a2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:45:33,357 - lava_callback - INFO - Received callback for node 68d3d9d0cd36afa834e115a5 INFO: 172.20.0.1:33702 - "POST /node/68d3d9d0cd36afa834e115a5 HTTP/1.0" 202 Accepted 2025-09-26 11:45:33,363 - lava_callback - INFO - Starting async job submit for node 68d3d9d0cd36afa834e115a5 2025-09-26 11:45:33,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:45:33,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d9d0cd36afa834e115a5 HTTP/1.1" 200 None 2025-09-26 11:45:33,377 - lava_callback - DEBUG - Processing node 68d3d9d0cd36afa834e115a5: ltp-input 2025-09-26 11:45:33,377 - lava_callback - ERROR - Error processing callback for node 68d3d9d0cd36afa834e115a5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:45:34,125 - lava_callback - INFO - Received callback for node 68d3d9d3cd36afa834e115a8 INFO: 172.20.0.1:33706 - "POST /node/68d3d9d3cd36afa834e115a8 HTTP/1.0" 202 Accepted 2025-09-26 11:45:34,134 - lava_callback - INFO - Starting async job submit for node 68d3d9d3cd36afa834e115a8 2025-09-26 11:45:34,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:45:34,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d9d3cd36afa834e115a8 HTTP/1.1" 200 None 2025-09-26 11:45:34,170 - lava_callback - DEBUG - Processing node 68d3d9d3cd36afa834e115a8: ltp-pty 2025-09-26 11:45:34,170 - lava_callback - ERROR - Error processing callback for node 68d3d9d3cd36afa834e115a8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:45:34,889 - lava_callback - INFO - Received callback for node 68d3d9d6cd36afa834e115ab INFO: 172.20.0.1:33710 - "POST /node/68d3d9d6cd36afa834e115ab HTTP/1.0" 202 Accepted 2025-09-26 11:45:34,898 - lava_callback - INFO - Starting async job submit for node 68d3d9d6cd36afa834e115ab 2025-09-26 11:45:34,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:45:34,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d9d6cd36afa834e115ab HTTP/1.1" 200 None 2025-09-26 11:45:34,931 - lava_callback - DEBUG - Processing node 68d3d9d6cd36afa834e115ab: ltp-ipc 2025-09-26 11:45:34,931 - lava_callback - ERROR - Error processing callback for node 68d3d9d6cd36afa834e115ab: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:45:35,642 - lava_callback - INFO - Received callback for node 68d3d9d8cd36afa834e115ae INFO: 172.20.0.1:33722 - "POST /node/68d3d9d8cd36afa834e115ae HTTP/1.0" 202 Accepted 2025-09-26 11:45:35,648 - lava_callback - INFO - Starting async job submit for node 68d3d9d8cd36afa834e115ae 2025-09-26 11:45:35,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:45:35,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d9d8cd36afa834e115ae HTTP/1.1" 200 None 2025-09-26 11:45:35,662 - lava_callback - DEBUG - Processing node 68d3d9d8cd36afa834e115ae: ltp-ipc 2025-09-26 11:45:35,662 - lava_callback - ERROR - Error processing callback for node 68d3d9d8cd36afa834e115ae: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:45:36,466 - lava_callback - INFO - Received callback for node 68d3d9dccd36afa834e115b1 INFO: 172.20.0.1:33738 - "POST /node/68d3d9dccd36afa834e115b1 HTTP/1.0" 202 Accepted 2025-09-26 11:45:36,472 - lava_callback - INFO - Starting async job submit for node 68d3d9dccd36afa834e115b1 2025-09-26 11:45:36,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:45:36,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d9dccd36afa834e115b1 HTTP/1.1" 200 None 2025-09-26 11:45:36,488 - lava_callback - DEBUG - Processing node 68d3d9dccd36afa834e115b1: ltp-sched 2025-09-26 11:45:36,488 - lava_callback - ERROR - Error processing callback for node 68d3d9dccd36afa834e115b1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:33746 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:45:37,220 - lava_callback - INFO - Received callback for node 68d3d9decd36afa834e115b4 INFO: 172.20.0.1:33762 - "POST /node/68d3d9decd36afa834e115b4 HTTP/1.0" 202 Accepted 2025-09-26 11:45:37,226 - lava_callback - INFO - Starting async job submit for node 68d3d9decd36afa834e115b4 2025-09-26 11:45:37,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:45:37,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d9decd36afa834e115b4 HTTP/1.1" 200 None 2025-09-26 11:45:37,240 - lava_callback - DEBUG - Processing node 68d3d9decd36afa834e115b4: ltp-pty 2025-09-26 11:45:37,240 - lava_callback - ERROR - Error processing callback for node 68d3d9decd36afa834e115b4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:50444 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:45:52,001 - lava_callback - INFO - Received callback for node 68d3d9e3cd36afa834e115ba INFO: 172.20.0.1:59482 - "POST /node/68d3d9e3cd36afa834e115ba HTTP/1.0" 202 Accepted 2025-09-26 11:45:52,007 - lava_callback - INFO - Starting async job submit for node 68d3d9e3cd36afa834e115ba 2025-09-26 11:45:52,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:45:52,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d9e3cd36afa834e115ba HTTP/1.1" 200 None 2025-09-26 11:45:52,020 - lava_callback - DEBUG - Processing node 68d3d9e3cd36afa834e115ba: ltp-cap-bounds 2025-09-26 11:45:52,020 - lava_callback - ERROR - Error processing callback for node 68d3d9e3cd36afa834e115ba: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:45:52,736 - lava_callback - INFO - Received callback for node 68d3d9e7cd36afa834e115bd INFO: 172.20.0.1:59494 - "POST /node/68d3d9e7cd36afa834e115bd HTTP/1.0" 202 Accepted 2025-09-26 11:45:52,742 - lava_callback - INFO - Starting async job submit for node 68d3d9e7cd36afa834e115bd 2025-09-26 11:45:52,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:45:52,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d9e7cd36afa834e115bd HTTP/1.1" 200 None 2025-09-26 11:45:52,757 - lava_callback - DEBUG - Processing node 68d3d9e7cd36afa834e115bd: ltp-controllers 2025-09-26 11:45:52,757 - lava_callback - ERROR - Error processing callback for node 68d3d9e7cd36afa834e115bd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:45:53,496 - lava_callback - INFO - Received callback for node 68d3d9eacd36afa834e115c0 INFO: 172.20.0.1:59500 - "POST /node/68d3d9eacd36afa834e115c0 HTTP/1.0" 202 Accepted 2025-09-26 11:45:53,502 - lava_callback - INFO - Starting async job submit for node 68d3d9eacd36afa834e115c0 2025-09-26 11:45:53,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:45:53,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d9eacd36afa834e115c0 HTTP/1.1" 200 None 2025-09-26 11:45:53,518 - lava_callback - DEBUG - Processing node 68d3d9eacd36afa834e115c0: ltp-containers 2025-09-26 11:45:53,518 - lava_callback - ERROR - Error processing callback for node 68d3d9eacd36afa834e115c0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:45:54,249 - lava_callback - INFO - Received callback for node 68d3d9edcd36afa834e115c3 INFO: 172.20.0.1:59502 - "POST /node/68d3d9edcd36afa834e115c3 HTTP/1.0" 202 Accepted 2025-09-26 11:45:54,255 - lava_callback - INFO - Starting async job submit for node 68d3d9edcd36afa834e115c3 2025-09-26 11:45:54,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:45:54,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d9edcd36afa834e115c3 HTTP/1.1" 200 None 2025-09-26 11:45:54,268 - lava_callback - DEBUG - Processing node 68d3d9edcd36afa834e115c3: ltp-watchqueue 2025-09-26 11:45:54,268 - lava_callback - ERROR - Error processing callback for node 68d3d9edcd36afa834e115c3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:45:55,064 - lava_callback - INFO - Received callback for node 68d3d9efcd36afa834e115c6 INFO: 172.20.0.1:59518 - "POST /node/68d3d9efcd36afa834e115c6 HTTP/1.0" 202 Accepted 2025-09-26 11:45:55,070 - lava_callback - INFO - Starting async job submit for node 68d3d9efcd36afa834e115c6 2025-09-26 11:45:55,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:45:55,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d9efcd36afa834e115c6 HTTP/1.1" 200 None 2025-09-26 11:45:55,087 - lava_callback - DEBUG - Processing node 68d3d9efcd36afa834e115c6: ltp-watchqueue 2025-09-26 11:45:55,087 - lava_callback - ERROR - Error processing callback for node 68d3d9efcd36afa834e115c6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:45:56,464 - lava_callback - INFO - Received callback for node 68d3dde5cd36afa834e11c33 INFO: 172.20.0.1:59522 - "POST /node/68d3dde5cd36afa834e11c33 HTTP/1.0" 202 Accepted 2025-09-26 11:45:56,470 - lava_callback - INFO - Starting async job submit for node 68d3dde5cd36afa834e11c33 2025-09-26 11:45:56,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:45:56,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dde5cd36afa834e11c33 HTTP/1.1" 200 None 2025-09-26 11:45:56,506 - lava_callback - DEBUG - Processing node 68d3dde5cd36afa834e11c33: baseline-arm64 INFO: 172.20.0.1:59524 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:45:56,800 - lava_callback - ERROR - Error processing callback for node 68d3dde5cd36afa834e11c33: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:45:59,056 - lava_callback - INFO - Received callback for node 68d3ddeacd36afa834e11c36 INFO: 172.20.0.1:59540 - "POST /node/68d3ddeacd36afa834e11c36 HTTP/1.0" 202 Accepted 2025-09-26 11:45:59,064 - lava_callback - INFO - Starting async job submit for node 68d3ddeacd36afa834e11c36 2025-09-26 11:45:59,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:45:59,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ddeacd36afa834e11c36 HTTP/1.1" 200 None 2025-09-26 11:45:59,106 - lava_callback - DEBUG - Processing node 68d3ddeacd36afa834e11c36: baseline-arm64 2025-09-26 11:46:00,226 - lava_callback - ERROR - Error processing callback for node 68d3ddeacd36afa834e11c36: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:51488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55330 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:46:21,411 - lava_callback - INFO - Received callback for node 68d3ddf6cd36afa834e11c48 INFO: 172.20.0.1:55338 - "POST /node/68d3ddf6cd36afa834e11c48 HTTP/1.0" 202 Accepted 2025-09-26 11:46:21,417 - lava_callback - INFO - Starting async job submit for node 68d3ddf6cd36afa834e11c48 2025-09-26 11:46:21,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:46:21,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ddf6cd36afa834e11c48 HTTP/1.1" 200 None 2025-09-26 11:46:21,470 - lava_callback - DEBUG - Processing node 68d3ddf6cd36afa834e11c48: baseline-arm64 2025-09-26 11:46:21,780 - lava_callback - ERROR - Error processing callback for node 68d3ddf6cd36afa834e11c48: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:46:24,526 - lava_callback - INFO - Received callback for node 68d3d59ccd36afa834e10919 INFO: 172.20.0.1:55344 - "POST /node/68d3d59ccd36afa834e10919 HTTP/1.0" 202 Accepted 2025-09-26 11:46:24,533 - lava_callback - INFO - Starting async job submit for node 68d3d59ccd36afa834e10919 2025-09-26 11:46:24,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:46:24,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d59ccd36afa834e10919 HTTP/1.1" 200 None 2025-09-26 11:46:24,583 - lava_callback - DEBUG - Processing node 68d3d59ccd36afa834e10919: ltp-sched 2025-09-26 11:46:24,909 - lava_callback - ERROR - Error processing callback for node 68d3d59ccd36afa834e10919: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:55360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50200 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:46:39,317 - lava_callback - INFO - Received callback for node 68d3ddebcd36afa834e11c39 INFO: 172.20.0.1:43872 - "POST /node/68d3ddebcd36afa834e11c39 HTTP/1.0" 202 Accepted 2025-09-26 11:46:39,323 - lava_callback - INFO - Starting async job submit for node 68d3ddebcd36afa834e11c39 2025-09-26 11:46:39,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:46:39,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ddebcd36afa834e11c39 HTTP/1.1" 200 None 2025-09-26 11:46:39,356 - lava_callback - DEBUG - Processing node 68d3ddebcd36afa834e11c39: baseline-arm64 2025-09-26 11:46:39,680 - lava_callback - ERROR - Error processing callback for node 68d3ddebcd36afa834e11c39: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:43878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34644 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:47:12,034 - lava_callback - INFO - Received callback for node 68d3da38cd36afa834e1163c INFO: 172.20.0.1:50774 - "POST /node/68d3da38cd36afa834e1163c HTTP/1.0" 202 Accepted 2025-09-26 11:47:12,040 - lava_callback - INFO - Starting async job submit for node 68d3da38cd36afa834e1163c 2025-09-26 11:47:12,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:47:12,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3da38cd36afa834e1163c HTTP/1.1" 200 None 2025-09-26 11:47:12,054 - lava_callback - DEBUG - Processing node 68d3da38cd36afa834e1163c: ltp-smoketest 2025-09-26 11:47:12,054 - lava_callback - ERROR - Error processing callback for node 68d3da38cd36afa834e1163c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:47:12,836 - lava_callback - INFO - Received callback for node 68d3da3bcd36afa834e1163f INFO: 172.20.0.1:50790 - "POST /node/68d3da3bcd36afa834e1163f HTTP/1.0" 202 Accepted 2025-09-26 11:47:12,842 - lava_callback - INFO - Starting async job submit for node 68d3da3bcd36afa834e1163f 2025-09-26 11:47:12,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:47:12,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3da3bcd36afa834e1163f HTTP/1.1" 200 None 2025-09-26 11:47:12,855 - lava_callback - DEBUG - Processing node 68d3da3bcd36afa834e1163f: ltp-sched 2025-09-26 11:47:12,856 - lava_callback - ERROR - Error processing callback for node 68d3da3bcd36afa834e1163f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:47:13,630 - lava_callback - INFO - Received callback for node 68d3da3dcd36afa834e11642 INFO: 172.20.0.1:50792 - "POST /node/68d3da3dcd36afa834e11642 HTTP/1.0" 202 Accepted 2025-09-26 11:47:13,640 - lava_callback - INFO - Starting async job submit for node 68d3da3dcd36afa834e11642 2025-09-26 11:47:13,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:47:13,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3da3dcd36afa834e11642 HTTP/1.1" 200 None 2025-09-26 11:47:13,655 - lava_callback - DEBUG - Processing node 68d3da3dcd36afa834e11642: ltp-sched 2025-09-26 11:47:13,655 - lava_callback - ERROR - Error processing callback for node 68d3da3dcd36afa834e11642: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:50802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34108 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:47:30,257 - lava_callback - INFO - Received callback for node 68d3d951cd36afa834e114e1 INFO: 172.20.0.1:44130 - "POST /node/68d3d951cd36afa834e114e1 HTTP/1.0" 202 Accepted 2025-09-26 11:47:30,263 - lava_callback - INFO - Starting async job submit for node 68d3d951cd36afa834e114e1 2025-09-26 11:47:30,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:47:30,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d951cd36afa834e114e1 HTTP/1.1" 200 None 2025-09-26 11:47:30,301 - lava_callback - DEBUG - Processing node 68d3d951cd36afa834e114e1: ltp-timers 2025-09-26 11:47:30,618 - lava_callback - ERROR - Error processing callback for node 68d3d951cd36afa834e114e1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:44134 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:47:32,214 - lava_callback - INFO - Received callback for node 68d3da45cd36afa834e11649 INFO: 172.20.0.1:44140 - "POST /node/68d3da45cd36afa834e11649 HTTP/1.0" 202 Accepted 2025-09-26 11:47:32,220 - lava_callback - INFO - Starting async job submit for node 68d3da45cd36afa834e11649 2025-09-26 11:47:32,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:47:32,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3da45cd36afa834e11649 HTTP/1.1" 200 None 2025-09-26 11:47:32,236 - lava_callback - DEBUG - Processing node 68d3da45cd36afa834e11649: ltp-syscalls 2025-09-26 11:47:32,236 - lava_callback - ERROR - Error processing callback for node 68d3da45cd36afa834e11649: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:47:36,404 - lava_callback - INFO - Received callback for node 68d3ddf9cd36afa834e11c4b INFO: 172.20.0.1:44152 - "POST /node/68d3ddf9cd36afa834e11c4b HTTP/1.0" 202 Accepted 2025-09-26 11:47:36,410 - lava_callback - INFO - Starting async job submit for node 68d3ddf9cd36afa834e11c4b 2025-09-26 11:47:36,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:47:36,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ddf9cd36afa834e11c4b HTTP/1.1" 200 None 2025-09-26 11:47:36,469 - lava_callback - DEBUG - Processing node 68d3ddf9cd36afa834e11c4b: baseline-arm64 INFO: 172.20.0.1:44164 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:47:36,795 - lava_callback - ERROR - Error processing callback for node 68d3ddf9cd36afa834e11c4b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:47:37,660 - lava_callback - INFO - Received callback for node 68d3de05cd36afa834e11c54 INFO: 172.20.0.1:44172 - "POST /node/68d3de05cd36afa834e11c54 HTTP/1.0" 202 Accepted 2025-09-26 11:47:37,668 - lava_callback - INFO - Starting async job submit for node 68d3de05cd36afa834e11c54 2025-09-26 11:47:37,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:47:37,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3de05cd36afa834e11c54 HTTP/1.1" 200 None 2025-09-26 11:47:37,709 - lava_callback - DEBUG - Processing node 68d3de05cd36afa834e11c54: baseline-arm64 2025-09-26 11:47:38,094 - lava_callback - ERROR - Error processing callback for node 68d3de05cd36afa834e11c54: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:47:44,305 - lava_callback - INFO - Received callback for node 68d3de06cd36afa834e11c57 INFO: 172.20.0.1:39136 - "POST /node/68d3de06cd36afa834e11c57 HTTP/1.0" 202 Accepted 2025-09-26 11:47:44,311 - lava_callback - INFO - Starting async job submit for node 68d3de06cd36afa834e11c57 2025-09-26 11:47:44,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:47:44,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3de06cd36afa834e11c57 HTTP/1.1" 200 None 2025-09-26 11:47:44,358 - lava_callback - DEBUG - Processing node 68d3de06cd36afa834e11c57: baseline-arm64 2025-09-26 11:47:44,659 - lava_callback - ERROR - Error processing callback for node 68d3de06cd36afa834e11c57: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:39140 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:47:51,966 - lava_callback - INFO - Received callback for node 68d3da5fcd36afa834e1166f INFO: 172.20.0.1:49002 - "POST /node/68d3da5fcd36afa834e1166f HTTP/1.0" 202 Accepted 2025-09-26 11:47:51,972 - lava_callback - INFO - Starting async job submit for node 68d3da5fcd36afa834e1166f 2025-09-26 11:47:51,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:47:51,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3da5fcd36afa834e1166f HTTP/1.1" 200 None 2025-09-26 11:47:51,986 - lava_callback - DEBUG - Processing node 68d3da5fcd36afa834e1166f: ltp-smoketest 2025-09-26 11:47:51,986 - lava_callback - ERROR - Error processing callback for node 68d3da5fcd36afa834e1166f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:49004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48242 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 11:48:16,306 - lava_callback - INFO - Received callback for node 68d3de09cd36afa834e11c5a INFO: 172.20.0.1:48244 - "POST /node/68d3de09cd36afa834e11c5a HTTP/1.0" 202 Accepted 2025-09-26 11:48:16,312 - lava_callback - INFO - Starting async job submit for node 68d3de09cd36afa834e11c5a 2025-09-26 11:48:16,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:48:16,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3de09cd36afa834e11c5a HTTP/1.1" 200 None 2025-09-26 11:48:16,346 - lava_callback - DEBUG - Processing node 68d3de09cd36afa834e11c5a: baseline-arm64 INFO: 172.20.0.1:48260 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:48:16,723 - lava_callback - ERROR - Error processing callback for node 68d3de09cd36afa834e11c5a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:55914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53214 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:49:19,735 - lava_callback - INFO - Received callback for node 68d3e021cd36afa834e11f34 INFO: 172.20.0.1:34176 - "POST /node/68d3e021cd36afa834e11f34 HTTP/1.0" 202 Accepted 2025-09-26 11:49:19,742 - lava_callback - INFO - Starting async job submit for node 68d3e021cd36afa834e11f34 2025-09-26 11:49:19,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:49:19,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e021cd36afa834e11f34 HTTP/1.1" 200 None 2025-09-26 11:49:19,785 - lava_callback - DEBUG - Processing node 68d3e021cd36afa834e11f34: baseline-arm64 2025-09-26 11:49:20,750 - lava_callback - ERROR - Error processing callback for node 68d3e021cd36afa834e11f34: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:34184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34188 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:49:32,227 - lava_callback - INFO - Received callback for node 68d3dab9cd36afa834e116f8 INFO: 172.20.0.1:53610 - "POST /node/68d3dab9cd36afa834e116f8 HTTP/1.0" 202 Accepted 2025-09-26 11:49:32,233 - lava_callback - INFO - Starting async job submit for node 68d3dab9cd36afa834e116f8 2025-09-26 11:49:32,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:49:32,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dab9cd36afa834e116f8 HTTP/1.1" 200 None 2025-09-26 11:49:32,247 - lava_callback - DEBUG - Processing node 68d3dab9cd36afa834e116f8: ltp-syscalls-ipc 2025-09-26 11:49:32,247 - lava_callback - ERROR - Error processing callback for node 68d3dab9cd36afa834e116f8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:53614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52008 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:49:52,068 - lava_callback - INFO - Received callback for node 68d3daddcd36afa834e11722 INFO: 172.20.0.1:51282 - "POST /node/68d3daddcd36afa834e11722 HTTP/1.0" 202 Accepted 2025-09-26 11:49:52,074 - lava_callback - INFO - Starting async job submit for node 68d3daddcd36afa834e11722 2025-09-26 11:49:52,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:49:52,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3daddcd36afa834e11722 HTTP/1.1" 200 None 2025-09-26 11:49:52,111 - lava_callback - DEBUG - Processing node 68d3daddcd36afa834e11722: ltp-containers 2025-09-26 11:49:52,111 - lava_callback - ERROR - Error processing callback for node 68d3daddcd36afa834e11722: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:49:55,047 - lava_callback - INFO - Received callback for node 68d3e024cd36afa834e11f37 INFO: 172.20.0.1:51292 - "POST /node/68d3e024cd36afa834e11f37 HTTP/1.0" 202 Accepted 2025-09-26 11:49:55,056 - lava_callback - INFO - Starting async job submit for node 68d3e024cd36afa834e11f37 2025-09-26 11:49:55,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:49:55,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e024cd36afa834e11f37 HTTP/1.1" 200 None 2025-09-26 11:49:55,092 - lava_callback - DEBUG - Processing node 68d3e024cd36afa834e11f37: baseline-arm64 2025-09-26 11:49:55,388 - lava_callback - ERROR - Error processing callback for node 68d3e024cd36afa834e11f37: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:51294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38908 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:50:12,148 - lava_callback - INFO - Received callback for node 68d3dadfcd36afa834e11725 INFO: 172.20.0.1:47424 - "POST /node/68d3dadfcd36afa834e11725 HTTP/1.0" 202 Accepted 2025-09-26 11:50:12,154 - lava_callback - INFO - Starting async job submit for node 68d3dadfcd36afa834e11725 2025-09-26 11:50:12,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:50:12,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dadfcd36afa834e11725 HTTP/1.1" 200 None 2025-09-26 11:50:12,179 - lava_callback - DEBUG - Processing node 68d3dadfcd36afa834e11725: ltp-syscalls 2025-09-26 11:50:12,179 - lava_callback - ERROR - Error processing callback for node 68d3dadfcd36afa834e11725: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:47440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51258 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:50:42,075 - lava_callback - INFO - Received callback for node 68d41b3ca5c2c05277bc5cb8 INFO: 172.20.0.1:51318 - "POST /node/68d41b3ca5c2c05277bc5cb8 HTTP/1.0" 202 Accepted 2025-09-26 11:50:42,080 - lava_callback - INFO - Starting async job submit for node 68d41b3ca5c2c05277bc5cb8 2025-09-26 11:50:42,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:50:42,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41b3ca5c2c05277bc5cb8 HTTP/1.1" 200 None 2025-09-26 11:50:42,119 - lava_callback - DEBUG - Processing node 68d41b3ca5c2c05277bc5cb8: baseline-arm 2025-09-26 11:50:42,346 - lava_callback - ERROR - Error processing callback for node 68d41b3ca5c2c05277bc5cb8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:51324 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:50:52,170 - lava_callback - INFO - Received callback for node 68d3db08cd36afa834e11775 INFO: 172.20.0.1:40374 - "POST /node/68d3db08cd36afa834e11775 HTTP/1.0" 202 Accepted 2025-09-26 11:50:52,176 - lava_callback - INFO - Starting async job submit for node 68d3db08cd36afa834e11775 2025-09-26 11:50:52,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:50:52,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3db08cd36afa834e11775 HTTP/1.1" 200 None 2025-09-26 11:50:52,191 - lava_callback - DEBUG - Processing node 68d3db08cd36afa834e11775: ltp-syscalls 2025-09-26 11:50:52,191 - lava_callback - ERROR - Error processing callback for node 68d3db08cd36afa834e11775: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:40386 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:50:57,963 - lava_callback - INFO - Received callback for node 68d3e032cd36afa834e11f46 INFO: 172.20.0.1:40396 - "POST /node/68d3e032cd36afa834e11f46 HTTP/1.0" 202 Accepted 2025-09-26 11:50:57,969 - lava_callback - INFO - Starting async job submit for node 68d3e032cd36afa834e11f46 2025-09-26 11:50:57,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:50:58,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e032cd36afa834e11f46 HTTP/1.1" 200 None 2025-09-26 11:50:58,009 - lava_callback - DEBUG - Processing node 68d3e032cd36afa834e11f46: baseline-arm64 2025-09-26 11:50:58,333 - lava_callback - ERROR - Error processing callback for node 68d3e032cd36afa834e11f46: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:50:59,243 - lava_callback - INFO - Received callback for node 68d3e035cd36afa834e11f49 INFO: 172.20.0.1:40402 - "POST /node/68d3e035cd36afa834e11f49 HTTP/1.0" 202 Accepted 2025-09-26 11:50:59,252 - lava_callback - INFO - Starting async job submit for node 68d3e035cd36afa834e11f49 2025-09-26 11:50:59,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:50:59,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e035cd36afa834e11f49 HTTP/1.1" 200 None 2025-09-26 11:50:59,308 - lava_callback - DEBUG - Processing node 68d3e035cd36afa834e11f49: baseline-arm64 2025-09-26 11:50:59,624 - lava_callback - ERROR - Error processing callback for node 68d3e035cd36afa834e11f49: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:49792 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:51:13,368 - lava_callback - INFO - Received callback for node 68d3e03ccd36afa834e11f58 INFO: 172.20.0.1:35374 - "POST /node/68d3e03ccd36afa834e11f58 HTTP/1.0" 202 Accepted 2025-09-26 11:51:13,375 - lava_callback - INFO - Starting async job submit for node 68d3e03ccd36afa834e11f58 2025-09-26 11:51:13,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:51:13,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e03ccd36afa834e11f58 HTTP/1.1" 200 None 2025-09-26 11:51:13,409 - lava_callback - DEBUG - Processing node 68d3e03ccd36afa834e11f58: baseline-arm64 2025-09-26 11:51:13,758 - lava_callback - ERROR - Error processing callback for node 68d3e03ccd36afa834e11f58: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:35390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46302 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:51:52,247 - lava_callback - INFO - Received callback for node 68d3db43cd36afa834e117bf INFO: 172.20.0.1:46132 - "POST /node/68d3db43cd36afa834e117bf HTTP/1.0" 202 Accepted 2025-09-26 11:51:52,253 - lava_callback - INFO - Starting async job submit for node 68d3db43cd36afa834e117bf 2025-09-26 11:51:52,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:51:52,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3db43cd36afa834e117bf HTTP/1.1" 200 None 2025-09-26 11:51:52,268 - lava_callback - DEBUG - Processing node 68d3db43cd36afa834e117bf: ltp-containers 2025-09-26 11:51:52,268 - lava_callback - ERROR - Error processing callback for node 68d3db43cd36afa834e117bf: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:51:53,037 - lava_callback - INFO - Received callback for node 68d3db46cd36afa834e117c2 INFO: 172.20.0.1:46140 - "POST /node/68d3db46cd36afa834e117c2 HTTP/1.0" 202 Accepted 2025-09-26 11:51:53,044 - lava_callback - INFO - Starting async job submit for node 68d3db46cd36afa834e117c2 2025-09-26 11:51:53,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:51:53,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3db46cd36afa834e117c2 HTTP/1.1" 200 None 2025-09-26 11:51:53,067 - lava_callback - DEBUG - Processing node 68d3db46cd36afa834e117c2: ltp-cve 2025-09-26 11:51:53,067 - lava_callback - ERROR - Error processing callback for node 68d3db46cd36afa834e117c2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:51:53,862 - lava_callback - INFO - Received callback for node 68d3db50cd36afa834e117cb INFO: 172.20.0.1:46148 - "POST /node/68d3db50cd36afa834e117cb HTTP/1.0" 202 Accepted 2025-09-26 11:51:53,871 - lava_callback - INFO - Starting async job submit for node 68d3db50cd36afa834e117cb 2025-09-26 11:51:53,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:51:53,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3db50cd36afa834e117cb HTTP/1.1" 200 None 2025-09-26 11:51:53,885 - lava_callback - DEBUG - Processing node 68d3db50cd36afa834e117cb: ltp-timers 2025-09-26 11:51:53,885 - lava_callback - ERROR - Error processing callback for node 68d3db50cd36afa834e117cb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:46162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41380 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:52:12,202 - lava_callback - INFO - Received callback for node 68d3db5bcd36afa834e117d4 INFO: 172.20.0.1:53676 - "POST /node/68d3db5bcd36afa834e117d4 HTTP/1.0" 202 Accepted 2025-09-26 11:52:12,208 - lava_callback - INFO - Starting async job submit for node 68d3db5bcd36afa834e117d4 2025-09-26 11:52:12,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:52:12,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3db5bcd36afa834e117d4 HTTP/1.1" 200 None 2025-09-26 11:52:12,246 - lava_callback - DEBUG - Processing node 68d3db5bcd36afa834e117d4: ltp-syscalls-ipc 2025-09-26 11:52:12,246 - lava_callback - ERROR - Error processing callback for node 68d3db5bcd36afa834e117d4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:53684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33026 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:52:21,458 - lava_callback - INFO - Received callback for node 68d45e6ba5c2c05277bcad57 INFO: 172.20.0.1:33030 - "POST /node/68d45e6ba5c2c05277bcad57 HTTP/1.0" 202 Accepted 2025-09-26 11:52:21,464 - lava_callback - INFO - Starting async job submit for node 68d45e6ba5c2c05277bcad57 2025-09-26 11:52:21,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:52:21,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d45e6ba5c2c05277bcad57 HTTP/1.1" 200 None 2025-09-26 11:52:21,496 - lava_callback - DEBUG - Processing node 68d45e6ba5c2c05277bcad57: baseline-arm64-broonie 2025-09-26 11:52:21,788 - lava_callback - ERROR - Error processing callback for node 68d45e6ba5c2c05277bcad57: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:33042 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:52:32,937 - lava_callback - INFO - Received callback for node 68d3e044cd36afa834e11f64 INFO: 172.20.0.1:49890 - "POST /node/68d3e044cd36afa834e11f64 HTTP/1.0" 202 Accepted 2025-09-26 11:52:32,943 - lava_callback - INFO - Starting async job submit for node 68d3e044cd36afa834e11f64 2025-09-26 11:52:32,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:52:32,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e044cd36afa834e11f64 HTTP/1.1" 200 None 2025-09-26 11:52:32,978 - lava_callback - DEBUG - Processing node 68d3e044cd36afa834e11f64: baseline-arm64 2025-09-26 11:52:33,267 - lava_callback - ERROR - Error processing callback for node 68d3e044cd36afa834e11f64: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:49896 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:52:34,185 - lava_callback - INFO - Received callback for node 68d3e03dcd36afa834e11f5b INFO: 172.20.0.1:49902 - "POST /node/68d3e03dcd36afa834e11f5b HTTP/1.0" 202 Accepted 2025-09-26 11:52:34,191 - lava_callback - INFO - Starting async job submit for node 68d3e03dcd36afa834e11f5b 2025-09-26 11:52:34,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:52:34,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e03dcd36afa834e11f5b HTTP/1.1" 200 None 2025-09-26 11:52:34,224 - lava_callback - DEBUG - Processing node 68d3e03dcd36afa834e11f5b: baseline-arm64 2025-09-26 11:52:34,533 - lava_callback - ERROR - Error processing callback for node 68d3e03dcd36afa834e11f5b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:52:35,459 - lava_callback - INFO - Received callback for node 68d3e046cd36afa834e11f67 INFO: 172.20.0.1:49910 - "POST /node/68d3e046cd36afa834e11f67 HTTP/1.0" 202 Accepted 2025-09-26 11:52:35,465 - lava_callback - INFO - Starting async job submit for node 68d3e046cd36afa834e11f67 2025-09-26 11:52:35,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:52:35,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e046cd36afa834e11f67 HTTP/1.1" 200 None 2025-09-26 11:52:35,515 - lava_callback - DEBUG - Processing node 68d3e046cd36afa834e11f67: baseline-arm64 2025-09-26 11:52:35,816 - lava_callback - ERROR - Error processing callback for node 68d3e046cd36afa834e11f67: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:49916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49170 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:52:52,167 - lava_callback - INFO - Received callback for node 68d3db83cd36afa834e11810 INFO: 172.20.0.1:59390 - "POST /node/68d3db83cd36afa834e11810 HTTP/1.0" 202 Accepted 2025-09-26 11:52:52,173 - lava_callback - INFO - Starting async job submit for node 68d3db83cd36afa834e11810 2025-09-26 11:52:52,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:52:52,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3db83cd36afa834e11810 HTTP/1.1" 200 None 2025-09-26 11:52:52,190 - lava_callback - DEBUG - Processing node 68d3db83cd36afa834e11810: ltp-controllers 2025-09-26 11:52:52,191 - lava_callback - ERROR - Error processing callback for node 68d3db83cd36afa834e11810: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:52:52,958 - lava_callback - INFO - Received callback for node 68d3db85cd36afa834e11813 INFO: 172.20.0.1:59406 - "POST /node/68d3db85cd36afa834e11813 HTTP/1.0" 202 Accepted 2025-09-26 11:52:52,964 - lava_callback - INFO - Starting async job submit for node 68d3db85cd36afa834e11813 2025-09-26 11:52:52,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:52:53,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3db85cd36afa834e11813 HTTP/1.1" 200 None 2025-09-26 11:52:53,011 - lava_callback - DEBUG - Processing node 68d3db85cd36afa834e11813: ltp-controllers 2025-09-26 11:52:53,011 - lava_callback - ERROR - Error processing callback for node 68d3db85cd36afa834e11813: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:52:53,778 - lava_callback - INFO - Received callback for node 68d3db8ecd36afa834e1181c INFO: 172.20.0.1:59420 - "POST /node/68d3db8ecd36afa834e1181c HTTP/1.0" 202 Accepted 2025-09-26 11:52:53,784 - lava_callback - INFO - Starting async job submit for node 68d3db8ecd36afa834e1181c 2025-09-26 11:52:53,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:52:53,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3db8ecd36afa834e1181c HTTP/1.1" 200 None 2025-09-26 11:52:53,798 - lava_callback - DEBUG - Processing node 68d3db8ecd36afa834e1181c: ltp-syscalls-ipc 2025-09-26 11:52:53,799 - lava_callback - ERROR - Error processing callback for node 68d3db8ecd36afa834e1181c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:59428 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:53:03,218 - lava_callback - INFO - Received callback for node 68d41b3ea5c2c05277bc5cc4 INFO: 172.20.0.1:42810 - "POST /node/68d41b3ea5c2c05277bc5cc4 HTTP/1.0" 202 Accepted 2025-09-26 11:53:03,224 - lava_callback - INFO - Starting async job submit for node 68d41b3ea5c2c05277bc5cc4 2025-09-26 11:53:03,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:53:03,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41b3ea5c2c05277bc5cc4 HTTP/1.1" 200 None 2025-09-26 11:53:03,258 - lava_callback - DEBUG - Processing node 68d41b3ea5c2c05277bc5cc4: baseline-arm 2025-09-26 11:53:03,480 - lava_callback - ERROR - Error processing callback for node 68d41b3ea5c2c05277bc5cc4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:42816 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:53:12,208 - lava_callback - INFO - Received callback for node 68d3db94cd36afa834e11825 INFO: 172.20.0.1:56678 - "POST /node/68d3db94cd36afa834e11825 HTTP/1.0" 202 Accepted 2025-09-26 11:53:12,214 - lava_callback - INFO - Starting async job submit for node 68d3db94cd36afa834e11825 2025-09-26 11:53:12,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:53:12,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3db94cd36afa834e11825 HTTP/1.1" 200 None 2025-09-26 11:53:12,230 - lava_callback - DEBUG - Processing node 68d3db94cd36afa834e11825: ltp-watchqueue 2025-09-26 11:53:12,230 - lava_callback - ERROR - Error processing callback for node 68d3db94cd36afa834e11825: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:56694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39810 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:53:52,224 - lava_callback - INFO - Received callback for node 68d3dbbfcd36afa834e11860 INFO: 172.20.0.1:33494 - "POST /node/68d3dbbfcd36afa834e11860 HTTP/1.0" 202 Accepted 2025-09-26 11:53:52,230 - lava_callback - INFO - Starting async job submit for node 68d3dbbfcd36afa834e11860 2025-09-26 11:53:52,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:53:52,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dbbfcd36afa834e11860 HTTP/1.1" 200 None 2025-09-26 11:53:52,244 - lava_callback - DEBUG - Processing node 68d3dbbfcd36afa834e11860: ltp-cve 2025-09-26 11:53:52,244 - lava_callback - ERROR - Error processing callback for node 68d3dbbfcd36afa834e11860: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:53:52,971 - lava_callback - INFO - Received callback for node 68d3dbc2cd36afa834e11867 INFO: 172.20.0.1:33510 - "POST /node/68d3dbc2cd36afa834e11867 HTTP/1.0" 202 Accepted 2025-09-26 11:53:52,977 - lava_callback - INFO - Starting async job submit for node 68d3dbc2cd36afa834e11867 2025-09-26 11:53:52,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:53:52,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dbc2cd36afa834e11867 HTTP/1.1" 200 None 2025-09-26 11:53:52,996 - lava_callback - DEBUG - Processing node 68d3dbc2cd36afa834e11867: ltp-cap-bounds 2025-09-26 11:53:52,996 - lava_callback - ERROR - Error processing callback for node 68d3dbc2cd36afa834e11867: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:53:53,731 - lava_callback - INFO - Received callback for node 68d3dbc4cd36afa834e1186a INFO: 172.20.0.1:33512 - "POST /node/68d3dbc4cd36afa834e1186a HTTP/1.0" 202 Accepted 2025-09-26 11:53:53,741 - lava_callback - INFO - Starting async job submit for node 68d3dbc4cd36afa834e1186a 2025-09-26 11:53:53,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:53:53,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dbc4cd36afa834e1186a HTTP/1.1" 200 None 2025-09-26 11:53:53,757 - lava_callback - DEBUG - Processing node 68d3dbc4cd36afa834e1186a: ltp-timers 2025-09-26 11:53:53,757 - lava_callback - ERROR - Error processing callback for node 68d3dbc4cd36afa834e1186a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:53:54,493 - lava_callback - INFO - Received callback for node 68d3dbcbcd36afa834e11870 INFO: 172.20.0.1:33522 - "POST /node/68d3dbcbcd36afa834e11870 HTTP/1.0" 202 Accepted 2025-09-26 11:53:54,499 - lava_callback - INFO - Starting async job submit for node 68d3dbcbcd36afa834e11870 2025-09-26 11:53:54,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:53:54,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dbcbcd36afa834e11870 HTTP/1.1" 200 None 2025-09-26 11:53:54,513 - lava_callback - DEBUG - Processing node 68d3dbcbcd36afa834e11870: ltp-timers 2025-09-26 11:53:54,513 - lava_callback - ERROR - Error processing callback for node 68d3dbcbcd36afa834e11870: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:53:55,902 - lava_callback - INFO - Received callback for node 68d3e05dcd36afa834e11f7c INFO: 172.20.0.1:33526 - "POST /node/68d3e05dcd36afa834e11f7c HTTP/1.0" 202 Accepted 2025-09-26 11:53:55,908 - lava_callback - INFO - Starting async job submit for node 68d3e05dcd36afa834e11f7c 2025-09-26 11:53:55,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:53:55,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e05dcd36afa834e11f7c HTTP/1.1" 200 None 2025-09-26 11:53:55,961 - lava_callback - DEBUG - Processing node 68d3e05dcd36afa834e11f7c: baseline-arm64 2025-09-26 11:53:56,252 - lava_callback - ERROR - Error processing callback for node 68d3e05dcd36afa834e11f7c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:33540 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:53:59,599 - lava_callback - INFO - Received callback for node 68d3e05ccd36afa834e11f79 INFO: 172.20.0.1:44982 - "POST /node/68d3e05ccd36afa834e11f79 HTTP/1.0" 202 Accepted 2025-09-26 11:53:59,605 - lava_callback - INFO - Starting async job submit for node 68d3e05ccd36afa834e11f79 2025-09-26 11:53:59,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:53:59,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e05ccd36afa834e11f79 HTTP/1.1" 200 None 2025-09-26 11:53:59,650 - lava_callback - DEBUG - Processing node 68d3e05ccd36afa834e11f79: baseline-arm64 2025-09-26 11:53:59,955 - lava_callback - ERROR - Error processing callback for node 68d3e05ccd36afa834e11f79: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:54:01,008 - lava_callback - INFO - Received callback for node 68d3e067cd36afa834e11f85 INFO: 172.20.0.1:44988 - "POST /node/68d3e067cd36afa834e11f85 HTTP/1.0" 202 Accepted 2025-09-26 11:54:01,017 - lava_callback - INFO - Starting async job submit for node 68d3e067cd36afa834e11f85 2025-09-26 11:54:01,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:54:01,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e067cd36afa834e11f85 HTTP/1.1" 200 None 2025-09-26 11:54:01,062 - lava_callback - DEBUG - Processing node 68d3e067cd36afa834e11f85: baseline-arm64 2025-09-26 11:54:01,372 - lava_callback - ERROR - Error processing callback for node 68d3e067cd36afa834e11f85: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:45000 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:54:12,308 - lava_callback - INFO - Received callback for node 68d3dbd1cd36afa834e11876 INFO: 172.20.0.1:38842 - "POST /node/68d3dbd1cd36afa834e11876 HTTP/1.0" 202 Accepted 2025-09-26 11:54:12,315 - lava_callback - INFO - Starting async job submit for node 68d3dbd1cd36afa834e11876 2025-09-26 11:54:12,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:54:12,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dbd1cd36afa834e11876 HTTP/1.1" 200 None 2025-09-26 11:54:12,339 - lava_callback - DEBUG - Processing node 68d3dbd1cd36afa834e11876: ltp-containers 2025-09-26 11:54:12,339 - lava_callback - ERROR - Error processing callback for node 68d3dbd1cd36afa834e11876: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:54:13,115 - lava_callback - INFO - Received callback for node 68d3dbd5cd36afa834e11879 INFO: 172.20.0.1:38846 - "POST /node/68d3dbd5cd36afa834e11879 HTTP/1.0" 202 Accepted 2025-09-26 11:54:13,121 - lava_callback - INFO - Starting async job submit for node 68d3dbd5cd36afa834e11879 2025-09-26 11:54:13,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:54:13,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dbd5cd36afa834e11879 HTTP/1.1" 200 None 2025-09-26 11:54:13,135 - lava_callback - DEBUG - Processing node 68d3dbd5cd36afa834e11879: ltp-cap-bounds 2025-09-26 11:54:13,135 - lava_callback - ERROR - Error processing callback for node 68d3dbd5cd36afa834e11879: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:54:13,885 - lava_callback - INFO - Received callback for node 68d3dbd8cd36afa834e1187c INFO: 172.20.0.1:38862 - "POST /node/68d3dbd8cd36afa834e1187c HTTP/1.0" 202 Accepted 2025-09-26 11:54:13,894 - lava_callback - INFO - Starting async job submit for node 68d3dbd8cd36afa834e1187c 2025-09-26 11:54:13,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:54:13,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dbd8cd36afa834e1187c HTTP/1.1" 200 None 2025-09-26 11:54:13,916 - lava_callback - DEBUG - Processing node 68d3dbd8cd36afa834e1187c: ltp-cve 2025-09-26 11:54:13,916 - lava_callback - ERROR - Error processing callback for node 68d3dbd8cd36afa834e1187c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:38876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54060 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:55:12,332 - lava_callback - INFO - Received callback for node 68d3dc19cd36afa834e118d9 INFO: 172.20.0.1:46544 - "POST /node/68d3dc19cd36afa834e118d9 HTTP/1.0" 202 Accepted 2025-09-26 11:55:12,338 - lava_callback - INFO - Starting async job submit for node 68d3dc19cd36afa834e118d9 2025-09-26 11:55:12,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:55:12,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dc19cd36afa834e118d9 HTTP/1.1" 200 None 2025-09-26 11:55:12,353 - lava_callback - DEBUG - Processing node 68d3dc19cd36afa834e118d9: ltp-cap-bounds 2025-09-26 11:55:12,353 - lava_callback - ERROR - Error processing callback for node 68d3dc19cd36afa834e118d9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:46554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51390 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:55:23,134 - lava_callback - INFO - Received callback for node 68d3e068cd36afa834e11f88 INFO: 172.20.0.1:51394 - "POST /node/68d3e068cd36afa834e11f88 HTTP/1.0" 202 Accepted 2025-09-26 11:55:23,140 - lava_callback - INFO - Starting async job submit for node 68d3e068cd36afa834e11f88 2025-09-26 11:55:23,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:55:23,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e068cd36afa834e11f88 HTTP/1.1" 200 None 2025-09-26 11:55:23,233 - lava_callback - DEBUG - Processing node 68d3e068cd36afa834e11f88: baseline-arm64 2025-09-26 11:55:23,637 - lava_callback - ERROR - Error processing callback for node 68d3e068cd36afa834e11f88: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:51410 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:55:32,431 - lava_callback - INFO - Received callback for node 68d3dc23cd36afa834e11901 INFO: 172.20.0.1:46882 - "POST /node/68d3dc23cd36afa834e11901 HTTP/1.0" 202 Accepted 2025-09-26 11:55:32,437 - lava_callback - INFO - Starting async job submit for node 68d3dc23cd36afa834e11901 2025-09-26 11:55:32,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:55:32,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dc23cd36afa834e11901 HTTP/1.1" 200 None 2025-09-26 11:55:32,458 - lava_callback - DEBUG - Processing node 68d3dc23cd36afa834e11901: ltp-controllers 2025-09-26 11:55:32,458 - lava_callback - ERROR - Error processing callback for node 68d3dc23cd36afa834e11901: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:55:33,197 - lava_callback - INFO - Received callback for node 68d3dc26cd36afa834e11904 INFO: 172.20.0.1:46886 - "POST /node/68d3dc26cd36afa834e11904 HTTP/1.0" 202 Accepted 2025-09-26 11:55:33,203 - lava_callback - INFO - Starting async job submit for node 68d3dc26cd36afa834e11904 2025-09-26 11:55:33,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:55:33,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dc26cd36afa834e11904 HTTP/1.1" 200 None 2025-09-26 11:55:33,225 - lava_callback - DEBUG - Processing node 68d3dc26cd36afa834e11904: ltp-containers 2025-09-26 11:55:33,225 - lava_callback - ERROR - Error processing callback for node 68d3dc26cd36afa834e11904: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:55:33,998 - lava_callback - INFO - Received callback for node 68d3dc2ecd36afa834e1190d INFO: 172.20.0.1:46888 - "POST /node/68d3dc2ecd36afa834e1190d HTTP/1.0" 202 Accepted 2025-09-26 11:55:34,005 - lava_callback - INFO - Starting async job submit for node 68d3dc2ecd36afa834e1190d 2025-09-26 11:55:34,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:55:34,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dc2ecd36afa834e1190d HTTP/1.1" 200 None 2025-09-26 11:55:34,019 - lava_callback - DEBUG - Processing node 68d3dc2ecd36afa834e1190d: ltp-watchqueue 2025-09-26 11:55:34,020 - lava_callback - ERROR - Error processing callback for node 68d3dc2ecd36afa834e1190d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:46904 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:55:34,761 - lava_callback - INFO - Received callback for node 68d3dc35cd36afa834e11916 INFO: 172.20.0.1:46920 - "POST /node/68d3dc35cd36afa834e11916 HTTP/1.0" 202 Accepted 2025-09-26 11:55:34,767 - lava_callback - INFO - Starting async job submit for node 68d3dc35cd36afa834e11916 2025-09-26 11:55:34,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:55:34,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dc35cd36afa834e11916 HTTP/1.1" 200 None 2025-09-26 11:55:34,783 - lava_callback - DEBUG - Processing node 68d3dc35cd36afa834e11916: ltp-watchqueue 2025-09-26 11:55:34,783 - lava_callback - ERROR - Error processing callback for node 68d3dc35cd36afa834e11916: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:55:36,062 - lava_callback - INFO - Received callback for node 68d3e1a4cd36afa834e1213f INFO: 172.20.0.1:46930 - "POST /node/68d3e1a4cd36afa834e1213f HTTP/1.0" 202 Accepted 2025-09-26 11:55:36,068 - lava_callback - INFO - Starting async job submit for node 68d3e1a4cd36afa834e1213f 2025-09-26 11:55:36,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:55:36,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e1a4cd36afa834e1213f HTTP/1.1" 200 None 2025-09-26 11:55:36,106 - lava_callback - DEBUG - Processing node 68d3e1a4cd36afa834e1213f: baseline-arm64 2025-09-26 11:55:36,420 - lava_callback - ERROR - Error processing callback for node 68d3e1a4cd36afa834e1213f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:46942 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:55:37,328 - lava_callback - INFO - Received callback for node 68d3e1a4cd36afa834e12142 INFO: 172.20.0.1:46954 - "POST /node/68d3e1a4cd36afa834e12142 HTTP/1.0" 202 Accepted 2025-09-26 11:55:37,334 - lava_callback - INFO - Starting async job submit for node 68d3e1a4cd36afa834e12142 2025-09-26 11:55:37,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:55:37,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e1a4cd36afa834e12142 HTTP/1.1" 200 None 2025-09-26 11:55:37,377 - lava_callback - DEBUG - Processing node 68d3e1a4cd36afa834e12142: baseline-arm64 2025-09-26 11:55:37,688 - lava_callback - ERROR - Error processing callback for node 68d3e1a4cd36afa834e12142: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:55:42,567 - lava_callback - INFO - Received callback for node 68d3de0acd36afa834e11c5d INFO: 172.20.0.1:52810 - "POST /node/68d3de0acd36afa834e11c5d HTTP/1.0" 202 Accepted 2025-09-26 11:55:42,575 - lava_callback - INFO - Starting async job submit for node 68d3de0acd36afa834e11c5d 2025-09-26 11:55:42,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:55:42,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3de0acd36afa834e11c5d HTTP/1.1" 200 None 2025-09-26 11:55:42,623 - lava_callback - DEBUG - Processing node 68d3de0acd36afa834e11c5d: baseline-arm64 2025-09-26 11:55:43,438 - lava_callback - ERROR - Error processing callback for node 68d3de0acd36afa834e11c5d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:52816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60506 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:55:56,558 - lava_callback - INFO - Received callback for node 68d3da32cd36afa834e11633 INFO: 172.20.0.1:60518 - "POST /node/68d3da32cd36afa834e11633 HTTP/1.0" 202 Accepted 2025-09-26 11:55:56,564 - lava_callback - INFO - Starting async job submit for node 68d3da32cd36afa834e11633 2025-09-26 11:55:56,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:55:56,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3da32cd36afa834e11633 HTTP/1.1" 200 None 2025-09-26 11:55:56,618 - lava_callback - DEBUG - Processing node 68d3da32cd36afa834e11633: ltp-pty 2025-09-26 11:55:56,982 - lava_callback - ERROR - Error processing callback for node 68d3da32cd36afa834e11633: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:43766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33114 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:56:50,625 - lava_callback - INFO - Received callback for node 68d3da49cd36afa834e1164c INFO: 172.20.0.1:44186 - "POST /node/68d3da49cd36afa834e1164c HTTP/1.0" 202 Accepted 2025-09-26 11:56:50,632 - lava_callback - INFO - Starting async job submit for node 68d3da49cd36afa834e1164c 2025-09-26 11:56:50,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:56:50,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3da49cd36afa834e1164c HTTP/1.1" 200 None 2025-09-26 11:56:50,700 - lava_callback - DEBUG - Processing node 68d3da49cd36afa834e1164c: ltp-smoketest 2025-09-26 11:56:51,125 - lava_callback - ERROR - Error processing callback for node 68d3da49cd36afa834e1164c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:44192 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:56:56,904 - lava_callback - INFO - Received callback for node 68d3e1a7cd36afa834e12145 INFO: 172.20.0.1:44206 - "POST /node/68d3e1a7cd36afa834e12145 HTTP/1.0" 202 Accepted 2025-09-26 11:56:56,910 - lava_callback - INFO - Starting async job submit for node 68d3e1a7cd36afa834e12145 2025-09-26 11:56:56,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:56:56,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e1a7cd36afa834e12145 HTTP/1.1" 200 None 2025-09-26 11:56:56,958 - lava_callback - DEBUG - Processing node 68d3e1a7cd36afa834e12145: baseline-arm64 2025-09-26 11:56:57,249 - lava_callback - ERROR - Error processing callback for node 68d3e1a7cd36afa834e12145: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:57:00,679 - lava_callback - INFO - Received callback for node 68d3e1aacd36afa834e12148 INFO: 172.20.0.1:42968 - "POST /node/68d3e1aacd36afa834e12148 HTTP/1.0" 202 Accepted 2025-09-26 11:57:00,685 - lava_callback - INFO - Starting async job submit for node 68d3e1aacd36afa834e12148 2025-09-26 11:57:00,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:57:00,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e1aacd36afa834e12148 HTTP/1.1" 200 None 2025-09-26 11:57:00,718 - lava_callback - DEBUG - Processing node 68d3e1aacd36afa834e12148: baseline-arm64 2025-09-26 11:57:01,032 - lava_callback - ERROR - Error processing callback for node 68d3e1aacd36afa834e12148: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:57:05,270 - lava_callback - INFO - Received callback for node 68d3e1b2cd36afa834e1216a INFO: 172.20.0.1:42982 - "POST /node/68d3e1b2cd36afa834e1216a HTTP/1.0" 202 Accepted 2025-09-26 11:57:05,276 - lava_callback - INFO - Starting async job submit for node 68d3e1b2cd36afa834e1216a 2025-09-26 11:57:05,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:57:05,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e1b2cd36afa834e1216a HTTP/1.1" 200 None 2025-09-26 11:57:05,309 - lava_callback - DEBUG - Processing node 68d3e1b2cd36afa834e1216a: baseline-arm64 2025-09-26 11:57:05,604 - lava_callback - ERROR - Error processing callback for node 68d3e1b2cd36afa834e1216a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:42992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46370 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 11:57:15,163 - lava_callback - INFO - Received callback for node 68d3e1afcd36afa834e12167 INFO: 172.20.0.1:46378 - "POST /node/68d3e1afcd36afa834e12167 HTTP/1.0" 202 Accepted 2025-09-26 11:57:15,168 - lava_callback - INFO - Starting async job submit for node 68d3e1afcd36afa834e12167 2025-09-26 11:57:15,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:57:15,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e1afcd36afa834e12167 HTTP/1.1" 200 None 2025-09-26 11:57:15,202 - lava_callback - DEBUG - Processing node 68d3e1afcd36afa834e12167: baseline-arm64 2025-09-26 11:57:15,486 - lava_callback - ERROR - Error processing callback for node 68d3e1afcd36afa834e12167: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:46386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49032 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:57:55,658 - lava_callback - INFO - Received callback for node 68d3dd2fcd36afa834e11ab9 INFO: 172.20.0.1:34212 - "POST /node/68d3dd2fcd36afa834e11ab9 HTTP/1.0" 202 Accepted 2025-09-26 11:57:55,663 - lava_callback - INFO - Starting async job submit for node 68d3dd2fcd36afa834e11ab9 2025-09-26 11:57:55,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:57:55,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd2fcd36afa834e11ab9 HTTP/1.1" 200 None 2025-09-26 11:57:55,730 - lava_callback - DEBUG - Processing node 68d3dd2fcd36afa834e11ab9: baseline-arm-broonie 2025-09-26 11:57:55,948 - lava_callback - ERROR - Error processing callback for node 68d3dd2fcd36afa834e11ab9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:34222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58740 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:58:21,624 - lava_callback - INFO - Received callback for node 68d3e1bdcd36afa834e12176 INFO: 172.20.0.1:58752 - "POST /node/68d3e1bdcd36afa834e12176 HTTP/1.0" 202 Accepted 2025-09-26 11:58:21,630 - lava_callback - INFO - Starting async job submit for node 68d3e1bdcd36afa834e12176 2025-09-26 11:58:21,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:58:21,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e1bdcd36afa834e12176 HTTP/1.1" 200 None 2025-09-26 11:58:21,663 - lava_callback - DEBUG - Processing node 68d3e1bdcd36afa834e12176: baseline-arm64 2025-09-26 11:58:21,970 - lava_callback - ERROR - Error processing callback for node 68d3e1bdcd36afa834e12176: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:58764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47232 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:58:36,999 - lava_callback - INFO - Received callback for node 68d3e1bccd36afa834e12173 INFO: 172.20.0.1:47248 - "POST /node/68d3e1bccd36afa834e12173 HTTP/1.0" 202 Accepted 2025-09-26 11:58:37,005 - lava_callback - INFO - Starting async job submit for node 68d3e1bccd36afa834e12173 2025-09-26 11:58:37,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:58:37,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e1bccd36afa834e12173 HTTP/1.1" 200 None 2025-09-26 11:58:37,040 - lava_callback - DEBUG - Processing node 68d3e1bccd36afa834e12173: baseline-arm64 2025-09-26 11:58:37,358 - lava_callback - ERROR - Error processing callback for node 68d3e1bccd36afa834e12173: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:58:38,368 - lava_callback - INFO - Received callback for node 68d3e1b7cd36afa834e12170 INFO: 172.20.0.1:47256 - "POST /node/68d3e1b7cd36afa834e12170 HTTP/1.0" 202 Accepted 2025-09-26 11:58:38,374 - lava_callback - INFO - Starting async job submit for node 68d3e1b7cd36afa834e12170 2025-09-26 11:58:38,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:58:38,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e1b7cd36afa834e12170 HTTP/1.1" 200 None 2025-09-26 11:58:38,447 - lava_callback - DEBUG - Processing node 68d3e1b7cd36afa834e12170: baseline-arm64 2025-09-26 11:58:38,735 - lava_callback - ERROR - Error processing callback for node 68d3e1b7cd36afa834e12170: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:37314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33382 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:59:08,342 - lava_callback - INFO - Received callback for node 68d3e1b5cd36afa834e1216d INFO: 172.20.0.1:33390 - "POST /node/68d3e1b5cd36afa834e1216d HTTP/1.0" 202 Accepted 2025-09-26 11:59:08,348 - lava_callback - INFO - Starting async job submit for node 68d3e1b5cd36afa834e1216d 2025-09-26 11:59:08,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:59:08,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e1b5cd36afa834e1216d HTTP/1.1" 200 None 2025-09-26 11:59:08,424 - lava_callback - DEBUG - Processing node 68d3e1b5cd36afa834e1216d: baseline-arm64 2025-09-26 11:59:08,842 - lava_callback - ERROR - Error processing callback for node 68d3e1b5cd36afa834e1216d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:50256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46178 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:59:37,906 - lava_callback - INFO - Received callback for node 68d3dd24cd36afa834e11a91 INFO: 172.20.0.1:46190 - "POST /node/68d3dd24cd36afa834e11a91 HTTP/1.0" 202 Accepted 2025-09-26 11:59:37,914 - lava_callback - INFO - Starting async job submit for node 68d3dd24cd36afa834e11a91 2025-09-26 11:59:37,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:59:37,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd24cd36afa834e11a91 HTTP/1.1" 200 None 2025-09-26 11:59:37,956 - lava_callback - DEBUG - Processing node 68d3dd24cd36afa834e11a91: baseline-arm 2025-09-26 11:59:37,956 - lava_callback - ERROR - Error processing callback for node 68d3dd24cd36afa834e11a91: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:59:41,972 - lava_callback - INFO - Received callback for node 68d3e1c2cd36afa834e12179 INFO: 172.20.0.1:58776 - "POST /node/68d3e1c2cd36afa834e12179 HTTP/1.0" 202 Accepted 2025-09-26 11:59:41,978 - lava_callback - INFO - Starting async job submit for node 68d3e1c2cd36afa834e12179 2025-09-26 11:59:41,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:59:42,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e1c2cd36afa834e12179 HTTP/1.1" 200 None 2025-09-26 11:59:42,023 - lava_callback - DEBUG - Processing node 68d3e1c2cd36afa834e12179: baseline-arm64 2025-09-26 11:59:42,333 - lava_callback - ERROR - Error processing callback for node 68d3e1c2cd36afa834e12179: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:58784 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:59:52,633 - lava_callback - INFO - Received callback for node 68d3dd32cd36afa834e11ac2 INFO: 172.20.0.1:45454 - "POST /node/68d3dd32cd36afa834e11ac2 HTTP/1.0" 202 Accepted 2025-09-26 11:59:52,638 - lava_callback - INFO - Starting async job submit for node 68d3dd32cd36afa834e11ac2 2025-09-26 11:59:52,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:59:52,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd32cd36afa834e11ac2 HTTP/1.1" 200 None 2025-09-26 11:59:52,652 - lava_callback - DEBUG - Processing node 68d3dd32cd36afa834e11ac2: baseline-arm-broonie 2025-09-26 11:59:52,652 - lava_callback - ERROR - Error processing callback for node 68d3dd32cd36afa834e11ac2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:59:55,596 - lava_callback - INFO - Received callback for node 68d42368a5c2c05277bc6ea9 INFO: 172.20.0.1:45464 - "POST /node/68d42368a5c2c05277bc6ea9 HTTP/1.0" 202 Accepted 2025-09-26 11:59:55,602 - lava_callback - INFO - Starting async job submit for node 68d42368a5c2c05277bc6ea9 2025-09-26 11:59:55,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:59:55,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42368a5c2c05277bc6ea9 HTTP/1.1" 200 None 2025-09-26 11:59:55,646 - lava_callback - DEBUG - Processing node 68d42368a5c2c05277bc6ea9: baseline-arm 2025-09-26 11:59:55,889 - lava_callback - ERROR - Error processing callback for node 68d42368a5c2c05277bc6ea9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 11:59:56,165 - lava_callback - INFO - Received callback for node 68d3dd37cd36afa834e11ad7 INFO: 172.20.0.1:45466 - "POST /node/68d3dd37cd36afa834e11ad7 HTTP/1.0" 202 Accepted 2025-09-26 11:59:56,171 - lava_callback - INFO - Starting async job submit for node 68d3dd37cd36afa834e11ad7 2025-09-26 11:59:56,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:59:56,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd37cd36afa834e11ad7 HTTP/1.1" 200 None 2025-09-26 11:59:56,188 - lava_callback - DEBUG - Processing node 68d3dd37cd36afa834e11ad7: baseline-arm-clabbe 2025-09-26 11:59:56,188 - lava_callback - ERROR - Error processing callback for node 68d3dd37cd36afa834e11ad7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:45482 - "GET / HTTP/1.0" 200 OK 2025-09-26 11:59:56,832 - lava_callback - INFO - Received callback for node 68d3dd39cd36afa834e11adf INFO: 172.20.0.1:45484 - "POST /node/68d3dd39cd36afa834e11adf HTTP/1.0" 202 Accepted 2025-09-26 11:59:56,840 - lava_callback - INFO - Starting async job submit for node 68d3dd39cd36afa834e11adf 2025-09-26 11:59:56,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:59:56,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd39cd36afa834e11adf HTTP/1.1" 200 None 2025-09-26 11:59:56,854 - lava_callback - DEBUG - Processing node 68d3dd39cd36afa834e11adf: baseline-arm-clabbe 2025-09-26 11:59:56,854 - lava_callback - ERROR - Error processing callback for node 68d3dd39cd36afa834e11adf: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 11:59:57,497 - lava_callback - INFO - Received callback for node 68d3dd39cd36afa834e11ae3 INFO: 172.20.0.1:45500 - "POST /node/68d3dd39cd36afa834e11ae3 HTTP/1.0" 202 Accepted 2025-09-26 11:59:57,505 - lava_callback - INFO - Starting async job submit for node 68d3dd39cd36afa834e11ae3 2025-09-26 11:59:57,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 11:59:57,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd39cd36afa834e11ae3 HTTP/1.1" 200 None 2025-09-26 11:59:57,523 - lava_callback - DEBUG - Processing node 68d3dd39cd36afa834e11ae3: baseline-arm-clabbe 2025-09-26 11:59:57,523 - lava_callback - ERROR - Error processing callback for node 68d3dd39cd36afa834e11ae3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:34244 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:00:12,741 - lava_callback - INFO - Received callback for node 68d3dd46cd36afa834e11b15 INFO: 172.20.0.1:46500 - "POST /node/68d3dd46cd36afa834e11b15 HTTP/1.0" 202 Accepted 2025-09-26 12:00:12,747 - lava_callback - INFO - Starting async job submit for node 68d3dd46cd36afa834e11b15 2025-09-26 12:00:12,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:00:12,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd46cd36afa834e11b15 HTTP/1.1" 200 None 2025-09-26 12:00:12,763 - lava_callback - DEBUG - Processing node 68d3dd46cd36afa834e11b15: ltp-controllers 2025-09-26 12:00:12,763 - lava_callback - ERROR - Error processing callback for node 68d3dd46cd36afa834e11b15: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:00:13,540 - lava_callback - INFO - Received callback for node 68d3dd47cd36afa834e11b19 INFO: 172.20.0.1:46512 - "POST /node/68d3dd47cd36afa834e11b19 HTTP/1.0" 202 Accepted 2025-09-26 12:00:13,546 - lava_callback - INFO - Starting async job submit for node 68d3dd47cd36afa834e11b19 2025-09-26 12:00:13,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:00:13,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd47cd36afa834e11b19 HTTP/1.1" 200 None 2025-09-26 12:00:13,561 - lava_callback - DEBUG - Processing node 68d3dd47cd36afa834e11b19: ltp-cve 2025-09-26 12:00:13,561 - lava_callback - ERROR - Error processing callback for node 68d3dd47cd36afa834e11b19: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:00:14,291 - lava_callback - INFO - Received callback for node 68d3dd48cd36afa834e11b1f INFO: 172.20.0.1:46522 - "POST /node/68d3dd48cd36afa834e11b1f HTTP/1.0" 202 Accepted 2025-09-26 12:00:14,297 - lava_callback - INFO - Starting async job submit for node 68d3dd48cd36afa834e11b1f 2025-09-26 12:00:14,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:00:14,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd48cd36afa834e11b1f HTTP/1.1" 200 None 2025-09-26 12:00:14,330 - lava_callback - DEBUG - Processing node 68d3dd48cd36afa834e11b1f: ltp-fs-bind 2025-09-26 12:00:14,330 - lava_callback - ERROR - Error processing callback for node 68d3dd48cd36afa834e11b1f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:00:15,093 - lava_callback - INFO - Received callback for node 68d3dd49cd36afa834e11b22 INFO: 172.20.0.1:46538 - "POST /node/68d3dd49cd36afa834e11b22 HTTP/1.0" 202 Accepted 2025-09-26 12:00:15,099 - lava_callback - INFO - Starting async job submit for node 68d3dd49cd36afa834e11b22 2025-09-26 12:00:15,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:00:15,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd49cd36afa834e11b22 HTTP/1.1" 200 None 2025-09-26 12:00:15,146 - lava_callback - DEBUG - Processing node 68d3dd49cd36afa834e11b22: ltp-fsx 2025-09-26 12:00:15,146 - lava_callback - ERROR - Error processing callback for node 68d3dd49cd36afa834e11b22: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:46552 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 12:00:16,073 - lava_callback - INFO - Received callback for node 68d3dd4acd36afa834e11b25 INFO: 172.20.0.1:46556 - "POST /node/68d3dd4acd36afa834e11b25 HTTP/1.0" 202 Accepted 2025-09-26 12:00:16,079 - lava_callback - INFO - Starting async job submit for node 68d3dd4acd36afa834e11b25 2025-09-26 12:00:16,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:00:16,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd4acd36afa834e11b25 HTTP/1.1" 200 None 2025-09-26 12:00:16,095 - lava_callback - DEBUG - Processing node 68d3dd4acd36afa834e11b25: ltp-input 2025-09-26 12:00:16,095 - lava_callback - ERROR - Error processing callback for node 68d3dd4acd36afa834e11b25: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:00:16,242 - lava_callback - INFO - Received callback for node 68d3dd3dcd36afa834e11af2 INFO: 172.20.0.1:46566 - "POST /node/68d3dd3dcd36afa834e11af2 HTTP/1.0" 202 Accepted 2025-09-26 12:00:16,247 - lava_callback - INFO - Starting async job submit for node 68d3dd3dcd36afa834e11af2 2025-09-26 12:00:16,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:00:16,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd3dcd36afa834e11af2 HTTP/1.1" 200 None 2025-09-26 12:00:16,285 - lava_callback - DEBUG - Processing node 68d3dd3dcd36afa834e11af2: baseline-arm-clabbe 2025-09-26 12:00:16,285 - lava_callback - ERROR - Error processing callback for node 68d3dd3dcd36afa834e11af2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:46582 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:00:17,047 - lava_callback - INFO - Received callback for node 68d3dd4acd36afa834e11b2a INFO: 172.20.0.1:46594 - "POST /node/68d3dd4acd36afa834e11b2a HTTP/1.0" 202 Accepted 2025-09-26 12:00:17,053 - lava_callback - INFO - Starting async job submit for node 68d3dd4acd36afa834e11b2a 2025-09-26 12:00:17,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:00:17,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd4acd36afa834e11b2a HTTP/1.1" 200 None 2025-09-26 12:00:17,077 - lava_callback - DEBUG - Processing node 68d3dd4acd36afa834e11b2a: ltp-ipc 2025-09-26 12:00:17,077 - lava_callback - ERROR - Error processing callback for node 68d3dd4acd36afa834e11b2a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:00:17,791 - lava_callback - INFO - Received callback for node 68d3dd4dcd36afa834e11b2e INFO: 172.20.0.1:46600 - "POST /node/68d3dd4dcd36afa834e11b2e HTTP/1.0" 202 Accepted 2025-09-26 12:00:17,797 - lava_callback - INFO - Starting async job submit for node 68d3dd4dcd36afa834e11b2e 2025-09-26 12:00:17,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:00:17,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd4dcd36afa834e11b2e HTTP/1.1" 200 None 2025-09-26 12:00:17,820 - lava_callback - DEBUG - Processing node 68d3dd4dcd36afa834e11b2e: ltp-pty 2025-09-26 12:00:17,820 - lava_callback - ERROR - Error processing callback for node 68d3dd4dcd36afa834e11b2e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:00:18,152 - lava_callback - INFO - Received callback for node 68d3e3afcd36afa834e1238a INFO: 172.20.0.1:46614 - "POST /node/68d3e3afcd36afa834e1238a HTTP/1.0" 202 Accepted 2025-09-26 12:00:18,158 - lava_callback - INFO - Starting async job submit for node 68d3e3afcd36afa834e1238a 2025-09-26 12:00:18,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:00:18,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e3afcd36afa834e1238a HTTP/1.1" 200 None 2025-09-26 12:00:18,193 - lava_callback - DEBUG - Processing node 68d3e3afcd36afa834e1238a: baseline-arm64 2025-09-26 12:00:18,487 - lava_callback - ERROR - Error processing callback for node 68d3e3afcd36afa834e1238a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:00:18,758 - lava_callback - INFO - Received callback for node 68d3dd4ecd36afa834e11b33 INFO: 172.20.0.1:46630 - "POST /node/68d3dd4ecd36afa834e11b33 HTTP/1.0" 202 Accepted 2025-09-26 12:00:18,764 - lava_callback - INFO - Starting async job submit for node 68d3dd4ecd36afa834e11b33 2025-09-26 12:00:18,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:00:18,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd4ecd36afa834e11b33 HTTP/1.1" 200 None 2025-09-26 12:00:18,777 - lava_callback - DEBUG - Processing node 68d3dd4ecd36afa834e11b33: ltp-sched 2025-09-26 12:00:18,777 - lava_callback - ERROR - Error processing callback for node 68d3dd4ecd36afa834e11b33: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:00:19,464 - lava_callback - INFO - Received callback for node 68d3e1c2cd36afa834e12180 INFO: 172.20.0.1:41626 - "POST /node/68d3e1c2cd36afa834e12180 HTTP/1.0" 202 Accepted 2025-09-26 12:00:19,470 - lava_callback - INFO - Starting async job submit for node 68d3e1c2cd36afa834e12180 2025-09-26 12:00:19,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:00:19,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e1c2cd36afa834e12180 HTTP/1.1" 200 None 2025-09-26 12:00:19,504 - lava_callback - DEBUG - Processing node 68d3e1c2cd36afa834e12180: baseline-arm64 2025-09-26 12:00:19,803 - lava_callback - INFO - Received callback for node 68d3dd4fcd36afa834e11b37 INFO: 172.20.0.1:41638 - "POST /node/68d3dd4fcd36afa834e11b37 HTTP/1.0" 202 Accepted 2025-09-26 12:00:19,822 - lava_callback - INFO - Starting async job submit for node 68d3dd4fcd36afa834e11b37 2025-09-26 12:00:19,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:00:19,838 - lava_callback - ERROR - Error processing callback for node 68d3e1c2cd36afa834e12180: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:00:19,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd4fcd36afa834e11b37 HTTP/1.1" 200 None 2025-09-26 12:00:19,849 - lava_callback - DEBUG - Processing node 68d3dd4fcd36afa834e11b37: ltp-smoketest 2025-09-26 12:00:19,849 - lava_callback - ERROR - Error processing callback for node 68d3dd4fcd36afa834e11b37: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:00:20,611 - lava_callback - INFO - Received callback for node 68d3dd50cd36afa834e11b3e INFO: 172.20.0.1:41652 - "POST /node/68d3dd50cd36afa834e11b3e HTTP/1.0" 202 Accepted 2025-09-26 12:00:20,617 - lava_callback - INFO - Starting async job submit for node 68d3dd50cd36afa834e11b3e 2025-09-26 12:00:20,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:00:20,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd50cd36afa834e11b3e HTTP/1.1" 200 None 2025-09-26 12:00:20,631 - lava_callback - DEBUG - Processing node 68d3dd50cd36afa834e11b3e: ltp-syscalls 2025-09-26 12:00:20,631 - lava_callback - ERROR - Error processing callback for node 68d3dd50cd36afa834e11b3e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:41662 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:00:21,363 - lava_callback - INFO - Received callback for node 68d3dd50cd36afa834e11b41 INFO: 172.20.0.1:41674 - "POST /node/68d3dd50cd36afa834e11b41 HTTP/1.0" 202 Accepted 2025-09-26 12:00:21,372 - lava_callback - INFO - Starting async job submit for node 68d3dd50cd36afa834e11b41 2025-09-26 12:00:21,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:00:21,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd50cd36afa834e11b41 HTTP/1.1" 200 None 2025-09-26 12:00:21,388 - lava_callback - DEBUG - Processing node 68d3dd50cd36afa834e11b41: ltp-syscalls-ipc 2025-09-26 12:00:21,388 - lava_callback - ERROR - Error processing callback for node 68d3dd50cd36afa834e11b41: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:00:22,136 - lava_callback - INFO - Received callback for node 68d3dd51cd36afa834e11b44 INFO: 172.20.0.1:41690 - "POST /node/68d3dd51cd36afa834e11b44 HTTP/1.0" 202 Accepted 2025-09-26 12:00:22,145 - lava_callback - INFO - Starting async job submit for node 68d3dd51cd36afa834e11b44 2025-09-26 12:00:22,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:00:22,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd51cd36afa834e11b44 HTTP/1.1" 200 None 2025-09-26 12:00:22,161 - lava_callback - DEBUG - Processing node 68d3dd51cd36afa834e11b44: ltp-timers 2025-09-26 12:00:22,161 - lava_callback - ERROR - Error processing callback for node 68d3dd51cd36afa834e11b44: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:41704 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:00:32,614 - lava_callback - INFO - Received callback for node 68d3dd52cd36afa834e11b47 INFO: 172.20.0.1:51248 - "POST /node/68d3dd52cd36afa834e11b47 HTTP/1.0" 202 Accepted 2025-09-26 12:00:32,620 - lava_callback - INFO - Starting async job submit for node 68d3dd52cd36afa834e11b47 2025-09-26 12:00:32,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:00:32,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd52cd36afa834e11b47 HTTP/1.1" 200 None 2025-09-26 12:00:32,636 - lava_callback - DEBUG - Processing node 68d3dd52cd36afa834e11b47: ltp-watchqueue 2025-09-26 12:00:32,636 - lava_callback - ERROR - Error processing callback for node 68d3dd52cd36afa834e11b47: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:51262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51264 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:00:39,774 - lava_callback - INFO - Received callback for node 68d3e3b2cd36afa834e1238d INFO: 172.20.0.1:38012 - "POST /node/68d3e3b2cd36afa834e1238d HTTP/1.0" 202 Accepted 2025-09-26 12:00:39,780 - lava_callback - INFO - Starting async job submit for node 68d3e3b2cd36afa834e1238d 2025-09-26 12:00:39,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:00:39,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e3b2cd36afa834e1238d HTTP/1.1" 200 None 2025-09-26 12:00:39,813 - lava_callback - DEBUG - Processing node 68d3e3b2cd36afa834e1238d: baseline-arm64 2025-09-26 12:00:40,133 - lava_callback - ERROR - Error processing callback for node 68d3e3b2cd36afa834e1238d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:38024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36178 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:01:00,165 - lava_callback - INFO - Received callback for node 68d3e3b5cd36afa834e12390 INFO: 172.20.0.1:60376 - "POST /node/68d3e3b5cd36afa834e12390 HTTP/1.0" 202 Accepted 2025-09-26 12:01:00,171 - lava_callback - INFO - Starting async job submit for node 68d3e3b5cd36afa834e12390 2025-09-26 12:01:00,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:01:00,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e3b5cd36afa834e12390 HTTP/1.1" 200 None 2025-09-26 12:01:00,207 - lava_callback - DEBUG - Processing node 68d3e3b5cd36afa834e12390: baseline-arm64 2025-09-26 12:01:00,560 - lava_callback - ERROR - Error processing callback for node 68d3e3b5cd36afa834e12390: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:60384 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:01:11,426 - lava_callback - INFO - Received callback for node 68d3d7d3cd36afa834e11264 INFO: 172.20.0.1:39882 - "POST /node/68d3d7d3cd36afa834e11264 HTTP/1.0" 202 Accepted 2025-09-26 12:01:11,433 - lava_callback - INFO - Starting async job submit for node 68d3d7d3cd36afa834e11264 2025-09-26 12:01:11,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:01:11,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d7d3cd36afa834e11264 HTTP/1.1" 200 None 2025-09-26 12:01:11,573 - lava_callback - DEBUG - Processing node 68d3d7d3cd36afa834e11264: ltp-cve 2025-09-26 12:01:12,311 - lava_callback - ERROR - Error processing callback for node 68d3d7d3cd36afa834e11264: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:01:13,257 - lava_callback - INFO - Received callback for node 68d3dd44cd36afa834e11b0a INFO: 172.20.0.1:39896 - "POST /node/68d3dd44cd36afa834e11b0a HTTP/1.0" 202 Accepted 2025-09-26 12:01:13,264 - lava_callback - INFO - Starting async job submit for node 68d3dd44cd36afa834e11b0a 2025-09-26 12:01:13,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:01:13,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd44cd36afa834e11b0a HTTP/1.1" 200 None 2025-09-26 12:01:13,304 - lava_callback - DEBUG - Processing node 68d3dd44cd36afa834e11b0a: ltp-cap-bounds 2025-09-26 12:01:13,618 - lava_callback - ERROR - Error processing callback for node 68d3dd44cd36afa834e11b0a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:39902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39906 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:01:20,349 - lava_callback - INFO - Received callback for node 68d46a1aa5c2c05277bcba1e INFO: 172.20.0.1:35240 - "POST /node/68d46a1aa5c2c05277bcba1e HTTP/1.0" 202 Accepted 2025-09-26 12:01:20,355 - lava_callback - INFO - Starting async job submit for node 68d46a1aa5c2c05277bcba1e 2025-09-26 12:01:20,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:01:20,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d46a1aa5c2c05277bcba1e HTTP/1.1" 200 None 2025-09-26 12:01:20,413 - lava_callback - DEBUG - Processing node 68d46a1aa5c2c05277bcba1e: baseline-arm64-broonie 2025-09-26 12:01:20,739 - lava_callback - ERROR - Error processing callback for node 68d46a1aa5c2c05277bcba1e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:35256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53190 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:01:58,243 - lava_callback - INFO - Received callback for node 68d3e3c2cd36afa834e12399 INFO: 172.20.0.1:53194 - "POST /node/68d3e3c2cd36afa834e12399 HTTP/1.0" 202 Accepted 2025-09-26 12:01:58,249 - lava_callback - INFO - Starting async job submit for node 68d3e3c2cd36afa834e12399 2025-09-26 12:01:58,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:01:58,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e3c2cd36afa834e12399 HTTP/1.1" 200 None 2025-09-26 12:01:58,288 - lava_callback - DEBUG - Processing node 68d3e3c2cd36afa834e12399: baseline-arm64 2025-09-26 12:01:58,616 - lava_callback - ERROR - Error processing callback for node 68d3e3c2cd36afa834e12399: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:01:59,528 - lava_callback - INFO - Received callback for node 68d4236ca5c2c05277bc6eb5 INFO: 172.20.0.1:44502 - "POST /node/68d4236ca5c2c05277bc6eb5 HTTP/1.0" 202 Accepted 2025-09-26 12:01:59,534 - lava_callback - INFO - Starting async job submit for node 68d4236ca5c2c05277bc6eb5 2025-09-26 12:01:59,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:01:59,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4236ca5c2c05277bc6eb5 HTTP/1.1" 200 None 2025-09-26 12:01:59,581 - lava_callback - DEBUG - Processing node 68d4236ca5c2c05277bc6eb5: baseline-arm 2025-09-26 12:01:59,676 - lava_callback - INFO - Received callback for node 68d3e3b8cd36afa834e12393 INFO: 172.20.0.1:44516 - "POST /node/68d3e3b8cd36afa834e12393 HTTP/1.0" 202 Accepted 2025-09-26 12:01:59,697 - lava_callback - INFO - Starting async job submit for node 68d3e3b8cd36afa834e12393 2025-09-26 12:01:59,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:01:59,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e3b8cd36afa834e12393 HTTP/1.1" 200 None 2025-09-26 12:01:59,828 - lava_callback - DEBUG - Processing node 68d3e3b8cd36afa834e12393: baseline-arm64 2025-09-26 12:01:59,900 - lava_callback - ERROR - Error processing callback for node 68d4236ca5c2c05277bc6eb5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:02:00,193 - lava_callback - ERROR - Error processing callback for node 68d3e3b8cd36afa834e12393: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:44520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60218 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:02:21,470 - lava_callback - INFO - Received callback for node 68d3e3c8cd36afa834e1239f INFO: 172.20.0.1:60224 - "POST /node/68d3e3c8cd36afa834e1239f HTTP/1.0" 202 Accepted 2025-09-26 12:02:21,480 - lava_callback - INFO - Starting async job submit for node 68d3e3c8cd36afa834e1239f 2025-09-26 12:02:21,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:02:21,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e3c8cd36afa834e1239f HTTP/1.1" 200 None 2025-09-26 12:02:21,516 - lava_callback - DEBUG - Processing node 68d3e3c8cd36afa834e1239f: baseline-arm64 2025-09-26 12:02:21,886 - lava_callback - ERROR - Error processing callback for node 68d3e3c8cd36afa834e1239f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:02:22,930 - lava_callback - INFO - Received callback for node 68d3e3c5cd36afa834e1239c INFO: 172.20.0.1:60234 - "POST /node/68d3e3c5cd36afa834e1239c HTTP/1.0" 202 Accepted 2025-09-26 12:02:22,937 - lava_callback - INFO - Starting async job submit for node 68d3e3c5cd36afa834e1239c 2025-09-26 12:02:22,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:02:22,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e3c5cd36afa834e1239c HTTP/1.1" 200 None 2025-09-26 12:02:22,979 - lava_callback - DEBUG - Processing node 68d3e3c5cd36afa834e1239c: baseline-arm64 2025-09-26 12:02:23,448 - lava_callback - ERROR - Error processing callback for node 68d3e3c5cd36afa834e1239c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:60236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37924 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:03:34,172 - lava_callback - INFO - Received callback for node 68d3e3cacd36afa834e123a2 INFO: 172.20.0.1:53970 - "POST /node/68d3e3cacd36afa834e123a2 HTTP/1.0" 202 Accepted 2025-09-26 12:03:34,178 - lava_callback - INFO - Starting async job submit for node 68d3e3cacd36afa834e123a2 2025-09-26 12:03:34,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:03:34,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e3cacd36afa834e123a2 HTTP/1.1" 200 None 2025-09-26 12:03:34,212 - lava_callback - DEBUG - Processing node 68d3e3cacd36afa834e123a2: baseline-arm64 2025-09-26 12:03:34,522 - lava_callback - ERROR - Error processing callback for node 68d3e3cacd36afa834e123a2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:03:35,615 - lava_callback - INFO - Received callback for node 68d3e3d9cd36afa834e123ad INFO: 172.20.0.1:53982 - "POST /node/68d3e3d9cd36afa834e123ad HTTP/1.0" 202 Accepted 2025-09-26 12:03:35,621 - lava_callback - INFO - Starting async job submit for node 68d3e3d9cd36afa834e123ad 2025-09-26 12:03:35,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:03:35,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e3d9cd36afa834e123ad HTTP/1.1" 200 None 2025-09-26 12:03:35,654 - lava_callback - DEBUG - Processing node 68d3e3d9cd36afa834e123ad: baseline-arm64 2025-09-26 12:03:35,942 - lava_callback - ERROR - Error processing callback for node 68d3e3d9cd36afa834e123ad: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:53996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54012 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:03:44,513 - lava_callback - INFO - Received callback for node 68d3e3e0cd36afa834e123b3 INFO: 172.20.0.1:54750 - "POST /node/68d3e3e0cd36afa834e123b3 HTTP/1.0" 202 Accepted 2025-09-26 12:03:44,519 - lava_callback - INFO - Starting async job submit for node 68d3e3e0cd36afa834e123b3 2025-09-26 12:03:44,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:03:44,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e3e0cd36afa834e123b3 HTTP/1.1" 200 None 2025-09-26 12:03:44,573 - lava_callback - DEBUG - Processing node 68d3e3e0cd36afa834e123b3: baseline-arm64 2025-09-26 12:03:44,894 - lava_callback - ERROR - Error processing callback for node 68d3e3e0cd36afa834e123b3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:54760 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:03:56,113 - lava_callback - INFO - Received callback for node 68d3e3dbcd36afa834e123b0 INFO: 172.20.0.1:41028 - "POST /node/68d3e3dbcd36afa834e123b0 HTTP/1.0" 202 Accepted 2025-09-26 12:03:56,119 - lava_callback - INFO - Starting async job submit for node 68d3e3dbcd36afa834e123b0 2025-09-26 12:03:56,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:03:56,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e3dbcd36afa834e123b0 HTTP/1.1" 200 None 2025-09-26 12:03:56,155 - lava_callback - DEBUG - Processing node 68d3e3dbcd36afa834e123b0: baseline-arm64 2025-09-26 12:03:56,449 - lava_callback - ERROR - Error processing callback for node 68d3e3dbcd36afa834e123b0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:41038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48398 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:04:28,120 - lava_callback - INFO - Received callback for node 68d42729a5c2c05277bc735e INFO: 172.20.0.1:48414 - "POST /node/68d42729a5c2c05277bc735e HTTP/1.0" 202 Accepted 2025-09-26 12:04:28,126 - lava_callback - INFO - Starting async job submit for node 68d42729a5c2c05277bc735e 2025-09-26 12:04:28,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:04:28,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42729a5c2c05277bc735e HTTP/1.1" 200 None 2025-09-26 12:04:28,163 - lava_callback - DEBUG - Processing node 68d42729a5c2c05277bc735e: baseline-arm 2025-09-26 12:04:28,391 - lava_callback - ERROR - Error processing callback for node 68d42729a5c2c05277bc735e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:41116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44066 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:04:52,319 - lava_callback - INFO - Received callback for node 68d3de5bcd36afa834e11ce0 INFO: 172.20.0.1:41774 - "POST /node/68d3de5bcd36afa834e11ce0 HTTP/1.0" 202 Accepted 2025-09-26 12:04:52,324 - lava_callback - INFO - Starting async job submit for node 68d3de5bcd36afa834e11ce0 2025-09-26 12:04:52,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:04:52,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3de5bcd36afa834e11ce0 HTTP/1.1" 200 None 2025-09-26 12:04:52,338 - lava_callback - DEBUG - Processing node 68d3de5bcd36afa834e11ce0: ltp-containers 2025-09-26 12:04:52,338 - lava_callback - ERROR - Error processing callback for node 68d3de5bcd36afa834e11ce0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:04:53,026 - lava_callback - INFO - Received callback for node 68d3e3e1cd36afa834e123b6 INFO: 172.20.0.1:41776 - "POST /node/68d3e3e1cd36afa834e123b6 HTTP/1.0" 202 Accepted 2025-09-26 12:04:53,032 - lava_callback - INFO - Starting async job submit for node 68d3e3e1cd36afa834e123b6 2025-09-26 12:04:53,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:04:53,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e3e1cd36afa834e123b6 HTTP/1.1" 200 None 2025-09-26 12:04:53,076 - lava_callback - DEBUG - Processing node 68d3e3e1cd36afa834e123b6: baseline-arm64 2025-09-26 12:04:53,381 - lava_callback - ERROR - Error processing callback for node 68d3e3e1cd36afa834e123b6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:04:53,625 - lava_callback - INFO - Received callback for node 68d3de5ecd36afa834e11ce3 INFO: 172.20.0.1:41790 - "POST /node/68d3de5ecd36afa834e11ce3 HTTP/1.0" 202 Accepted 2025-09-26 12:04:53,631 - lava_callback - INFO - Starting async job submit for node 68d3de5ecd36afa834e11ce3 2025-09-26 12:04:53,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:04:53,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3de5ecd36afa834e11ce3 HTTP/1.1" 200 None 2025-09-26 12:04:53,645 - lava_callback - DEBUG - Processing node 68d3de5ecd36afa834e11ce3: ltp-cve 2025-09-26 12:04:53,645 - lava_callback - ERROR - Error processing callback for node 68d3de5ecd36afa834e11ce3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:41796 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:04:59,022 - lava_callback - INFO - Received callback for node 68d3e8c3cd36afa834e131b9 INFO: 172.20.0.1:41804 - "POST /node/68d3e8c3cd36afa834e131b9 HTTP/1.0" 202 Accepted 2025-09-26 12:04:59,031 - lava_callback - INFO - Starting async job submit for node 68d3e8c3cd36afa834e131b9 2025-09-26 12:04:59,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:04:59,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e8c3cd36afa834e131b9 HTTP/1.1" 200 None 2025-09-26 12:04:59,084 - lava_callback - DEBUG - Processing node 68d3e8c3cd36afa834e131b9: baseline-arm64 2025-09-26 12:05:01,171 - lava_callback - ERROR - Error processing callback for node 68d3e8c3cd36afa834e131b9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:05:03,742 - lava_callback - INFO - Received callback for node 68d3e8c6cd36afa834e131bc INFO: 172.20.0.1:33100 - "POST /node/68d3e8c6cd36afa834e131bc HTTP/1.0" 202 Accepted 2025-09-26 12:05:03,748 - lava_callback - INFO - Starting async job submit for node 68d3e8c6cd36afa834e131bc 2025-09-26 12:05:03,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:05:03,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e8c6cd36afa834e131bc HTTP/1.1" 200 None 2025-09-26 12:05:03,797 - lava_callback - DEBUG - Processing node 68d3e8c6cd36afa834e131bc: baseline-arm64 2025-09-26 12:05:04,239 - lava_callback - ERROR - Error processing callback for node 68d3e8c6cd36afa834e131bc: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:33102 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:05:10,938 - lava_callback - INFO - Received callback for node 68d3e8cdcd36afa834e131c2 INFO: 172.20.0.1:39744 - "POST /node/68d3e8cdcd36afa834e131c2 HTTP/1.0" 202 Accepted 2025-09-26 12:05:10,944 - lava_callback - INFO - Starting async job submit for node 68d3e8cdcd36afa834e131c2 2025-09-26 12:05:10,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:05:10,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e8cdcd36afa834e131c2 HTTP/1.1" 200 None 2025-09-26 12:05:10,977 - lava_callback - DEBUG - Processing node 68d3e8cdcd36afa834e131c2: baseline-arm64 2025-09-26 12:05:11,273 - lava_callback - ERROR - Error processing callback for node 68d3e8cdcd36afa834e131c2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:39746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36254 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:05:36,931 - lava_callback - INFO - Received callback for node 68d3dd45cd36afa834e11b0f INFO: 172.20.0.1:36262 - "POST /node/68d3dd45cd36afa834e11b0f HTTP/1.0" 202 Accepted 2025-09-26 12:05:36,938 - lava_callback - INFO - Starting async job submit for node 68d3dd45cd36afa834e11b0f 2025-09-26 12:05:37,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:05:37,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd45cd36afa834e11b0f HTTP/1.1" 200 None 2025-09-26 12:05:37,055 - lava_callback - DEBUG - Processing node 68d3dd45cd36afa834e11b0f: ltp-containers 2025-09-26 12:05:37,830 - lava_callback - ERROR - Error processing callback for node 68d3dd45cd36afa834e11b0f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:51334 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:05:48,315 - lava_callback - INFO - Received callback for node 68d3dd21cd36afa834e11a83 INFO: 172.20.0.1:51336 - "POST /node/68d3dd21cd36afa834e11a83 HTTP/1.0" 202 Accepted 2025-09-26 12:05:48,321 - lava_callback - INFO - Starting async job submit for node 68d3dd21cd36afa834e11a83 2025-09-26 12:05:48,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:05:48,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dd21cd36afa834e11a83 HTTP/1.1" 200 None 2025-09-26 12:05:48,368 - lava_callback - DEBUG - Processing node 68d3dd21cd36afa834e11a83: baseline-arm 2025-09-26 12:05:48,693 - lava_callback - ERROR - Error processing callback for node 68d3dd21cd36afa834e11a83: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:05:52,632 - lava_callback - INFO - Received callback for node 68d3de99cd36afa834e11d3f INFO: 172.20.0.1:39064 - "POST /node/68d3de99cd36afa834e11d3f HTTP/1.0" 202 Accepted 2025-09-26 12:05:52,638 - lava_callback - INFO - Starting async job submit for node 68d3de99cd36afa834e11d3f 2025-09-26 12:05:52,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:05:52,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3de99cd36afa834e11d3f HTTP/1.1" 200 None 2025-09-26 12:05:52,673 - lava_callback - DEBUG - Processing node 68d3de99cd36afa834e11d3f: ltp-controllers 2025-09-26 12:05:52,673 - lava_callback - ERROR - Error processing callback for node 68d3de99cd36afa834e11d3f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:39074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56570 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:06:11,240 - lava_callback - INFO - Received callback for node 68d3e8cecd36afa834e131c5 INFO: 172.20.0.1:35110 - "POST /node/68d3e8cecd36afa834e131c5 HTTP/1.0" 202 Accepted 2025-09-26 12:06:11,246 - lava_callback - INFO - Starting async job submit for node 68d3e8cecd36afa834e131c5 2025-09-26 12:06:11,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:06:11,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e8cecd36afa834e131c5 HTTP/1.1" 200 None 2025-09-26 12:06:11,279 - lava_callback - DEBUG - Processing node 68d3e8cecd36afa834e131c5: baseline-arm64 2025-09-26 12:06:11,573 - lava_callback - ERROR - Error processing callback for node 68d3e8cecd36afa834e131c5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:06:12,355 - lava_callback - INFO - Received callback for node 68d3dea0cd36afa834e11d48 INFO: 172.20.0.1:35112 - "POST /node/68d3dea0cd36afa834e11d48 HTTP/1.0" 202 Accepted 2025-09-26 12:06:12,361 - lava_callback - INFO - Starting async job submit for node 68d3dea0cd36afa834e11d48 2025-09-26 12:06:12,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:06:12,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dea0cd36afa834e11d48 HTTP/1.1" 200 None 2025-09-26 12:06:12,374 - lava_callback - DEBUG - Processing node 68d3dea0cd36afa834e11d48: ltp-controllers 2025-09-26 12:06:12,375 - lava_callback - ERROR - Error processing callback for node 68d3dea0cd36afa834e11d48: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:35118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42074 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:06:33,760 - lava_callback - INFO - Received callback for node 68d3e8ddcd36afa834e131d4 INFO: 172.20.0.1:59454 - "POST /node/68d3e8ddcd36afa834e131d4 HTTP/1.0" 202 Accepted 2025-09-26 12:06:33,766 - lava_callback - INFO - Starting async job submit for node 68d3e8ddcd36afa834e131d4 2025-09-26 12:06:33,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:06:33,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e8ddcd36afa834e131d4 HTTP/1.1" 200 None 2025-09-26 12:06:33,820 - lava_callback - DEBUG - Processing node 68d3e8ddcd36afa834e131d4: baseline-arm64 2025-09-26 12:06:34,109 - lava_callback - ERROR - Error processing callback for node 68d3e8ddcd36afa834e131d4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:06:35,609 - lava_callback - INFO - Received callback for node 68d3e8dacd36afa834e131d1 INFO: 172.20.0.1:59464 - "POST /node/68d3e8dacd36afa834e131d1 HTTP/1.0" 202 Accepted 2025-09-26 12:06:35,615 - lava_callback - INFO - Starting async job submit for node 68d3e8dacd36afa834e131d1 2025-09-26 12:06:35,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:06:35,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e8dacd36afa834e131d1 HTTP/1.1" 200 None 2025-09-26 12:06:35,776 - lava_callback - DEBUG - Processing node 68d3e8dacd36afa834e131d1: baseline-arm64 2025-09-26 12:06:36,092 - lava_callback - ERROR - Error processing callback for node 68d3e8dacd36afa834e131d1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:59470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59480 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:06:39,599 - lava_callback - INFO - Received callback for node 68d4272ba5c2c05277bc7361 INFO: 172.20.0.1:40332 - "POST /node/68d4272ba5c2c05277bc7361 HTTP/1.0" 202 Accepted 2025-09-26 12:06:39,605 - lava_callback - INFO - Starting async job submit for node 68d4272ba5c2c05277bc7361 2025-09-26 12:06:39,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:06:39,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4272ba5c2c05277bc7361 HTTP/1.1" 200 None 2025-09-26 12:06:39,640 - lava_callback - DEBUG - Processing node 68d4272ba5c2c05277bc7361: baseline-arm 2025-09-26 12:06:39,855 - lava_callback - ERROR - Error processing callback for node 68d4272ba5c2c05277bc7361: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:40348 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:06:55,100 - lava_callback - INFO - Received callback for node 68d3e8dacd36afa834e131ce INFO: 172.20.0.1:43606 - "POST /node/68d3e8dacd36afa834e131ce HTTP/1.0" 202 Accepted 2025-09-26 12:06:55,108 - lava_callback - INFO - Starting async job submit for node 68d3e8dacd36afa834e131ce 2025-09-26 12:06:55,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:06:55,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e8dacd36afa834e131ce HTTP/1.1" 200 None 2025-09-26 12:06:55,162 - lava_callback - DEBUG - Processing node 68d3e8dacd36afa834e131ce: baseline-arm64 2025-09-26 12:06:55,601 - lava_callback - ERROR - Error processing callback for node 68d3e8dacd36afa834e131ce: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:43608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41556 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:07:12,491 - lava_callback - INFO - Received callback for node 68d3dedfcd36afa834e11d97 INFO: 172.20.0.1:42252 - "POST /node/68d3dedfcd36afa834e11d97 HTTP/1.0" 202 Accepted 2025-09-26 12:07:12,497 - lava_callback - INFO - Starting async job submit for node 68d3dedfcd36afa834e11d97 2025-09-26 12:07:12,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:07:12,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3dedfcd36afa834e11d97 HTTP/1.1" 200 None 2025-09-26 12:07:12,533 - lava_callback - DEBUG - Processing node 68d3dedfcd36afa834e11d97: ltp-cve 2025-09-26 12:07:12,533 - lava_callback - ERROR - Error processing callback for node 68d3dedfcd36afa834e11d97: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:42260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38574 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:07:31,539 - lava_callback - INFO - Received callback for node 68d3e8dfcd36afa834e131d7 INFO: 172.20.0.1:55346 - "POST /node/68d3e8dfcd36afa834e131d7 HTTP/1.0" 202 Accepted 2025-09-26 12:07:31,545 - lava_callback - INFO - Starting async job submit for node 68d3e8dfcd36afa834e131d7 2025-09-26 12:07:31,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:07:31,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e8dfcd36afa834e131d7 HTTP/1.1" 200 None 2025-09-26 12:07:31,578 - lava_callback - DEBUG - Processing node 68d3e8dfcd36afa834e131d7: baseline-arm64 2025-09-26 12:07:31,863 - lava_callback - ERROR - Error processing callback for node 68d3e8dfcd36afa834e131d7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:55356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59884 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:07:50,978 - lava_callback - INFO - Received callback for node 68d3e9b2cd36afa834e13349 INFO: 172.20.0.1:56742 - "POST /node/68d3e9b2cd36afa834e13349 HTTP/1.0" 202 Accepted 2025-09-26 12:07:50,984 - lava_callback - INFO - Starting async job submit for node 68d3e9b2cd36afa834e13349 2025-09-26 12:07:51,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:07:51,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e9b2cd36afa834e13349 HTTP/1.1" 200 None 2025-09-26 12:07:51,017 - lava_callback - DEBUG - Processing node 68d3e9b2cd36afa834e13349: baseline-arm64 2025-09-26 12:07:51,306 - lava_callback - ERROR - Error processing callback for node 68d3e9b2cd36afa834e13349: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:07:56,357 - lava_callback - INFO - Received callback for node 68d3e9b0cd36afa834e13346 INFO: 172.20.0.1:56758 - "POST /node/68d3e9b0cd36afa834e13346 HTTP/1.0" 202 Accepted 2025-09-26 12:07:56,363 - lava_callback - INFO - Starting async job submit for node 68d3e9b0cd36afa834e13346 2025-09-26 12:07:56,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:07:56,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e9b0cd36afa834e13346 HTTP/1.1" 200 None 2025-09-26 12:07:56,397 - lava_callback - DEBUG - Processing node 68d3e9b0cd36afa834e13346: baseline-arm64 INFO: 172.20.0.1:56772 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:07:56,711 - lava_callback - ERROR - Error processing callback for node 68d3e9b0cd36afa834e13346: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:07:57,912 - lava_callback - INFO - Received callback for node 68d3e9b7cd36afa834e1334c INFO: 172.20.0.1:56788 - "POST /node/68d3e9b7cd36afa834e1334c HTTP/1.0" 202 Accepted 2025-09-26 12:07:57,918 - lava_callback - INFO - Starting async job submit for node 68d3e9b7cd36afa834e1334c 2025-09-26 12:07:57,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:07:57,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e9b7cd36afa834e1334c HTTP/1.1" 200 None 2025-09-26 12:07:57,951 - lava_callback - DEBUG - Processing node 68d3e9b7cd36afa834e1334c: baseline-arm64 2025-09-26 12:07:58,247 - lava_callback - ERROR - Error processing callback for node 68d3e9b7cd36afa834e1334c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:51056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36352 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:08:32,544 - lava_callback - INFO - Received callback for node 68d3df30cd36afa834e11dfa INFO: 172.20.0.1:34748 - "POST /node/68d3df30cd36afa834e11dfa HTTP/1.0" 202 Accepted 2025-09-26 12:08:32,550 - lava_callback - INFO - Starting async job submit for node 68d3df30cd36afa834e11dfa 2025-09-26 12:08:32,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:08:32,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3df30cd36afa834e11dfa HTTP/1.1" 200 None 2025-09-26 12:08:32,591 - lava_callback - DEBUG - Processing node 68d3df30cd36afa834e11dfa: ltp-cve 2025-09-26 12:08:32,591 - lava_callback - ERROR - Error processing callback for node 68d3df30cd36afa834e11dfa: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:34762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43374 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:08:50,933 - lava_callback - INFO - Received callback for node 68d3e9bacd36afa834e1334f INFO: 172.20.0.1:35072 - "POST /node/68d3e9bacd36afa834e1334f HTTP/1.0" 202 Accepted 2025-09-26 12:08:50,939 - lava_callback - INFO - Starting async job submit for node 68d3e9bacd36afa834e1334f 2025-09-26 12:08:50,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:08:50,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e9bacd36afa834e1334f HTTP/1.1" 200 None 2025-09-26 12:08:50,971 - lava_callback - DEBUG - Processing node 68d3e9bacd36afa834e1334f: baseline-arm64 2025-09-26 12:08:51,262 - lava_callback - ERROR - Error processing callback for node 68d3e9bacd36afa834e1334f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:35082 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:08:59,885 - lava_callback - INFO - Received callback for node 68d4272ea5c2c05277bc7364 INFO: 172.20.0.1:37950 - "POST /node/68d4272ea5c2c05277bc7364 HTTP/1.0" 202 Accepted 2025-09-26 12:08:59,891 - lava_callback - INFO - Starting async job submit for node 68d4272ea5c2c05277bc7364 2025-09-26 12:08:59,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:08:59,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4272ea5c2c05277bc7364 HTTP/1.1" 200 None 2025-09-26 12:08:59,924 - lava_callback - DEBUG - Processing node 68d4272ea5c2c05277bc7364: baseline-arm 2025-09-26 12:09:00,165 - lava_callback - ERROR - Error processing callback for node 68d4272ea5c2c05277bc7364: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:37964 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:09:12,154 - lava_callback - INFO - Received callback for node 68d3e9edcd36afa834e133b1 INFO: 172.20.0.1:46564 - "POST /node/68d3e9edcd36afa834e133b1 HTTP/1.0" 202 Accepted 2025-09-26 12:09:12,160 - lava_callback - INFO - Starting async job submit for node 68d3e9edcd36afa834e133b1 2025-09-26 12:09:12,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:09:12,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e9edcd36afa834e133b1 HTTP/1.1" 200 None 2025-09-26 12:09:12,193 - lava_callback - DEBUG - Processing node 68d3e9edcd36afa834e133b1: baseline-arm64 2025-09-26 12:09:12,484 - lava_callback - ERROR - Error processing callback for node 68d3e9edcd36afa834e133b1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:46580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46582 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:09:17,591 - lava_callback - INFO - Received callback for node 68d3e9f1cd36afa834e133b4 INFO: 172.20.0.1:46584 - "POST /node/68d3e9f1cd36afa834e133b4 HTTP/1.0" 202 Accepted 2025-09-26 12:09:17,597 - lava_callback - INFO - Starting async job submit for node 68d3e9f1cd36afa834e133b4 2025-09-26 12:09:17,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:09:17,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e9f1cd36afa834e133b4 HTTP/1.1" 200 None 2025-09-26 12:09:17,631 - lava_callback - DEBUG - Processing node 68d3e9f1cd36afa834e133b4: baseline-arm64 2025-09-26 12:09:17,930 - lava_callback - ERROR - Error processing callback for node 68d3e9f1cd36afa834e133b4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:35034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56174 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:10:19,203 - lava_callback - INFO - Received callback for node 68d3e9f3cd36afa834e133b7 INFO: 172.20.0.1:56178 - "POST /node/68d3e9f3cd36afa834e133b7 HTTP/1.0" 202 Accepted 2025-09-26 12:10:19,209 - lava_callback - INFO - Starting async job submit for node 68d3e9f3cd36afa834e133b7 2025-09-26 12:10:19,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:10:19,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e9f3cd36afa834e133b7 HTTP/1.1" 200 None 2025-09-26 12:10:19,262 - lava_callback - DEBUG - Processing node 68d3e9f3cd36afa834e133b7: baseline-arm64 2025-09-26 12:10:19,556 - lava_callback - ERROR - Error processing callback for node 68d3e9f3cd36afa834e133b7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:36950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36960 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:10:33,637 - lava_callback - INFO - Received callback for node 68d3ea14cd36afa834e133d8 INFO: 172.20.0.1:50618 - "POST /node/68d3ea14cd36afa834e133d8 HTTP/1.0" 202 Accepted 2025-09-26 12:10:33,643 - lava_callback - INFO - Starting async job submit for node 68d3ea14cd36afa834e133d8 2025-09-26 12:10:33,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:10:33,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ea14cd36afa834e133d8 HTTP/1.1" 200 None 2025-09-26 12:10:33,677 - lava_callback - DEBUG - Processing node 68d3ea14cd36afa834e133d8: baseline-arm64 2025-09-26 12:10:33,969 - lava_callback - ERROR - Error processing callback for node 68d3ea14cd36afa834e133d8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:10:36,334 - lava_callback - INFO - Received callback for node 68d3e9e9cd36afa834e13386 INFO: 172.20.0.1:50630 - "POST /node/68d3e9e9cd36afa834e13386 HTTP/1.0" 202 Accepted 2025-09-26 12:10:36,383 - lava_callback - INFO - Starting async job submit for node 68d3e9e9cd36afa834e13386 2025-09-26 12:10:36,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:10:36,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e9e9cd36afa834e13386 HTTP/1.1" 200 None 2025-09-26 12:10:36,429 - lava_callback - DEBUG - Processing node 68d3e9e9cd36afa834e13386: baseline-arm64 INFO: 172.20.0.1:50642 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:10:37,777 - lava_callback - INFO - Received callback for node 68d3ea17cd36afa834e133db INFO: 172.20.0.1:50652 - "POST /node/68d3ea17cd36afa834e133db HTTP/1.0" 202 Accepted 2025-09-26 12:10:37,804 - lava_callback - INFO - Starting async job submit for node 68d3ea17cd36afa834e133db 2025-09-26 12:10:37,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:10:37,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ea17cd36afa834e133db HTTP/1.1" 200 None 2025-09-26 12:10:37,913 - lava_callback - DEBUG - Processing node 68d3ea17cd36afa834e133db: baseline-arm64 INFO: 172.20.0.1:50664 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:10:38,592 - lava_callback - ERROR - Error processing callback for node 68d3ea17cd36afa834e133db: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:50650 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:10:56,422 - lava_callback - ERROR - Error processing callback for node 68d3e9e9cd36afa834e13386: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:39788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46698 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:11:10,828 - lava_callback - INFO - Received callback for node 68d42730a5c2c05277bc7367 INFO: 172.20.0.1:50540 - "POST /node/68d42730a5c2c05277bc7367 HTTP/1.0" 202 Accepted 2025-09-26 12:11:10,834 - lava_callback - INFO - Starting async job submit for node 68d42730a5c2c05277bc7367 2025-09-26 12:11:10,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:11:10,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42730a5c2c05277bc7367 HTTP/1.1" 200 None 2025-09-26 12:11:10,867 - lava_callback - DEBUG - Processing node 68d42730a5c2c05277bc7367: baseline-arm 2025-09-26 12:11:11,084 - lava_callback - ERROR - Error processing callback for node 68d42730a5c2c05277bc7367: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:50550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49056 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:11:51,961 - lava_callback - INFO - Received callback for node 68d3ea4ecd36afa834e1343b INFO: 172.20.0.1:46004 - "POST /node/68d3ea4ecd36afa834e1343b HTTP/1.0" 202 Accepted 2025-09-26 12:11:51,967 - lava_callback - INFO - Starting async job submit for node 68d3ea4ecd36afa834e1343b 2025-09-26 12:11:51,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:11:52,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ea4ecd36afa834e1343b HTTP/1.1" 200 None 2025-09-26 12:11:52,019 - lava_callback - DEBUG - Processing node 68d3ea4ecd36afa834e1343b: baseline-arm64 2025-09-26 12:11:52,308 - lava_callback - ERROR - Error processing callback for node 68d3ea4ecd36afa834e1343b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:11:53,571 - lava_callback - INFO - Received callback for node 68d3ea1fcd36afa834e133e1 INFO: 172.20.0.1:46018 - "POST /node/68d3ea1fcd36afa834e133e1 HTTP/1.0" 202 Accepted 2025-09-26 12:11:53,577 - lava_callback - INFO - Starting async job submit for node 68d3ea1fcd36afa834e133e1 2025-09-26 12:11:53,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:11:53,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ea1fcd36afa834e133e1 HTTP/1.1" 200 None 2025-09-26 12:11:53,611 - lava_callback - DEBUG - Processing node 68d3ea1fcd36afa834e133e1: baseline-arm64 2025-09-26 12:11:53,911 - lava_callback - ERROR - Error processing callback for node 68d3ea1fcd36afa834e133e1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:46032 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:11:58,307 - lava_callback - INFO - Received callback for node 68d3ea21cd36afa834e133e4 INFO: 172.20.0.1:46046 - "POST /node/68d3ea21cd36afa834e133e4 HTTP/1.0" 202 Accepted 2025-09-26 12:11:58,315 - lava_callback - INFO - Starting async job submit for node 68d3ea21cd36afa834e133e4 2025-09-26 12:11:58,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:11:58,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ea21cd36afa834e133e4 HTTP/1.1" 200 None 2025-09-26 12:11:58,363 - lava_callback - DEBUG - Processing node 68d3ea21cd36afa834e133e4: baseline-arm64 2025-09-26 12:11:59,783 - lava_callback - ERROR - Error processing callback for node 68d3ea21cd36afa834e133e4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:12:00,278 - lava_callback - INFO - Received callback for node 68d3ea51cd36afa834e1343e INFO: 172.20.0.1:37900 - "POST /node/68d3ea51cd36afa834e1343e HTTP/1.0" 202 Accepted 2025-09-26 12:12:00,284 - lava_callback - INFO - Starting async job submit for node 68d3ea51cd36afa834e1343e 2025-09-26 12:12:00,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:12:00,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ea51cd36afa834e1343e HTTP/1.1" 200 None 2025-09-26 12:12:00,339 - lava_callback - DEBUG - Processing node 68d3ea51cd36afa834e1343e: baseline-arm64 2025-09-26 12:12:00,644 - lava_callback - ERROR - Error processing callback for node 68d3ea51cd36afa834e1343e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:37902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43996 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:13:12,273 - lava_callback - INFO - Received callback for node 68d3ea57cd36afa834e13444 INFO: 172.20.0.1:46142 - "POST /node/68d3ea57cd36afa834e13444 HTTP/1.0" 202 Accepted 2025-09-26 12:13:12,279 - lava_callback - INFO - Starting async job submit for node 68d3ea57cd36afa834e13444 2025-09-26 12:13:12,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:13:12,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ea57cd36afa834e13444 HTTP/1.1" 200 None 2025-09-26 12:13:12,321 - lava_callback - DEBUG - Processing node 68d3ea57cd36afa834e13444: baseline-arm64 2025-09-26 12:13:12,620 - lava_callback - ERROR - Error processing callback for node 68d3ea57cd36afa834e13444: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:46144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46154 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:13:18,094 - lava_callback - INFO - Received callback for node 68d42733a5c2c05277bc736a INFO: 172.20.0.1:46156 - "POST /node/68d42733a5c2c05277bc736a HTTP/1.0" 202 Accepted 2025-09-26 12:13:18,099 - lava_callback - INFO - Starting async job submit for node 68d42733a5c2c05277bc736a 2025-09-26 12:13:18,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:13:18,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42733a5c2c05277bc736a HTTP/1.1" 200 None 2025-09-26 12:13:18,133 - lava_callback - DEBUG - Processing node 68d42733a5c2c05277bc736a: baseline-arm 2025-09-26 12:13:18,353 - lava_callback - ERROR - Error processing callback for node 68d42733a5c2c05277bc736a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:41362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46348 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:13:45,970 - lava_callback - INFO - Received callback for node 68d3ea54cd36afa834e13441 INFO: 172.20.0.1:37350 - "POST /node/68d3ea54cd36afa834e13441 HTTP/1.0" 202 Accepted 2025-09-26 12:13:45,976 - lava_callback - INFO - Starting async job submit for node 68d3ea54cd36afa834e13441 2025-09-26 12:13:46,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:13:46,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ea54cd36afa834e13441 HTTP/1.1" 200 None 2025-09-26 12:13:46,048 - lava_callback - DEBUG - Processing node 68d3ea54cd36afa834e13441: baseline-arm64 2025-09-26 12:13:46,445 - lava_callback - ERROR - Error processing callback for node 68d3ea54cd36afa834e13441: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:37362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60044 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:14:09,869 - lava_callback - INFO - Received callback for node 68d3ea88cd36afa834e134a2 INFO: 172.20.0.1:35032 - "POST /node/68d3ea88cd36afa834e134a2 HTTP/1.0" 202 Accepted 2025-09-26 12:14:09,875 - lava_callback - INFO - Starting async job submit for node 68d3ea88cd36afa834e134a2 2025-09-26 12:14:09,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:14:09,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ea88cd36afa834e134a2 HTTP/1.1" 200 None 2025-09-26 12:14:09,917 - lava_callback - DEBUG - Processing node 68d3ea88cd36afa834e134a2: baseline-arm64 2025-09-26 12:14:10,275 - lava_callback - ERROR - Error processing callback for node 68d3ea88cd36afa834e134a2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:35044 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 12:14:15,456 - lava_callback - INFO - Received callback for node 68d3ea8bcd36afa834e134a5 INFO: 172.20.0.1:35056 - "POST /node/68d3ea8bcd36afa834e134a5 HTTP/1.0" 202 Accepted 2025-09-26 12:14:15,463 - lava_callback - INFO - Starting async job submit for node 68d3ea8bcd36afa834e134a5 2025-09-26 12:14:15,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:14:15,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ea8bcd36afa834e134a5 HTTP/1.1" 200 None 2025-09-26 12:14:15,515 - lava_callback - DEBUG - Processing node 68d3ea8bcd36afa834e134a5: baseline-arm64 2025-09-26 12:14:15,871 - lava_callback - ERROR - Error processing callback for node 68d3ea8bcd36afa834e134a5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:35060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37856 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:14:37,282 - lava_callback - INFO - Received callback for node 68d3eaa2cd36afa834e134bd INFO: 172.20.0.1:37866 - "POST /node/68d3eaa2cd36afa834e134bd HTTP/1.0" 202 Accepted 2025-09-26 12:14:37,288 - lava_callback - INFO - Starting async job submit for node 68d3eaa2cd36afa834e134bd 2025-09-26 12:14:37,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:14:37,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eaa2cd36afa834e134bd HTTP/1.1" 200 None 2025-09-26 12:14:37,321 - lava_callback - DEBUG - Processing node 68d3eaa2cd36afa834e134bd: baseline-arm64 2025-09-26 12:14:37,619 - lava_callback - ERROR - Error processing callback for node 68d3eaa2cd36afa834e134bd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:37876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55296 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:15:14,676 - lava_callback - INFO - Received callback for node 68d3eaa5cd36afa834e134c0 INFO: 172.20.0.1:53438 - "POST /node/68d3eaa5cd36afa834e134c0 HTTP/1.0" 202 Accepted 2025-09-26 12:15:14,682 - lava_callback - INFO - Starting async job submit for node 68d3eaa5cd36afa834e134c0 2025-09-26 12:15:14,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:15:14,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eaa5cd36afa834e134c0 HTTP/1.1" 200 None 2025-09-26 12:15:14,723 - lava_callback - DEBUG - Processing node 68d3eaa5cd36afa834e134c0: baseline-arm64 2025-09-26 12:15:15,053 - lava_callback - ERROR - Error processing callback for node 68d3eaa5cd36afa834e134c0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:53444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41000 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:15:24,742 - lava_callback - INFO - Received callback for node 68d3eaaccd36afa834e134ea INFO: 172.20.0.1:41012 - "POST /node/68d3eaaccd36afa834e134ea HTTP/1.0" 202 Accepted 2025-09-26 12:15:24,748 - lava_callback - INFO - Starting async job submit for node 68d3eaaccd36afa834e134ea 2025-09-26 12:15:24,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:15:24,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eaaccd36afa834e134ea HTTP/1.1" 200 None 2025-09-26 12:15:24,788 - lava_callback - DEBUG - Processing node 68d3eaaccd36afa834e134ea: baseline-arm64 2025-09-26 12:15:25,079 - lava_callback - ERROR - Error processing callback for node 68d3eaaccd36afa834e134ea: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:41024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53472 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:15:37,246 - lava_callback - INFO - Received callback for node 68d3eaafcd36afa834e134ee INFO: 172.20.0.1:53476 - "POST /node/68d3eaafcd36afa834e134ee HTTP/1.0" 202 Accepted 2025-09-26 12:15:37,252 - lava_callback - INFO - Starting async job submit for node 68d3eaafcd36afa834e134ee 2025-09-26 12:15:37,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:15:37,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eaafcd36afa834e134ee HTTP/1.1" 200 None 2025-09-26 12:15:37,288 - lava_callback - DEBUG - Processing node 68d3eaafcd36afa834e134ee: baseline-arm64 2025-09-26 12:15:37,655 - lava_callback - ERROR - Error processing callback for node 68d3eaafcd36afa834e134ee: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:56604 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:15:42,057 - lava_callback - INFO - Received callback for node 68d42734a5c2c05277bc736d INFO: 172.20.0.1:56612 - "POST /node/68d42734a5c2c05277bc736d HTTP/1.0" 202 Accepted 2025-09-26 12:15:42,063 - lava_callback - INFO - Starting async job submit for node 68d42734a5c2c05277bc736d 2025-09-26 12:15:42,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:15:42,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42734a5c2c05277bc736d HTTP/1.1" 200 None 2025-09-26 12:15:42,103 - lava_callback - DEBUG - Processing node 68d42734a5c2c05277bc736d: baseline-arm 2025-09-26 12:15:42,345 - lava_callback - ERROR - Error processing callback for node 68d42734a5c2c05277bc736d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:56622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38176 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:16:17,269 - lava_callback - INFO - Received callback for node 68d3eacccd36afa834e13509 INFO: 172.20.0.1:38180 - "POST /node/68d3eacccd36afa834e13509 HTTP/1.0" 202 Accepted 2025-09-26 12:16:17,275 - lava_callback - INFO - Starting async job submit for node 68d3eacccd36afa834e13509 2025-09-26 12:16:17,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:16:17,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eacccd36afa834e13509 HTTP/1.1" 200 None 2025-09-26 12:16:17,325 - lava_callback - DEBUG - Processing node 68d3eacccd36afa834e13509: baseline-arm64 2025-09-26 12:16:17,613 - lava_callback - ERROR - Error processing callback for node 68d3eacccd36afa834e13509: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:43004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43012 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:16:33,046 - lava_callback - INFO - Received callback for node 68d3eacfcd36afa834e1350c INFO: 172.20.0.1:58686 - "POST /node/68d3eacfcd36afa834e1350c HTTP/1.0" 202 Accepted 2025-09-26 12:16:33,052 - lava_callback - INFO - Starting async job submit for node 68d3eacfcd36afa834e1350c 2025-09-26 12:16:33,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:16:33,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eacfcd36afa834e1350c HTTP/1.1" 200 None 2025-09-26 12:16:33,101 - lava_callback - DEBUG - Processing node 68d3eacfcd36afa834e1350c: baseline-arm64 2025-09-26 12:16:33,653 - lava_callback - ERROR - Error processing callback for node 68d3eacfcd36afa834e1350c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:58696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36016 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:16:41,458 - lava_callback - INFO - Received callback for node 68d3ead6cd36afa834e13512 INFO: 172.20.0.1:36026 - "POST /node/68d3ead6cd36afa834e13512 HTTP/1.0" 202 Accepted 2025-09-26 12:16:41,464 - lava_callback - INFO - Starting async job submit for node 68d3ead6cd36afa834e13512 2025-09-26 12:16:41,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:16:41,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ead6cd36afa834e13512 HTTP/1.1" 200 None 2025-09-26 12:16:41,500 - lava_callback - DEBUG - Processing node 68d3ead6cd36afa834e13512: baseline-arm64 2025-09-26 12:16:41,792 - lava_callback - ERROR - Error processing callback for node 68d3ead6cd36afa834e13512: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:36042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51368 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:17:19,351 - lava_callback - INFO - Received callback for node 68d3ead6cd36afa834e13515 INFO: 172.20.0.1:47916 - "POST /node/68d3ead6cd36afa834e13515 HTTP/1.0" 202 Accepted 2025-09-26 12:17:19,357 - lava_callback - INFO - Starting async job submit for node 68d3ead6cd36afa834e13515 2025-09-26 12:17:19,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:17:19,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ead6cd36afa834e13515 HTTP/1.1" 200 None 2025-09-26 12:17:19,394 - lava_callback - DEBUG - Processing node 68d3ead6cd36afa834e13515: baseline-arm64 2025-09-26 12:17:19,684 - lava_callback - ERROR - Error processing callback for node 68d3ead6cd36afa834e13515: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:47928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56936 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:17:58,471 - lava_callback - INFO - Received callback for node 68d3eb2dcd36afa834e135b2 INFO: 172.20.0.1:56948 - "POST /node/68d3eb2dcd36afa834e135b2 HTTP/1.0" 202 Accepted 2025-09-26 12:17:58,477 - lava_callback - INFO - Starting async job submit for node 68d3eb2dcd36afa834e135b2 2025-09-26 12:17:58,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:17:58,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eb2dcd36afa834e135b2 HTTP/1.1" 200 None 2025-09-26 12:17:58,509 - lava_callback - DEBUG - Processing node 68d3eb2dcd36afa834e135b2: baseline-arm64 2025-09-26 12:17:58,819 - lava_callback - ERROR - Error processing callback for node 68d3eb2dcd36afa834e135b2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:18:01,403 - lava_callback - INFO - Received callback for node 68d42736a5c2c05277bc7370 INFO: 172.20.0.1:47872 - "POST /node/68d42736a5c2c05277bc7370 HTTP/1.0" 202 Accepted 2025-09-26 12:18:01,409 - lava_callback - INFO - Starting async job submit for node 68d42736a5c2c05277bc7370 2025-09-26 12:18:01,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:18:01,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42736a5c2c05277bc7370 HTTP/1.1" 200 None 2025-09-26 12:18:01,441 - lava_callback - DEBUG - Processing node 68d42736a5c2c05277bc7370: baseline-arm 2025-09-26 12:18:01,668 - lava_callback - ERROR - Error processing callback for node 68d42736a5c2c05277bc7370: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:18:02,805 - lava_callback - INFO - Received callback for node 68d3eb2fcd36afa834e135b5 INFO: 172.20.0.1:47880 - "POST /node/68d3eb2fcd36afa834e135b5 HTTP/1.0" 202 Accepted 2025-09-26 12:18:02,812 - lava_callback - INFO - Starting async job submit for node 68d3eb2fcd36afa834e135b5 2025-09-26 12:18:02,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:18:02,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eb2fcd36afa834e135b5 HTTP/1.1" 200 None 2025-09-26 12:18:02,845 - lava_callback - DEBUG - Processing node 68d3eb2fcd36afa834e135b5: baseline-arm64 2025-09-26 12:18:03,169 - lava_callback - ERROR - Error processing callback for node 68d3eb2fcd36afa834e135b5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:47882 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:18:07,842 - lava_callback - INFO - Received callback for node 68d3eb34cd36afa834e135b8 INFO: 172.20.0.1:47886 - "POST /node/68d3eb34cd36afa834e135b8 HTTP/1.0" 202 Accepted 2025-09-26 12:18:07,848 - lava_callback - INFO - Starting async job submit for node 68d3eb34cd36afa834e135b8 2025-09-26 12:18:07,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:18:07,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eb34cd36afa834e135b8 HTTP/1.1" 200 None 2025-09-26 12:18:07,881 - lava_callback - DEBUG - Processing node 68d3eb34cd36afa834e135b8: baseline-arm64 2025-09-26 12:18:08,171 - lava_callback - ERROR - Error processing callback for node 68d3eb34cd36afa834e135b8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:18:11,102 - lava_callback - INFO - Received callback for node 68d683fb2f83206171a9132e INFO: 172.20.0.1:43072 - "POST /node/68d683fb2f83206171a9132e HTTP/1.0" 202 Accepted 2025-09-26 12:18:11,108 - lava_callback - INFO - Starting async job submit for node 68d683fb2f83206171a9132e 2025-09-26 12:18:11,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:18:11,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d683fb2f83206171a9132e HTTP/1.1" 200 None 2025-09-26 12:18:11,143 - lava_callback - DEBUG - Processing node 68d683fb2f83206171a9132e: baseline-arm 2025-09-26 12:18:11,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:18:11,522 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:18:11,522 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d683fb2f83206171a9132e/log.txt.gz 2025-09-26 12:18:11,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:18:11,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:18:11,697 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d683fb2f83206171a9132e/lava_callback.json.gz 2025-09-26 12:18:11,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:18:11,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d683fb2f83206171a9132e HTTP/1.1" 200 None 2025-09-26 12:18:11,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:18:11,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c3cc1bc82a30b37a90d HTTP/1.1" 200 None 2025-09-26 12:18:11,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:18:11,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d683fb2f83206171a9132e HTTP/1.1" 200 None 2025-09-26 12:18:11,797 - lava_callback - INFO - Completed processing callback for node 68d683fb2f83206171a9132e INFO: 172.20.0.1:43088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47508 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:18:52,134 - lava_callback - INFO - Received callback for node 68d3eb35cd36afa834e135bb INFO: 172.20.0.1:60614 - "POST /node/68d3eb35cd36afa834e135bb HTTP/1.0" 202 Accepted 2025-09-26 12:18:52,140 - lava_callback - INFO - Starting async job submit for node 68d3eb35cd36afa834e135bb 2025-09-26 12:18:52,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:18:52,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eb35cd36afa834e135bb HTTP/1.1" 200 None 2025-09-26 12:18:52,173 - lava_callback - DEBUG - Processing node 68d3eb35cd36afa834e135bb: baseline-arm64 2025-09-26 12:18:52,486 - lava_callback - ERROR - Error processing callback for node 68d3eb35cd36afa834e135bb: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:60628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33894 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:19:19,565 - lava_callback - INFO - Received callback for node 68d3eb48cd36afa834e135cd INFO: 172.20.0.1:60776 - "POST /node/68d3eb48cd36afa834e135cd HTTP/1.0" 202 Accepted 2025-09-26 12:19:19,571 - lava_callback - INFO - Starting async job submit for node 68d3eb48cd36afa834e135cd 2025-09-26 12:19:19,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:19:19,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eb48cd36afa834e135cd HTTP/1.1" 200 None 2025-09-26 12:19:19,608 - lava_callback - DEBUG - Processing node 68d3eb48cd36afa834e135cd: baseline-arm64 2025-09-26 12:19:19,901 - lava_callback - ERROR - Error processing callback for node 68d3eb48cd36afa834e135cd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:60786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39256 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:19:37,545 - lava_callback - INFO - Received callback for node 68d3eb47cd36afa834e135ca INFO: 172.20.0.1:39268 - "POST /node/68d3eb47cd36afa834e135ca HTTP/1.0" 202 Accepted 2025-09-26 12:19:37,551 - lava_callback - INFO - Starting async job submit for node 68d3eb47cd36afa834e135ca 2025-09-26 12:19:37,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:19:37,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eb47cd36afa834e135ca HTTP/1.1" 200 None 2025-09-26 12:19:37,584 - lava_callback - DEBUG - Processing node 68d3eb47cd36afa834e135ca: baseline-arm64 2025-09-26 12:19:37,881 - lava_callback - ERROR - Error processing callback for node 68d3eb47cd36afa834e135ca: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:19:39,050 - lava_callback - INFO - Received callback for node 68d3eb52cd36afa834e135d6 INFO: 172.20.0.1:39270 - "POST /node/68d3eb52cd36afa834e135d6 HTTP/1.0" 202 Accepted 2025-09-26 12:19:39,056 - lava_callback - INFO - Starting async job submit for node 68d3eb52cd36afa834e135d6 2025-09-26 12:19:39,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:19:39,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eb52cd36afa834e135d6 HTTP/1.1" 200 None 2025-09-26 12:19:39,089 - lava_callback - DEBUG - Processing node 68d3eb52cd36afa834e135d6: baseline-arm64 2025-09-26 12:19:39,399 - lava_callback - ERROR - Error processing callback for node 68d3eb52cd36afa834e135d6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:50834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55196 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:20:25,300 - lava_callback - INFO - Received callback for node 68d42739a5c2c05277bc7373 INFO: 172.20.0.1:55208 - "POST /node/68d42739a5c2c05277bc7373 HTTP/1.0" 202 Accepted 2025-09-26 12:20:25,306 - lava_callback - INFO - Starting async job submit for node 68d42739a5c2c05277bc7373 2025-09-26 12:20:25,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:20:25,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42739a5c2c05277bc7373 HTTP/1.1" 200 None 2025-09-26 12:20:25,339 - lava_callback - DEBUG - Processing node 68d42739a5c2c05277bc7373: baseline-arm 2025-09-26 12:20:25,557 - lava_callback - ERROR - Error processing callback for node 68d42739a5c2c05277bc7373: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:55218 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:20:27,560 - lava_callback - INFO - Received callback for node 68d3eb55cd36afa834e135d9 INFO: 172.20.0.1:55224 - "POST /node/68d3eb55cd36afa834e135d9 HTTP/1.0" 202 Accepted 2025-09-26 12:20:27,566 - lava_callback - INFO - Starting async job submit for node 68d3eb55cd36afa834e135d9 2025-09-26 12:20:27,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:20:27,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eb55cd36afa834e135d9 HTTP/1.1" 200 None 2025-09-26 12:20:27,600 - lava_callback - DEBUG - Processing node 68d3eb55cd36afa834e135d9: baseline-arm64 2025-09-26 12:20:27,899 - lava_callback - ERROR - Error processing callback for node 68d3eb55cd36afa834e135d9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46622 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:20:40,840 - lava_callback - INFO - Received callback for node 68d3eb83cd36afa834e1362d INFO: 172.20.0.1:46638 - "POST /node/68d3eb83cd36afa834e1362d HTTP/1.0" 202 Accepted 2025-09-26 12:20:40,846 - lava_callback - INFO - Starting async job submit for node 68d3eb83cd36afa834e1362d 2025-09-26 12:20:40,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:20:40,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eb83cd36afa834e1362d HTTP/1.1" 200 None 2025-09-26 12:20:40,900 - lava_callback - DEBUG - Processing node 68d3eb83cd36afa834e1362d: baseline-arm64 2025-09-26 12:20:41,214 - lava_callback - ERROR - Error processing callback for node 68d3eb83cd36afa834e1362d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:46640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33866 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:21:17,182 - lava_callback - INFO - Received callback for node 68d3eb8acd36afa834e13633 INFO: 172.20.0.1:33878 - "POST /node/68d3eb8acd36afa834e13633 HTTP/1.0" 202 Accepted 2025-09-26 12:21:17,189 - lava_callback - INFO - Starting async job submit for node 68d3eb8acd36afa834e13633 2025-09-26 12:21:17,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:21:17,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eb8acd36afa834e13633 HTTP/1.1" 200 None 2025-09-26 12:21:17,253 - lava_callback - DEBUG - Processing node 68d3eb8acd36afa834e13633: baseline-arm64 2025-09-26 12:21:17,612 - lava_callback - ERROR - Error processing callback for node 68d3eb8acd36afa834e13633: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:47064 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:21:21,893 - lava_callback - INFO - Received callback for node 68d3eb86cd36afa834e13630 INFO: 172.20.0.1:47080 - "POST /node/68d3eb86cd36afa834e13630 HTTP/1.0" 202 Accepted 2025-09-26 12:21:21,899 - lava_callback - INFO - Starting async job submit for node 68d3eb86cd36afa834e13630 2025-09-26 12:21:21,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:21:21,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eb86cd36afa834e13630 HTTP/1.1" 200 None 2025-09-26 12:21:21,932 - lava_callback - DEBUG - Processing node 68d3eb86cd36afa834e13630: baseline-arm64 2025-09-26 12:21:22,259 - lava_callback - ERROR - Error processing callback for node 68d3eb86cd36afa834e13630: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:47082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35718 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:21:57,038 - lava_callback - INFO - Received callback for node 68d3eb8bcd36afa834e13636 INFO: 172.20.0.1:35720 - "POST /node/68d3eb8bcd36afa834e13636 HTTP/1.0" 202 Accepted 2025-09-26 12:21:57,046 - lava_callback - INFO - Starting async job submit for node 68d3eb8bcd36afa834e13636 2025-09-26 12:21:57,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:21:57,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eb8bcd36afa834e13636 HTTP/1.1" 200 None 2025-09-26 12:21:57,088 - lava_callback - DEBUG - Processing node 68d3eb8bcd36afa834e13636: baseline-arm64 2025-09-26 12:21:58,421 - lava_callback - INFO - Received callback for node 68d3ebaacd36afa834e1367f INFO: 172.20.0.1:35730 - "POST /node/68d3ebaacd36afa834e1367f HTTP/1.0" 202 Accepted 2025-09-26 12:21:58,448 - lava_callback - INFO - Starting async job submit for node 68d3ebaacd36afa834e1367f 2025-09-26 12:21:58,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:21:58,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ebaacd36afa834e1367f HTTP/1.1" 200 None 2025-09-26 12:21:58,587 - lava_callback - DEBUG - Processing node 68d3ebaacd36afa834e1367f: baseline-arm64 2025-09-26 12:21:58,857 - lava_callback - ERROR - Error processing callback for node 68d3eb8bcd36afa834e13636: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:21:59,081 - lava_callback - ERROR - Error processing callback for node 68d3ebaacd36afa834e1367f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:22:06,061 - lava_callback - INFO - Received callback for node 68d3e263cd36afa834e1222d INFO: 172.20.0.1:37048 - "POST /node/68d3e263cd36afa834e1222d HTTP/1.0" 202 Accepted 2025-09-26 12:22:06,066 - lava_callback - INFO - Starting async job submit for node 68d3e263cd36afa834e1222d 2025-09-26 12:22:06,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:22:06,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e263cd36afa834e1222d HTTP/1.1" 200 None 2025-09-26 12:22:06,102 - lava_callback - DEBUG - Processing node 68d3e263cd36afa834e1222d: baseline-arm64-baylibre 2025-09-26 12:22:06,102 - lava_callback - ERROR - Error processing callback for node 68d3e263cd36afa834e1222d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:37062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43978 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:22:26,074 - lava_callback - INFO - Received callback for node 68d3e270cd36afa834e1223a INFO: 172.20.0.1:43984 - "POST /node/68d3e270cd36afa834e1223a HTTP/1.0" 202 Accepted 2025-09-26 12:22:26,079 - lava_callback - INFO - Starting async job submit for node 68d3e270cd36afa834e1223a 2025-09-26 12:22:26,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:22:26,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e270cd36afa834e1223a HTTP/1.1" 200 None 2025-09-26 12:22:26,094 - lava_callback - DEBUG - Processing node 68d3e270cd36afa834e1223a: baseline-arm64-baylibre 2025-09-26 12:22:26,095 - lava_callback - ERROR - Error processing callback for node 68d3e270cd36afa834e1223a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:43996 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:22:26,769 - lava_callback - INFO - Received callback for node 68d3e27acd36afa834e12243 INFO: 172.20.0.1:44002 - "POST /node/68d3e27acd36afa834e12243 HTTP/1.0" 202 Accepted 2025-09-26 12:22:26,775 - lava_callback - INFO - Starting async job submit for node 68d3e27acd36afa834e12243 2025-09-26 12:22:26,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:22:26,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e27acd36afa834e12243 HTTP/1.1" 200 None 2025-09-26 12:22:26,811 - lava_callback - DEBUG - Processing node 68d3e27acd36afa834e12243: baseline-arm64-baylibre 2025-09-26 12:22:26,811 - lava_callback - ERROR - Error processing callback for node 68d3e27acd36afa834e12243: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:22:32,758 - lava_callback - INFO - Received callback for node 68d3ebaacd36afa834e13682 INFO: 172.20.0.1:49938 - "POST /node/68d3ebaacd36afa834e13682 HTTP/1.0" 202 Accepted 2025-09-26 12:22:32,764 - lava_callback - INFO - Starting async job submit for node 68d3ebaacd36afa834e13682 2025-09-26 12:22:32,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:22:32,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ebaacd36afa834e13682 HTTP/1.1" 200 None 2025-09-26 12:22:32,797 - lava_callback - DEBUG - Processing node 68d3ebaacd36afa834e13682: baseline-arm64 2025-09-26 12:22:32,826 - lava_callback - INFO - Received callback for node 68d3d738cd36afa834e10b9b INFO: 172.20.0.1:49948 - "POST /node/68d3d738cd36afa834e10b9b HTTP/1.0" 202 Accepted 2025-09-26 12:22:32,940 - lava_callback - INFO - Starting async job submit for node 68d3d738cd36afa834e10b9b 2025-09-26 12:22:33,333 - lava_callback - ERROR - Error processing callback for node 68d3ebaacd36afa834e13682: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:22:34,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:22:34,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3d738cd36afa834e10b9b HTTP/1.1" 200 None 2025-09-26 12:22:34,459 - lava_callback - DEBUG - Processing node 68d3d738cd36afa834e10b9b: ltp-syscalls INFO: 172.20.0.1:49962 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:22:39,585 - lava_callback - INFO - Received callback for node 68d4273ea5c2c05277bc738f INFO: 172.20.0.1:55736 - "POST /node/68d4273ea5c2c05277bc738f HTTP/1.0" 202 Accepted 2025-09-26 12:22:39,612 - lava_callback - INFO - Starting async job submit for node 68d4273ea5c2c05277bc738f 2025-09-26 12:22:39,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:22:39,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4273ea5c2c05277bc738f HTTP/1.1" 200 None 2025-09-26 12:22:39,728 - lava_callback - DEBUG - Processing node 68d4273ea5c2c05277bc738f: baseline-arm 2025-09-26 12:22:40,235 - lava_callback - ERROR - Error processing callback for node 68d4273ea5c2c05277bc738f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:55742 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:22:41,749 - lava_callback - ERROR - Error processing callback for node 68d3d738cd36afa834e10b9b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:55756 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:22:51,814 - lava_callback - INFO - Received callback for node 68d3ddefcd36afa834e11c3c INFO: 172.20.0.1:59234 - "POST /node/68d3ddefcd36afa834e11c3c HTTP/1.0" 202 Accepted 2025-09-26 12:22:51,822 - lava_callback - INFO - Starting async job submit for node 68d3ddefcd36afa834e11c3c 2025-09-26 12:22:51,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:22:51,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ddefcd36afa834e11c3c HTTP/1.1" 200 None 2025-09-26 12:22:51,941 - lava_callback - DEBUG - Processing node 68d3ddefcd36afa834e11c3c: ltp-containers 2025-09-26 12:22:52,677 - lava_callback - INFO - Received callback for node 68d3ebadcd36afa834e13685 INFO: 172.20.0.1:59236 - "POST /node/68d3ebadcd36afa834e13685 HTTP/1.0" 202 Accepted 2025-09-26 12:22:52,703 - lava_callback - INFO - Starting async job submit for node 68d3ebadcd36afa834e13685 2025-09-26 12:22:52,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:22:52,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ebadcd36afa834e13685 HTTP/1.1" 200 None 2025-09-26 12:22:52,828 - lava_callback - DEBUG - Processing node 68d3ebadcd36afa834e13685: baseline-arm64 2025-09-26 12:22:52,955 - lava_callback - ERROR - Error processing callback for node 68d3ddefcd36afa834e11c3c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:22:53,188 - lava_callback - ERROR - Error processing callback for node 68d3ebadcd36afa834e13685: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:59238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39712 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:23:11,262 - lava_callback - INFO - Received callback for node 68d3ebafcd36afa834e13688 INFO: 172.20.0.1:33098 - "POST /node/68d3ebafcd36afa834e13688 HTTP/1.0" 202 Accepted 2025-09-26 12:23:11,268 - lava_callback - INFO - Starting async job submit for node 68d3ebafcd36afa834e13688 2025-09-26 12:23:11,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:23:11,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ebafcd36afa834e13688 HTTP/1.1" 200 None 2025-09-26 12:23:11,314 - lava_callback - DEBUG - Processing node 68d3ebafcd36afa834e13688: baseline-arm64 2025-09-26 12:23:11,621 - lava_callback - ERROR - Error processing callback for node 68d3ebafcd36afa834e13688: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:33112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33114 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:23:20,862 - lava_callback - INFO - Received callback for node 68d3ebcbcd36afa834e136b3 INFO: 172.20.0.1:37404 - "POST /node/68d3ebcbcd36afa834e136b3 HTTP/1.0" 202 Accepted 2025-09-26 12:23:20,868 - lava_callback - INFO - Starting async job submit for node 68d3ebcbcd36afa834e136b3 2025-09-26 12:23:20,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:23:20,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ebcbcd36afa834e136b3 HTTP/1.1" 200 None 2025-09-26 12:23:20,901 - lava_callback - DEBUG - Processing node 68d3ebcbcd36afa834e136b3: baseline-arm64 2025-09-26 12:23:21,197 - lava_callback - ERROR - Error processing callback for node 68d3ebcbcd36afa834e136b3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:37418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33146 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:24:11,551 - lava_callback - INFO - Received callback for node 68d3ebd3cd36afa834e136bd INFO: 172.20.0.1:49988 - "POST /node/68d3ebd3cd36afa834e136bd HTTP/1.0" 202 Accepted 2025-09-26 12:24:11,557 - lava_callback - INFO - Starting async job submit for node 68d3ebd3cd36afa834e136bd 2025-09-26 12:24:11,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:24:11,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ebd3cd36afa834e136bd HTTP/1.1" 200 None 2025-09-26 12:24:11,591 - lava_callback - DEBUG - Processing node 68d3ebd3cd36afa834e136bd: baseline-arm64 2025-09-26 12:24:11,900 - lava_callback - ERROR - Error processing callback for node 68d3ebd3cd36afa834e136bd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:50004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50018 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:24:18,937 - lava_callback - INFO - Received callback for node 68d3e2e8cd36afa834e122cb INFO: 172.20.0.1:50034 - "POST /node/68d3e2e8cd36afa834e122cb HTTP/1.0" 202 Accepted 2025-09-26 12:24:18,943 - lava_callback - INFO - Starting async job submit for node 68d3e2e8cd36afa834e122cb 2025-09-26 12:24:18,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:24:18,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e2e8cd36afa834e122cb HTTP/1.1" 200 None 2025-09-26 12:24:18,957 - lava_callback - DEBUG - Processing node 68d3e2e8cd36afa834e122cb: baseline-arm 2025-09-26 12:24:18,957 - lava_callback - ERROR - Error processing callback for node 68d3e2e8cd36afa834e122cb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:24:20,969 - lava_callback - INFO - Received callback for node 68d3ebcecd36afa834e136b6 INFO: 172.20.0.1:42858 - "POST /node/68d3ebcecd36afa834e136b6 HTTP/1.0" 202 Accepted 2025-09-26 12:24:20,976 - lava_callback - INFO - Starting async job submit for node 68d3ebcecd36afa834e136b6 2025-09-26 12:24:21,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:24:21,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ebcecd36afa834e136b6 HTTP/1.1" 200 None 2025-09-26 12:24:21,029 - lava_callback - DEBUG - Processing node 68d3ebcecd36afa834e136b6: baseline-arm64 2025-09-26 12:24:21,421 - lava_callback - ERROR - Error processing callback for node 68d3ebcecd36afa834e136b6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:42868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42884 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:24:31,291 - lava_callback - INFO - Received callback for node 68d3ebd3cd36afa834e136c0 INFO: 172.20.0.1:58852 - "POST /node/68d3ebd3cd36afa834e136c0 HTTP/1.0" 202 Accepted 2025-09-26 12:24:31,297 - lava_callback - INFO - Starting async job submit for node 68d3ebd3cd36afa834e136c0 2025-09-26 12:24:31,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:24:31,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ebd3cd36afa834e136c0 HTTP/1.1" 200 None 2025-09-26 12:24:31,350 - lava_callback - DEBUG - Processing node 68d3ebd3cd36afa834e136c0: baseline-arm64 2025-09-26 12:24:31,639 - lava_callback - ERROR - Error processing callback for node 68d3ebd3cd36afa834e136c0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:58866 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:24:41,312 - lava_callback - INFO - Received callback for node 68d3ebe6cd36afa834e136f5 INFO: 172.20.0.1:33544 - "POST /node/68d3ebe6cd36afa834e136f5 HTTP/1.0" 202 Accepted 2025-09-26 12:24:41,318 - lava_callback - INFO - Starting async job submit for node 68d3ebe6cd36afa834e136f5 2025-09-26 12:24:41,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:24:41,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ebe6cd36afa834e136f5 HTTP/1.1" 200 None 2025-09-26 12:24:41,369 - lava_callback - DEBUG - Processing node 68d3ebe6cd36afa834e136f5: baseline-arm64 2025-09-26 12:24:41,658 - lava_callback - ERROR - Error processing callback for node 68d3ebe6cd36afa834e136f5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:33560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33568 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:24:53,863 - lava_callback - INFO - Received callback for node 68d4273fa5c2c05277bc7392 INFO: 172.20.0.1:40218 - "POST /node/68d4273fa5c2c05277bc7392 HTTP/1.0" 202 Accepted 2025-09-26 12:24:53,869 - lava_callback - INFO - Starting async job submit for node 68d4273fa5c2c05277bc7392 2025-09-26 12:24:53,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:24:53,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4273fa5c2c05277bc7392 HTTP/1.1" 200 None 2025-09-26 12:24:53,902 - lava_callback - DEBUG - Processing node 68d4273fa5c2c05277bc7392: baseline-arm 2025-09-26 12:24:54,119 - lava_callback - ERROR - Error processing callback for node 68d4273fa5c2c05277bc7392: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:40234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57638 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:25:22,614 - lava_callback - INFO - Received callback for node 68d3e2e7cd36afa834e122c8 INFO: 172.20.0.1:57644 - "POST /node/68d3e2e7cd36afa834e122c8 HTTP/1.0" 202 Accepted 2025-09-26 12:25:22,620 - lava_callback - INFO - Starting async job submit for node 68d3e2e7cd36afa834e122c8 2025-09-26 12:25:22,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:25:22,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e2e7cd36afa834e122c8 HTTP/1.1" 200 None 2025-09-26 12:25:22,663 - lava_callback - DEBUG - Processing node 68d3e2e7cd36afa834e122c8: baseline-arm 2025-09-26 12:25:22,957 - lava_callback - ERROR - Error processing callback for node 68d3e2e7cd36afa834e122c8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:57650 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:25:30,426 - lava_callback - INFO - Received callback for node 68d3ebe8cd36afa834e136f8 INFO: 172.20.0.1:53116 - "POST /node/68d3ebe8cd36afa834e136f8 HTTP/1.0" 202 Accepted 2025-09-26 12:25:30,432 - lava_callback - INFO - Starting async job submit for node 68d3ebe8cd36afa834e136f8 2025-09-26 12:25:30,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:25:30,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ebe8cd36afa834e136f8 HTTP/1.1" 200 None 2025-09-26 12:25:30,465 - lava_callback - DEBUG - Processing node 68d3ebe8cd36afa834e136f8: baseline-arm64 2025-09-26 12:25:30,752 - lava_callback - ERROR - Error processing callback for node 68d3ebe8cd36afa834e136f8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:53132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40664 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:25:42,556 - lava_callback - INFO - Received callback for node 68d685dd2f83206171a91345 INFO: 172.20.0.1:40676 - "POST /node/68d685dd2f83206171a91345 HTTP/1.0" 202 Accepted 2025-09-26 12:25:42,561 - lava_callback - INFO - Starting async job submit for node 68d685dd2f83206171a91345 2025-09-26 12:25:42,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:25:42,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d685dd2f83206171a91345 HTTP/1.1" 200 None 2025-09-26 12:25:42,594 - lava_callback - DEBUG - Processing node 68d685dd2f83206171a91345: baseline-riscv-collabora 2025-09-26 12:25:42,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:25:42,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:25:42,917 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-riscv-collabora-68d685dd2f83206171a91345/log.txt.gz 2025-09-26 12:25:42,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:25:43,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:25:43,053 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-riscv-collabora-68d685dd2f83206171a91345/lava_callback.json.gz 2025-09-26 12:25:43,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:25:43,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d685dd2f83206171a91345 HTTP/1.1" 200 None 2025-09-26 12:25:43,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:25:43,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8d12be2da466069ac15 HTTP/1.1" 200 None 2025-09-26 12:25:43,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:25:43,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d685dd2f83206171a91345 HTTP/1.1" 200 None 2025-09-26 12:25:43,160 - lava_callback - INFO - Completed processing callback for node 68d685dd2f83206171a91345 INFO: 172.20.0.1:40686 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:25:53,237 - lava_callback - INFO - Received callback for node 68d3ebf1cd36afa834e13705 INFO: 172.20.0.1:50982 - "POST /node/68d3ebf1cd36afa834e13705 HTTP/1.0" 202 Accepted 2025-09-26 12:25:53,243 - lava_callback - INFO - Starting async job submit for node 68d3ebf1cd36afa834e13705 2025-09-26 12:25:53,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:25:53,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ebf1cd36afa834e13705 HTTP/1.1" 200 None 2025-09-26 12:25:53,276 - lava_callback - DEBUG - Processing node 68d3ebf1cd36afa834e13705: baseline-arm64 2025-09-26 12:25:53,589 - lava_callback - ERROR - Error processing callback for node 68d3ebf1cd36afa834e13705: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:50998 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:25:58,232 - lava_callback - INFO - Received callback for node 68d3ed0acd36afa834e138a9 INFO: 172.20.0.1:51004 - "POST /node/68d3ed0acd36afa834e138a9 HTTP/1.0" 202 Accepted 2025-09-26 12:25:58,240 - lava_callback - INFO - Starting async job submit for node 68d3ed0acd36afa834e138a9 2025-09-26 12:25:58,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:25:58,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ed0acd36afa834e138a9 HTTP/1.1" 200 None 2025-09-26 12:25:58,285 - lava_callback - DEBUG - Processing node 68d3ed0acd36afa834e138a9: baseline-arm64 2025-09-26 12:25:58,602 - lava_callback - ERROR - Error processing callback for node 68d3ed0acd36afa834e138a9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:42752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50956 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:26:19,549 - lava_callback - INFO - Received callback for node 68d685dc2f83206171a91342 INFO: 172.20.0.1:39354 - "POST /node/68d685dc2f83206171a91342 HTTP/1.0" 202 Accepted 2025-09-26 12:26:19,554 - lava_callback - INFO - Starting async job submit for node 68d685dc2f83206171a91342 2025-09-26 12:26:19,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:26:19,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d685dc2f83206171a91342 HTTP/1.1" 200 None 2025-09-26 12:26:19,588 - lava_callback - DEBUG - Processing node 68d685dc2f83206171a91342: baseline-riscv-broonie 2025-09-26 12:26:19,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:26:19,928 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:26:19,929 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-riscv-broonie-68d685dc2f83206171a91342/log.txt.gz 2025-09-26 12:26:19,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:26:20,066 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:26:20,067 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-riscv-broonie-68d685dc2f83206171a91342/lava_callback.json.gz 2025-09-26 12:26:20,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:26:20,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d685dc2f83206171a91342 HTTP/1.1" 200 None 2025-09-26 12:26:20,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:26:20,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8d12be2da466069ac15 HTTP/1.1" 200 None 2025-09-26 12:26:20,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:26:20,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d685dc2f83206171a91342 HTTP/1.1" 200 None 2025-09-26 12:26:20,142 - lava_callback - INFO - Completed processing callback for node 68d685dc2f83206171a91342 INFO: 172.20.0.1:39368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53606 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:26:51,527 - lava_callback - INFO - Received callback for node 68d3ed0ccd36afa834e138ac INFO: 172.20.0.1:56236 - "POST /node/68d3ed0ccd36afa834e138ac HTTP/1.0" 202 Accepted 2025-09-26 12:26:51,533 - lava_callback - INFO - Starting async job submit for node 68d3ed0ccd36afa834e138ac 2025-09-26 12:26:51,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:26:51,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ed0ccd36afa834e138ac HTTP/1.1" 200 None 2025-09-26 12:26:51,567 - lava_callback - DEBUG - Processing node 68d3ed0ccd36afa834e138ac: baseline-arm64 2025-09-26 12:26:51,885 - lava_callback - ERROR - Error processing callback for node 68d3ed0ccd36afa834e138ac: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:56250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50364 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:27:19,375 - lava_callback - INFO - Received callback for node 68d3ed16cd36afa834e138b5 INFO: 172.20.0.1:44266 - "POST /node/68d3ed16cd36afa834e138b5 HTTP/1.0" 202 Accepted 2025-09-26 12:27:19,381 - lava_callback - INFO - Starting async job submit for node 68d3ed16cd36afa834e138b5 2025-09-26 12:27:19,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:27:19,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ed16cd36afa834e138b5 HTTP/1.1" 200 None 2025-09-26 12:27:19,415 - lava_callback - DEBUG - Processing node 68d3ed16cd36afa834e138b5: baseline-arm64 2025-09-26 12:27:19,706 - lava_callback - ERROR - Error processing callback for node 68d3ed16cd36afa834e138b5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:44272 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:27:23,651 - lava_callback - INFO - Received callback for node 68d3ed18cd36afa834e138b8 INFO: 172.20.0.1:44278 - "POST /node/68d3ed18cd36afa834e138b8 HTTP/1.0" 202 Accepted 2025-09-26 12:27:23,657 - lava_callback - INFO - Starting async job submit for node 68d3ed18cd36afa834e138b8 2025-09-26 12:27:23,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:27:23,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ed18cd36afa834e138b8 HTTP/1.1" 200 None 2025-09-26 12:27:23,690 - lava_callback - DEBUG - Processing node 68d3ed18cd36afa834e138b8: baseline-arm64 2025-09-26 12:27:23,985 - lava_callback - ERROR - Error processing callback for node 68d3ed18cd36afa834e138b8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:44280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55566 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:27:44,179 - lava_callback - INFO - Received callback for node 68d686942f83206171a91353 INFO: 172.20.0.1:55578 - "POST /node/68d686942f83206171a91353 HTTP/1.0" 202 Accepted 2025-09-26 12:27:44,185 - lava_callback - INFO - Starting async job submit for node 68d686942f83206171a91353 2025-09-26 12:27:44,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:27:44,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d686942f83206171a91353 HTTP/1.1" 200 None 2025-09-26 12:27:44,214 - lava_callback - DEBUG - Processing node 68d686942f83206171a91353: baseline-x86 2025-09-26 12:27:44,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:27:44,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:27:44,544 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d686942f83206171a91353/log.txt.gz 2025-09-26 12:27:44,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:27:44,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:27:44,682 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d686942f83206171a91353/lava_callback.json.gz 2025-09-26 12:27:44,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:27:44,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d686942f83206171a91353 HTTP/1.1" 200 None 2025-09-26 12:27:44,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:27:44,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c53c1bc82a30b37a925 HTTP/1.1" 200 None 2025-09-26 12:27:44,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:27:44,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d686942f83206171a91353 HTTP/1.1" 200 None 2025-09-26 12:27:44,760 - lava_callback - INFO - Completed processing callback for node 68d686942f83206171a91353 INFO: 172.20.0.1:55582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52370 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:27:56,708 - lava_callback - INFO - Received callback for node 68d42741a5c2c05277bc7395 INFO: 172.20.0.1:52378 - "POST /node/68d42741a5c2c05277bc7395 HTTP/1.0" 202 Accepted 2025-09-26 12:27:56,714 - lava_callback - INFO - Starting async job submit for node 68d42741a5c2c05277bc7395 2025-09-26 12:27:56,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:27:56,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42741a5c2c05277bc7395 HTTP/1.1" 200 None 2025-09-26 12:27:56,754 - lava_callback - DEBUG - Processing node 68d42741a5c2c05277bc7395: baseline-arm 2025-09-26 12:27:57,026 - lava_callback - ERROR - Error processing callback for node 68d42741a5c2c05277bc7395: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:40990 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:28:11,897 - lava_callback - INFO - Received callback for node 68d3ed44cd36afa834e13900 INFO: 172.20.0.1:53870 - "POST /node/68d3ed44cd36afa834e13900 HTTP/1.0" 202 Accepted 2025-09-26 12:28:11,904 - lava_callback - INFO - Starting async job submit for node 68d3ed44cd36afa834e13900 2025-09-26 12:28:11,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:28:11,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ed44cd36afa834e13900 HTTP/1.1" 200 None 2025-09-26 12:28:11,936 - lava_callback - DEBUG - Processing node 68d3ed44cd36afa834e13900: baseline-arm64 2025-09-26 12:28:12,231 - lava_callback - ERROR - Error processing callback for node 68d3ed44cd36afa834e13900: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:53878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55560 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:28:38,692 - lava_callback - INFO - Received callback for node 68d3ed46cd36afa834e13903 INFO: 172.20.0.1:55568 - "POST /node/68d3ed46cd36afa834e13903 HTTP/1.0" 202 Accepted 2025-09-26 12:28:38,698 - lava_callback - INFO - Starting async job submit for node 68d3ed46cd36afa834e13903 2025-09-26 12:28:38,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:28:38,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ed46cd36afa834e13903 HTTP/1.1" 200 None 2025-09-26 12:28:38,731 - lava_callback - DEBUG - Processing node 68d3ed46cd36afa834e13903: baseline-arm64 2025-09-26 12:28:39,058 - lava_callback - ERROR - Error processing callback for node 68d3ed46cd36afa834e13903: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:45488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53088 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:28:58,709 - lava_callback - INFO - Received callback for node 68d3ed4bcd36afa834e13906 INFO: 172.20.0.1:53102 - "POST /node/68d3ed4bcd36afa834e13906 HTTP/1.0" 202 Accepted 2025-09-26 12:28:58,715 - lava_callback - INFO - Starting async job submit for node 68d3ed4bcd36afa834e13906 2025-09-26 12:28:58,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:28:58,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ed4bcd36afa834e13906 HTTP/1.1" 200 None 2025-09-26 12:28:58,775 - lava_callback - DEBUG - Processing node 68d3ed4bcd36afa834e13906: baseline-arm64 2025-09-26 12:28:59,066 - lava_callback - ERROR - Error processing callback for node 68d3ed4bcd36afa834e13906: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:29:06,349 - lava_callback - INFO - Received callback for node 68d3e3fccd36afa834e123ce INFO: 172.20.0.1:37664 - "POST /node/68d3e3fccd36afa834e123ce HTTP/1.0" 202 Accepted 2025-09-26 12:29:06,355 - lava_callback - INFO - Starting async job submit for node 68d3e3fccd36afa834e123ce 2025-09-26 12:29:06,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:29:06,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e3fccd36afa834e123ce HTTP/1.1" 200 None 2025-09-26 12:29:06,368 - lava_callback - DEBUG - Processing node 68d3e3fccd36afa834e123ce: baseline-arm64-baylibre 2025-09-26 12:29:06,368 - lava_callback - ERROR - Error processing callback for node 68d3e3fccd36afa834e123ce: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:37666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60070 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:29:26,366 - lava_callback - INFO - Received callback for node 68d3e41ecd36afa834e123f5 INFO: 172.20.0.1:60086 - "POST /node/68d3e41ecd36afa834e123f5 HTTP/1.0" 202 Accepted 2025-09-26 12:29:26,372 - lava_callback - INFO - Starting async job submit for node 68d3e41ecd36afa834e123f5 2025-09-26 12:29:26,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:29:26,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e41ecd36afa834e123f5 HTTP/1.1" 200 None 2025-09-26 12:29:26,385 - lava_callback - DEBUG - Processing node 68d3e41ecd36afa834e123f5: baseline-arm64-baylibre 2025-09-26 12:29:26,385 - lava_callback - ERROR - Error processing callback for node 68d3e41ecd36afa834e123f5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53864 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:29:36,703 - lava_callback - INFO - Received callback for node 68d3ed4ecd36afa834e13909 INFO: 172.20.0.1:53872 - "POST /node/68d3ed4ecd36afa834e13909 HTTP/1.0" 202 Accepted 2025-09-26 12:29:36,709 - lava_callback - INFO - Starting async job submit for node 68d3ed4ecd36afa834e13909 2025-09-26 12:29:36,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:29:36,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ed4ecd36afa834e13909 HTTP/1.1" 200 None 2025-09-26 12:29:36,742 - lava_callback - DEBUG - Processing node 68d3ed4ecd36afa834e13909: baseline-arm64 2025-09-26 12:29:37,037 - lava_callback - ERROR - Error processing callback for node 68d3ed4ecd36afa834e13909: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:46298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48944 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:29:59,134 - lava_callback - INFO - Received callback for node 68d42743a5c2c05277bc7398 INFO: 172.20.0.1:48948 - "POST /node/68d42743a5c2c05277bc7398 HTTP/1.0" 202 Accepted 2025-09-26 12:29:59,140 - lava_callback - INFO - Starting async job submit for node 68d42743a5c2c05277bc7398 2025-09-26 12:29:59,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:29:59,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42743a5c2c05277bc7398 HTTP/1.1" 200 None 2025-09-26 12:29:59,179 - lava_callback - DEBUG - Processing node 68d42743a5c2c05277bc7398: baseline-arm 2025-09-26 12:29:59,418 - lava_callback - ERROR - Error processing callback for node 68d42743a5c2c05277bc7398: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:30:06,393 - lava_callback - INFO - Received callback for node 68d3e441cd36afa834e12413 INFO: 172.20.0.1:42990 - "POST /node/68d3e441cd36afa834e12413 HTTP/1.0" 202 Accepted 2025-09-26 12:30:06,398 - lava_callback - INFO - Starting async job submit for node 68d3e441cd36afa834e12413 2025-09-26 12:30:06,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:30:06,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e441cd36afa834e12413 HTTP/1.1" 200 None 2025-09-26 12:30:06,414 - lava_callback - DEBUG - Processing node 68d3e441cd36afa834e12413: baseline-arm64-baylibre 2025-09-26 12:30:06,414 - lava_callback - ERROR - Error processing callback for node 68d3e441cd36afa834e12413: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:42996 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:30:11,931 - lava_callback - INFO - Received callback for node 68d3e478cd36afa834e129b5 INFO: 172.20.0.1:60200 - "POST /node/68d3e478cd36afa834e129b5 HTTP/1.0" 202 Accepted 2025-09-26 12:30:11,938 - lava_callback - INFO - Starting async job submit for node 68d3e478cd36afa834e129b5 2025-09-26 12:30:12,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:30:12,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e478cd36afa834e129b5 HTTP/1.1" 200 None 2025-09-26 12:30:12,072 - lava_callback - DEBUG - Processing node 68d3e478cd36afa834e129b5: ltp-fs-bind 2025-09-26 12:30:12,592 - lava_callback - ERROR - Error processing callback for node 68d3e478cd36afa834e129b5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:60214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33352 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:30:27,767 - lava_callback - INFO - Received callback for node 68d3ed70cd36afa834e13939 INFO: 172.20.0.1:33356 - "POST /node/68d3ed70cd36afa834e13939 HTTP/1.0" 202 Accepted 2025-09-26 12:30:27,773 - lava_callback - INFO - Starting async job submit for node 68d3ed70cd36afa834e13939 2025-09-26 12:30:27,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:30:27,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ed70cd36afa834e13939 HTTP/1.1" 200 None 2025-09-26 12:30:27,826 - lava_callback - DEBUG - Processing node 68d3ed70cd36afa834e13939: baseline-arm64 2025-09-26 12:30:28,236 - lava_callback - ERROR - Error processing callback for node 68d3ed70cd36afa834e13939: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:30:31,363 - lava_callback - INFO - Received callback for node 68d3ed72cd36afa834e1393c INFO: 172.20.0.1:35640 - "POST /node/68d3ed72cd36afa834e1393c HTTP/1.0" 202 Accepted 2025-09-26 12:30:31,369 - lava_callback - INFO - Starting async job submit for node 68d3ed72cd36afa834e1393c 2025-09-26 12:30:31,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:30:31,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ed72cd36afa834e1393c HTTP/1.1" 200 None 2025-09-26 12:30:31,402 - lava_callback - DEBUG - Processing node 68d3ed72cd36afa834e1393c: baseline-arm64 2025-09-26 12:30:31,693 - lava_callback - ERROR - Error processing callback for node 68d3ed72cd36afa834e1393c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:35646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36326 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:30:52,338 - lava_callback - INFO - Received callback for node 68d3e5dfcd36afa834e12ba1 INFO: 172.20.0.1:44764 - "POST /node/68d3e5dfcd36afa834e12ba1 HTTP/1.0" 202 Accepted 2025-09-26 12:30:52,345 - lava_callback - INFO - Starting async job submit for node 68d3e5dfcd36afa834e12ba1 2025-09-26 12:30:52,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:30:52,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e5dfcd36afa834e12ba1 HTTP/1.1" 200 None 2025-09-26 12:30:52,401 - lava_callback - DEBUG - Processing node 68d3e5dfcd36afa834e12ba1: ltp-fsx 2025-09-26 12:30:52,730 - lava_callback - ERROR - Error processing callback for node 68d3e5dfcd36afa834e12ba1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:30:55,230 - lava_callback - INFO - Received callback for node 68d3ed83cd36afa834e1394c INFO: 172.20.0.1:44778 - "POST /node/68d3ed83cd36afa834e1394c HTTP/1.0" 202 Accepted 2025-09-26 12:30:55,236 - lava_callback - INFO - Starting async job submit for node 68d3ed83cd36afa834e1394c 2025-09-26 12:30:55,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:30:55,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ed83cd36afa834e1394c HTTP/1.1" 200 None 2025-09-26 12:30:55,269 - lava_callback - DEBUG - Processing node 68d3ed83cd36afa834e1394c: baseline-arm64 2025-09-26 12:30:55,557 - lava_callback - ERROR - Error processing callback for node 68d3ed83cd36afa834e1394c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:44782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47860 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:31:38,516 - lava_callback - INFO - Received callback for node 68d3ed83cd36afa834e1394f INFO: 172.20.0.1:47872 - "POST /node/68d3ed83cd36afa834e1394f HTTP/1.0" 202 Accepted 2025-09-26 12:31:38,522 - lava_callback - INFO - Starting async job submit for node 68d3ed83cd36afa834e1394f 2025-09-26 12:31:38,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:31:38,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ed83cd36afa834e1394f HTTP/1.1" 200 None 2025-09-26 12:31:38,559 - lava_callback - DEBUG - Processing node 68d3ed83cd36afa834e1394f: baseline-arm64 2025-09-26 12:31:38,871 - lava_callback - ERROR - Error processing callback for node 68d3ed83cd36afa834e1394f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:55128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55140 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:31:51,624 - lava_callback - INFO - Received callback for node 68d3eda8cd36afa834e13983 INFO: 172.20.0.1:54860 - "POST /node/68d3eda8cd36afa834e13983 HTTP/1.0" 202 Accepted 2025-09-26 12:31:51,630 - lava_callback - INFO - Starting async job submit for node 68d3eda8cd36afa834e13983 2025-09-26 12:31:51,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:31:51,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eda8cd36afa834e13983 HTTP/1.1" 200 None 2025-09-26 12:31:51,662 - lava_callback - DEBUG - Processing node 68d3eda8cd36afa834e13983: baseline-arm64 2025-09-26 12:31:51,953 - lava_callback - ERROR - Error processing callback for node 68d3eda8cd36afa834e13983: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:54862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46096 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:32:12,174 - lava_callback - INFO - Received callback for node 68d3eda9cd36afa834e13986 INFO: 172.20.0.1:33746 - "POST /node/68d3eda9cd36afa834e13986 HTTP/1.0" 202 Accepted 2025-09-26 12:32:12,180 - lava_callback - INFO - Starting async job submit for node 68d3eda9cd36afa834e13986 2025-09-26 12:32:12,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:32:12,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eda9cd36afa834e13986 HTTP/1.1" 200 None 2025-09-26 12:32:12,223 - lava_callback - DEBUG - Processing node 68d3eda9cd36afa834e13986: baseline-arm64 2025-09-26 12:32:12,517 - lava_callback - ERROR - Error processing callback for node 68d3eda9cd36afa834e13986: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:33762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33770 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:32:20,555 - lava_callback - INFO - Received callback for node 68d42745a5c2c05277bc739b INFO: 172.20.0.1:45588 - "POST /node/68d42745a5c2c05277bc739b HTTP/1.0" 202 Accepted 2025-09-26 12:32:20,561 - lava_callback - INFO - Starting async job submit for node 68d42745a5c2c05277bc739b 2025-09-26 12:32:20,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:32:20,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42745a5c2c05277bc739b HTTP/1.1" 200 None 2025-09-26 12:32:20,594 - lava_callback - DEBUG - Processing node 68d42745a5c2c05277bc739b: baseline-arm 2025-09-26 12:32:20,830 - lava_callback - ERROR - Error processing callback for node 68d42745a5c2c05277bc739b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:45598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45614 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:32:32,165 - lava_callback - INFO - Received callback for node 68d3ebf4cd36afa834e13708 INFO: 172.20.0.1:53568 - "POST /node/68d3ebf4cd36afa834e13708 HTTP/1.0" 202 Accepted 2025-09-26 12:32:32,172 - lava_callback - INFO - Starting async job submit for node 68d3ebf4cd36afa834e13708 2025-09-26 12:32:32,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:32:32,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ebf4cd36afa834e13708 HTTP/1.1" 200 None 2025-09-26 12:32:32,243 - lava_callback - DEBUG - Processing node 68d3ebf4cd36afa834e13708: baseline-arm64 2025-09-26 12:32:33,202 - lava_callback - ERROR - Error processing callback for node 68d3ebf4cd36afa834e13708: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:53584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41778 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:33:01,423 - lava_callback - INFO - Received callback for node 68d3edb4cd36afa834e13992 INFO: 172.20.0.1:49448 - "POST /node/68d3edb4cd36afa834e13992 HTTP/1.0" 202 Accepted 2025-09-26 12:33:01,434 - lava_callback - INFO - Starting async job submit for node 68d3edb4cd36afa834e13992 2025-09-26 12:33:01,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:33:01,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3edb4cd36afa834e13992 HTTP/1.1" 200 None 2025-09-26 12:33:01,500 - lava_callback - DEBUG - Processing node 68d3edb4cd36afa834e13992: baseline-arm64 2025-09-26 12:33:02,058 - lava_callback - ERROR - Error processing callback for node 68d3edb4cd36afa834e13992: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:49458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50856 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:33:16,542 - lava_callback - INFO - Received callback for node 68d3edb3cd36afa834e1398f INFO: 172.20.0.1:50858 - "POST /node/68d3edb3cd36afa834e1398f HTTP/1.0" 202 Accepted 2025-09-26 12:33:16,549 - lava_callback - INFO - Starting async job submit for node 68d3edb3cd36afa834e1398f 2025-09-26 12:33:16,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:33:16,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3edb3cd36afa834e1398f HTTP/1.1" 200 None 2025-09-26 12:33:16,603 - lava_callback - DEBUG - Processing node 68d3edb3cd36afa834e1398f: baseline-arm64 2025-09-26 12:33:16,984 - lava_callback - ERROR - Error processing callback for node 68d3edb3cd36afa834e1398f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:53468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53474 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:33:30,883 - lava_callback - INFO - Received callback for node 68d3ede4cd36afa834e139d7 INFO: 172.20.0.1:50590 - "POST /node/68d3ede4cd36afa834e139d7 HTTP/1.0" 202 Accepted 2025-09-26 12:33:30,892 - lava_callback - INFO - Starting async job submit for node 68d3ede4cd36afa834e139d7 2025-09-26 12:33:30,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:33:30,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ede4cd36afa834e139d7 HTTP/1.1" 200 None 2025-09-26 12:33:30,934 - lava_callback - DEBUG - Processing node 68d3ede4cd36afa834e139d7: baseline-arm64 2025-09-26 12:33:31,302 - lava_callback - ERROR - Error processing callback for node 68d3ede4cd36afa834e139d7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:50596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52470 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:33:46,637 - lava_callback - INFO - Received callback for node 68d3e525cd36afa834e12aae INFO: 172.20.0.1:52486 - "POST /node/68d3e525cd36afa834e12aae HTTP/1.0" 202 Accepted 2025-09-26 12:33:46,643 - lava_callback - INFO - Starting async job submit for node 68d3e525cd36afa834e12aae 2025-09-26 12:33:46,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:33:46,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e525cd36afa834e12aae HTTP/1.1" 200 None 2025-09-26 12:33:46,656 - lava_callback - DEBUG - Processing node 68d3e525cd36afa834e12aae: baseline-arm64-baylibre 2025-09-26 12:33:46,656 - lava_callback - ERROR - Error processing callback for node 68d3e525cd36afa834e12aae: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:33:52,848 - lava_callback - INFO - Received callback for node 68d3ede6cd36afa834e139da INFO: 172.20.0.1:34518 - "POST /node/68d3ede6cd36afa834e139da HTTP/1.0" 202 Accepted 2025-09-26 12:33:52,860 - lava_callback - INFO - Starting async job submit for node 68d3ede6cd36afa834e139da 2025-09-26 12:33:53,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:33:53,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ede6cd36afa834e139da HTTP/1.1" 200 None 2025-09-26 12:33:53,021 - lava_callback - DEBUG - Processing node 68d3ede6cd36afa834e139da: baseline-arm64 2025-09-26 12:33:54,036 - lava_callback - ERROR - Error processing callback for node 68d3ede6cd36afa834e139da: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:34522 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:34:05,725 - lava_callback - INFO - Received callback for node 68d688022f83206171a913ad INFO: 172.20.0.1:51964 - "POST /node/68d688022f83206171a913ad HTTP/1.0" 202 Accepted 2025-09-26 12:34:05,734 - lava_callback - INFO - Starting async job submit for node 68d688022f83206171a913ad 2025-09-26 12:34:05,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:05,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688022f83206171a913ad HTTP/1.1" 200 None 2025-09-26 12:34:05,787 - lava_callback - DEBUG - Processing node 68d688022f83206171a913ad: baseline-arm 2025-09-26 12:34:06,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:34:06,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:34:06,349 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d688022f83206171a913ad/log.txt.gz 2025-09-26 12:34:06,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:34:06,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:34:06,492 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d688022f83206171a913ad/lava_callback.json.gz 2025-09-26 12:34:06,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:51972 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:34:06,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688022f83206171a913ad HTTP/1.1" 200 None 2025-09-26 12:34:06,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:06,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-26 12:34:06,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:06,583 - lava_callback - INFO - Received callback for node 68d3e52ecd36afa834e12ab4 INFO: 172.20.0.1:51988 - "POST /node/68d3e52ecd36afa834e12ab4 HTTP/1.0" 202 Accepted 2025-09-26 12:34:06,592 - lava_callback - INFO - Starting async job submit for node 68d3e52ecd36afa834e12ab4 2025-09-26 12:34:06,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:06,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688022f83206171a913ad HTTP/1.1" 200 None 2025-09-26 12:34:06,602 - lava_callback - INFO - Completed processing callback for node 68d688022f83206171a913ad 2025-09-26 12:34:06,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e52ecd36afa834e12ab4 HTTP/1.1" 200 None 2025-09-26 12:34:06,622 - lava_callback - DEBUG - Processing node 68d3e52ecd36afa834e12ab4: baseline-arm64-baylibre 2025-09-26 12:34:06,622 - lava_callback - ERROR - Error processing callback for node 68d3e52ecd36afa834e12ab4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:34:07,258 - lava_callback - INFO - Received callback for node 68d3e536cd36afa834e12aba INFO: 172.20.0.1:51998 - "POST /node/68d3e536cd36afa834e12aba HTTP/1.0" 202 Accepted 2025-09-26 12:34:07,265 - lava_callback - INFO - Starting async job submit for node 68d3e536cd36afa834e12aba 2025-09-26 12:34:07,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:07,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e536cd36afa834e12aba HTTP/1.1" 200 None 2025-09-26 12:34:07,279 - lava_callback - DEBUG - Processing node 68d3e536cd36afa834e12aba: baseline-arm64-baylibre 2025-09-26 12:34:07,280 - lava_callback - ERROR - Error processing callback for node 68d3e536cd36afa834e12aba: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:40574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60280 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:34:22,135 - lava_callback - INFO - Received callback for node 68d687fa2f83206171a91382 INFO: 172.20.0.1:60286 - "POST /node/68d687fa2f83206171a91382 HTTP/1.0" 202 Accepted 2025-09-26 12:34:22,142 - lava_callback - INFO - Starting async job submit for node 68d687fa2f83206171a91382 2025-09-26 12:34:22,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:22,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d687fa2f83206171a91382 HTTP/1.1" 200 None 2025-09-26 12:34:22,182 - lava_callback - DEBUG - Processing node 68d687fa2f83206171a91382: baseline-arm 2025-09-26 12:34:22,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:34:22,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:34:22,723 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d687fa2f83206171a91382/log.txt.gz 2025-09-26 12:34:22,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:34:22,870 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:34:22,871 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d687fa2f83206171a91382/lava_callback.json.gz 2025-09-26 12:34:22,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:22,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d687fa2f83206171a91382 HTTP/1.1" 200 None 2025-09-26 12:34:22,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:22,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-26 12:34:22,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:22,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d687fa2f83206171a91382 HTTP/1.1" 200 None 2025-09-26 12:34:22,957 - lava_callback - INFO - Completed processing callback for node 68d687fa2f83206171a91382 2025-09-26 12:34:23,816 - lava_callback - INFO - Received callback for node 68d687f92f83206171a91369 INFO: 172.20.0.1:60290 - "POST /node/68d687f92f83206171a91369 HTTP/1.0" 202 Accepted 2025-09-26 12:34:23,823 - lava_callback - INFO - Starting async job submit for node 68d687f92f83206171a91369 2025-09-26 12:34:23,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:23,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d687f92f83206171a91369 HTTP/1.1" 200 None 2025-09-26 12:34:23,859 - lava_callback - DEBUG - Processing node 68d687f92f83206171a91369: baseline-arm 2025-09-26 12:34:24,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:34:24,245 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:34:24,245 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d687f92f83206171a91369/log.txt.gz 2025-09-26 12:34:24,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:34:24,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:34:24,385 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d687f92f83206171a91369/lava_callback.json.gz 2025-09-26 12:34:24,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:24,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d687f92f83206171a91369 HTTP/1.1" 200 None 2025-09-26 12:34:24,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:24,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-26 12:34:24,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:24,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d687f92f83206171a91369 HTTP/1.1" 200 None 2025-09-26 12:34:24,483 - lava_callback - INFO - Completed processing callback for node 68d687f92f83206171a91369 2025-09-26 12:34:25,167 - lava_callback - INFO - Received callback for node 68d688032f83206171a913b0 INFO: 172.20.0.1:60296 - "POST /node/68d688032f83206171a913b0 HTTP/1.0" 202 Accepted 2025-09-26 12:34:25,174 - lava_callback - INFO - Starting async job submit for node 68d688032f83206171a913b0 2025-09-26 12:34:25,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:25,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688032f83206171a913b0 HTTP/1.1" 200 None 2025-09-26 12:34:25,207 - lava_callback - DEBUG - Processing node 68d688032f83206171a913b0: baseline-arm 2025-09-26 12:34:25,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:34:25,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:34:25,707 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d688032f83206171a913b0/log.txt.gz 2025-09-26 12:34:25,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:34:25,832 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:34:25,833 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d688032f83206171a913b0/lava_callback.json.gz 2025-09-26 12:34:25,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:25,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688032f83206171a913b0 HTTP/1.1" 200 None 2025-09-26 12:34:25,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:25,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-26 12:34:25,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:25,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688032f83206171a913b0 HTTP/1.1" 200 None 2025-09-26 12:34:25,910 - lava_callback - INFO - Completed processing callback for node 68d688032f83206171a913b0 INFO: 172.20.0.1:60306 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:34:32,697 - lava_callback - INFO - Received callback for node 68d3e5e5cd36afa834e12ba7 INFO: 172.20.0.1:59386 - "POST /node/68d3e5e5cd36afa834e12ba7 HTTP/1.0" 202 Accepted 2025-09-26 12:34:32,705 - lava_callback - INFO - Starting async job submit for node 68d3e5e5cd36afa834e12ba7 2025-09-26 12:34:32,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:32,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e5e5cd36afa834e12ba7 HTTP/1.1" 200 None 2025-09-26 12:34:32,851 - lava_callback - DEBUG - Processing node 68d3e5e5cd36afa834e12ba7: ltp-fs-bind 2025-09-26 12:34:33,486 - lava_callback - ERROR - Error processing callback for node 68d3e5e5cd36afa834e12ba7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:34:35,680 - lava_callback - INFO - Received callback for node 68d42746a5c2c05277bc739e INFO: 172.20.0.1:59400 - "POST /node/68d42746a5c2c05277bc739e HTTP/1.0" 202 Accepted 2025-09-26 12:34:35,689 - lava_callback - INFO - Starting async job submit for node 68d42746a5c2c05277bc739e 2025-09-26 12:34:35,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:35,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42746a5c2c05277bc739e HTTP/1.1" 200 None 2025-09-26 12:34:35,729 - lava_callback - DEBUG - Processing node 68d42746a5c2c05277bc739e: baseline-arm 2025-09-26 12:34:36,013 - lava_callback - ERROR - Error processing callback for node 68d42746a5c2c05277bc739e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:59402 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:34:39,649 - lava_callback - INFO - Received callback for node 68d688052f83206171a913b6 INFO: 172.20.0.1:42098 - "POST /node/68d688052f83206171a913b6 HTTP/1.0" 202 Accepted 2025-09-26 12:34:39,656 - lava_callback - INFO - Starting async job submit for node 68d688052f83206171a913b6 2025-09-26 12:34:39,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:39,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688052f83206171a913b6 HTTP/1.1" 200 None 2025-09-26 12:34:39,699 - lava_callback - DEBUG - Processing node 68d688052f83206171a913b6: baseline-arm 2025-09-26 12:34:39,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:34:40,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:34:40,112 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d688052f83206171a913b6/log.txt.gz 2025-09-26 12:34:40,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:34:40,260 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:34:40,260 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d688052f83206171a913b6/lava_callback.json.gz 2025-09-26 12:34:40,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:40,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688052f83206171a913b6 HTTP/1.1" 200 None 2025-09-26 12:34:40,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:40,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-26 12:34:40,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:40,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688052f83206171a913b6 HTTP/1.1" 200 None 2025-09-26 12:34:40,349 - lava_callback - INFO - Completed processing callback for node 68d688052f83206171a913b6 2025-09-26 12:34:40,896 - lava_callback - INFO - Received callback for node 68d688042f83206171a913b3 INFO: 172.20.0.1:42106 - "POST /node/68d688042f83206171a913b3 HTTP/1.0" 202 Accepted 2025-09-26 12:34:40,902 - lava_callback - INFO - Starting async job submit for node 68d688042f83206171a913b3 2025-09-26 12:34:40,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:40,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688042f83206171a913b3 HTTP/1.1" 200 None 2025-09-26 12:34:40,956 - lava_callback - DEBUG - Processing node 68d688042f83206171a913b3: baseline-arm 2025-09-26 12:34:41,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:34:41,340 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:34:41,341 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d688042f83206171a913b3/log.txt.gz 2025-09-26 12:34:41,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:34:41,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:34:41,500 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d688042f83206171a913b3/lava_callback.json.gz 2025-09-26 12:34:41,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:41,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688042f83206171a913b3 HTTP/1.1" 200 None 2025-09-26 12:34:41,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:41,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-26 12:34:41,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:41,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688042f83206171a913b3 HTTP/1.1" 200 None 2025-09-26 12:34:41,590 - lava_callback - INFO - Completed processing callback for node 68d688042f83206171a913b3 2025-09-26 12:34:42,245 - lava_callback - INFO - Received callback for node 68d3edeccd36afa834e139e0 INFO: 172.20.0.1:42116 - "POST /node/68d3edeccd36afa834e139e0 HTTP/1.0" 202 Accepted 2025-09-26 12:34:42,255 - lava_callback - INFO - Starting async job submit for node 68d3edeccd36afa834e139e0 2025-09-26 12:34:42,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:42,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3edeccd36afa834e139e0 HTTP/1.1" 200 None 2025-09-26 12:34:42,307 - lava_callback - DEBUG - Processing node 68d3edeccd36afa834e139e0: baseline-arm64 2025-09-26 12:34:42,683 - lava_callback - ERROR - Error processing callback for node 68d3edeccd36afa834e139e0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:42120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42136 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:34:51,865 - lava_callback - INFO - Received callback for node 68d3ee0fcd36afa834e13a04 INFO: 172.20.0.1:54510 - "POST /node/68d3ee0fcd36afa834e13a04 HTTP/1.0" 202 Accepted 2025-09-26 12:34:51,871 - lava_callback - INFO - Starting async job submit for node 68d3ee0fcd36afa834e13a04 2025-09-26 12:34:51,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:51,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ee0fcd36afa834e13a04 HTTP/1.1" 200 None 2025-09-26 12:34:51,905 - lava_callback - DEBUG - Processing node 68d3ee0fcd36afa834e13a04: baseline-arm64 2025-09-26 12:34:52,290 - lava_callback - ERROR - Error processing callback for node 68d3ee0fcd36afa834e13a04: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:34:52,615 - lava_callback - INFO - Received callback for node 68d688362f83206171a91410 INFO: 172.20.0.1:54518 - "POST /node/68d688362f83206171a91410 HTTP/1.0" 202 Accepted 2025-09-26 12:34:52,664 - lava_callback - INFO - Starting async job submit for node 68d688362f83206171a91410 2025-09-26 12:34:52,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:52,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688362f83206171a91410 HTTP/1.1" 200 None 2025-09-26 12:34:52,704 - lava_callback - DEBUG - Processing node 68d688362f83206171a91410: baseline-arm-pengutronix 2025-09-26 12:34:52,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:34:52,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:34:52,954 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d688362f83206171a91410/log.txt.gz 2025-09-26 12:34:52,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:34:53,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:34:53,093 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d688362f83206171a91410/lava_callback.json.gz 2025-09-26 12:34:53,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:53,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688362f83206171a91410 HTTP/1.1" 200 None 2025-09-26 12:34:53,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:53,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-26 12:34:53,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:53,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688362f83206171a91410 HTTP/1.1" 200 None 2025-09-26 12:34:53,181 - lava_callback - INFO - Completed processing callback for node 68d688362f83206171a91410 INFO: 172.20.0.1:54530 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:34:58,653 - lava_callback - INFO - Received callback for node 68d688342f83206171a9140d INFO: 172.20.0.1:54540 - "POST /node/68d688342f83206171a9140d HTTP/1.0" 202 Accepted 2025-09-26 12:34:58,662 - lava_callback - INFO - Starting async job submit for node 68d688342f83206171a9140d 2025-09-26 12:34:58,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:58,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688342f83206171a9140d HTTP/1.1" 200 None 2025-09-26 12:34:58,703 - lava_callback - DEBUG - Processing node 68d688342f83206171a9140d: baseline-arm-pengutronix 2025-09-26 12:34:58,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:34:59,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:34:59,001 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d688342f83206171a9140d/log.txt.gz 2025-09-26 12:34:59,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:34:59,117 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:34:59,117 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d688342f83206171a9140d/lava_callback.json.gz 2025-09-26 12:34:59,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:59,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688342f83206171a9140d HTTP/1.1" 200 None 2025-09-26 12:34:59,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:59,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-26 12:34:59,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:34:59,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688342f83206171a9140d HTTP/1.1" 200 None 2025-09-26 12:34:59,203 - lava_callback - INFO - Completed processing callback for node 68d688342f83206171a9140d 2025-09-26 12:35:04,356 - lava_callback - INFO - Received callback for node 68d6880b2f83206171a913c5 INFO: 172.20.0.1:50356 - "POST /node/68d6880b2f83206171a913c5 HTTP/1.0" 202 Accepted 2025-09-26 12:35:04,362 - lava_callback - INFO - Starting async job submit for node 68d6880b2f83206171a913c5 2025-09-26 12:35:04,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:04,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6880b2f83206171a913c5 HTTP/1.1" 200 None 2025-09-26 12:35:04,399 - lava_callback - DEBUG - Processing node 68d6880b2f83206171a913c5: baseline-arm 2025-09-26 12:35:04,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:35:04,871 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:35:04,871 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d6880b2f83206171a913c5/log.txt.gz 2025-09-26 12:35:04,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:35:05,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:35:05,039 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d6880b2f83206171a913c5/lava_callback.json.gz 2025-09-26 12:35:05,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:05,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6880b2f83206171a913c5 HTTP/1.1" 200 None 2025-09-26 12:35:05,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:05,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-26 12:35:05,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:05,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6880b2f83206171a913c5 HTTP/1.1" 200 None 2025-09-26 12:35:05,159 - lava_callback - INFO - Completed processing callback for node 68d6880b2f83206171a913c5 INFO: 172.20.0.1:50362 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:35:12,176 - lava_callback - INFO - Received callback for node 68d6880d2f83206171a913cb INFO: 172.20.0.1:40946 - "POST /node/68d6880d2f83206171a913cb HTTP/1.0" 202 Accepted 2025-09-26 12:35:12,182 - lava_callback - INFO - Starting async job submit for node 68d6880d2f83206171a913cb 2025-09-26 12:35:12,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:12,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6880d2f83206171a913cb HTTP/1.1" 200 None 2025-09-26 12:35:12,219 - lava_callback - DEBUG - Processing node 68d6880d2f83206171a913cb: baseline-arm-baylibre 2025-09-26 12:35:12,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:35:12,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:35:12,642 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d6880d2f83206171a913cb/log.txt.gz 2025-09-26 12:35:12,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:35:12,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:35:12,819 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d6880d2f83206171a913cb/lava_callback.json.gz 2025-09-26 12:35:12,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:12,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6880d2f83206171a913cb HTTP/1.1" 200 None 2025-09-26 12:35:12,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:12,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-26 12:35:12,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:12,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6880d2f83206171a913cb HTTP/1.1" 200 None 2025-09-26 12:35:12,906 - lava_callback - INFO - Completed processing callback for node 68d6880d2f83206171a913cb INFO: 172.20.0.1:40952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40960 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:35:20,288 - lava_callback - INFO - Received callback for node 68d688262f83206171a913f5 INFO: 172.20.0.1:39812 - "POST /node/68d688262f83206171a913f5 HTTP/1.0" 202 Accepted 2025-09-26 12:35:20,296 - lava_callback - INFO - Starting async job submit for node 68d688262f83206171a913f5 2025-09-26 12:35:20,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:20,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688262f83206171a913f5 HTTP/1.1" 200 None 2025-09-26 12:35:20,335 - lava_callback - DEBUG - Processing node 68d688262f83206171a913f5: baseline-arm-clabbe 2025-09-26 12:35:20,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:35:20,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:35:20,706 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d688262f83206171a913f5/log.txt.gz 2025-09-26 12:35:20,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:35:20,823 - lava_callback - INFO - Received callback for node 68d3ee13cd36afa834e13a1c INFO: 172.20.0.1:39818 - "POST /node/68d3ee13cd36afa834e13a1c HTTP/1.0" 202 Accepted 2025-09-26 12:35:20,830 - lava_callback - INFO - Starting async job submit for node 68d3ee13cd36afa834e13a1c 2025-09-26 12:35:20,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:35:20,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:20,855 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d688262f83206171a913f5/lava_callback.json.gz 2025-09-26 12:35:20,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:20,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ee13cd36afa834e13a1c HTTP/1.1" 200 None 2025-09-26 12:35:20,913 - lava_callback - DEBUG - Processing node 68d3ee13cd36afa834e13a1c: baseline-arm64 2025-09-26 12:35:20,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688262f83206171a913f5 HTTP/1.1" 200 None 2025-09-26 12:35:20,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:21,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-26 12:35:21,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:21,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688262f83206171a913f5 HTTP/1.1" 200 None 2025-09-26 12:35:21,130 - lava_callback - INFO - Completed processing callback for node 68d688262f83206171a913f5 2025-09-26 12:35:21,375 - lava_callback - ERROR - Error processing callback for node 68d3ee13cd36afa834e13a1c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:39834 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:35:22,773 - lava_callback - INFO - Received callback for node 68d686d42f83206171a91362 INFO: 172.20.0.1:39848 - "POST /node/68d686d42f83206171a91362 HTTP/1.0" 202 Accepted 2025-09-26 12:35:22,782 - lava_callback - INFO - Starting async job submit for node 68d686d42f83206171a91362 2025-09-26 12:35:22,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:22,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d686d42f83206171a91362 HTTP/1.1" 200 None 2025-09-26 12:35:22,817 - lava_callback - DEBUG - Processing node 68d686d42f83206171a91362: blktests-ddp-x86 2025-09-26 12:35:23,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:35:23,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:35:23,720 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/blktests-ddp-x86-68d686d42f83206171a91362/log.txt.gz 2025-09-26 12:35:23,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:35:23,868 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:35:23,868 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/blktests-ddp-x86-68d686d42f83206171a91362/lava_callback.json.gz 2025-09-26 12:35:23,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:23,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d686d42f83206171a91362 HTTP/1.1" 200 None 2025-09-26 12:35:23,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:23,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8d52be2da466069ac18 HTTP/1.1" 200 None 2025-09-26 12:35:23,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:23,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d686d42f83206171a91362 HTTP/1.1" 200 None 2025-09-26 12:35:23,954 - lava_callback - INFO - Completed processing callback for node 68d686d42f83206171a91362 INFO: 172.20.0.1:39858 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:35:31,969 - lava_callback - INFO - Received callback for node 68d6880b2f83206171a913c8 INFO: 172.20.0.1:59390 - "POST /node/68d6880b2f83206171a913c8 HTTP/1.0" 202 Accepted 2025-09-26 12:35:31,976 - lava_callback - INFO - Starting async job submit for node 68d6880b2f83206171a913c8 2025-09-26 12:35:31,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:32,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6880b2f83206171a913c8 HTTP/1.1" 200 None 2025-09-26 12:35:32,009 - lava_callback - DEBUG - Processing node 68d6880b2f83206171a913c8: baseline-arm 2025-09-26 12:35:32,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:35:32,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:35:32,533 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d6880b2f83206171a913c8/log.txt.gz 2025-09-26 12:35:32,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:35:32,670 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:35:32,671 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d6880b2f83206171a913c8/lava_callback.json.gz 2025-09-26 12:35:32,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:32,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6880b2f83206171a913c8 HTTP/1.1" 200 None 2025-09-26 12:35:32,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:32,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-26 12:35:32,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:32,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6880b2f83206171a913c8 HTTP/1.1" 200 None 2025-09-26 12:35:32,751 - lava_callback - INFO - Completed processing callback for node 68d6880b2f83206171a913c8 2025-09-26 12:35:33,384 - lava_callback - INFO - Received callback for node 68d6880f2f83206171a913ce INFO: 172.20.0.1:59398 - "POST /node/68d6880f2f83206171a913ce HTTP/1.0" 202 Accepted 2025-09-26 12:35:33,391 - lava_callback - INFO - Starting async job submit for node 68d6880f2f83206171a913ce 2025-09-26 12:35:33,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:33,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6880f2f83206171a913ce HTTP/1.1" 200 None 2025-09-26 12:35:33,428 - lava_callback - DEBUG - Processing node 68d6880f2f83206171a913ce: baseline-arm-baylibre 2025-09-26 12:35:33,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:35:33,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:35:33,769 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d6880f2f83206171a913ce/log.txt.gz 2025-09-26 12:35:33,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:35:33,926 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:35:33,927 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d6880f2f83206171a913ce/lava_callback.json.gz 2025-09-26 12:35:33,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:33,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6880f2f83206171a913ce HTTP/1.1" 200 None 2025-09-26 12:35:33,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:33,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-26 12:35:33,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:34,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6880f2f83206171a913ce HTTP/1.1" 200 None 2025-09-26 12:35:34,016 - lava_callback - INFO - Completed processing callback for node 68d6880f2f83206171a913ce INFO: 172.20.0.1:59404 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:35:42,602 - lava_callback - INFO - Received callback for node 68d688142f83206171a913d7 INFO: 172.20.0.1:37468 - "POST /node/68d688142f83206171a913d7 HTTP/1.0" 202 Accepted 2025-09-26 12:35:42,608 - lava_callback - INFO - Starting async job submit for node 68d688142f83206171a913d7 2025-09-26 12:35:42,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:42,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688142f83206171a913d7 HTTP/1.1" 200 None 2025-09-26 12:35:42,643 - lava_callback - DEBUG - Processing node 68d688142f83206171a913d7: baseline-arm-baylibre 2025-09-26 12:35:42,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:35:43,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:35:43,013 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d688142f83206171a913d7/log.txt.gz 2025-09-26 12:35:43,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:35:43,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:35:43,144 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d688142f83206171a913d7/lava_callback.json.gz 2025-09-26 12:35:43,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:43,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688142f83206171a913d7 HTTP/1.1" 200 None 2025-09-26 12:35:43,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:43,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-26 12:35:43,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:43,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688142f83206171a913d7 HTTP/1.1" 200 None 2025-09-26 12:35:43,235 - lava_callback - INFO - Completed processing callback for node 68d688142f83206171a913d7 INFO: 172.20.0.1:37472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37486 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:35:47,524 - lava_callback - INFO - Received callback for node 68d688152f83206171a913da INFO: 172.20.0.1:37490 - "POST /node/68d688152f83206171a913da HTTP/1.0" 202 Accepted 2025-09-26 12:35:47,530 - lava_callback - INFO - Starting async job submit for node 68d688152f83206171a913da 2025-09-26 12:35:47,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:47,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688152f83206171a913da HTTP/1.1" 200 None 2025-09-26 12:35:47,564 - lava_callback - DEBUG - Processing node 68d688152f83206171a913da: baseline-arm-baylibre 2025-09-26 12:35:47,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:35:47,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:35:47,917 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d688152f83206171a913da/log.txt.gz 2025-09-26 12:35:47,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:35:48,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:35:48,044 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d688152f83206171a913da/lava_callback.json.gz 2025-09-26 12:35:48,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:48,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688152f83206171a913da HTTP/1.1" 200 None 2025-09-26 12:35:48,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:48,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-26 12:35:48,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:48,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688152f83206171a913da HTTP/1.1" 200 None 2025-09-26 12:35:48,126 - lava_callback - INFO - Completed processing callback for node 68d688152f83206171a913da 2025-09-26 12:35:53,149 - lava_callback - INFO - Received callback for node 68d683fc2f83206171a91331 INFO: 172.20.0.1:56142 - "POST /node/68d683fc2f83206171a91331 HTTP/1.0" 202 Accepted 2025-09-26 12:35:53,156 - lava_callback - INFO - Starting async job submit for node 68d683fc2f83206171a91331 2025-09-26 12:35:53,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:53,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d683fc2f83206171a91331 HTTP/1.1" 200 None 2025-09-26 12:35:53,225 - lava_callback - DEBUG - Processing node 68d683fc2f83206171a91331: ltp-smoketest 2025-09-26 12:35:53,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:35:53,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:35:53,782 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d683fc2f83206171a91331/log.txt.gz 2025-09-26 12:35:53,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:35:53,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:35:53,900 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d683fc2f83206171a91331/lava_callback.json.gz 2025-09-26 12:35:54,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:54,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d683fc2f83206171a91331 HTTP/1.1" 200 None 2025-09-26 12:35:54,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:54,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c3cc1bc82a30b37a90d HTTP/1.1" 200 None 2025-09-26 12:35:54,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:54,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d683fc2f83206171a91331 HTTP/1.1" 200 None 2025-09-26 12:35:54,068 - lava_callback - INFO - Completed processing callback for node 68d683fc2f83206171a91331 INFO: 172.20.0.1:56146 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:35:57,193 - lava_callback - INFO - Received callback for node 68d688112f83206171a913d1 INFO: 172.20.0.1:56160 - "POST /node/68d688112f83206171a913d1 HTTP/1.0" 202 Accepted 2025-09-26 12:35:57,199 - lava_callback - INFO - Starting async job submit for node 68d688112f83206171a913d1 2025-09-26 12:35:57,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:57,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688112f83206171a913d1 HTTP/1.1" 200 None 2025-09-26 12:35:57,242 - lava_callback - DEBUG - Processing node 68d688112f83206171a913d1: baseline-arm-baylibre 2025-09-26 12:35:57,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:35:57,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:35:57,620 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d688112f83206171a913d1/log.txt.gz 2025-09-26 12:35:57,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:35:57,773 - lava_callback - INFO - Received callback for node 68d688322f83206171a9140a INFO: 172.20.0.1:56162 - "POST /node/68d688322f83206171a9140a HTTP/1.0" 202 Accepted 2025-09-26 12:35:57,779 - lava_callback - INFO - Starting async job submit for node 68d688322f83206171a9140a 2025-09-26 12:35:57,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:35:57,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:57,802 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d688112f83206171a913d1/lava_callback.json.gz 2025-09-26 12:35:57,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:57,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688322f83206171a9140a HTTP/1.1" 200 None 2025-09-26 12:35:57,833 - lava_callback - DEBUG - Processing node 68d688322f83206171a9140a: baseline-arm-pengutronix 2025-09-26 12:35:57,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688112f83206171a913d1 HTTP/1.1" 200 None 2025-09-26 12:35:57,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:57,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-26 12:35:57,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:57,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:35:58,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688112f83206171a913d1 HTTP/1.1" 200 None 2025-09-26 12:35:58,010 - lava_callback - INFO - Completed processing callback for node 68d688112f83206171a913d1 2025-09-26 12:35:58,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:35:58,137 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d688322f83206171a9140a/log.txt.gz 2025-09-26 12:35:58,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:35:58,260 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:35:58,261 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d688322f83206171a9140a/lava_callback.json.gz 2025-09-26 12:35:58,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:58,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688322f83206171a9140a HTTP/1.1" 200 None 2025-09-26 12:35:58,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:58,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-26 12:35:58,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:58,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688322f83206171a9140a HTTP/1.1" 200 None 2025-09-26 12:35:58,365 - lava_callback - INFO - Completed processing callback for node 68d688322f83206171a9140a 2025-09-26 12:35:58,750 - lava_callback - INFO - Received callback for node 68d688122f83206171a913d4 INFO: 172.20.0.1:56164 - "POST /node/68d688122f83206171a913d4 HTTP/1.0" 202 Accepted 2025-09-26 12:35:58,757 - lava_callback - INFO - Starting async job submit for node 68d688122f83206171a913d4 2025-09-26 12:35:58,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:58,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688122f83206171a913d4 HTTP/1.1" 200 None 2025-09-26 12:35:58,801 - lava_callback - DEBUG - Processing node 68d688122f83206171a913d4: baseline-arm-baylibre 2025-09-26 12:35:58,988 - lava_callback - INFO - Received callback for node 68d3ede9cd36afa834e139dd INFO: 172.20.0.1:56174 - "POST /node/68d3ede9cd36afa834e139dd HTTP/1.0" 202 Accepted 2025-09-26 12:35:59,105 - lava_callback - INFO - Starting async job submit for node 68d3ede9cd36afa834e139dd 2025-09-26 12:35:59,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:59,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:35:59,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ede9cd36afa834e139dd HTTP/1.1" 200 None 2025-09-26 12:35:59,197 - lava_callback - DEBUG - Processing node 68d3ede9cd36afa834e139dd: baseline-arm64 2025-09-26 12:35:59,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:35:59,359 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d688122f83206171a913d4/log.txt.gz 2025-09-26 12:35:59,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:35:59,595 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:35:59,637 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d688122f83206171a913d4/lava_callback.json.gz 2025-09-26 12:35:59,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:59,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688122f83206171a913d4 HTTP/1.1" 200 None 2025-09-26 12:35:59,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:59,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-26 12:35:59,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:35:59,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688122f83206171a913d4 HTTP/1.1" 200 None 2025-09-26 12:35:59,989 - lava_callback - INFO - Completed processing callback for node 68d688122f83206171a913d4 2025-09-26 12:36:00,746 - lava_callback - INFO - Received callback for node 68d688512f83206171a9146e INFO: 172.20.0.1:33600 - "POST /node/68d688512f83206171a9146e HTTP/1.0" 202 Accepted 2025-09-26 12:36:00,843 - lava_callback - INFO - Starting async job submit for node 68d688512f83206171a9146e 2025-09-26 12:36:00,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:00,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688512f83206171a9146e HTTP/1.1" 200 None 2025-09-26 12:36:00,946 - lava_callback - DEBUG - Processing node 68d688512f83206171a9146e: baseline-arm 2025-09-26 12:36:01,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:01,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:01,677 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d688512f83206171a9146e/log.txt.gz 2025-09-26 12:36:01,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:02,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:02,063 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d688512f83206171a9146e/lava_callback.json.gz 2025-09-26 12:36:02,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:02,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688512f83206171a9146e HTTP/1.1" 200 None 2025-09-26 12:36:02,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:02,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8bb2be2da466069ac00 HTTP/1.1" 200 None 2025-09-26 12:36:02,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:02,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688512f83206171a9146e HTTP/1.1" 200 None 2025-09-26 12:36:02,368 - lava_callback - INFO - Completed processing callback for node 68d688512f83206171a9146e 2025-09-26 12:36:06,174 - lava_callback - INFO - Received callback for node 68d6884d2f83206171a9145a INFO: 172.20.0.1:33612 - "POST /node/68d6884d2f83206171a9145a HTTP/1.0" 202 Accepted 2025-09-26 12:36:06,200 - lava_callback - INFO - Starting async job submit for node 68d6884d2f83206171a9145a 2025-09-26 12:36:06,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:06,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6884d2f83206171a9145a HTTP/1.1" 200 None 2025-09-26 12:36:06,328 - lava_callback - DEBUG - Processing node 68d6884d2f83206171a9145a: baseline-arm INFO: 172.20.0.1:33620 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:36:07,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:07,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:07,330 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d6884d2f83206171a9145a/log.txt.gz 2025-09-26 12:36:07,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:07,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:07,708 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d6884d2f83206171a9145a/lava_callback.json.gz 2025-09-26 12:36:07,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:07,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6884d2f83206171a9145a HTTP/1.1" 200 None 2025-09-26 12:36:07,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:07,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8bb2be2da466069ac00 HTTP/1.1" 200 None 2025-09-26 12:36:07,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:07,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6884d2f83206171a9145a HTTP/1.1" 200 None 2025-09-26 12:36:07,996 - lava_callback - INFO - Completed processing callback for node 68d6884d2f83206171a9145a 2025-09-26 12:36:08,074 - lava_callback - INFO - Received callback for node 68d6884d2f83206171a9145d INFO: 172.20.0.1:33630 - "POST /node/68d6884d2f83206171a9145d HTTP/1.0" 202 Accepted 2025-09-26 12:36:08,091 - lava_callback - INFO - Starting async job submit for node 68d6884d2f83206171a9145d 2025-09-26 12:36:08,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:08,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6884d2f83206171a9145d HTTP/1.1" 200 None 2025-09-26 12:36:08,234 - lava_callback - DEBUG - Processing node 68d6884d2f83206171a9145d: baseline-arm 2025-09-26 12:36:09,002 - lava_callback - INFO - Received callback for node 68d3ee1dcd36afa834e13a25 INFO: 172.20.0.1:33634 - "POST /node/68d3ee1dcd36afa834e13a25 HTTP/1.0" 202 Accepted 2025-09-26 12:36:09,029 - lava_callback - INFO - Received callback for node 68d688622f83206171a914a1 2025-09-26 12:36:09,035 - lava_callback - INFO - Starting async job submit for node 68d3ee1dcd36afa834e13a25 INFO: 172.20.0.1:33644 - "POST /node/68d688622f83206171a914a1 HTTP/1.0" 202 Accepted 2025-09-26 12:36:09,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:09,096 - lava_callback - INFO - Starting async job submit for node 68d688622f83206171a914a1 2025-09-26 12:36:09,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:09,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:09,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688622f83206171a914a1 HTTP/1.1" 200 None 2025-09-26 12:36:09,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ee1dcd36afa834e13a25 HTTP/1.1" 200 None 2025-09-26 12:36:09,220 - lava_callback - DEBUG - Processing node 68d3ee1dcd36afa834e13a25: baseline-arm64 2025-09-26 12:36:09,221 - lava_callback - DEBUG - Processing node 68d688622f83206171a914a1: baseline-arm 2025-09-26 12:36:09,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:09,432 - lava_callback - INFO - Received callback for node 68d688512f83206171a9146b 2025-09-26 12:36:09,468 - lava_callback - INFO - Starting async job submit for node 68d688512f83206171a9146b 2025-09-26 12:36:09,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:32868 - "POST /node/68d688512f83206171a9146b HTTP/1.0" 202 Accepted 2025-09-26 12:36:09,987 - lava_callback - ERROR - Error processing callback for node 68d3ee1dcd36afa834e13a25: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:36:09,992 - lava_callback - INFO - Received callback for node 68d688862f83206171a91508 2025-09-26 12:36:10,030 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d6884d2f83206171a9145d/log.txt.gz INFO: 172.20.0.1:32880 - "POST /node/68d688862f83206171a91508 HTTP/1.0" 202 Accepted 2025-09-26 12:36:10,039 - lava_callback - INFO - Starting async job submit for node 68d688862f83206171a91508 2025-09-26 12:36:10,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:10,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688512f83206171a9146b HTTP/1.1" 200 None 2025-09-26 12:36:10,148 - lava_callback - DEBUG - Processing node 68d688512f83206171a9146b: baseline-arm 2025-09-26 12:36:10,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:10,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:10,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688862f83206171a91508 HTTP/1.1" 200 None 2025-09-26 12:36:10,307 - lava_callback - DEBUG - Processing node 68d688862f83206171a91508: baseline-arm-pengutronix 2025-09-26 12:36:10,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:10,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:10,708 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:10,719 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d688622f83206171a914a1/log.txt.gz 2025-09-26 12:36:10,735 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d6884d2f83206171a9145d/lava_callback.json.gz 2025-09-26 12:36:10,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:10,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:10,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:10,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:10,832 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d688862f83206171a91508/log.txt.gz 2025-09-26 12:36:10,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6884d2f83206171a9145d HTTP/1.1" 200 None 2025-09-26 12:36:10,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:10,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:10,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8bb2be2da466069ac00 HTTP/1.1" 200 None 2025-09-26 12:36:10,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:11,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:11,010 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d688512f83206171a9146b/log.txt.gz 2025-09-26 12:36:11,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:11,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6884d2f83206171a9145d HTTP/1.1" 200 None 2025-09-26 12:36:11,091 - lava_callback - INFO - Completed processing callback for node 68d6884d2f83206171a9145d 2025-09-26 12:36:11,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:11,130 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d688622f83206171a914a1/lava_callback.json.gz 2025-09-26 12:36:11,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:11,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:11,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:11,267 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d688862f83206171a91508/lava_callback.json.gz 2025-09-26 12:36:11,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:11,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688622f83206171a914a1 HTTP/1.1" 200 None 2025-09-26 12:36:11,339 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d688512f83206171a9146b/lava_callback.json.gz 2025-09-26 12:36:11,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:11,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:11,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688862f83206171a91508 HTTP/1.1" 200 None 2025-09-26 12:36:11,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:11,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8bb2be2da466069ac00 HTTP/1.1" 200 None 2025-09-26 12:36:11,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:11,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688512f83206171a9146b HTTP/1.1" 200 None 2025-09-26 12:36:11,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:11,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8bb2be2da466069ac00 HTTP/1.1" 200 None 2025-09-26 12:36:11,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:11,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688622f83206171a914a1 HTTP/1.1" 200 None 2025-09-26 12:36:11,899 - lava_callback - INFO - Completed processing callback for node 68d688622f83206171a914a1 2025-09-26 12:36:11,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8bb2be2da466069ac00 HTTP/1.1" 200 None 2025-09-26 12:36:11,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:11,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688862f83206171a91508 HTTP/1.1" 200 None 2025-09-26 12:36:11,969 - lava_callback - INFO - Completed processing callback for node 68d688862f83206171a91508 2025-09-26 12:36:11,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688512f83206171a9146b HTTP/1.1" 200 None 2025-09-26 12:36:11,989 - lava_callback - INFO - Completed processing callback for node 68d688512f83206171a9146b INFO: 172.20.0.1:32896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32906 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:36:16,872 - lava_callback - INFO - Received callback for node 68d688842f83206171a91505 INFO: 172.20.0.1:32920 - "POST /node/68d688842f83206171a91505 HTTP/1.0" 202 Accepted 2025-09-26 12:36:16,898 - lava_callback - INFO - Starting async job submit for node 68d688842f83206171a91505 2025-09-26 12:36:16,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:17,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688842f83206171a91505 HTTP/1.1" 200 None 2025-09-26 12:36:17,024 - lava_callback - DEBUG - Processing node 68d688842f83206171a91505: baseline-arm-pengutronix 2025-09-26 12:36:17,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:17,908 - lava_callback - INFO - Received callback for node 68d3ee1ecd36afa834e13a28 INFO: 172.20.0.1:32930 - "POST /node/68d3ee1ecd36afa834e13a28 HTTP/1.0" 202 Accepted 2025-09-26 12:36:17,930 - lava_callback - INFO - Starting async job submit for node 68d3ee1ecd36afa834e13a28 2025-09-26 12:36:17,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:18,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ee1ecd36afa834e13a28 HTTP/1.1" 200 None 2025-09-26 12:36:18,039 - lava_callback - DEBUG - Processing node 68d3ee1ecd36afa834e13a28: baseline-arm64 2025-09-26 12:36:18,698 - lava_callback - ERROR - Error processing callback for node 68d3ee1ecd36afa834e13a28: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:36:18,699 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:18,735 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d688842f83206171a91505/log.txt.gz 2025-09-26 12:36:18,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:19,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:19,084 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d688842f83206171a91505/lava_callback.json.gz 2025-09-26 12:36:19,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:19,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688842f83206171a91505 HTTP/1.1" 200 None 2025-09-26 12:36:19,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:19,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8bb2be2da466069ac00 HTTP/1.1" 200 None 2025-09-26 12:36:19,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:19,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688842f83206171a91505 HTTP/1.1" 200 None 2025-09-26 12:36:19,381 - lava_callback - INFO - Completed processing callback for node 68d688842f83206171a91505 2025-09-26 12:36:20,407 - lava_callback - INFO - Received callback for node 68d688662f83206171a914ad INFO: 172.20.0.1:38944 - "POST /node/68d688662f83206171a914ad HTTP/1.0" 202 Accepted 2025-09-26 12:36:20,434 - lava_callback - INFO - Starting async job submit for node 68d688662f83206171a914ad 2025-09-26 12:36:20,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:20,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688662f83206171a914ad HTTP/1.1" 200 None 2025-09-26 12:36:20,548 - lava_callback - DEBUG - Processing node 68d688662f83206171a914ad: baseline-arm 2025-09-26 12:36:21,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:21,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:21,256 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d688662f83206171a914ad/log.txt.gz 2025-09-26 12:36:21,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:21,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:22,210 - lava_callback - INFO - Received callback for node 68d688672f83206171a914b0 INFO: 172.20.0.1:38946 - "POST /node/68d688672f83206171a914b0 HTTP/1.0" 202 Accepted INFO: 172.20.0.1:38958 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:36:22,252 - lava_callback - INFO - Starting async job submit for node 68d688672f83206171a914b0 2025-09-26 12:36:22,257 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d688662f83206171a914ad/lava_callback.json.gz 2025-09-26 12:36:22,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:22,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:22,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688662f83206171a914ad HTTP/1.1" 200 None 2025-09-26 12:36:22,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:22,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688672f83206171a914b0 HTTP/1.1" 200 None 2025-09-26 12:36:22,462 - lava_callback - DEBUG - Processing node 68d688672f83206171a914b0: baseline-arm 2025-09-26 12:36:22,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8bb2be2da466069ac00 HTTP/1.1" 200 None 2025-09-26 12:36:22,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:22,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:23,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688662f83206171a914ad HTTP/1.1" 200 None 2025-09-26 12:36:23,095 - lava_callback - INFO - Completed processing callback for node 68d688662f83206171a914ad 2025-09-26 12:36:23,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:23,264 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d688672f83206171a914b0/log.txt.gz 2025-09-26 12:36:23,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:23,697 - lava_callback - ERROR - Error processing callback for node 68d3ede9cd36afa834e139dd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:36:23,727 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:23,728 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d688672f83206171a914b0/lava_callback.json.gz 2025-09-26 12:36:23,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:23,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688672f83206171a914b0 HTTP/1.1" 200 None 2025-09-26 12:36:23,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:23,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8bb2be2da466069ac00 HTTP/1.1" 200 None 2025-09-26 12:36:23,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:23,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688672f83206171a914b0 HTTP/1.1" 200 None 2025-09-26 12:36:23,810 - lava_callback - INFO - Completed processing callback for node 68d688672f83206171a914b0 INFO: 172.20.0.1:38960 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:36:35,127 - lava_callback - INFO - Received callback for node 68d688632f83206171a914a4 INFO: 172.20.0.1:58842 - "POST /node/68d688632f83206171a914a4 HTTP/1.0" 202 Accepted 2025-09-26 12:36:35,137 - lava_callback - INFO - Starting async job submit for node 68d688632f83206171a914a4 2025-09-26 12:36:35,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:35,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688632f83206171a914a4 HTTP/1.1" 200 None 2025-09-26 12:36:35,169 - lava_callback - DEBUG - Processing node 68d688632f83206171a914a4: baseline-arm 2025-09-26 12:36:35,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:35,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:35,579 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d688632f83206171a914a4/log.txt.gz 2025-09-26 12:36:35,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:35,735 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:35,736 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d688632f83206171a914a4/lava_callback.json.gz 2025-09-26 12:36:35,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:35,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688632f83206171a914a4 HTTP/1.1" 200 None 2025-09-26 12:36:35,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:35,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8bb2be2da466069ac00 HTTP/1.1" 200 None 2025-09-26 12:36:35,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:35,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688632f83206171a914a4 HTTP/1.1" 200 None 2025-09-26 12:36:35,821 - lava_callback - INFO - Completed processing callback for node 68d688632f83206171a914a4 INFO: 172.20.0.1:58856 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:36:43,226 - lava_callback - INFO - Received callback for node 68d688422f83206171a91445 INFO: 172.20.0.1:34476 - "POST /node/68d688422f83206171a91445 HTTP/1.0" 202 Accepted 2025-09-26 12:36:43,233 - lava_callback - INFO - Starting async job submit for node 68d688422f83206171a91445 2025-09-26 12:36:43,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:43,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688422f83206171a91445 HTTP/1.1" 200 None 2025-09-26 12:36:43,278 - lava_callback - DEBUG - Processing node 68d688422f83206171a91445: ltp-dio 2025-09-26 12:36:43,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:43,764 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:43,765 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-68d688422f83206171a91445/log.txt.gz 2025-09-26 12:36:43,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:43,885 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:43,886 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-68d688422f83206171a91445/lava_callback.json.gz 2025-09-26 12:36:43,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:43,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688422f83206171a91445 HTTP/1.1" 200 None 2025-09-26 12:36:43,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:43,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-26 12:36:43,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:44,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688422f83206171a91445 HTTP/1.1" 200 None 2025-09-26 12:36:44,007 - lava_callback - INFO - Completed processing callback for node 68d688422f83206171a91445 INFO: 172.20.0.1:34484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34488 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:36:52,035 - lava_callback - INFO - Received callback for node 68d42748a5c2c05277bc73a1 INFO: 172.20.0.1:35412 - "POST /node/68d42748a5c2c05277bc73a1 HTTP/1.0" 202 Accepted 2025-09-26 12:36:52,041 - lava_callback - INFO - Starting async job submit for node 68d42748a5c2c05277bc73a1 2025-09-26 12:36:52,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:52,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42748a5c2c05277bc73a1 HTTP/1.1" 200 None 2025-09-26 12:36:52,074 - lava_callback - DEBUG - Processing node 68d42748a5c2c05277bc73a1: baseline-arm 2025-09-26 12:36:52,233 - lava_callback - INFO - Received callback for node 68d3ee88cd36afa834e13a96 INFO: 172.20.0.1:35426 - "POST /node/68d3ee88cd36afa834e13a96 HTTP/1.0" 202 Accepted 2025-09-26 12:36:52,254 - lava_callback - INFO - Starting async job submit for node 68d3ee88cd36afa834e13a96 2025-09-26 12:36:52,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:52,328 - lava_callback - ERROR - Error processing callback for node 68d42748a5c2c05277bc73a1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:36:52,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ee88cd36afa834e13a96 HTTP/1.1" 200 None 2025-09-26 12:36:52,339 - lava_callback - DEBUG - Processing node 68d3ee88cd36afa834e13a96: baseline-arm64 2025-09-26 12:36:52,636 - lava_callback - ERROR - Error processing callback for node 68d3ee88cd36afa834e13a96: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:36:54,529 - lava_callback - INFO - Received callback for node 68d688822f83206171a91502 INFO: 172.20.0.1:35428 - "POST /node/68d688822f83206171a91502 HTTP/1.0" 202 Accepted 2025-09-26 12:36:54,534 - lava_callback - INFO - Starting async job submit for node 68d688822f83206171a91502 2025-09-26 12:36:54,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:54,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688822f83206171a91502 HTTP/1.1" 200 None 2025-09-26 12:36:54,629 - lava_callback - DEBUG - Processing node 68d688822f83206171a91502: baseline-arm-pengutronix 2025-09-26 12:36:54,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:54,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:54,883 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d688822f83206171a91502/log.txt.gz 2025-09-26 12:36:54,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:55,015 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:55,016 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d688822f83206171a91502/lava_callback.json.gz 2025-09-26 12:36:55,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:55,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688822f83206171a91502 HTTP/1.1" 200 None 2025-09-26 12:36:55,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:55,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8bb2be2da466069ac00 HTTP/1.1" 200 None 2025-09-26 12:36:55,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:55,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688822f83206171a91502 HTTP/1.1" 200 None 2025-09-26 12:36:55,094 - lava_callback - INFO - Completed processing callback for node 68d688822f83206171a91502 INFO: 172.20.0.1:35438 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:36:59,351 - lava_callback - INFO - Received callback for node 68d6882c2f83206171a91401 INFO: 172.20.0.1:39938 - "POST /node/68d6882c2f83206171a91401 HTTP/1.0" 202 Accepted 2025-09-26 12:36:59,357 - lava_callback - INFO - Starting async job submit for node 68d6882c2f83206171a91401 2025-09-26 12:36:59,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:59,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6882c2f83206171a91401 HTTP/1.1" 200 None 2025-09-26 12:36:59,390 - lava_callback - DEBUG - Processing node 68d6882c2f83206171a91401: baseline-arm-clabbe 2025-09-26 12:36:59,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:59,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:59,691 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d6882c2f83206171a91401/log.txt.gz 2025-09-26 12:36:59,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:36:59,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:36:59,803 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d6882c2f83206171a91401/lava_callback.json.gz 2025-09-26 12:36:59,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:59,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6882c2f83206171a91401 HTTP/1.1" 200 None 2025-09-26 12:36:59,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:59,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-26 12:36:59,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:36:59,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6882c2f83206171a91401 HTTP/1.1" 200 None 2025-09-26 12:36:59,890 - lava_callback - INFO - Completed processing callback for node 68d6882c2f83206171a91401 2025-09-26 12:37:04,492 - lava_callback - INFO - Received callback for node 68d688642f83206171a914a7 INFO: 172.20.0.1:39948 - "POST /node/68d688642f83206171a914a7 HTTP/1.0" 202 Accepted 2025-09-26 12:37:04,498 - lava_callback - INFO - Starting async job submit for node 68d688642f83206171a914a7 2025-09-26 12:37:04,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:37:04,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688642f83206171a914a7 HTTP/1.1" 200 None 2025-09-26 12:37:04,530 - lava_callback - DEBUG - Processing node 68d688642f83206171a914a7: baseline-arm 2025-09-26 12:37:04,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:37:04,928 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:37:04,929 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d688642f83206171a914a7/log.txt.gz 2025-09-26 12:37:04,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:37:05,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:37:05,069 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d688642f83206171a914a7/lava_callback.json.gz 2025-09-26 12:37:05,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:37:05,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688642f83206171a914a7 HTTP/1.1" 200 None 2025-09-26 12:37:05,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:37:05,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8bb2be2da466069ac00 HTTP/1.1" 200 None 2025-09-26 12:37:05,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:37:05,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688642f83206171a914a7 HTTP/1.1" 200 None 2025-09-26 12:37:05,157 - lava_callback - INFO - Completed processing callback for node 68d688642f83206171a914a7 INFO: 172.20.0.1:39960 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:37:14,107 - lava_callback - INFO - Received callback for node 68d3e5e7cd36afa834e12baa INFO: 172.20.0.1:49170 - "POST /node/68d3e5e7cd36afa834e12baa HTTP/1.0" 202 Accepted 2025-09-26 12:37:14,115 - lava_callback - INFO - Starting async job submit for node 68d3e5e7cd36afa834e12baa 2025-09-26 12:37:14,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:37:14,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e5e7cd36afa834e12baa HTTP/1.1" 200 None 2025-09-26 12:37:14,133 - lava_callback - DEBUG - Processing node 68d3e5e7cd36afa834e12baa: ltp-fs-bind 2025-09-26 12:37:14,133 - lava_callback - ERROR - Error processing callback for node 68d3e5e7cd36afa834e12baa: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:49176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49182 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:37:19,259 - lava_callback - INFO - Received callback for node 68d3ee92cd36afa834e13aa7 INFO: 172.20.0.1:49184 - "POST /node/68d3ee92cd36afa834e13aa7 HTTP/1.0" 202 Accepted 2025-09-26 12:37:19,265 - lava_callback - INFO - Starting async job submit for node 68d3ee92cd36afa834e13aa7 2025-09-26 12:37:19,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:37:19,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ee92cd36afa834e13aa7 HTTP/1.1" 200 None 2025-09-26 12:37:19,334 - lava_callback - DEBUG - Processing node 68d3ee92cd36afa834e13aa7: baseline-arm64 2025-09-26 12:37:19,627 - lava_callback - ERROR - Error processing callback for node 68d3ee92cd36afa834e13aa7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:36084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36090 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:37:31,647 - lava_callback - INFO - Received callback for node 68d3ee8ecd36afa834e13aa4 INFO: 172.20.0.1:34610 - "POST /node/68d3ee8ecd36afa834e13aa4 HTTP/1.0" 202 Accepted 2025-09-26 12:37:31,655 - lava_callback - INFO - Starting async job submit for node 68d3ee8ecd36afa834e13aa4 2025-09-26 12:37:31,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:37:31,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ee8ecd36afa834e13aa4 HTTP/1.1" 200 None 2025-09-26 12:37:31,693 - lava_callback - DEBUG - Processing node 68d3ee8ecd36afa834e13aa4: baseline-arm64 2025-09-26 12:37:32,046 - lava_callback - ERROR - Error processing callback for node 68d3ee8ecd36afa834e13aa4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:37:33,953 - lava_callback - INFO - Received callback for node 68d688652f83206171a914aa INFO: 172.20.0.1:34624 - "POST /node/68d688652f83206171a914aa HTTP/1.0" 202 Accepted 2025-09-26 12:37:33,964 - lava_callback - INFO - Starting async job submit for node 68d688652f83206171a914aa 2025-09-26 12:37:33,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:37:34,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688652f83206171a914aa HTTP/1.1" 200 None 2025-09-26 12:37:34,012 - lava_callback - DEBUG - Processing node 68d688652f83206171a914aa: baseline-arm 2025-09-26 12:37:34,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:37:34,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:37:34,533 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d688652f83206171a914aa/log.txt.gz 2025-09-26 12:37:34,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:37:34,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:37:34,667 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d688652f83206171a914aa/lava_callback.json.gz 2025-09-26 12:37:34,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:37:34,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688652f83206171a914aa HTTP/1.1" 200 None 2025-09-26 12:37:34,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:37:34,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8bb2be2da466069ac00 HTTP/1.1" 200 None 2025-09-26 12:37:34,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:37:34,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688652f83206171a914aa HTTP/1.1" 200 None 2025-09-26 12:37:34,755 - lava_callback - INFO - Completed processing callback for node 68d688652f83206171a914aa INFO: 172.20.0.1:34638 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:37:43,267 - lava_callback - INFO - Received callback for node 68d688692f83206171a914b3 INFO: 172.20.0.1:36506 - "POST /node/68d688692f83206171a914b3 HTTP/1.0" 202 Accepted 2025-09-26 12:37:43,273 - lava_callback - INFO - Starting async job submit for node 68d688692f83206171a914b3 2025-09-26 12:37:43,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:37:43,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688692f83206171a914b3 HTTP/1.1" 200 None 2025-09-26 12:37:43,306 - lava_callback - DEBUG - Processing node 68d688692f83206171a914b3: baseline-arm 2025-09-26 12:37:43,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:37:43,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:37:43,623 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d688692f83206171a914b3/log.txt.gz 2025-09-26 12:37:43,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:37:43,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:37:43,779 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d688692f83206171a914b3/lava_callback.json.gz 2025-09-26 12:37:43,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:37:43,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688692f83206171a914b3 HTTP/1.1" 200 None 2025-09-26 12:37:43,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:37:43,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8bb2be2da466069ac00 HTTP/1.1" 200 None 2025-09-26 12:37:43,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:37:43,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688692f83206171a914b3 HTTP/1.1" 200 None 2025-09-26 12:37:43,875 - lava_callback - INFO - Completed processing callback for node 68d688692f83206171a914b3 2025-09-26 12:37:44,489 - lava_callback - INFO - Received callback for node 68d688692f83206171a914b6 INFO: 172.20.0.1:36522 - "POST /node/68d688692f83206171a914b6 HTTP/1.0" 202 Accepted 2025-09-26 12:37:44,495 - lava_callback - INFO - Starting async job submit for node 68d688692f83206171a914b6 2025-09-26 12:37:44,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:37:44,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688692f83206171a914b6 HTTP/1.1" 200 None 2025-09-26 12:37:44,527 - lava_callback - DEBUG - Processing node 68d688692f83206171a914b6: baseline-arm 2025-09-26 12:37:44,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:37:44,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:37:44,844 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d688692f83206171a914b6/log.txt.gz 2025-09-26 12:37:44,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:37:44,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:37:44,965 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d688692f83206171a914b6/lava_callback.json.gz 2025-09-26 12:37:44,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:37:44,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688692f83206171a914b6 HTTP/1.1" 200 None 2025-09-26 12:37:44,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:37:45,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8bb2be2da466069ac00 HTTP/1.1" 200 None 2025-09-26 12:37:45,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:37:45,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688692f83206171a914b6 HTTP/1.1" 200 None 2025-09-26 12:37:45,074 - lava_callback - INFO - Completed processing callback for node 68d688692f83206171a914b6 INFO: 172.20.0.1:36532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36548 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:37:46,825 - lava_callback - INFO - Received callback for node 68d3e60fcd36afa834e12beb INFO: 172.20.0.1:36554 - "POST /node/68d3e60fcd36afa834e12beb HTTP/1.0" 202 Accepted 2025-09-26 12:37:46,830 - lava_callback - INFO - Starting async job submit for node 68d3e60fcd36afa834e12beb 2025-09-26 12:37:46,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:37:46,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e60fcd36afa834e12beb HTTP/1.1" 200 None 2025-09-26 12:37:46,844 - lava_callback - DEBUG - Processing node 68d3e60fcd36afa834e12beb: baseline-arm64-baylibre 2025-09-26 12:37:46,844 - lava_callback - ERROR - Error processing callback for node 68d3e60fcd36afa834e12beb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:37:55,048 - lava_callback - INFO - Received callback for node 68d3ee93cd36afa834e13aaa INFO: 172.20.0.1:35864 - "POST /node/68d3ee93cd36afa834e13aaa HTTP/1.0" 202 Accepted 2025-09-26 12:37:55,054 - lava_callback - INFO - Starting async job submit for node 68d3ee93cd36afa834e13aaa 2025-09-26 12:37:55,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:37:55,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ee93cd36afa834e13aaa HTTP/1.1" 200 None 2025-09-26 12:37:55,087 - lava_callback - DEBUG - Processing node 68d3ee93cd36afa834e13aaa: baseline-arm64 2025-09-26 12:37:55,398 - lava_callback - ERROR - Error processing callback for node 68d3ee93cd36afa834e13aaa: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:35880 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:38:06,333 - lava_callback - INFO - Received callback for node 68d688732f83206171a914d9 INFO: 172.20.0.1:49956 - "POST /node/68d688732f83206171a914d9 HTTP/1.0" 202 Accepted 2025-09-26 12:38:06,343 - lava_callback - INFO - Starting async job submit for node 68d688732f83206171a914d9 2025-09-26 12:38:06,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:06,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688732f83206171a914d9 HTTP/1.1" 200 None 2025-09-26 12:38:06,395 - lava_callback - DEBUG - Processing node 68d688732f83206171a914d9: baseline-arm INFO: 172.20.0.1:49970 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:38:06,849 - lava_callback - INFO - Received callback for node 68d3e626cd36afa834e12bfa INFO: 172.20.0.1:49974 - "POST /node/68d3e626cd36afa834e12bfa HTTP/1.0" 202 Accepted 2025-09-26 12:38:06,870 - lava_callback - INFO - Starting async job submit for node 68d3e626cd36afa834e12bfa 2025-09-26 12:38:06,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:06,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:38:06,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e626cd36afa834e12bfa HTTP/1.1" 200 None 2025-09-26 12:38:06,897 - lava_callback - DEBUG - Processing node 68d3e626cd36afa834e12bfa: baseline-arm64-baylibre 2025-09-26 12:38:06,897 - lava_callback - ERROR - Error processing callback for node 68d3e626cd36afa834e12bfa: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:38:07,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:38:07,074 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d688732f83206171a914d9/log.txt.gz 2025-09-26 12:38:07,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:38:07,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:38:07,259 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d688732f83206171a914d9/lava_callback.json.gz 2025-09-26 12:38:07,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:07,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688732f83206171a914d9 HTTP/1.1" 200 None 2025-09-26 12:38:07,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:07,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8bb2be2da466069ac00 HTTP/1.1" 200 None 2025-09-26 12:38:07,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:07,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688732f83206171a914d9 HTTP/1.1" 200 None 2025-09-26 12:38:07,384 - lava_callback - INFO - Completed processing callback for node 68d688732f83206171a914d9 2025-09-26 12:38:11,794 - lava_callback - INFO - Received callback for node 68d3eea3cd36afa834e13abd INFO: 172.20.0.1:37110 - "POST /node/68d3eea3cd36afa834e13abd HTTP/1.0" 202 Accepted 2025-09-26 12:38:11,800 - lava_callback - INFO - Starting async job submit for node 68d3eea3cd36afa834e13abd 2025-09-26 12:38:11,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:11,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eea3cd36afa834e13abd HTTP/1.1" 200 None 2025-09-26 12:38:11,843 - lava_callback - DEBUG - Processing node 68d3eea3cd36afa834e13abd: baseline-arm64 2025-09-26 12:38:12,155 - lava_callback - ERROR - Error processing callback for node 68d3eea3cd36afa834e13abd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:37124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60740 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:38:27,090 - lava_callback - INFO - Received callback for node 68d3e637cd36afa834e12c06 INFO: 172.20.0.1:60756 - "POST /node/68d3e637cd36afa834e12c06 HTTP/1.0" 202 Accepted 2025-09-26 12:38:27,097 - lava_callback - INFO - Starting async job submit for node 68d3e637cd36afa834e12c06 2025-09-26 12:38:27,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:27,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e637cd36afa834e12c06 HTTP/1.1" 200 None 2025-09-26 12:38:27,113 - lava_callback - DEBUG - Processing node 68d3e637cd36afa834e12c06: baseline-arm64-baylibre 2025-09-26 12:38:27,113 - lava_callback - ERROR - Error processing callback for node 68d3e637cd36afa834e12c06: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:38:31,351 - lava_callback - INFO - Received callback for node 68d688742f83206171a914dc INFO: 172.20.0.1:35048 - "POST /node/68d688742f83206171a914dc HTTP/1.0" 202 Accepted 2025-09-26 12:38:31,357 - lava_callback - INFO - Starting async job submit for node 68d688742f83206171a914dc 2025-09-26 12:38:31,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:31,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688742f83206171a914dc HTTP/1.1" 200 None 2025-09-26 12:38:31,389 - lava_callback - DEBUG - Processing node 68d688742f83206171a914dc: baseline-arm 2025-09-26 12:38:31,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:38:31,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:38:31,815 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d688742f83206171a914dc/log.txt.gz 2025-09-26 12:38:31,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:38:31,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:38:31,954 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d688742f83206171a914dc/lava_callback.json.gz 2025-09-26 12:38:31,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:32,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688742f83206171a914dc HTTP/1.1" 200 None 2025-09-26 12:38:32,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:32,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8bb2be2da466069ac00 HTTP/1.1" 200 None 2025-09-26 12:38:32,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:32,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688742f83206171a914dc HTTP/1.1" 200 None 2025-09-26 12:38:32,068 - lava_callback - INFO - Completed processing callback for node 68d688742f83206171a914dc INFO: 172.20.0.1:35056 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:38:38,863 - lava_callback - INFO - Received callback for node 68d688ef2f83206171a915bf INFO: 172.20.0.1:35070 - "POST /node/68d688ef2f83206171a915bf HTTP/1.0" 202 Accepted 2025-09-26 12:38:38,871 - lava_callback - INFO - Starting async job submit for node 68d688ef2f83206171a915bf 2025-09-26 12:38:38,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:38,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688ef2f83206171a915bf HTTP/1.1" 200 None 2025-09-26 12:38:38,909 - lava_callback - DEBUG - Processing node 68d688ef2f83206171a915bf: baseline-arm 2025-09-26 12:38:38,955 - lava_callback - INFO - Received callback for node 68d688ee2f83206171a915b2 INFO: 172.20.0.1:35084 - "POST /node/68d688ee2f83206171a915b2 HTTP/1.0" 202 Accepted 2025-09-26 12:38:38,988 - lava_callback - INFO - Starting async job submit for node 68d688ee2f83206171a915b2 2025-09-26 12:38:39,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:39,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688ee2f83206171a915b2 HTTP/1.1" 200 None 2025-09-26 12:38:39,109 - lava_callback - DEBUG - Processing node 68d688ee2f83206171a915b2: baseline-arm 2025-09-26 12:38:39,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:38:39,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:38:39,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:38:39,534 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d688ef2f83206171a915bf/log.txt.gz 2025-09-26 12:38:39,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:38:39,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:38:39,613 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d688ee2f83206171a915b2/log.txt.gz 2025-09-26 12:38:39,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:38:39,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:38:39,673 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d688ef2f83206171a915bf/lava_callback.json.gz 2025-09-26 12:38:39,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:39,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688ef2f83206171a915bf HTTP/1.1" 200 None 2025-09-26 12:38:39,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:39,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:38:39,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:39,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688ef2f83206171a915bf HTTP/1.1" 200 None 2025-09-26 12:38:39,776 - lava_callback - INFO - Completed processing callback for node 68d688ef2f83206171a915bf 2025-09-26 12:38:39,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:38:39,818 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d688ee2f83206171a915b2/lava_callback.json.gz 2025-09-26 12:38:39,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:39,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688ee2f83206171a915b2 HTTP/1.1" 200 None 2025-09-26 12:38:39,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:39,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:38:39,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:39,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688ee2f83206171a915b2 HTTP/1.1" 200 None 2025-09-26 12:38:39,928 - lava_callback - INFO - Completed processing callback for node 68d688ee2f83206171a915b2 2025-09-26 12:38:41,325 - lava_callback - INFO - Received callback for node 68d688f22f83206171a915c6 INFO: 172.20.0.1:33862 - "POST /node/68d688f22f83206171a915c6 HTTP/1.0" 202 Accepted 2025-09-26 12:38:41,331 - lava_callback - INFO - Starting async job submit for node 68d688f22f83206171a915c6 2025-09-26 12:38:41,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:41,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688f22f83206171a915c6 HTTP/1.1" 200 None 2025-09-26 12:38:41,368 - lava_callback - DEBUG - Processing node 68d688f22f83206171a915c6: baseline-arm 2025-09-26 12:38:41,541 - lava_callback - INFO - Received callback for node 68d3eea9cd36afa834e13ac3 INFO: 172.20.0.1:33872 - "POST /node/68d3eea9cd36afa834e13ac3 HTTP/1.0" 202 Accepted 2025-09-26 12:38:41,566 - lava_callback - INFO - Starting async job submit for node 68d3eea9cd36afa834e13ac3 2025-09-26 12:38:41,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:41,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eea9cd36afa834e13ac3 HTTP/1.1" 200 None 2025-09-26 12:38:41,713 - lava_callback - DEBUG - Processing node 68d3eea9cd36afa834e13ac3: baseline-arm64 2025-09-26 12:38:41,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:38:41,997 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:38:42,008 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d688f22f83206171a915c6/log.txt.gz 2025-09-26 12:38:42,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:38:42,148 - lava_callback - ERROR - Error processing callback for node 68d3eea9cd36afa834e13ac3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:38:42,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:38:42,238 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d688f22f83206171a915c6/lava_callback.json.gz 2025-09-26 12:38:42,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:42,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688f22f83206171a915c6 HTTP/1.1" 200 None 2025-09-26 12:38:42,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:42,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:38:42,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:42,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688f22f83206171a915c6 HTTP/1.1" 200 None 2025-09-26 12:38:42,308 - lava_callback - INFO - Completed processing callback for node 68d688f22f83206171a915c6 2025-09-26 12:38:42,487 - lava_callback - INFO - Received callback for node 68d6882e2f83206171a91404 INFO: 172.20.0.1:33874 - "POST /node/68d6882e2f83206171a91404 HTTP/1.0" 202 Accepted 2025-09-26 12:38:42,493 - lava_callback - INFO - Starting async job submit for node 68d6882e2f83206171a91404 2025-09-26 12:38:42,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:42,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6882e2f83206171a91404 HTTP/1.1" 200 None 2025-09-26 12:38:42,530 - lava_callback - DEBUG - Processing node 68d6882e2f83206171a91404: baseline-arm-clabbe 2025-09-26 12:38:42,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:38:42,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:38:42,874 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d6882e2f83206171a91404/log.txt.gz 2025-09-26 12:38:42,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:38:43,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:38:43,043 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d6882e2f83206171a91404/lava_callback.json.gz 2025-09-26 12:38:43,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:43,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6882e2f83206171a91404 HTTP/1.1" 200 None 2025-09-26 12:38:43,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:43,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-26 12:38:43,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:43,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6882e2f83206171a91404 HTTP/1.1" 200 None 2025-09-26 12:38:43,142 - lava_callback - INFO - Completed processing callback for node 68d6882e2f83206171a91404 2025-09-26 12:38:43,598 - lava_callback - INFO - Received callback for node 68d688f22f83206171a915c9 INFO: 172.20.0.1:33888 - "POST /node/68d688f22f83206171a915c9 HTTP/1.0" 202 Accepted 2025-09-26 12:38:43,605 - lava_callback - INFO - Starting async job submit for node 68d688f22f83206171a915c9 2025-09-26 12:38:43,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:43,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688f22f83206171a915c9 HTTP/1.1" 200 None 2025-09-26 12:38:43,644 - lava_callback - DEBUG - Processing node 68d688f22f83206171a915c9: baseline-arm 2025-09-26 12:38:43,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:38:44,066 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:38:44,066 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d688f22f83206171a915c9/log.txt.gz 2025-09-26 12:38:44,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:38:44,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:38:44,203 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d688f22f83206171a915c9/lava_callback.json.gz 2025-09-26 12:38:44,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:44,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688f22f83206171a915c9 HTTP/1.1" 200 None 2025-09-26 12:38:44,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:44,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:38:44,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:44,321 - lava_callback - INFO - Received callback for node 68d6888f2f83206171a9151f INFO: 172.20.0.1:33896 - "POST /node/68d6888f2f83206171a9151f HTTP/1.0" 202 Accepted 2025-09-26 12:38:44,334 - lava_callback - INFO - Starting async job submit for node 68d6888f2f83206171a9151f 2025-09-26 12:38:44,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688f22f83206171a915c9 HTTP/1.1" 200 None 2025-09-26 12:38:44,355 - lava_callback - INFO - Completed processing callback for node 68d688f22f83206171a915c9 2025-09-26 12:38:44,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:44,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6888f2f83206171a9151f HTTP/1.1" 200 None 2025-09-26 12:38:44,412 - lava_callback - DEBUG - Processing node 68d6888f2f83206171a9151f: ltp-dio 2025-09-26 12:38:44,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:38:44,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:38:44,985 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-68d6888f2f83206171a9151f/log.txt.gz 2025-09-26 12:38:44,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:38:45,126 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:38:45,127 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-68d6888f2f83206171a9151f/lava_callback.json.gz 2025-09-26 12:38:45,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:45,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6888f2f83206171a9151f HTTP/1.1" 200 None 2025-09-26 12:38:45,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:45,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8bb2be2da466069ac00 HTTP/1.1" 200 None 2025-09-26 12:38:45,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:45,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6888f2f83206171a9151f HTTP/1.1" 200 None 2025-09-26 12:38:45,257 - lava_callback - INFO - Completed processing callback for node 68d6888f2f83206171a9151f INFO: 172.20.0.1:33906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33910 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:38:51,561 - lava_callback - INFO - Received callback for node 68d3eea6cd36afa834e13ac0 INFO: 172.20.0.1:43400 - "POST /node/68d3eea6cd36afa834e13ac0 HTTP/1.0" 202 Accepted 2025-09-26 12:38:51,572 - lava_callback - INFO - Starting async job submit for node 68d3eea6cd36afa834e13ac0 2025-09-26 12:38:51,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:51,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eea6cd36afa834e13ac0 HTTP/1.1" 200 None 2025-09-26 12:38:51,616 - lava_callback - DEBUG - Processing node 68d3eea6cd36afa834e13ac0: baseline-arm64 2025-09-26 12:38:52,012 - lava_callback - ERROR - Error processing callback for node 68d3eea6cd36afa834e13ac0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:38:54,028 - lava_callback - INFO - Received callback for node 68d3e65bcd36afa834e12c43 INFO: 172.20.0.1:43406 - "POST /node/68d3e65bcd36afa834e12c43 HTTP/1.0" 202 Accepted 2025-09-26 12:38:54,038 - lava_callback - INFO - Starting async job submit for node 68d3e65bcd36afa834e12c43 2025-09-26 12:38:54,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:54,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e65bcd36afa834e12c43 HTTP/1.1" 200 None 2025-09-26 12:38:54,057 - lava_callback - DEBUG - Processing node 68d3e65bcd36afa834e12c43: ltp-fs-bind 2025-09-26 12:38:54,057 - lava_callback - ERROR - Error processing callback for node 68d3e65bcd36afa834e12c43: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:38:55,253 - lava_callback - INFO - Received callback for node 68d688ae2f83206171a91568 INFO: 172.20.0.1:43410 - "POST /node/68d688ae2f83206171a91568 HTTP/1.0" 202 Accepted 2025-09-26 12:38:55,260 - lava_callback - INFO - Starting async job submit for node 68d688ae2f83206171a91568 2025-09-26 12:38:55,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:55,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688ae2f83206171a91568 HTTP/1.1" 200 None 2025-09-26 12:38:55,302 - lava_callback - DEBUG - Processing node 68d688ae2f83206171a91568: baseline-arm-pengutronix 2025-09-26 12:38:55,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:38:55,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:38:55,599 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d688ae2f83206171a91568/log.txt.gz 2025-09-26 12:38:55,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:38:55,743 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:38:55,744 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d688ae2f83206171a91568/lava_callback.json.gz 2025-09-26 12:38:55,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:55,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688ae2f83206171a91568 HTTP/1.1" 200 None 2025-09-26 12:38:55,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:55,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-26 12:38:55,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:38:55,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688ae2f83206171a91568 HTTP/1.1" 200 None 2025-09-26 12:38:55,880 - lava_callback - INFO - Completed processing callback for node 68d688ae2f83206171a91568 INFO: 172.20.0.1:43426 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:39:02,293 - lava_callback - INFO - Received callback for node 68d42749a5c2c05277bc73a4 INFO: 172.20.0.1:57360 - "POST /node/68d42749a5c2c05277bc73a4 HTTP/1.0" 202 Accepted 2025-09-26 12:39:02,300 - lava_callback - INFO - Starting async job submit for node 68d42749a5c2c05277bc73a4 2025-09-26 12:39:02,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:02,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42749a5c2c05277bc73a4 HTTP/1.1" 200 None 2025-09-26 12:39:02,341 - lava_callback - DEBUG - Processing node 68d42749a5c2c05277bc73a4: baseline-arm 2025-09-26 12:39:02,632 - lava_callback - ERROR - Error processing callback for node 68d42749a5c2c05277bc73a4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:57364 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:39:10,517 - lava_callback - INFO - Received callback for node 68d688752f83206171a914df INFO: 172.20.0.1:55974 - "POST /node/68d688752f83206171a914df HTTP/1.0" 202 Accepted 2025-09-26 12:39:10,523 - lava_callback - INFO - Starting async job submit for node 68d688752f83206171a914df 2025-09-26 12:39:10,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:10,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688752f83206171a914df HTTP/1.1" 200 None 2025-09-26 12:39:10,559 - lava_callback - DEBUG - Processing node 68d688752f83206171a914df: baseline-arm 2025-09-26 12:39:11,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:39:11,123 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:39:11,124 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d688752f83206171a914df/log.txt.gz 2025-09-26 12:39:11,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:39:11,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:39:11,244 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d688752f83206171a914df/lava_callback.json.gz 2025-09-26 12:39:11,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:11,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688752f83206171a914df HTTP/1.1" 200 None 2025-09-26 12:39:11,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:11,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8bb2be2da466069ac00 HTTP/1.1" 200 None 2025-09-26 12:39:11,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:11,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688752f83206171a914df HTTP/1.1" 200 None 2025-09-26 12:39:11,330 - lava_callback - INFO - Completed processing callback for node 68d688752f83206171a914df 2025-09-26 12:39:11,941 - lava_callback - INFO - Received callback for node 68d3eeaccd36afa834e13ac6 INFO: 172.20.0.1:55984 - "POST /node/68d3eeaccd36afa834e13ac6 HTTP/1.0" 202 Accepted 2025-09-26 12:39:11,948 - lava_callback - INFO - Starting async job submit for node 68d3eeaccd36afa834e13ac6 2025-09-26 12:39:11,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:12,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eeaccd36afa834e13ac6 HTTP/1.1" 200 None 2025-09-26 12:39:12,000 - lava_callback - DEBUG - Processing node 68d3eeaccd36afa834e13ac6: baseline-arm64 2025-09-26 12:39:12,360 - lava_callback - ERROR - Error processing callback for node 68d3eeaccd36afa834e13ac6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:39:14,037 - lava_callback - INFO - Received callback for node 68d3e65dcd36afa834e12c46 INFO: 172.20.0.1:55988 - "POST /node/68d3e65dcd36afa834e12c46 HTTP/1.0" 202 Accepted 2025-09-26 12:39:14,045 - lava_callback - INFO - Starting async job submit for node 68d3e65dcd36afa834e12c46 2025-09-26 12:39:14,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:14,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e65dcd36afa834e12c46 HTTP/1.1" 200 None 2025-09-26 12:39:14,060 - lava_callback - DEBUG - Processing node 68d3e65dcd36afa834e12c46: ltp-fsx 2025-09-26 12:39:14,060 - lava_callback - ERROR - Error processing callback for node 68d3e65dcd36afa834e12c46: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:39:14,855 - lava_callback - INFO - Received callback for node 68d3e663cd36afa834e12c4c INFO: 172.20.0.1:56002 - "POST /node/68d3e663cd36afa834e12c4c HTTP/1.0" 202 Accepted 2025-09-26 12:39:14,862 - lava_callback - INFO - Starting async job submit for node 68d3e663cd36afa834e12c4c 2025-09-26 12:39:14,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:14,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e663cd36afa834e12c4c HTTP/1.1" 200 None 2025-09-26 12:39:14,876 - lava_callback - DEBUG - Processing node 68d3e663cd36afa834e12c4c: ltp-fsx 2025-09-26 12:39:14,876 - lava_callback - ERROR - Error processing callback for node 68d3e663cd36afa834e12c4c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:56006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38066 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:39:23,619 - lava_callback - INFO - Received callback for node 68d689042f83206171a915f0 INFO: 172.20.0.1:38074 - "POST /node/68d689042f83206171a915f0 HTTP/1.0" 202 Accepted 2025-09-26 12:39:23,625 - lava_callback - INFO - Starting async job submit for node 68d689042f83206171a915f0 2025-09-26 12:39:23,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:23,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689042f83206171a915f0 HTTP/1.1" 200 None 2025-09-26 12:39:23,660 - lava_callback - DEBUG - Processing node 68d689042f83206171a915f0: baseline-arm 2025-09-26 12:39:23,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:39:23,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:39:23,976 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d689042f83206171a915f0/log.txt.gz 2025-09-26 12:39:23,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:39:24,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:39:24,109 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d689042f83206171a915f0/lava_callback.json.gz 2025-09-26 12:39:24,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:24,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689042f83206171a915f0 HTTP/1.1" 200 None 2025-09-26 12:39:24,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:24,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:39:24,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:24,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689042f83206171a915f0 HTTP/1.1" 200 None 2025-09-26 12:39:24,179 - lava_callback - INFO - Completed processing callback for node 68d689042f83206171a915f0 2025-09-26 12:39:26,137 - lava_callback - INFO - Received callback for node 68d689052f83206171a915f3 INFO: 172.20.0.1:38080 - "POST /node/68d689052f83206171a915f3 HTTP/1.0" 202 Accepted 2025-09-26 12:39:26,142 - lava_callback - INFO - Starting async job submit for node 68d689052f83206171a915f3 2025-09-26 12:39:26,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:26,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689052f83206171a915f3 HTTP/1.1" 200 None 2025-09-26 12:39:26,176 - lava_callback - DEBUG - Processing node 68d689052f83206171a915f3: baseline-arm 2025-09-26 12:39:26,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:38082 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:39:26,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:39:26,515 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d689052f83206171a915f3/log.txt.gz 2025-09-26 12:39:26,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:39:26,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:39:26,634 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d689052f83206171a915f3/lava_callback.json.gz 2025-09-26 12:39:26,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:26,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689052f83206171a915f3 HTTP/1.1" 200 None 2025-09-26 12:39:26,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:26,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:39:26,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:26,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689052f83206171a915f3 HTTP/1.1" 200 None 2025-09-26 12:39:26,736 - lava_callback - INFO - Completed processing callback for node 68d689052f83206171a915f3 2025-09-26 12:39:32,755 - lava_callback - INFO - Received callback for node 68d688762f83206171a914e5 INFO: 172.20.0.1:44144 - "POST /node/68d688762f83206171a914e5 HTTP/1.0" 202 Accepted 2025-09-26 12:39:32,761 - lava_callback - INFO - Starting async job submit for node 68d688762f83206171a914e5 2025-09-26 12:39:32,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:32,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688762f83206171a914e5 HTTP/1.1" 200 None 2025-09-26 12:39:32,793 - lava_callback - DEBUG - Processing node 68d688762f83206171a914e5: baseline-arm 2025-09-26 12:39:33,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:39:33,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:39:33,222 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d688762f83206171a914e5/log.txt.gz 2025-09-26 12:39:33,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:39:33,354 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:39:33,355 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d688762f83206171a914e5/lava_callback.json.gz 2025-09-26 12:39:33,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:33,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688762f83206171a914e5 HTTP/1.1" 200 None 2025-09-26 12:39:33,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:33,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8bb2be2da466069ac00 HTTP/1.1" 200 None 2025-09-26 12:39:33,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:33,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688762f83206171a914e5 HTTP/1.1" 200 None 2025-09-26 12:39:33,429 - lava_callback - INFO - Completed processing callback for node 68d688762f83206171a914e5 INFO: 172.20.0.1:44146 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:39:40,032 - lava_callback - INFO - Received callback for node 68d3eee3cd36afa834e13b27 INFO: 172.20.0.1:41742 - "POST /node/68d3eee3cd36afa834e13b27 HTTP/1.0" 202 Accepted 2025-09-26 12:39:40,038 - lava_callback - INFO - Starting async job submit for node 68d3eee3cd36afa834e13b27 2025-09-26 12:39:40,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:40,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eee3cd36afa834e13b27 HTTP/1.1" 200 None 2025-09-26 12:39:40,071 - lava_callback - DEBUG - Processing node 68d3eee3cd36afa834e13b27: baseline-arm64 2025-09-26 12:39:40,358 - lava_callback - ERROR - Error processing callback for node 68d3eee3cd36afa834e13b27: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:41746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41762 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:39:49,602 - lava_callback - INFO - Received callback for node 68d6895b2f83206171a916bc INFO: 172.20.0.1:44758 - "POST /node/68d6895b2f83206171a916bc HTTP/1.0" 202 Accepted 2025-09-26 12:39:49,652 - lava_callback - INFO - Starting async job submit for node 68d6895b2f83206171a916bc 2025-09-26 12:39:49,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:49,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6895b2f83206171a916bc HTTP/1.1" 200 None 2025-09-26 12:39:49,684 - lava_callback - DEBUG - Processing node 68d6895b2f83206171a916bc: baseline-arm-pengutronix 2025-09-26 12:39:49,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:39:49,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:39:49,936 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d6895b2f83206171a916bc/log.txt.gz 2025-09-26 12:39:49,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:39:50,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:39:50,066 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d6895b2f83206171a916bc/lava_callback.json.gz 2025-09-26 12:39:50,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:50,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6895b2f83206171a916bc HTTP/1.1" 200 None 2025-09-26 12:39:50,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:50,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:39:50,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:50,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6895b2f83206171a916bc HTTP/1.1" 200 None 2025-09-26 12:39:50,139 - lava_callback - INFO - Completed processing callback for node 68d6895b2f83206171a916bc 2025-09-26 12:39:54,477 - lava_callback - INFO - Received callback for node 68d689582f83206171a916b6 INFO: 172.20.0.1:44762 - "POST /node/68d689582f83206171a916b6 HTTP/1.0" 202 Accepted 2025-09-26 12:39:54,483 - lava_callback - INFO - Starting async job submit for node 68d689582f83206171a916b6 2025-09-26 12:39:54,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:54,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689582f83206171a916b6 HTTP/1.1" 200 None 2025-09-26 12:39:54,514 - lava_callback - DEBUG - Processing node 68d689582f83206171a916b6: baseline-arm-pengutronix 2025-09-26 12:39:54,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:39:54,796 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:39:54,797 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d689582f83206171a916b6/log.txt.gz 2025-09-26 12:39:54,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:39:54,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:39:54,906 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d689582f83206171a916b6/lava_callback.json.gz 2025-09-26 12:39:54,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:54,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689582f83206171a916b6 HTTP/1.1" 200 None 2025-09-26 12:39:54,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:54,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:39:54,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:39:54,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689582f83206171a916b6 HTTP/1.1" 200 None 2025-09-26 12:39:54,976 - lava_callback - INFO - Completed processing callback for node 68d689582f83206171a916b6 INFO: 172.20.0.1:44768 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:40:00,845 - lava_callback - INFO - Received callback for node 68d3eee5cd36afa834e13b2a INFO: 172.20.0.1:42658 - "POST /node/68d3eee5cd36afa834e13b2a HTTP/1.0" 202 Accepted 2025-09-26 12:40:00,851 - lava_callback - INFO - Starting async job submit for node 68d3eee5cd36afa834e13b2a 2025-09-26 12:40:00,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:00,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eee5cd36afa834e13b2a HTTP/1.1" 200 None 2025-09-26 12:40:00,890 - lava_callback - DEBUG - Processing node 68d3eee5cd36afa834e13b2a: baseline-arm64 2025-09-26 12:40:01,179 - lava_callback - ERROR - Error processing callback for node 68d3eee5cd36afa834e13b2a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:40:06,254 - lava_callback - INFO - Received callback for node 68d688fc2f83206171a915e4 INFO: 172.20.0.1:42672 - "POST /node/68d688fc2f83206171a915e4 HTTP/1.0" 202 Accepted 2025-09-26 12:40:06,260 - lava_callback - INFO - Starting async job submit for node 68d688fc2f83206171a915e4 2025-09-26 12:40:06,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:06,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688fc2f83206171a915e4 HTTP/1.1" 200 None 2025-09-26 12:40:06,296 - lava_callback - DEBUG - Processing node 68d688fc2f83206171a915e4: baseline-arm INFO: 172.20.0.1:42676 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:40:06,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:40:07,145 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:40:07,146 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d688fc2f83206171a915e4/log.txt.gz 2025-09-26 12:40:07,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:40:07,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:40:07,386 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d688fc2f83206171a915e4/lava_callback.json.gz 2025-09-26 12:40:07,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:07,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688fc2f83206171a915e4 HTTP/1.1" 200 None 2025-09-26 12:40:07,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:07,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:40:07,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:07,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688fc2f83206171a915e4 HTTP/1.1" 200 None 2025-09-26 12:40:07,602 - lava_callback - INFO - Completed processing callback for node 68d688fc2f83206171a915e4 2025-09-26 12:40:11,759 - lava_callback - INFO - Received callback for node 68d689312f83206171a91650 INFO: 172.20.0.1:50916 - "POST /node/68d689312f83206171a91650 HTTP/1.0" 202 Accepted 2025-09-26 12:40:11,769 - lava_callback - INFO - Starting async job submit for node 68d689312f83206171a91650 2025-09-26 12:40:11,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:11,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689312f83206171a91650 HTTP/1.1" 200 None 2025-09-26 12:40:11,830 - lava_callback - DEBUG - Processing node 68d689312f83206171a91650: baseline-arm-baylibre 2025-09-26 12:40:11,949 - lava_callback - INFO - Received callback for node 68d3eeeecd36afa834e13b33 INFO: 172.20.0.1:50920 - "POST /node/68d3eeeecd36afa834e13b33 HTTP/1.0" 202 Accepted 2025-09-26 12:40:11,981 - lava_callback - INFO - Starting async job submit for node 68d3eeeecd36afa834e13b33 2025-09-26 12:40:12,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:12,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eeeecd36afa834e13b33 HTTP/1.1" 200 None 2025-09-26 12:40:12,136 - lava_callback - DEBUG - Processing node 68d3eeeecd36afa834e13b33: baseline-arm64 2025-09-26 12:40:12,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:40:12,642 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:40:12,643 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d689312f83206171a91650/log.txt.gz 2025-09-26 12:40:12,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:40:12,752 - lava_callback - ERROR - Error processing callback for node 68d3eeeecd36afa834e13b33: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:40:12,923 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:40:12,923 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d689312f83206171a91650/lava_callback.json.gz 2025-09-26 12:40:12,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:12,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689312f83206171a91650 HTTP/1.1" 200 None 2025-09-26 12:40:12,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:13,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:40:13,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:13,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689312f83206171a91650 HTTP/1.1" 200 None 2025-09-26 12:40:13,057 - lava_callback - INFO - Completed processing callback for node 68d689312f83206171a91650 INFO: 172.20.0.1:50926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50934 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:40:18,420 - lava_callback - INFO - Received callback for node 68d689062f83206171a915f6 INFO: 172.20.0.1:50944 - "POST /node/68d689062f83206171a915f6 HTTP/1.0" 202 Accepted 2025-09-26 12:40:18,426 - lava_callback - INFO - Starting async job submit for node 68d689062f83206171a915f6 2025-09-26 12:40:18,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:18,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689062f83206171a915f6 HTTP/1.1" 200 None 2025-09-26 12:40:18,468 - lava_callback - DEBUG - Processing node 68d689062f83206171a915f6: baseline-arm 2025-09-26 12:40:18,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:40:18,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:40:18,873 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d689062f83206171a915f6/log.txt.gz 2025-09-26 12:40:18,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:40:19,117 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:40:19,117 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d689062f83206171a915f6/lava_callback.json.gz 2025-09-26 12:40:19,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:19,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689062f83206171a915f6 HTTP/1.1" 200 None 2025-09-26 12:40:19,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:19,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:40:19,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:19,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689062f83206171a915f6 HTTP/1.1" 200 None 2025-09-26 12:40:19,209 - lava_callback - INFO - Completed processing callback for node 68d689062f83206171a915f6 2025-09-26 12:40:19,418 - lava_callback - INFO - Received callback for node 68d689072f83206171a915f9 INFO: 172.20.0.1:34628 - "POST /node/68d689072f83206171a915f9 HTTP/1.0" 202 Accepted 2025-09-26 12:40:19,426 - lava_callback - INFO - Starting async job submit for node 68d689072f83206171a915f9 2025-09-26 12:40:19,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:19,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689072f83206171a915f9 HTTP/1.1" 200 None 2025-09-26 12:40:19,467 - lava_callback - DEBUG - Processing node 68d689072f83206171a915f9: baseline-arm 2025-09-26 12:40:19,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:40:19,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:40:19,893 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d689072f83206171a915f9/log.txt.gz 2025-09-26 12:40:19,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:40:19,949 - lava_callback - INFO - Received callback for node 68d689382f83206171a9165c INFO: 172.20.0.1:34634 - "POST /node/68d689382f83206171a9165c HTTP/1.0" 202 Accepted 2025-09-26 12:40:19,958 - lava_callback - INFO - Starting async job submit for node 68d689382f83206171a9165c 2025-09-26 12:40:19,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:20,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689382f83206171a9165c HTTP/1.1" 200 None 2025-09-26 12:40:20,004 - lava_callback - DEBUG - Processing node 68d689382f83206171a9165c: baseline-arm-baylibre 2025-09-26 12:40:20,024 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:40:20,061 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d689072f83206171a915f9/lava_callback.json.gz 2025-09-26 12:40:20,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:20,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689072f83206171a915f9 HTTP/1.1" 200 None 2025-09-26 12:40:20,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:20,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:40:20,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:40:20,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:20,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689072f83206171a915f9 HTTP/1.1" 200 None 2025-09-26 12:40:20,296 - lava_callback - INFO - Completed processing callback for node 68d689072f83206171a915f9 2025-09-26 12:40:20,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:40:20,419 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d689382f83206171a9165c/log.txt.gz 2025-09-26 12:40:20,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:40:20,530 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:40:20,531 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d689382f83206171a9165c/lava_callback.json.gz 2025-09-26 12:40:20,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:20,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689382f83206171a9165c HTTP/1.1" 200 None 2025-09-26 12:40:20,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:20,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:40:20,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:20,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689382f83206171a9165c HTTP/1.1" 200 None 2025-09-26 12:40:20,661 - lava_callback - INFO - Completed processing callback for node 68d689382f83206171a9165c 2025-09-26 12:40:21,415 - lava_callback - INFO - Received callback for node 68d689332f83206171a91653 INFO: 172.20.0.1:34636 - "POST /node/68d689332f83206171a91653 HTTP/1.0" 202 Accepted 2025-09-26 12:40:21,422 - lava_callback - INFO - Starting async job submit for node 68d689332f83206171a91653 2025-09-26 12:40:21,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:21,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689332f83206171a91653 HTTP/1.1" 200 None 2025-09-26 12:40:21,461 - lava_callback - DEBUG - Processing node 68d689332f83206171a91653: baseline-arm-baylibre 2025-09-26 12:40:21,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:40:21,830 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:40:21,831 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d689332f83206171a91653/log.txt.gz 2025-09-26 12:40:21,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:40:21,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:40:21,952 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d689332f83206171a91653/lava_callback.json.gz 2025-09-26 12:40:21,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:21,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689332f83206171a91653 HTTP/1.1" 200 None 2025-09-26 12:40:22,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:22,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:40:22,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:22,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689332f83206171a91653 HTTP/1.1" 200 None 2025-09-26 12:40:22,054 - lava_callback - INFO - Completed processing callback for node 68d689332f83206171a91653 INFO: 172.20.0.1:34638 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:40:25,577 - lava_callback - INFO - Received callback for node 68d6894a2f83206171a9167e INFO: 172.20.0.1:34652 - "POST /node/68d6894a2f83206171a9167e HTTP/1.0" 202 Accepted 2025-09-26 12:40:25,587 - lava_callback - INFO - Starting async job submit for node 68d6894a2f83206171a9167e 2025-09-26 12:40:25,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:25,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6894a2f83206171a9167e HTTP/1.1" 200 None 2025-09-26 12:40:25,630 - lava_callback - DEBUG - Processing node 68d6894a2f83206171a9167e: baseline-arm-clabbe 2025-09-26 12:40:25,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:40:26,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:40:26,029 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d6894a2f83206171a9167e/log.txt.gz 2025-09-26 12:40:26,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:40:26,162 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:40:26,163 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d6894a2f83206171a9167e/lava_callback.json.gz 2025-09-26 12:40:26,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:26,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6894a2f83206171a9167e HTTP/1.1" 200 None 2025-09-26 12:40:26,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:26,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:40:26,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:26,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6894a2f83206171a9167e HTTP/1.1" 200 None 2025-09-26 12:40:26,246 - lava_callback - INFO - Completed processing callback for node 68d6894a2f83206171a9167e INFO: 172.20.0.1:34660 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:40:30,932 - lava_callback - INFO - Received callback for node 68d688fd2f83206171a915e7 INFO: 172.20.0.1:33598 - "POST /node/68d688fd2f83206171a915e7 HTTP/1.0" 202 Accepted 2025-09-26 12:40:30,940 - lava_callback - INFO - Starting async job submit for node 68d688fd2f83206171a915e7 2025-09-26 12:40:30,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:30,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688fd2f83206171a915e7 HTTP/1.1" 200 None 2025-09-26 12:40:30,976 - lava_callback - DEBUG - Processing node 68d688fd2f83206171a915e7: baseline-arm 2025-09-26 12:40:31,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:40:31,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:40:31,452 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d688fd2f83206171a915e7/log.txt.gz 2025-09-26 12:40:31,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:40:31,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:40:31,613 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d688fd2f83206171a915e7/lava_callback.json.gz 2025-09-26 12:40:31,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:31,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688fd2f83206171a915e7 HTTP/1.1" 200 None 2025-09-26 12:40:31,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:31,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:40:31,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:31,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688fd2f83206171a915e7 HTTP/1.1" 200 None 2025-09-26 12:40:31,702 - lava_callback - INFO - Completed processing callback for node 68d688fd2f83206171a915e7 2025-09-26 12:40:32,613 - lava_callback - INFO - Received callback for node 68d3eef0cd36afa834e13b36 INFO: 172.20.0.1:33614 - "POST /node/68d3eef0cd36afa834e13b36 HTTP/1.0" 202 Accepted 2025-09-26 12:40:32,620 - lava_callback - INFO - Starting async job submit for node 68d3eef0cd36afa834e13b36 2025-09-26 12:40:32,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:32,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eef0cd36afa834e13b36 HTTP/1.1" 200 None 2025-09-26 12:40:32,660 - lava_callback - DEBUG - Processing node 68d3eef0cd36afa834e13b36: baseline-arm64 2025-09-26 12:40:33,009 - lava_callback - ERROR - Error processing callback for node 68d3eef0cd36afa834e13b36: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:40:34,189 - lava_callback - INFO - Received callback for node 68d3e6aecd36afa834e12cb8 INFO: 172.20.0.1:33628 - "POST /node/68d3e6aecd36afa834e12cb8 HTTP/1.0" 202 Accepted 2025-09-26 12:40:34,197 - lava_callback - INFO - Starting async job submit for node 68d3e6aecd36afa834e12cb8 2025-09-26 12:40:34,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:34,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e6aecd36afa834e12cb8 HTTP/1.1" 200 None 2025-09-26 12:40:34,248 - lava_callback - DEBUG - Processing node 68d3e6aecd36afa834e12cb8: ltp-ipc 2025-09-26 12:40:34,248 - lava_callback - ERROR - Error processing callback for node 68d3e6aecd36afa834e12cb8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:40:35,714 - lava_callback - INFO - Received callback for node 68d689592f83206171a916b9 INFO: 172.20.0.1:33636 - "POST /node/68d689592f83206171a916b9 HTTP/1.0" 202 Accepted 2025-09-26 12:40:35,724 - lava_callback - INFO - Starting async job submit for node 68d689592f83206171a916b9 2025-09-26 12:40:35,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:35,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689592f83206171a916b9 HTTP/1.1" 200 None 2025-09-26 12:40:35,765 - lava_callback - DEBUG - Processing node 68d689592f83206171a916b9: baseline-arm-pengutronix 2025-09-26 12:40:36,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:40:36,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:40:36,153 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d689592f83206171a916b9/log.txt.gz 2025-09-26 12:40:36,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:40:36,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:40:36,283 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d689592f83206171a916b9/lava_callback.json.gz 2025-09-26 12:40:36,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:36,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689592f83206171a916b9 HTTP/1.1" 200 None 2025-09-26 12:40:36,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:36,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:40:36,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:36,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689592f83206171a916b9 HTTP/1.1" 200 None 2025-09-26 12:40:36,396 - lava_callback - INFO - Completed processing callback for node 68d689592f83206171a916b9 INFO: 172.20.0.1:33638 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:40:38,134 - lava_callback - INFO - Received callback for node 68d6893a2f83206171a9165f INFO: 172.20.0.1:33652 - "POST /node/68d6893a2f83206171a9165f HTTP/1.0" 202 Accepted 2025-09-26 12:40:38,142 - lava_callback - INFO - Starting async job submit for node 68d6893a2f83206171a9165f 2025-09-26 12:40:38,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:38,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6893a2f83206171a9165f HTTP/1.1" 200 None 2025-09-26 12:40:38,178 - lava_callback - DEBUG - Processing node 68d6893a2f83206171a9165f: baseline-arm-baylibre 2025-09-26 12:40:38,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:40:38,587 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:40:38,587 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d6893a2f83206171a9165f/log.txt.gz 2025-09-26 12:40:38,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:40:38,718 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:40:38,719 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d6893a2f83206171a9165f/lava_callback.json.gz 2025-09-26 12:40:38,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:38,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6893a2f83206171a9165f HTTP/1.1" 200 None 2025-09-26 12:40:38,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:38,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:40:38,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:38,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6893a2f83206171a9165f HTTP/1.1" 200 None 2025-09-26 12:40:38,810 - lava_callback - INFO - Completed processing callback for node 68d6893a2f83206171a9165f INFO: 172.20.0.1:46254 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:40:46,548 - lava_callback - INFO - Received callback for node 68d689372f83206171a91659 INFO: 172.20.0.1:46260 - "POST /node/68d689372f83206171a91659 HTTP/1.0" 202 Accepted 2025-09-26 12:40:46,554 - lava_callback - INFO - Starting async job submit for node 68d689372f83206171a91659 2025-09-26 12:40:46,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:46,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689372f83206171a91659 HTTP/1.1" 200 None 2025-09-26 12:40:46,616 - lava_callback - DEBUG - Processing node 68d689372f83206171a91659: baseline-arm-baylibre INFO: 172.20.0.1:46270 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:40:46,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:40:47,001 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:40:47,001 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d689372f83206171a91659/log.txt.gz 2025-09-26 12:40:47,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:40:47,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:40:47,113 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d689372f83206171a91659/lava_callback.json.gz 2025-09-26 12:40:47,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:47,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689372f83206171a91659 HTTP/1.1" 200 None 2025-09-26 12:40:47,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:47,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:40:47,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:47,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689372f83206171a91659 HTTP/1.1" 200 None 2025-09-26 12:40:47,197 - lava_callback - INFO - Completed processing callback for node 68d689372f83206171a91659 2025-09-26 12:40:51,695 - lava_callback - INFO - Received callback for node 68d689352f83206171a91656 INFO: 172.20.0.1:47916 - "POST /node/68d689352f83206171a91656 HTTP/1.0" 202 Accepted 2025-09-26 12:40:51,704 - lava_callback - INFO - Starting async job submit for node 68d689352f83206171a91656 2025-09-26 12:40:51,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:51,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689352f83206171a91656 HTTP/1.1" 200 None 2025-09-26 12:40:51,741 - lava_callback - DEBUG - Processing node 68d689352f83206171a91656: baseline-arm-baylibre 2025-09-26 12:40:51,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:40:52,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:40:52,165 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d689352f83206171a91656/log.txt.gz 2025-09-26 12:40:52,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:40:52,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:40:52,318 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d689352f83206171a91656/lava_callback.json.gz 2025-09-26 12:40:52,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:52,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689352f83206171a91656 HTTP/1.1" 200 None 2025-09-26 12:40:52,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:52,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:40:52,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:52,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689352f83206171a91656 HTTP/1.1" 200 None 2025-09-26 12:40:52,440 - lava_callback - INFO - Completed processing callback for node 68d689352f83206171a91656 2025-09-26 12:40:54,197 - lava_callback - INFO - Received callback for node 68d3e6c7cd36afa834e12ce9 INFO: 172.20.0.1:47928 - "POST /node/68d3e6c7cd36afa834e12ce9 HTTP/1.0" 202 Accepted 2025-09-26 12:40:54,204 - lava_callback - INFO - Starting async job submit for node 68d3e6c7cd36afa834e12ce9 2025-09-26 12:40:54,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:40:54,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e6c7cd36afa834e12ce9 HTTP/1.1" 200 None 2025-09-26 12:40:54,217 - lava_callback - DEBUG - Processing node 68d3e6c7cd36afa834e12ce9: ltp-input 2025-09-26 12:40:54,217 - lava_callback - ERROR - Error processing callback for node 68d3e6c7cd36afa834e12ce9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:47940 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:41:02,713 - lava_callback - INFO - Received callback for node 68d689022f83206171a915ea INFO: 172.20.0.1:45806 - "POST /node/68d689022f83206171a915ea HTTP/1.0" 202 Accepted 2025-09-26 12:41:02,721 - lava_callback - INFO - Starting async job submit for node 68d689022f83206171a915ea 2025-09-26 12:41:02,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:02,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689022f83206171a915ea HTTP/1.1" 200 None 2025-09-26 12:41:02,756 - lava_callback - DEBUG - Processing node 68d689022f83206171a915ea: baseline-arm 2025-09-26 12:41:03,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:41:03,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:41:03,349 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d689022f83206171a915ea/log.txt.gz 2025-09-26 12:41:03,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:41:03,475 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:41:03,476 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d689022f83206171a915ea/lava_callback.json.gz 2025-09-26 12:41:03,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:03,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689022f83206171a915ea HTTP/1.1" 200 None 2025-09-26 12:41:03,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:03,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:41:03,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:03,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689022f83206171a915ea HTTP/1.1" 200 None 2025-09-26 12:41:03,564 - lava_callback - INFO - Completed processing callback for node 68d689022f83206171a915ea INFO: 172.20.0.1:45816 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:41:12,620 - lava_callback - INFO - Received callback for node 68d3ef15cd36afa834e13b75 INFO: 172.20.0.1:33272 - "POST /node/68d3ef15cd36afa834e13b75 HTTP/1.0" 202 Accepted 2025-09-26 12:41:12,631 - lava_callback - INFO - Starting async job submit for node 68d3ef15cd36afa834e13b75 2025-09-26 12:41:12,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:12,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ef15cd36afa834e13b75 HTTP/1.1" 200 None 2025-09-26 12:41:12,676 - lava_callback - DEBUG - Processing node 68d3ef15cd36afa834e13b75: baseline-arm64 2025-09-26 12:41:13,037 - lava_callback - ERROR - Error processing callback for node 68d3ef15cd36afa834e13b75: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:33274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33290 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:41:18,435 - lava_callback - INFO - Received callback for node 68d4274ca5c2c05277bc73a7 INFO: 172.20.0.1:33300 - "POST /node/68d4274ca5c2c05277bc73a7 HTTP/1.0" 202 Accepted 2025-09-26 12:41:18,443 - lava_callback - INFO - Starting async job submit for node 68d4274ca5c2c05277bc73a7 2025-09-26 12:41:18,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:18,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4274ca5c2c05277bc73a7 HTTP/1.1" 200 None 2025-09-26 12:41:18,483 - lava_callback - DEBUG - Processing node 68d4274ca5c2c05277bc73a7: baseline-arm 2025-09-26 12:41:18,802 - lava_callback - ERROR - Error processing callback for node 68d4274ca5c2c05277bc73a7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:48512 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:41:24,110 - lava_callback - INFO - Received callback for node 68d3ef18cd36afa834e13b78 INFO: 172.20.0.1:48518 - "POST /node/68d3ef18cd36afa834e13b78 HTTP/1.0" 202 Accepted 2025-09-26 12:41:24,117 - lava_callback - INFO - Starting async job submit for node 68d3ef18cd36afa834e13b78 2025-09-26 12:41:24,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:24,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ef18cd36afa834e13b78 HTTP/1.1" 200 None 2025-09-26 12:41:24,181 - lava_callback - DEBUG - Processing node 68d3ef18cd36afa834e13b78: baseline-arm64 2025-09-26 12:41:24,620 - lava_callback - ERROR - Error processing callback for node 68d3ef18cd36afa834e13b78: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:48530 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:41:31,731 - lava_callback - INFO - Received callback for node 68d689032f83206171a915ed INFO: 172.20.0.1:49586 - "POST /node/68d689032f83206171a915ed HTTP/1.0" 202 Accepted 2025-09-26 12:41:31,738 - lava_callback - INFO - Starting async job submit for node 68d689032f83206171a915ed 2025-09-26 12:41:31,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:31,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689032f83206171a915ed HTTP/1.1" 200 None 2025-09-26 12:41:31,780 - lava_callback - DEBUG - Processing node 68d689032f83206171a915ed: baseline-arm 2025-09-26 12:41:32,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:41:32,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:41:32,288 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d689032f83206171a915ed/log.txt.gz 2025-09-26 12:41:32,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:41:32,414 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:41:32,415 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d689032f83206171a915ed/lava_callback.json.gz 2025-09-26 12:41:32,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:32,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689032f83206171a915ed HTTP/1.1" 200 None 2025-09-26 12:41:32,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:32,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:41:32,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:32,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689032f83206171a915ed HTTP/1.1" 200 None 2025-09-26 12:41:32,506 - lava_callback - INFO - Completed processing callback for node 68d689032f83206171a915ed 2025-09-26 12:41:32,972 - lava_callback - INFO - Received callback for node 68d3ef21cd36afa834e13b81 INFO: 172.20.0.1:49594 - "POST /node/68d3ef21cd36afa834e13b81 HTTP/1.0" 202 Accepted 2025-09-26 12:41:32,979 - lava_callback - INFO - Starting async job submit for node 68d3ef21cd36afa834e13b81 2025-09-26 12:41:33,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:33,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ef21cd36afa834e13b81 HTTP/1.1" 200 None 2025-09-26 12:41:33,042 - lava_callback - DEBUG - Processing node 68d3ef21cd36afa834e13b81: baseline-arm64 2025-09-26 12:41:33,376 - lava_callback - ERROR - Error processing callback for node 68d3ef21cd36afa834e13b81: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:41:34,197 - lava_callback - INFO - Received callback for node 68d3e6f6cd36afa834e12d16 INFO: 172.20.0.1:49600 - "POST /node/68d3e6f6cd36afa834e12d16 HTTP/1.0" 202 Accepted 2025-09-26 12:41:34,204 - lava_callback - INFO - Starting async job submit for node 68d3e6f6cd36afa834e12d16 2025-09-26 12:41:34,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:34,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e6f6cd36afa834e12d16 HTTP/1.1" 200 None 2025-09-26 12:41:34,219 - lava_callback - DEBUG - Processing node 68d3e6f6cd36afa834e12d16: ltp-input 2025-09-26 12:41:34,219 - lava_callback - ERROR - Error processing callback for node 68d3e6f6cd36afa834e12d16: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:49604 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:41:39,511 - lava_callback - INFO - Received callback for node 68d689c52f83206171a917a0 INFO: 172.20.0.1:40500 - "POST /node/68d689c52f83206171a917a0 HTTP/1.0" 202 Accepted 2025-09-26 12:41:39,518 - lava_callback - INFO - Starting async job submit for node 68d689c52f83206171a917a0 2025-09-26 12:41:39,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:39,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689c52f83206171a917a0 HTTP/1.1" 200 None 2025-09-26 12:41:39,553 - lava_callback - DEBUG - Processing node 68d689c52f83206171a917a0: baseline-arm64 2025-09-26 12:41:39,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:41:40,002 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:41:40,003 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689c52f83206171a917a0/log.txt.gz 2025-09-26 12:41:40,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:41:40,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:41:40,141 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689c52f83206171a917a0/lava_callback.json.gz 2025-09-26 12:41:40,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:40,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689c52f83206171a917a0 HTTP/1.1" 200 None 2025-09-26 12:41:40,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:40,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:41:40,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:40,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689c52f83206171a917a0 HTTP/1.1" 200 None 2025-09-26 12:41:40,235 - lava_callback - INFO - Completed processing callback for node 68d689c52f83206171a917a0 2025-09-26 12:41:41,467 - lava_callback - INFO - Received callback for node 68d689c52f83206171a917a3 INFO: 172.20.0.1:40514 - "POST /node/68d689c52f83206171a917a3 HTTP/1.0" 202 Accepted 2025-09-26 12:41:41,474 - lava_callback - INFO - Starting async job submit for node 68d689c52f83206171a917a3 2025-09-26 12:41:41,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:41,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689c52f83206171a917a3 HTTP/1.1" 200 None 2025-09-26 12:41:41,517 - lava_callback - DEBUG - Processing node 68d689c52f83206171a917a3: baseline-arm64 2025-09-26 12:41:41,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:41:41,983 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:41:41,984 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689c52f83206171a917a3/log.txt.gz 2025-09-26 12:41:41,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:41:42,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:41:42,106 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689c52f83206171a917a3/lava_callback.json.gz 2025-09-26 12:41:42,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:42,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689c52f83206171a917a3 HTTP/1.1" 200 None 2025-09-26 12:41:42,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:42,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:41:42,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:42,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689c52f83206171a917a3 HTTP/1.1" 200 None 2025-09-26 12:41:42,192 - lava_callback - INFO - Completed processing callback for node 68d689c52f83206171a917a3 2025-09-26 12:41:42,860 - lava_callback - INFO - Received callback for node 68d689ac2f83206171a91756 INFO: 172.20.0.1:40520 - "POST /node/68d689ac2f83206171a91756 HTTP/1.0" 202 Accepted 2025-09-26 12:41:42,866 - lava_callback - INFO - Starting async job submit for node 68d689ac2f83206171a91756 2025-09-26 12:41:42,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:42,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689ac2f83206171a91756 HTTP/1.1" 200 None 2025-09-26 12:41:42,915 - lava_callback - DEBUG - Processing node 68d689ac2f83206171a91756: baseline-arm64 2025-09-26 12:41:43,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:41:43,406 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:41:43,407 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689ac2f83206171a91756/log.txt.gz 2025-09-26 12:41:43,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:41:43,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:41:43,529 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689ac2f83206171a91756/lava_callback.json.gz 2025-09-26 12:41:43,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:43,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689ac2f83206171a91756 HTTP/1.1" 200 None 2025-09-26 12:41:43,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:43,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:41:43,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:43,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689ac2f83206171a91756 HTTP/1.1" 200 None 2025-09-26 12:41:43,640 - lava_callback - INFO - Completed processing callback for node 68d689ac2f83206171a91756 INFO: 172.20.0.1:40522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40526 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:41:47,535 - lava_callback - INFO - Received callback for node 68d689ad2f83206171a9175d INFO: 172.20.0.1:40540 - "POST /node/68d689ad2f83206171a9175d HTTP/1.0" 202 Accepted 2025-09-26 12:41:47,542 - lava_callback - INFO - Starting async job submit for node 68d689ad2f83206171a9175d 2025-09-26 12:41:47,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:47,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689ad2f83206171a9175d HTTP/1.1" 200 None 2025-09-26 12:41:47,626 - lava_callback - DEBUG - Processing node 68d689ad2f83206171a9175d: baseline-arm64 2025-09-26 12:41:47,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:41:48,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:41:48,042 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689ad2f83206171a9175d/log.txt.gz 2025-09-26 12:41:48,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:41:48,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:41:48,196 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689ad2f83206171a9175d/lava_callback.json.gz 2025-09-26 12:41:48,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:48,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689ad2f83206171a9175d HTTP/1.1" 200 None 2025-09-26 12:41:48,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:48,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:41:48,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:48,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689ad2f83206171a9175d HTTP/1.1" 200 None 2025-09-26 12:41:48,287 - lava_callback - INFO - Completed processing callback for node 68d689ad2f83206171a9175d 2025-09-26 12:41:50,627 - lava_callback - INFO - Received callback for node 68d689a72f83206171a91731 INFO: 172.20.0.1:43906 - "POST /node/68d689a72f83206171a91731 HTTP/1.0" 202 Accepted 2025-09-26 12:41:50,635 - lava_callback - INFO - Starting async job submit for node 68d689a72f83206171a91731 2025-09-26 12:41:50,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:50,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689a72f83206171a91731 HTTP/1.1" 200 None 2025-09-26 12:41:50,674 - lava_callback - DEBUG - Processing node 68d689a72f83206171a91731: baseline-arm64 2025-09-26 12:41:50,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:41:51,143 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:41:51,144 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689a72f83206171a91731/log.txt.gz 2025-09-26 12:41:51,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:41:51,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:41:51,342 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689a72f83206171a91731/lava_callback.json.gz 2025-09-26 12:41:51,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:51,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689a72f83206171a91731 HTTP/1.1" 200 None 2025-09-26 12:41:51,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:51,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:41:51,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:51,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689a72f83206171a91731 HTTP/1.1" 200 None 2025-09-26 12:41:51,481 - lava_callback - INFO - Completed processing callback for node 68d689a72f83206171a91731 2025-09-26 12:41:53,206 - lava_callback - INFO - Received callback for node 68d3ef23cd36afa834e13b84 INFO: 172.20.0.1:43916 - "POST /node/68d3ef23cd36afa834e13b84 HTTP/1.0" 202 Accepted 2025-09-26 12:41:53,214 - lava_callback - INFO - Starting async job submit for node 68d3ef23cd36afa834e13b84 2025-09-26 12:41:53,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:53,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ef23cd36afa834e13b84 HTTP/1.1" 200 None 2025-09-26 12:41:53,254 - lava_callback - DEBUG - Processing node 68d3ef23cd36afa834e13b84: baseline-arm64 2025-09-26 12:41:53,671 - lava_callback - ERROR - Error processing callback for node 68d3ef23cd36afa834e13b84: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:41:55,168 - lava_callback - INFO - Received callback for node 68d689682f83206171a916d5 INFO: 172.20.0.1:43924 - "POST /node/68d689682f83206171a916d5 HTTP/1.0" 202 Accepted 2025-09-26 12:41:55,175 - lava_callback - INFO - Starting async job submit for node 68d689682f83206171a916d5 2025-09-26 12:41:55,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:55,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689682f83206171a916d5 HTTP/1.1" 200 None 2025-09-26 12:41:55,216 - lava_callback - DEBUG - Processing node 68d689682f83206171a916d5: baseline-arm-pengutronix 2025-09-26 12:41:55,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:41:55,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:41:55,537 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d689682f83206171a916d5/log.txt.gz 2025-09-26 12:41:55,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:41:55,662 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:41:55,663 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d689682f83206171a916d5/lava_callback.json.gz 2025-09-26 12:41:55,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:55,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689682f83206171a916d5 HTTP/1.1" 200 None 2025-09-26 12:41:55,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:55,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-26 12:41:55,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:41:55,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689682f83206171a916d5 HTTP/1.1" 200 None 2025-09-26 12:41:55,786 - lava_callback - INFO - Completed processing callback for node 68d689682f83206171a916d5 INFO: 172.20.0.1:43932 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:42:00,237 - lava_callback - INFO - Received callback for node 68d689be2f83206171a9178c INFO: 172.20.0.1:51590 - "POST /node/68d689be2f83206171a9178c HTTP/1.0" 202 Accepted 2025-09-26 12:42:00,249 - lava_callback - INFO - Starting async job submit for node 68d689be2f83206171a9178c 2025-09-26 12:42:00,263 - lava_callback - INFO - Received callback for node 68d689c22f83206171a91799 INFO: 172.20.0.1:51594 - "POST /node/68d689c22f83206171a91799 HTTP/1.0" 202 Accepted 2025-09-26 12:42:00,283 - lava_callback - INFO - Starting async job submit for node 68d689c22f83206171a91799 2025-09-26 12:42:00,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:00,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:00,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689be2f83206171a9178c HTTP/1.1" 200 None 2025-09-26 12:42:00,328 - lava_callback - DEBUG - Processing node 68d689be2f83206171a9178c: baseline-arm64 2025-09-26 12:42:00,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689c22f83206171a91799 HTTP/1.1" 200 None 2025-09-26 12:42:00,361 - lava_callback - DEBUG - Processing node 68d689c22f83206171a91799: baseline-arm64 2025-09-26 12:42:00,900 - lava_callback - INFO - Received callback for node 68d689512f83206171a91692 INFO: 172.20.0.1:51600 - "POST /node/68d689512f83206171a91692 HTTP/1.0" 202 Accepted 2025-09-26 12:42:00,933 - lava_callback - INFO - Starting async job submit for node 68d689512f83206171a91692 2025-09-26 12:42:01,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:01,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689512f83206171a91692 HTTP/1.1" 200 None 2025-09-26 12:42:01,151 - lava_callback - DEBUG - Processing node 68d689512f83206171a91692: baseline-arm-clabbe 2025-09-26 12:42:01,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:01,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:01,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:01,440 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689be2f83206171a9178c/log.txt.gz 2025-09-26 12:42:01,462 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:01,463 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689c22f83206171a91799/log.txt.gz 2025-09-26 12:42:01,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:01,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:01,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:01,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:01,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:01,649 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689c22f83206171a91799/lava_callback.json.gz 2025-09-26 12:42:01,654 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689be2f83206171a9178c/lava_callback.json.gz 2025-09-26 12:42:01,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:01,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:01,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:01,703 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d689512f83206171a91692/log.txt.gz 2025-09-26 12:42:01,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:01,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689c22f83206171a91799 HTTP/1.1" 200 None 2025-09-26 12:42:01,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:01,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689be2f83206171a9178c HTTP/1.1" 200 None 2025-09-26 12:42:01,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:01,731 - lava_callback - INFO - Received callback for node 68d689a62f83206171a9171c INFO: 172.20.0.1:51608 - "POST /node/68d689a62f83206171a9171c HTTP/1.0" 202 Accepted 2025-09-26 12:42:01,741 - lava_callback - INFO - Starting async job submit for node 68d689a62f83206171a9171c 2025-09-26 12:42:01,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:01,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:42:01,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:01,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:42:01,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:01,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689c22f83206171a91799 HTTP/1.1" 200 None 2025-09-26 12:42:01,815 - lava_callback - INFO - Completed processing callback for node 68d689c22f83206171a91799 2025-09-26 12:42:01,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689a62f83206171a9171c HTTP/1.1" 200 None 2025-09-26 12:42:01,822 - lava_callback - DEBUG - Processing node 68d689a62f83206171a9171c: baseline-arm64 2025-09-26 12:42:01,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689be2f83206171a9178c HTTP/1.1" 200 None 2025-09-26 12:42:01,872 - lava_callback - INFO - Completed processing callback for node 68d689be2f83206171a9178c 2025-09-26 12:42:01,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:01,900 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d689512f83206171a91692/lava_callback.json.gz 2025-09-26 12:42:01,970 - lava_callback - INFO - Received callback for node 68d689652f83206171a916cf INFO: 172.20.0.1:51622 - "POST /node/68d689652f83206171a916cf HTTP/1.0" 202 Accepted 2025-09-26 12:42:02,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:02,001 - lava_callback - INFO - Starting async job submit for node 68d689652f83206171a916cf 2025-09-26 12:42:02,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689512f83206171a91692 HTTP/1.1" 200 None 2025-09-26 12:42:02,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:02,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:02,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:42:02,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689652f83206171a916cf HTTP/1.1" 200 None 2025-09-26 12:42:02,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:02,191 - lava_callback - DEBUG - Processing node 68d689652f83206171a916cf: ltp-dio 2025-09-26 12:42:02,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689512f83206171a91692 HTTP/1.1" 200 None 2025-09-26 12:42:02,285 - lava_callback - INFO - Completed processing callback for node 68d689512f83206171a91692 2025-09-26 12:42:02,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:02,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:02,823 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689a62f83206171a9171c/log.txt.gz 2025-09-26 12:42:02,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:02,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:03,057 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:03,058 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689a62f83206171a9171c/lava_callback.json.gz 2025-09-26 12:42:03,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:03,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:03,086 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-68d689652f83206171a916cf/log.txt.gz 2025-09-26 12:42:03,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:03,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689a62f83206171a9171c HTTP/1.1" 200 None 2025-09-26 12:42:03,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:03,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:42:03,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:03,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689a62f83206171a9171c HTTP/1.1" 200 None 2025-09-26 12:42:03,158 - lava_callback - INFO - Completed processing callback for node 68d689a62f83206171a9171c 2025-09-26 12:42:03,255 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:03,256 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-68d689652f83206171a916cf/lava_callback.json.gz 2025-09-26 12:42:03,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:03,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689652f83206171a916cf HTTP/1.1" 200 None 2025-09-26 12:42:03,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:03,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:42:03,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:03,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689652f83206171a916cf HTTP/1.1" 200 None 2025-09-26 12:42:03,409 - lava_callback - INFO - Completed processing callback for node 68d689652f83206171a916cf 2025-09-26 12:42:04,626 - lava_callback - INFO - Received callback for node 68d6892b2f83206171a91627 INFO: 172.20.0.1:51632 - "POST /node/68d6892b2f83206171a91627 HTTP/1.0" 202 Accepted 2025-09-26 12:42:04,632 - lava_callback - INFO - Starting async job submit for node 68d6892b2f83206171a91627 2025-09-26 12:42:04,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:04,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6892b2f83206171a91627 HTTP/1.1" 200 None 2025-09-26 12:42:04,679 - lava_callback - DEBUG - Processing node 68d6892b2f83206171a91627: baseline-arm 2025-09-26 12:42:05,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:05,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:05,224 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d6892b2f83206171a91627/log.txt.gz 2025-09-26 12:42:05,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:05,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:05,385 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d6892b2f83206171a91627/lava_callback.json.gz 2025-09-26 12:42:05,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:05,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6892b2f83206171a91627 HTTP/1.1" 200 None 2025-09-26 12:42:05,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:05,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:42:05,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:05,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6892b2f83206171a91627 HTTP/1.1" 200 None 2025-09-26 12:42:05,471 - lava_callback - INFO - Completed processing callback for node 68d6892b2f83206171a91627 2025-09-26 12:42:05,752 - lava_callback - INFO - Received callback for node 68d689bf2f83206171a9178f INFO: 172.20.0.1:51646 - "POST /node/68d689bf2f83206171a9178f HTTP/1.0" 202 Accepted 2025-09-26 12:42:05,761 - lava_callback - INFO - Starting async job submit for node 68d689bf2f83206171a9178f 2025-09-26 12:42:05,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:05,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689bf2f83206171a9178f HTTP/1.1" 200 None 2025-09-26 12:42:05,806 - lava_callback - DEBUG - Processing node 68d689bf2f83206171a9178f: baseline-arm64 2025-09-26 12:42:06,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:06,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:06,363 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689bf2f83206171a9178f/log.txt.gz 2025-09-26 12:42:06,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:51658 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:42:06,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:06,536 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689bf2f83206171a9178f/lava_callback.json.gz 2025-09-26 12:42:06,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:06,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689bf2f83206171a9178f HTTP/1.1" 200 None 2025-09-26 12:42:06,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:06,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:42:06,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:06,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689bf2f83206171a9178f HTTP/1.1" 200 None 2025-09-26 12:42:06,638 - lava_callback - INFO - Completed processing callback for node 68d689bf2f83206171a9178f 2025-09-26 12:42:12,375 - lava_callback - INFO - Received callback for node 68d3e659cd36afa834e12c40 INFO: 172.20.0.1:47522 - "POST /node/68d3e659cd36afa834e12c40 HTTP/1.0" 202 Accepted 2025-09-26 12:42:12,383 - lava_callback - INFO - Starting async job submit for node 68d3e659cd36afa834e12c40 2025-09-26 12:42:12,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:12,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e659cd36afa834e12c40 HTTP/1.1" 200 None 2025-09-26 12:42:12,429 - lava_callback - DEBUG - Processing node 68d3e659cd36afa834e12c40: ltp-input 2025-09-26 12:42:13,019 - lava_callback - ERROR - Error processing callback for node 68d3e659cd36afa834e12c40: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:42:14,804 - lava_callback - INFO - Received callback for node 68d689cb2f83206171a917b0 INFO: 172.20.0.1:47532 - "POST /node/68d689cb2f83206171a917b0 HTTP/1.0" 202 Accepted 2025-09-26 12:42:14,811 - lava_callback - INFO - Starting async job submit for node 68d689cb2f83206171a917b0 2025-09-26 12:42:14,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:14,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689cb2f83206171a917b0 HTTP/1.1" 200 None 2025-09-26 12:42:14,858 - lava_callback - DEBUG - Processing node 68d689cb2f83206171a917b0: baseline-arm64 INFO: 172.20.0.1:47540 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 12:42:15,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:15,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:15,513 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689cb2f83206171a917b0/log.txt.gz 2025-09-26 12:42:15,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:15,699 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:15,699 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689cb2f83206171a917b0/lava_callback.json.gz 2025-09-26 12:42:15,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:15,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689cb2f83206171a917b0 HTTP/1.1" 200 None 2025-09-26 12:42:15,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:15,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:42:15,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:15,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689cb2f83206171a917b0 HTTP/1.1" 200 None 2025-09-26 12:42:15,797 - lava_callback - INFO - Completed processing callback for node 68d689cb2f83206171a917b0 INFO: 172.20.0.1:47552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47750 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:42:30,463 - lava_callback - INFO - Received callback for node 68d689c12f83206171a91796 INFO: 172.20.0.1:54222 - "POST /node/68d689c12f83206171a91796 HTTP/1.0" 202 Accepted 2025-09-26 12:42:30,470 - lava_callback - INFO - Starting async job submit for node 68d689c12f83206171a91796 2025-09-26 12:42:30,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:30,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689c12f83206171a91796 HTTP/1.1" 200 None 2025-09-26 12:42:30,512 - lava_callback - DEBUG - Processing node 68d689c12f83206171a91796: baseline-arm64 2025-09-26 12:42:30,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:31,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:31,039 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689c12f83206171a91796/log.txt.gz 2025-09-26 12:42:31,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:31,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:31,154 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689c12f83206171a91796/lava_callback.json.gz 2025-09-26 12:42:31,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:31,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689c12f83206171a91796 HTTP/1.1" 200 None 2025-09-26 12:42:31,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:31,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:42:31,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:31,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689c12f83206171a91796 HTTP/1.1" 200 None 2025-09-26 12:42:31,234 - lava_callback - INFO - Completed processing callback for node 68d689c12f83206171a91796 2025-09-26 12:42:32,227 - lava_callback - INFO - Received callback for node 68d3f3e1cd36afa834e1439d INFO: 172.20.0.1:54224 - "POST /node/68d3f3e1cd36afa834e1439d HTTP/1.0" 202 Accepted 2025-09-26 12:42:32,234 - lava_callback - INFO - Starting async job submit for node 68d3f3e1cd36afa834e1439d 2025-09-26 12:42:32,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:32,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f3e1cd36afa834e1439d HTTP/1.1" 200 None 2025-09-26 12:42:32,274 - lava_callback - DEBUG - Processing node 68d3f3e1cd36afa834e1439d: baseline-arm64 2025-09-26 12:42:32,695 - lava_callback - ERROR - Error processing callback for node 68d3f3e1cd36afa834e1439d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:42:33,657 - lava_callback - INFO - Received callback for node 68d689c82f83206171a917ad INFO: 172.20.0.1:54234 - "POST /node/68d689c82f83206171a917ad HTTP/1.0" 202 Accepted 2025-09-26 12:42:33,667 - lava_callback - INFO - Starting async job submit for node 68d689c82f83206171a917ad 2025-09-26 12:42:33,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:33,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689c82f83206171a917ad HTTP/1.1" 200 None 2025-09-26 12:42:33,710 - lava_callback - DEBUG - Processing node 68d689c82f83206171a917ad: baseline-arm64 2025-09-26 12:42:34,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:34,171 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:34,172 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689c82f83206171a917ad/log.txt.gz 2025-09-26 12:42:34,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:34,307 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:34,308 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689c82f83206171a917ad/lava_callback.json.gz 2025-09-26 12:42:34,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:34,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689c82f83206171a917ad HTTP/1.1" 200 None 2025-09-26 12:42:34,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:34,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:42:34,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:34,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689c82f83206171a917ad HTTP/1.1" 200 None 2025-09-26 12:42:34,420 - lava_callback - INFO - Completed processing callback for node 68d689c82f83206171a917ad INFO: 172.20.0.1:54248 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:42:37,514 - lava_callback - INFO - Received callback for node 68d689c82f83206171a917aa INFO: 172.20.0.1:54252 - "POST /node/68d689c82f83206171a917aa HTTP/1.0" 202 Accepted 2025-09-26 12:42:37,521 - lava_callback - INFO - Starting async job submit for node 68d689c82f83206171a917aa 2025-09-26 12:42:37,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:37,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689c82f83206171a917aa HTTP/1.1" 200 None 2025-09-26 12:42:37,566 - lava_callback - DEBUG - Processing node 68d689c82f83206171a917aa: baseline-arm64 2025-09-26 12:42:37,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:37,973 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:37,974 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689c82f83206171a917aa/log.txt.gz 2025-09-26 12:42:37,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:38,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:38,103 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689c82f83206171a917aa/lava_callback.json.gz 2025-09-26 12:42:38,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:38,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689c82f83206171a917aa HTTP/1.1" 200 None 2025-09-26 12:42:38,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:38,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:42:38,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:38,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689c82f83206171a917aa HTTP/1.1" 200 None 2025-09-26 12:42:38,205 - lava_callback - INFO - Completed processing callback for node 68d689c82f83206171a917aa 2025-09-26 12:42:39,193 - lava_callback - INFO - Received callback for node 68d689df2f83206171a917e3 INFO: 172.20.0.1:54266 - "POST /node/68d689df2f83206171a917e3 HTTP/1.0" 202 Accepted 2025-09-26 12:42:39,201 - lava_callback - INFO - Starting async job submit for node 68d689df2f83206171a917e3 2025-09-26 12:42:39,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:39,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689df2f83206171a917e3 HTTP/1.1" 200 None 2025-09-26 12:42:39,241 - lava_callback - DEBUG - Processing node 68d689df2f83206171a917e3: baseline-arm64 2025-09-26 12:42:39,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:39,769 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:39,770 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689df2f83206171a917e3/log.txt.gz 2025-09-26 12:42:39,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:39,871 - lava_callback - INFO - Received callback for node 68d689db2f83206171a917d6 INFO: 172.20.0.1:60328 - "POST /node/68d689db2f83206171a917d6 HTTP/1.0" 202 Accepted 2025-09-26 12:42:39,881 - lava_callback - INFO - Starting async job submit for node 68d689db2f83206171a917d6 2025-09-26 12:42:39,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:39,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689db2f83206171a917d6 HTTP/1.1" 200 None 2025-09-26 12:42:39,929 - lava_callback - DEBUG - Processing node 68d689db2f83206171a917d6: baseline-arm64 2025-09-26 12:42:39,945 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:39,992 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689df2f83206171a917e3/lava_callback.json.gz 2025-09-26 12:42:40,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:40,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689df2f83206171a917e3 HTTP/1.1" 200 None 2025-09-26 12:42:40,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:40,194 - lava_callback - INFO - Received callback for node 68d6892c2f83206171a91635 INFO: 172.20.0.1:60336 - "POST /node/68d6892c2f83206171a91635 HTTP/1.0" 202 Accepted 2025-09-26 12:42:40,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:42:40,227 - lava_callback - INFO - Starting async job submit for node 68d6892c2f83206171a91635 2025-09-26 12:42:40,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:40,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:40,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:40,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6892c2f83206171a91635 HTTP/1.1" 200 None 2025-09-26 12:42:40,270 - lava_callback - DEBUG - Processing node 68d6892c2f83206171a91635: baseline-arm 2025-09-26 12:42:40,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689df2f83206171a917e3 HTTP/1.1" 200 None 2025-09-26 12:42:40,307 - lava_callback - INFO - Completed processing callback for node 68d689df2f83206171a917e3 2025-09-26 12:42:40,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:40,484 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689db2f83206171a917d6/log.txt.gz 2025-09-26 12:42:40,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:40,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:40,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:40,733 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689db2f83206171a917d6/lava_callback.json.gz 2025-09-26 12:42:40,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:40,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689db2f83206171a917d6 HTTP/1.1" 200 None 2025-09-26 12:42:40,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:40,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:42:40,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:40,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689db2f83206171a917d6 HTTP/1.1" 200 None 2025-09-26 12:42:40,831 - lava_callback - INFO - Completed processing callback for node 68d689db2f83206171a917d6 2025-09-26 12:42:40,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:40,865 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d6892c2f83206171a91635/log.txt.gz 2025-09-26 12:42:40,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:41,027 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:41,028 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d6892c2f83206171a91635/lava_callback.json.gz 2025-09-26 12:42:41,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:41,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6892c2f83206171a91635 HTTP/1.1" 200 None 2025-09-26 12:42:41,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:41,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:42:41,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:41,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6892c2f83206171a91635 HTTP/1.1" 200 None 2025-09-26 12:42:41,111 - lava_callback - INFO - Completed processing callback for node 68d6892c2f83206171a91635 2025-09-26 12:42:41,219 - lava_callback - INFO - Received callback for node 68d689df2f83206171a917dc INFO: 172.20.0.1:60338 - "POST /node/68d689df2f83206171a917dc HTTP/1.0" 202 Accepted 2025-09-26 12:42:41,228 - lava_callback - INFO - Starting async job submit for node 68d689df2f83206171a917dc 2025-09-26 12:42:41,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:41,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689df2f83206171a917dc HTTP/1.1" 200 None 2025-09-26 12:42:41,269 - lava_callback - DEBUG - Processing node 68d689df2f83206171a917dc: baseline-arm64 2025-09-26 12:42:41,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:41,795 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:41,796 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689df2f83206171a917dc/log.txt.gz 2025-09-26 12:42:41,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:41,950 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:41,951 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689df2f83206171a917dc/lava_callback.json.gz 2025-09-26 12:42:41,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:42,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689df2f83206171a917dc HTTP/1.1" 200 None 2025-09-26 12:42:42,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:42,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:42:42,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:42,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689df2f83206171a917dc HTTP/1.1" 200 None 2025-09-26 12:42:42,082 - lava_callback - INFO - Completed processing callback for node 68d689df2f83206171a917dc 2025-09-26 12:42:43,758 - lava_callback - INFO - Received callback for node 68d3f3e9cd36afa834e143a3 INFO: 172.20.0.1:60354 - "POST /node/68d3f3e9cd36afa834e143a3 HTTP/1.0" 202 Accepted 2025-09-26 12:42:43,768 - lava_callback - INFO - Starting async job submit for node 68d3f3e9cd36afa834e143a3 2025-09-26 12:42:43,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:43,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f3e9cd36afa834e143a3 HTTP/1.1" 200 None 2025-09-26 12:42:43,810 - lava_callback - DEBUG - Processing node 68d3f3e9cd36afa834e143a3: baseline-arm64 2025-09-26 12:42:44,226 - lava_callback - ERROR - Error processing callback for node 68d3f3e9cd36afa834e143a3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:60370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60384 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:42:50,178 - lava_callback - INFO - Received callback for node 68d688192f83206171a913e0 INFO: 172.20.0.1:60420 - "POST /node/68d688192f83206171a913e0 HTTP/1.0" 202 Accepted 2025-09-26 12:42:50,185 - lava_callback - INFO - Starting async job submit for node 68d688192f83206171a913e0 2025-09-26 12:42:50,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:50,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688192f83206171a913e0 HTTP/1.1" 200 None 2025-09-26 12:42:50,239 - lava_callback - DEBUG - Processing node 68d688192f83206171a913e0: baseline-arm-broonie 2025-09-26 12:42:50,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:50,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:50,682 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d688192f83206171a913e0/log.txt.gz 2025-09-26 12:42:50,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:50,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:50,843 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d688192f83206171a913e0/lava_callback.json.gz 2025-09-26 12:42:50,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:50,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688192f83206171a913e0 HTTP/1.1" 200 None 2025-09-26 12:42:50,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:50,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-26 12:42:50,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:50,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688192f83206171a913e0 HTTP/1.1" 200 None 2025-09-26 12:42:50,955 - lava_callback - INFO - Completed processing callback for node 68d688192f83206171a913e0 2025-09-26 12:42:51,333 - lava_callback - INFO - Received callback for node 68d3f3e4cd36afa834e143a0 INFO: 172.20.0.1:60430 - "POST /node/68d3f3e4cd36afa834e143a0 HTTP/1.0" 202 Accepted 2025-09-26 12:42:51,341 - lava_callback - INFO - Starting async job submit for node 68d3f3e4cd36afa834e143a0 2025-09-26 12:42:51,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:51,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f3e4cd36afa834e143a0 HTTP/1.1" 200 None 2025-09-26 12:42:51,378 - lava_callback - DEBUG - Processing node 68d3f3e4cd36afa834e143a0: baseline-arm64 2025-09-26 12:42:51,804 - lava_callback - ERROR - Error processing callback for node 68d3f3e4cd36afa834e143a0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:60436 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:42:58,491 - lava_callback - INFO - Received callback for node 68d689e32f83206171a917e9 INFO: 172.20.0.1:60440 - "POST /node/68d689e32f83206171a917e9 HTTP/1.0" 202 Accepted 2025-09-26 12:42:58,497 - lava_callback - INFO - Starting async job submit for node 68d689e32f83206171a917e9 2025-09-26 12:42:58,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:58,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689e32f83206171a917e9 HTTP/1.1" 200 None 2025-09-26 12:42:58,534 - lava_callback - DEBUG - Processing node 68d689e32f83206171a917e9: baseline-arm64 2025-09-26 12:42:58,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:58,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:58,888 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689e32f83206171a917e9/log.txt.gz 2025-09-26 12:42:58,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:58,928 - lava_callback - INFO - Received callback for node 68d689e22f83206171a917e6 INFO: 172.20.0.1:60442 - "POST /node/68d689e22f83206171a917e6 HTTP/1.0" 202 Accepted 2025-09-26 12:42:58,934 - lava_callback - INFO - Starting async job submit for node 68d689e22f83206171a917e6 2025-09-26 12:42:58,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:58,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689e22f83206171a917e6 HTTP/1.1" 200 None 2025-09-26 12:42:58,969 - lava_callback - DEBUG - Processing node 68d689e22f83206171a917e6: baseline-arm64 2025-09-26 12:42:59,025 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:59,071 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689e32f83206171a917e9/lava_callback.json.gz 2025-09-26 12:42:59,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:59,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689e32f83206171a917e9 HTTP/1.1" 200 None 2025-09-26 12:42:59,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:59,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:59,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:42:59,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:59,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689e32f83206171a917e9 HTTP/1.1" 200 None 2025-09-26 12:42:59,304 - lava_callback - INFO - Completed processing callback for node 68d689e32f83206171a917e9 2025-09-26 12:42:59,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:59,442 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689e22f83206171a917e6/log.txt.gz 2025-09-26 12:42:59,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:42:59,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:42:59,584 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689e22f83206171a917e6/lava_callback.json.gz 2025-09-26 12:42:59,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:59,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689e22f83206171a917e6 HTTP/1.1" 200 None 2025-09-26 12:42:59,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:59,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:42:59,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:42:59,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689e22f83206171a917e6 HTTP/1.1" 200 None 2025-09-26 12:42:59,664 - lava_callback - INFO - Completed processing callback for node 68d689e22f83206171a917e6 2025-09-26 12:43:05,555 - lava_callback - INFO - Received callback for node 68d6892f2f83206171a91646 INFO: 172.20.0.1:52956 - "POST /node/68d6892f2f83206171a91646 HTTP/1.0" 202 Accepted 2025-09-26 12:43:05,561 - lava_callback - INFO - Starting async job submit for node 68d6892f2f83206171a91646 2025-09-26 12:43:05,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:05,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6892f2f83206171a91646 HTTP/1.1" 200 None 2025-09-26 12:43:05,611 - lava_callback - DEBUG - Processing node 68d6892f2f83206171a91646: baseline-arm 2025-09-26 12:43:05,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:43:06,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:43:06,012 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d6892f2f83206171a91646/log.txt.gz 2025-09-26 12:43:06,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:43:06,140 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:43:06,140 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d6892f2f83206171a91646/lava_callback.json.gz 2025-09-26 12:43:06,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:06,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6892f2f83206171a91646 HTTP/1.1" 200 None 2025-09-26 12:43:06,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:06,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:43:06,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:06,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6892f2f83206171a91646 HTTP/1.1" 200 None 2025-09-26 12:43:06,222 - lava_callback - INFO - Completed processing callback for node 68d6892f2f83206171a91646 INFO: 172.20.0.1:52958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42550 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:43:17,659 - lava_callback - INFO - Received callback for node 68d3f3e9cd36afa834e143a6 INFO: 172.20.0.1:42556 - "POST /node/68d3f3e9cd36afa834e143a6 HTTP/1.0" 202 Accepted 2025-09-26 12:43:17,665 - lava_callback - INFO - Starting async job submit for node 68d3f3e9cd36afa834e143a6 2025-09-26 12:43:17,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:17,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f3e9cd36afa834e143a6 HTTP/1.1" 200 None 2025-09-26 12:43:17,703 - lava_callback - DEBUG - Processing node 68d3f3e9cd36afa834e143a6: baseline-arm64 2025-09-26 12:43:18,001 - lava_callback - ERROR - Error processing callback for node 68d3f3e9cd36afa834e143a6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:42756 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:43:24,341 - lava_callback - INFO - Received callback for node 68d689cb2f83206171a917b3 INFO: 172.20.0.1:42772 - "POST /node/68d689cb2f83206171a917b3 HTTP/1.0" 202 Accepted 2025-09-26 12:43:24,347 - lava_callback - INFO - Starting async job submit for node 68d689cb2f83206171a917b3 2025-09-26 12:43:24,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:24,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689cb2f83206171a917b3 HTTP/1.1" 200 None 2025-09-26 12:43:24,407 - lava_callback - DEBUG - Processing node 68d689cb2f83206171a917b3: baseline-arm64 2025-09-26 12:43:24,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:43:24,812 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:43:24,813 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689cb2f83206171a917b3/log.txt.gz 2025-09-26 12:43:24,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:43:24,959 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:43:24,960 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689cb2f83206171a917b3/lava_callback.json.gz 2025-09-26 12:43:24,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:25,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689cb2f83206171a917b3 HTTP/1.1" 200 None 2025-09-26 12:43:25,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:25,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:43:25,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:25,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689cb2f83206171a917b3 HTTP/1.1" 200 None 2025-09-26 12:43:25,057 - lava_callback - INFO - Completed processing callback for node 68d689cb2f83206171a917b3 INFO: 172.20.0.1:42776 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:43:27,270 - lava_callback - INFO - Received callback for node 68d4274da5c2c05277bc73aa INFO: 172.20.0.1:42792 - "POST /node/68d4274da5c2c05277bc73aa HTTP/1.0" 202 Accepted 2025-09-26 12:43:27,275 - lava_callback - INFO - Starting async job submit for node 68d4274da5c2c05277bc73aa 2025-09-26 12:43:27,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:27,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4274da5c2c05277bc73aa HTTP/1.1" 200 None 2025-09-26 12:43:27,309 - lava_callback - DEBUG - Processing node 68d4274da5c2c05277bc73aa: baseline-arm 2025-09-26 12:43:27,529 - lava_callback - ERROR - Error processing callback for node 68d4274da5c2c05277bc73aa: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:43:29,833 - lava_callback - INFO - Received callback for node 68d68a3f2f83206171a91899 INFO: 172.20.0.1:33898 - "POST /node/68d68a3f2f83206171a91899 HTTP/1.0" 202 Accepted 2025-09-26 12:43:29,839 - lava_callback - INFO - Starting async job submit for node 68d68a3f2f83206171a91899 2025-09-26 12:43:29,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:29,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a3f2f83206171a91899 HTTP/1.1" 200 None 2025-09-26 12:43:29,870 - lava_callback - DEBUG - Processing node 68d68a3f2f83206171a91899: baseline-arm64-pengutronix 2025-09-26 12:43:30,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:43:30,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:43:30,156 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d68a3f2f83206171a91899/log.txt.gz 2025-09-26 12:43:30,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:43:30,304 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:43:30,304 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d68a3f2f83206171a91899/lava_callback.json.gz 2025-09-26 12:43:30,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:30,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a3f2f83206171a91899 HTTP/1.1" 200 None 2025-09-26 12:43:30,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:30,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:43:30,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:30,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68a3f2f83206171a91899 HTTP/1.1" 200 None 2025-09-26 12:43:30,384 - lava_callback - INFO - Completed processing callback for node 68d68a3f2f83206171a91899 2025-09-26 12:43:31,907 - lava_callback - INFO - Received callback for node 68d689542f83206171a9169d INFO: 172.20.0.1:33902 - "POST /node/68d689542f83206171a9169d HTTP/1.0" 202 Accepted 2025-09-26 12:43:31,913 - lava_callback - INFO - Starting async job submit for node 68d689542f83206171a9169d 2025-09-26 12:43:31,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:31,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689542f83206171a9169d HTTP/1.1" 200 None 2025-09-26 12:43:31,946 - lava_callback - DEBUG - Processing node 68d689542f83206171a9169d: baseline-arm-clabbe 2025-09-26 12:43:32,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:43:32,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:43:32,274 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d689542f83206171a9169d/log.txt.gz 2025-09-26 12:43:32,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:43:32,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:43:32,428 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d689542f83206171a9169d/lava_callback.json.gz 2025-09-26 12:43:32,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:32,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689542f83206171a9169d HTTP/1.1" 200 None 2025-09-26 12:43:32,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:32,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:43:32,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:32,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689542f83206171a9169d HTTP/1.1" 200 None 2025-09-26 12:43:32,525 - lava_callback - INFO - Completed processing callback for node 68d689542f83206171a9169d INFO: 172.20.0.1:33918 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:43:37,987 - lava_callback - INFO - Received callback for node 68d68a432f83206171a918ac INFO: 172.20.0.1:33920 - "POST /node/68d68a432f83206171a918ac HTTP/1.0" 202 Accepted 2025-09-26 12:43:37,993 - lava_callback - INFO - Starting async job submit for node 68d68a432f83206171a918ac 2025-09-26 12:43:38,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:38,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a432f83206171a918ac HTTP/1.1" 200 None 2025-09-26 12:43:38,024 - lava_callback - DEBUG - Processing node 68d68a432f83206171a918ac: baseline-arm64-pengutronix 2025-09-26 12:43:38,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:43:38,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:43:38,325 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d68a432f83206171a918ac/log.txt.gz 2025-09-26 12:43:38,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:43:38,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:43:38,441 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d68a432f83206171a918ac/lava_callback.json.gz 2025-09-26 12:43:38,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:38,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a432f83206171a918ac HTTP/1.1" 200 None 2025-09-26 12:43:38,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:38,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:43:38,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:38,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68a432f83206171a918ac HTTP/1.1" 200 None 2025-09-26 12:43:38,512 - lava_callback - INFO - Completed processing callback for node 68d68a432f83206171a918ac 2025-09-26 12:43:44,869 - lava_callback - INFO - Received callback for node 68d68a492f83206171a918b2 INFO: 172.20.0.1:58046 - "POST /node/68d68a492f83206171a918b2 HTTP/1.0" 202 Accepted 2025-09-26 12:43:44,876 - lava_callback - INFO - Starting async job submit for node 68d68a492f83206171a918b2 2025-09-26 12:43:44,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:44,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a492f83206171a918b2 HTTP/1.1" 200 None 2025-09-26 12:43:44,923 - lava_callback - DEBUG - Processing node 68d68a492f83206171a918b2: baseline-arm64-foundriesio 2025-09-26 12:43:45,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:43:45,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:43:45,444 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d68a492f83206171a918b2/log.txt.gz 2025-09-26 12:43:45,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:43:45,808 - lava_callback - INFO - Received callback for node 68d689dc2f83206171a917d9 INFO: 172.20.0.1:58056 - "POST /node/68d689dc2f83206171a917d9 HTTP/1.0" 202 Accepted 2025-09-26 12:43:45,814 - lava_callback - INFO - Starting async job submit for node 68d689dc2f83206171a917d9 2025-09-26 12:43:45,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:45,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689dc2f83206171a917d9 HTTP/1.1" 200 None 2025-09-26 12:43:45,847 - lava_callback - DEBUG - Processing node 68d689dc2f83206171a917d9: baseline-arm64 2025-09-26 12:43:46,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:43:46,242 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:43:46,243 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689dc2f83206171a917d9/log.txt.gz 2025-09-26 12:43:46,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:43:46,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:43:46,376 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689dc2f83206171a917d9/lava_callback.json.gz 2025-09-26 12:43:46,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:46,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689dc2f83206171a917d9 HTTP/1.1" 200 None 2025-09-26 12:43:46,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:46,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:43:46,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:46,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689dc2f83206171a917d9 HTTP/1.1" 200 None 2025-09-26 12:43:46,450 - lava_callback - INFO - Completed processing callback for node 68d689dc2f83206171a917d9 INFO: 172.20.0.1:58060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58072 - "GET / HTTP/1.0" 200 OK Upload attempt 1 failed with ConnectionError: HTTPSConnectionPool(host='files-staging.kernelci.org', port=443): Max retries exceeded with url: /upload (Caused by NameResolutionError(": Failed to resolve 'files-staging.kernelci.org' ([Errno -2] Name or service not known)")) Retrying in 10 seconds... (4 retries remaining) 2025-09-26 12:43:52,172 - lava_callback - INFO - Received callback for node 68d68a462f83206171a918af INFO: 172.20.0.1:39036 - "POST /node/68d68a462f83206171a918af HTTP/1.0" 202 Accepted 2025-09-26 12:43:52,178 - lava_callback - INFO - Starting async job submit for node 68d68a462f83206171a918af 2025-09-26 12:43:52,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:52,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a462f83206171a918af HTTP/1.1" 200 None 2025-09-26 12:43:52,211 - lava_callback - DEBUG - Processing node 68d68a462f83206171a918af: baseline-arm64-foundriesio 2025-09-26 12:43:52,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:43:52,545 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:43:52,546 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d68a462f83206171a918af/log.txt.gz 2025-09-26 12:43:52,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:43:52,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:43:52,683 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d68a462f83206171a918af/lava_callback.json.gz 2025-09-26 12:43:52,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:52,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a462f83206171a918af HTTP/1.1" 200 None 2025-09-26 12:43:52,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:52,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:43:52,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:52,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68a462f83206171a918af HTTP/1.1" 200 None 2025-09-26 12:43:52,760 - lava_callback - INFO - Completed processing callback for node 68d68a462f83206171a918af 2025-09-26 12:43:53,030 - lava_callback - INFO - Received callback for node 68d6892f2f83206171a9164d INFO: 172.20.0.1:39042 - "POST /node/68d6892f2f83206171a9164d HTTP/1.0" 202 Accepted 2025-09-26 12:43:53,036 - lava_callback - INFO - Starting async job submit for node 68d6892f2f83206171a9164d 2025-09-26 12:43:53,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:53,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6892f2f83206171a9164d HTTP/1.1" 200 None 2025-09-26 12:43:53,068 - lava_callback - DEBUG - Processing node 68d6892f2f83206171a9164d: baseline-arm 2025-09-26 12:43:53,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:43:53,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:43:53,623 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d6892f2f83206171a9164d/log.txt.gz 2025-09-26 12:43:53,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:43:53,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:43:53,740 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d6892f2f83206171a9164d/lava_callback.json.gz 2025-09-26 12:43:53,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:53,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6892f2f83206171a9164d HTTP/1.1" 200 None 2025-09-26 12:43:53,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:53,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:43:53,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:53,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6892f2f83206171a9164d HTTP/1.1" 200 None 2025-09-26 12:43:53,810 - lava_callback - INFO - Completed processing callback for node 68d6892f2f83206171a9164d 2025-09-26 12:43:56,145 - lava_callback - INFO - Received callback for node 68d68a4c2f83206171a918b9 INFO: 172.20.0.1:39058 - "POST /node/68d68a4c2f83206171a918b9 HTTP/1.0" 202 Accepted 2025-09-26 12:43:56,150 - lava_callback - INFO - Starting async job submit for node 68d68a4c2f83206171a918b9 2025-09-26 12:43:56,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:56,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a4c2f83206171a918b9 HTTP/1.1" 200 None 2025-09-26 12:43:56,181 - lava_callback - DEBUG - Processing node 68d68a4c2f83206171a918b9: baseline-arm-pengutronix 2025-09-26 12:43:56,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:43:56,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:43:56,456 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d68a4c2f83206171a918b9/log.txt.gz 2025-09-26 12:43:56,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:39068 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:43:56,573 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:43:56,574 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d68a4c2f83206171a918b9/lava_callback.json.gz 2025-09-26 12:43:56,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:56,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a4c2f83206171a918b9 HTTP/1.1" 200 None 2025-09-26 12:43:56,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:56,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:43:56,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:56,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68a4c2f83206171a918b9 HTTP/1.1" 200 None 2025-09-26 12:43:56,656 - lava_callback - INFO - Completed processing callback for node 68d68a4c2f83206171a918b9 2025-09-26 12:43:56,827 - lava_callback - INFO - Received callback for node 68d3f3f5cd36afa834e143df INFO: 172.20.0.1:39082 - "POST /node/68d3f3f5cd36afa834e143df HTTP/1.0" 202 Accepted 2025-09-26 12:43:56,834 - lava_callback - INFO - Starting async job submit for node 68d3f3f5cd36afa834e143df 2025-09-26 12:43:56,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:56,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f3f5cd36afa834e143df HTTP/1.1" 200 None 2025-09-26 12:43:56,887 - lava_callback - DEBUG - Processing node 68d3f3f5cd36afa834e143df: baseline-arm64 2025-09-26 12:43:57,274 - lava_callback - ERROR - Error processing callback for node 68d3f3f5cd36afa834e143df: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:43:57,840 - lava_callback - INFO - Received callback for node 68d3f3fccd36afa834e143e5 INFO: 172.20.0.1:39096 - "POST /node/68d3f3fccd36afa834e143e5 HTTP/1.0" 202 Accepted 2025-09-26 12:43:57,846 - lava_callback - INFO - Starting async job submit for node 68d3f3fccd36afa834e143e5 2025-09-26 12:43:57,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:57,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f3fccd36afa834e143e5 HTTP/1.1" 200 None 2025-09-26 12:43:57,887 - lava_callback - DEBUG - Processing node 68d3f3fccd36afa834e143e5: baseline-arm64 2025-09-26 12:43:58,178 - lava_callback - ERROR - Error processing callback for node 68d3f3fccd36afa834e143e5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:43:59,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:43:59,567 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:43:59,568 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d68a492f83206171a918b2/lava_callback.json.gz 2025-09-26 12:43:59,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:59,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a492f83206171a918b2 HTTP/1.1" 200 None 2025-09-26 12:43:59,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:59,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:43:59,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:43:59,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68a492f83206171a918b2 HTTP/1.1" 200 None 2025-09-26 12:43:59,646 - lava_callback - INFO - Completed processing callback for node 68d68a492f83206171a918b2 INFO: 172.20.0.1:44862 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:44:10,246 - lava_callback - INFO - Received callback for node 68d68a2b2f83206171a91878 INFO: 172.20.0.1:41334 - "POST /node/68d68a2b2f83206171a91878 HTTP/1.0" 202 Accepted 2025-09-26 12:44:10,252 - lava_callback - INFO - Starting async job submit for node 68d68a2b2f83206171a91878 2025-09-26 12:44:10,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:44:10,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a2b2f83206171a91878 HTTP/1.1" 200 None 2025-09-26 12:44:10,285 - lava_callback - DEBUG - Processing node 68d68a2b2f83206171a91878: baseline-arm64-clabbe 2025-09-26 12:44:10,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:44:10,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:44:10,747 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d68a2b2f83206171a91878/log.txt.gz 2025-09-26 12:44:10,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:44:10,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:44:10,883 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d68a2b2f83206171a91878/lava_callback.json.gz 2025-09-26 12:44:10,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:44:10,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a2b2f83206171a91878 HTTP/1.1" 200 None 2025-09-26 12:44:10,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:44:10,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:44:10,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:44:10,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68a2b2f83206171a91878 HTTP/1.1" 200 None 2025-09-26 12:44:10,972 - lava_callback - INFO - Completed processing callback for node 68d68a2b2f83206171a91878 2025-09-26 12:44:11,479 - lava_callback - INFO - Received callback for node 68d3f3f7cd36afa834e143e2 INFO: 172.20.0.1:41348 - "POST /node/68d3f3f7cd36afa834e143e2 HTTP/1.0" 202 Accepted 2025-09-26 12:44:11,485 - lava_callback - INFO - Starting async job submit for node 68d3f3f7cd36afa834e143e2 2025-09-26 12:44:11,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:44:11,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f3f7cd36afa834e143e2 HTTP/1.1" 200 None 2025-09-26 12:44:11,521 - lava_callback - DEBUG - Processing node 68d3f3f7cd36afa834e143e2: baseline-arm64 2025-09-26 12:44:11,815 - lava_callback - ERROR - Error processing callback for node 68d3f3f7cd36afa834e143e2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:41360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37044 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:44:25,451 - lava_callback - INFO - Received callback for node 68d6887a2f83206171a914ef INFO: 172.20.0.1:37048 - "POST /node/68d6887a2f83206171a914ef HTTP/1.0" 202 Accepted 2025-09-26 12:44:25,458 - lava_callback - INFO - Starting async job submit for node 68d6887a2f83206171a914ef 2025-09-26 12:44:25,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:44:25,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6887a2f83206171a914ef HTTP/1.1" 200 None 2025-09-26 12:44:25,496 - lava_callback - DEBUG - Processing node 68d6887a2f83206171a914ef: baseline-arm-broonie 2025-09-26 12:44:25,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:44:25,811 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:44:25,812 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d6887a2f83206171a914ef/log.txt.gz 2025-09-26 12:44:25,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:44:25,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:44:25,948 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d6887a2f83206171a914ef/lava_callback.json.gz 2025-09-26 12:44:25,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:44:26,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6887a2f83206171a914ef HTTP/1.1" 200 None 2025-09-26 12:44:26,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:44:26,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8bb2be2da466069ac00 HTTP/1.1" 200 None 2025-09-26 12:44:26,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:44:26,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6887a2f83206171a914ef HTTP/1.1" 200 None 2025-09-26 12:44:26,065 - lava_callback - INFO - Completed processing callback for node 68d6887a2f83206171a914ef INFO: 172.20.0.1:37054 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:44:31,985 - lava_callback - INFO - Received callback for node 68d3f3fdcd36afa834e143e8 INFO: 172.20.0.1:51246 - "POST /node/68d3f3fdcd36afa834e143e8 HTTP/1.0" 202 Accepted 2025-09-26 12:44:31,991 - lava_callback - INFO - Starting async job submit for node 68d3f3fdcd36afa834e143e8 2025-09-26 12:44:32,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:44:32,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f3fdcd36afa834e143e8 HTTP/1.1" 200 None 2025-09-26 12:44:32,024 - lava_callback - DEBUG - Processing node 68d3f3fdcd36afa834e143e8: baseline-arm64 2025-09-26 12:44:32,312 - lava_callback - ERROR - Error processing callback for node 68d3f3fdcd36afa834e143e8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:44:32,752 - lava_callback - INFO - Received callback for node 68d68a242f83206171a9186e INFO: 172.20.0.1:51260 - "POST /node/68d68a242f83206171a9186e HTTP/1.0" 202 Accepted 2025-09-26 12:44:32,758 - lava_callback - INFO - Starting async job submit for node 68d68a242f83206171a9186e 2025-09-26 12:44:32,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:44:32,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a242f83206171a9186e HTTP/1.1" 200 None 2025-09-26 12:44:32,802 - lava_callback - DEBUG - Processing node 68d68a242f83206171a9186e: baseline-arm64-broonie 2025-09-26 12:44:33,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:44:33,174 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:44:33,175 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d68a242f83206171a9186e/log.txt.gz 2025-09-26 12:44:33,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:44:33,294 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:44:33,295 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d68a242f83206171a9186e/lava_callback.json.gz 2025-09-26 12:44:33,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:44:33,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a242f83206171a9186e HTTP/1.1" 200 None 2025-09-26 12:44:33,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:44:33,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:44:33,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:44:33,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68a242f83206171a9186e HTTP/1.1" 200 None 2025-09-26 12:44:33,371 - lava_callback - INFO - Completed processing callback for node 68d68a242f83206171a9186e 2025-09-26 12:44:34,545 - lava_callback - INFO - Received callback for node 68d3e7a6cd36afa834e12fe5 INFO: 172.20.0.1:51266 - "POST /node/68d3e7a6cd36afa834e12fe5 HTTP/1.0" 202 Accepted 2025-09-26 12:44:34,551 - lava_callback - INFO - Starting async job submit for node 68d3e7a6cd36afa834e12fe5 2025-09-26 12:44:34,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:44:34,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e7a6cd36afa834e12fe5 HTTP/1.1" 200 None 2025-09-26 12:44:34,564 - lava_callback - DEBUG - Processing node 68d3e7a6cd36afa834e12fe5: ltp-ipc 2025-09-26 12:44:34,564 - lava_callback - ERROR - Error processing callback for node 68d3e7a6cd36afa834e12fe5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:44:36,322 - lava_callback - INFO - Received callback for node 68d68a3c2f83206171a91892 INFO: 172.20.0.1:51276 - "POST /node/68d68a3c2f83206171a91892 HTTP/1.0" 202 Accepted 2025-09-26 12:44:36,328 - lava_callback - INFO - Starting async job submit for node 68d68a3c2f83206171a91892 2025-09-26 12:44:36,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:44:36,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a3c2f83206171a91892 HTTP/1.1" 200 None 2025-09-26 12:44:36,361 - lava_callback - DEBUG - Processing node 68d68a3c2f83206171a91892: baseline-arm64-clabbe INFO: 172.20.0.1:51292 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:44:36,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:44:36,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:44:36,738 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d68a3c2f83206171a91892/log.txt.gz 2025-09-26 12:44:36,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:44:36,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:44:36,858 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d68a3c2f83206171a91892/lava_callback.json.gz 2025-09-26 12:44:36,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:44:36,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a3c2f83206171a91892 HTTP/1.1" 200 None 2025-09-26 12:44:36,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:44:36,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:44:36,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:44:36,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68a3c2f83206171a91892 HTTP/1.1" 200 None 2025-09-26 12:44:36,936 - lava_callback - INFO - Completed processing callback for node 68d68a3c2f83206171a91892 INFO: 172.20.0.1:39438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39450 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:44:48,113 - lava_callback - INFO - Received callback for node 68d689e92f83206171a917ef INFO: 172.20.0.1:39452 - "POST /node/68d689e92f83206171a917ef HTTP/1.0" 202 Accepted 2025-09-26 12:44:48,119 - lava_callback - INFO - Starting async job submit for node 68d689e92f83206171a917ef 2025-09-26 12:44:48,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:44:48,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689e92f83206171a917ef HTTP/1.1" 200 None 2025-09-26 12:44:48,151 - lava_callback - DEBUG - Processing node 68d689e92f83206171a917ef: baseline-arm64-baylibre 2025-09-26 12:44:48,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:44:48,542 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:44:48,543 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d689e92f83206171a917ef/log.txt.gz 2025-09-26 12:44:48,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:44:48,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:44:48,655 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d689e92f83206171a917ef/lava_callback.json.gz 2025-09-26 12:44:48,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:44:48,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689e92f83206171a917ef HTTP/1.1" 200 None 2025-09-26 12:44:48,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:44:48,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:44:48,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:44:48,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689e92f83206171a917ef HTTP/1.1" 200 None 2025-09-26 12:44:48,736 - lava_callback - INFO - Completed processing callback for node 68d689e92f83206171a917ef INFO: 172.20.0.1:47902 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:45:01,581 - lava_callback - INFO - Received callback for node 68d3f410cd36afa834e143f7 INFO: 172.20.0.1:54088 - "POST /node/68d3f410cd36afa834e143f7 HTTP/1.0" 202 Accepted 2025-09-26 12:45:01,587 - lava_callback - INFO - Starting async job submit for node 68d3f410cd36afa834e143f7 2025-09-26 12:45:01,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:45:01,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f410cd36afa834e143f7 HTTP/1.1" 200 None 2025-09-26 12:45:01,623 - lava_callback - DEBUG - Processing node 68d3f410cd36afa834e143f7: baseline-arm64 2025-09-26 12:45:01,913 - lava_callback - ERROR - Error processing callback for node 68d3f410cd36afa834e143f7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:45:02,795 - lava_callback - INFO - Received callback for node 68d3f089cd36afa834e13de2 INFO: 172.20.0.1:54102 - "POST /node/68d3f089cd36afa834e13de2 HTTP/1.0" 202 Accepted 2025-09-26 12:45:02,801 - lava_callback - INFO - Starting async job submit for node 68d3f089cd36afa834e13de2 2025-09-26 12:45:02,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:45:02,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f089cd36afa834e13de2 HTTP/1.1" 200 None 2025-09-26 12:45:02,847 - lava_callback - DEBUG - Processing node 68d3f089cd36afa834e13de2: baseline-arm 2025-09-26 12:45:03,129 - lava_callback - ERROR - Error processing callback for node 68d3f089cd36afa834e13de2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:45:05,986 - lava_callback - INFO - Received callback for node 68d689f12f83206171a917f8 INFO: 172.20.0.1:54114 - "POST /node/68d689f12f83206171a917f8 HTTP/1.0" 202 Accepted 2025-09-26 12:45:05,992 - lava_callback - INFO - Starting async job submit for node 68d689f12f83206171a917f8 2025-09-26 12:45:06,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:45:06,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689f12f83206171a917f8 HTTP/1.1" 200 None 2025-09-26 12:45:06,025 - lava_callback - DEBUG - Processing node 68d689f12f83206171a917f8: baseline-arm64-baylibre 2025-09-26 12:45:06,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:45:06,406 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:45:06,407 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d689f12f83206171a917f8/log.txt.gz 2025-09-26 12:45:06,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:54126 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:45:06,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:45:06,554 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d689f12f83206171a917f8/lava_callback.json.gz 2025-09-26 12:45:06,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:45:06,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689f12f83206171a917f8 HTTP/1.1" 200 None 2025-09-26 12:45:06,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:45:06,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:45:06,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:45:06,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689f12f83206171a917f8 HTTP/1.1" 200 None 2025-09-26 12:45:06,627 - lava_callback - INFO - Completed processing callback for node 68d689f12f83206171a917f8 2025-09-26 12:45:14,421 - lava_callback - INFO - Received callback for node 68d6881b2f83206171a913e3 INFO: 172.20.0.1:45346 - "POST /node/68d6881b2f83206171a913e3 HTTP/1.0" 202 Accepted 2025-09-26 12:45:14,426 - lava_callback - INFO - Starting async job submit for node 68d6881b2f83206171a913e3 2025-09-26 12:45:14,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:45:14,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6881b2f83206171a913e3 HTTP/1.1" 200 None 2025-09-26 12:45:14,480 - lava_callback - DEBUG - Processing node 68d6881b2f83206171a913e3: baseline-arm-broonie 2025-09-26 12:45:14,516 - lava_callback - INFO - Received callback for node 68d3e7cbcd36afa834e1302f INFO: 172.20.0.1:45358 - "POST /node/68d3e7cbcd36afa834e1302f HTTP/1.0" 202 Accepted 2025-09-26 12:45:14,532 - lava_callback - INFO - Starting async job submit for node 68d3e7cbcd36afa834e1302f 2025-09-26 12:45:14,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:45:14,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e7cbcd36afa834e1302f HTTP/1.1" 200 None 2025-09-26 12:45:14,602 - lava_callback - DEBUG - Processing node 68d3e7cbcd36afa834e1302f: ltp-sched 2025-09-26 12:45:14,602 - lava_callback - ERROR - Error processing callback for node 68d3e7cbcd36afa834e1302f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:45:14,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:45:14,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:45:14,835 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d6881b2f83206171a913e3/log.txt.gz 2025-09-26 12:45:14,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:45:14,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:45:14,966 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d6881b2f83206171a913e3/lava_callback.json.gz 2025-09-26 12:45:14,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:45:15,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6881b2f83206171a913e3 HTTP/1.1" 200 None 2025-09-26 12:45:15,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:45:15,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c36c1bc82a30b37a907 HTTP/1.1" 200 None 2025-09-26 12:45:15,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:45:15,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6881b2f83206171a913e3 HTTP/1.1" 200 None 2025-09-26 12:45:15,062 - lava_callback - INFO - Completed processing callback for node 68d6881b2f83206171a913e3 2025-09-26 12:45:15,107 - lava_callback - INFO - Received callback for node 68d689f42f83206171a917fb INFO: 172.20.0.1:45370 - "POST /node/68d689f42f83206171a917fb HTTP/1.0" 202 Accepted 2025-09-26 12:45:15,116 - lava_callback - INFO - Starting async job submit for node 68d689f42f83206171a917fb 2025-09-26 12:45:15,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:45:15,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689f42f83206171a917fb HTTP/1.1" 200 None 2025-09-26 12:45:15,160 - lava_callback - DEBUG - Processing node 68d689f42f83206171a917fb: baseline-arm64-baylibre INFO: 172.20.0.1:45376 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 12:45:15,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:45:15,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:45:15,601 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d689f42f83206171a917fb/log.txt.gz 2025-09-26 12:45:15,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:45:15,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:45:15,766 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d689f42f83206171a917fb/lava_callback.json.gz 2025-09-26 12:45:15,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:45:15,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689f42f83206171a917fb HTTP/1.1" 200 None 2025-09-26 12:45:15,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:45:15,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:45:15,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:45:15,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689f42f83206171a917fb HTTP/1.1" 200 None 2025-09-26 12:45:15,842 - lava_callback - INFO - Completed processing callback for node 68d689f42f83206171a917fb 2025-09-26 12:45:15,896 - lava_callback - INFO - Received callback for node 68d3f40fcd36afa834e143f4 INFO: 172.20.0.1:45382 - "POST /node/68d3f40fcd36afa834e143f4 HTTP/1.0" 202 Accepted 2025-09-26 12:45:15,903 - lava_callback - INFO - Starting async job submit for node 68d3f40fcd36afa834e143f4 2025-09-26 12:45:15,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:45:15,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f40fcd36afa834e143f4 HTTP/1.1" 200 None 2025-09-26 12:45:15,936 - lava_callback - DEBUG - Processing node 68d3f40fcd36afa834e143f4: baseline-arm64 2025-09-26 12:45:16,228 - lava_callback - ERROR - Error processing callback for node 68d3f40fcd36afa834e143f4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:45388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46032 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:45:31,467 - lava_callback - INFO - Received callback for node 68d42750a5c2c05277bc73ad INFO: 172.20.0.1:34458 - "POST /node/68d42750a5c2c05277bc73ad HTTP/1.0" 202 Accepted 2025-09-26 12:45:31,472 - lava_callback - INFO - Starting async job submit for node 68d42750a5c2c05277bc73ad 2025-09-26 12:45:31,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:45:31,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42750a5c2c05277bc73ad HTTP/1.1" 200 None 2025-09-26 12:45:31,513 - lava_callback - DEBUG - Processing node 68d42750a5c2c05277bc73ad: baseline-arm 2025-09-26 12:45:31,730 - lava_callback - ERROR - Error processing callback for node 68d42750a5c2c05277bc73ad: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:34470 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:45:37,071 - lava_callback - INFO - Received callback for node 68d3f413cd36afa834e143fa INFO: 172.20.0.1:34474 - "POST /node/68d3f413cd36afa834e143fa HTTP/1.0" 202 Accepted 2025-09-26 12:45:37,077 - lava_callback - INFO - Starting async job submit for node 68d3f413cd36afa834e143fa 2025-09-26 12:45:37,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:45:37,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f413cd36afa834e143fa HTTP/1.1" 200 None 2025-09-26 12:45:37,127 - lava_callback - DEBUG - Processing node 68d3f413cd36afa834e143fa: baseline-arm64 2025-09-26 12:45:37,477 - lava_callback - ERROR - Error processing callback for node 68d3f413cd36afa834e143fa: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:42234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42250 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:45:52,086 - lava_callback - INFO - Received callback for node 68d3f415cd36afa834e143fd INFO: 172.20.0.1:44118 - "POST /node/68d3f415cd36afa834e143fd HTTP/1.0" 202 Accepted 2025-09-26 12:45:52,092 - lava_callback - INFO - Starting async job submit for node 68d3f415cd36afa834e143fd 2025-09-26 12:45:52,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:45:52,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f415cd36afa834e143fd HTTP/1.1" 200 None 2025-09-26 12:45:52,125 - lava_callback - DEBUG - Processing node 68d3f415cd36afa834e143fd: baseline-arm64 2025-09-26 12:45:52,419 - lava_callback - ERROR - Error processing callback for node 68d3f415cd36afa834e143fd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:45:54,666 - lava_callback - INFO - Received callback for node 68d3e7eecd36afa834e13053 INFO: 172.20.0.1:44126 - "POST /node/68d3e7eecd36afa834e13053 HTTP/1.0" 202 Accepted 2025-09-26 12:45:54,672 - lava_callback - INFO - Starting async job submit for node 68d3e7eecd36afa834e13053 2025-09-26 12:45:54,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:45:54,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e7eecd36afa834e13053 HTTP/1.1" 200 None 2025-09-26 12:45:54,685 - lava_callback - DEBUG - Processing node 68d3e7eecd36afa834e13053: ltp-pty 2025-09-26 12:45:54,685 - lava_callback - ERROR - Error processing callback for node 68d3e7eecd36afa834e13053: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:44138 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:45:56,812 - lava_callback - INFO - Received callback for node 68d689eb2f83206171a917f2 INFO: 172.20.0.1:44148 - "POST /node/68d689eb2f83206171a917f2 HTTP/1.0" 202 Accepted 2025-09-26 12:45:56,818 - lava_callback - INFO - Starting async job submit for node 68d689eb2f83206171a917f2 2025-09-26 12:45:56,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:45:56,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689eb2f83206171a917f2 HTTP/1.1" 200 None 2025-09-26 12:45:56,871 - lava_callback - DEBUG - Processing node 68d689eb2f83206171a917f2: baseline-arm64-baylibre 2025-09-26 12:45:57,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:45:57,250 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:45:57,251 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d689eb2f83206171a917f2/log.txt.gz 2025-09-26 12:45:57,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:45:57,407 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:45:57,407 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d689eb2f83206171a917f2/lava_callback.json.gz 2025-09-26 12:45:57,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:45:57,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689eb2f83206171a917f2 HTTP/1.1" 200 None 2025-09-26 12:45:57,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:45:57,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:45:57,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:45:57,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689eb2f83206171a917f2 HTTP/1.1" 200 None 2025-09-26 12:45:57,484 - lava_callback - INFO - Completed processing callback for node 68d689eb2f83206171a917f2 2025-09-26 12:46:03,607 - lava_callback - INFO - Received callback for node 68d6893e2f83206171a91665 INFO: 172.20.0.1:36000 - "POST /node/68d6893e2f83206171a91665 HTTP/1.0" 202 Accepted 2025-09-26 12:46:03,613 - lava_callback - INFO - Starting async job submit for node 68d6893e2f83206171a91665 2025-09-26 12:46:03,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:46:03,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6893e2f83206171a91665 HTTP/1.1" 200 None 2025-09-26 12:46:03,647 - lava_callback - DEBUG - Processing node 68d6893e2f83206171a91665: baseline-arm-broonie 2025-09-26 12:46:03,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:46:03,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:46:03,968 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d6893e2f83206171a91665/log.txt.gz 2025-09-26 12:46:03,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:46:04,114 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:46:04,115 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d6893e2f83206171a91665/lava_callback.json.gz 2025-09-26 12:46:04,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:46:04,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6893e2f83206171a91665 HTTP/1.1" 200 None 2025-09-26 12:46:04,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:46:04,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:46:04,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:46:04,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6893e2f83206171a91665 HTTP/1.1" 200 None 2025-09-26 12:46:04,205 - lava_callback - INFO - Completed processing callback for node 68d6893e2f83206171a91665 INFO: 172.20.0.1:36012 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:46:13,931 - lava_callback - INFO - Received callback for node 68d689ee2f83206171a917f5 INFO: 172.20.0.1:34018 - "POST /node/68d689ee2f83206171a917f5 HTTP/1.0" 202 Accepted 2025-09-26 12:46:13,937 - lava_callback - INFO - Starting async job submit for node 68d689ee2f83206171a917f5 2025-09-26 12:46:13,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:46:13,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689ee2f83206171a917f5 HTTP/1.1" 200 None 2025-09-26 12:46:13,970 - lava_callback - DEBUG - Processing node 68d689ee2f83206171a917f5: baseline-arm64-baylibre 2025-09-26 12:46:14,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:46:14,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:46:14,417 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d689ee2f83206171a917f5/log.txt.gz 2025-09-26 12:46:14,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:46:14,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:46:14,547 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d689ee2f83206171a917f5/lava_callback.json.gz 2025-09-26 12:46:14,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:46:14,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689ee2f83206171a917f5 HTTP/1.1" 200 None 2025-09-26 12:46:14,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:46:14,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:46:14,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:46:14,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689ee2f83206171a917f5 HTTP/1.1" 200 None 2025-09-26 12:46:14,620 - lava_callback - INFO - Completed processing callback for node 68d689ee2f83206171a917f5 INFO: 172.20.0.1:34030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34046 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:46:21,161 - lava_callback - INFO - Received callback for node 68d3f420cd36afa834e14403 INFO: 172.20.0.1:39002 - "POST /node/68d3f420cd36afa834e14403 HTTP/1.0" 202 Accepted 2025-09-26 12:46:21,168 - lava_callback - INFO - Starting async job submit for node 68d3f420cd36afa834e14403 2025-09-26 12:46:21,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:46:21,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f420cd36afa834e14403 HTTP/1.1" 200 None 2025-09-26 12:46:21,218 - lava_callback - DEBUG - Processing node 68d3f420cd36afa834e14403: baseline-arm64 2025-09-26 12:46:21,369 - lava_callback - INFO - Received callback for node 68d689fa2f83206171a91801 INFO: 172.20.0.1:39004 - "POST /node/68d689fa2f83206171a91801 HTTP/1.0" 202 Accepted 2025-09-26 12:46:21,385 - lava_callback - INFO - Starting async job submit for node 68d689fa2f83206171a91801 2025-09-26 12:46:21,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:46:21,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689fa2f83206171a91801 HTTP/1.1" 200 None 2025-09-26 12:46:21,523 - lava_callback - DEBUG - Processing node 68d689fa2f83206171a91801: baseline-arm64-baylibre 2025-09-26 12:46:22,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:46:22,307 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:46:22,359 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d689fa2f83206171a91801/log.txt.gz 2025-09-26 12:46:22,465 - lava_callback - ERROR - Error processing callback for node 68d3f420cd36afa834e14403: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:39012 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:46:22,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:46:22,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:46:22,607 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d689fa2f83206171a91801/lava_callback.json.gz 2025-09-26 12:46:22,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:46:22,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689fa2f83206171a91801 HTTP/1.1" 200 None 2025-09-26 12:46:22,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:46:22,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:46:22,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:46:22,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689fa2f83206171a91801 HTTP/1.1" 200 None 2025-09-26 12:46:22,687 - lava_callback - INFO - Completed processing callback for node 68d689fa2f83206171a91801 INFO: 172.20.0.1:39026 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:46:34,842 - lava_callback - INFO - Received callback for node 68d3f423cd36afa834e14406 INFO: 172.20.0.1:45140 - "POST /node/68d3f423cd36afa834e14406 HTTP/1.0" 202 Accepted 2025-09-26 12:46:34,848 - lava_callback - INFO - Starting async job submit for node 68d3f423cd36afa834e14406 2025-09-26 12:46:34,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:46:34,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f423cd36afa834e14406 HTTP/1.1" 200 None 2025-09-26 12:46:34,881 - lava_callback - DEBUG - Processing node 68d3f423cd36afa834e14406: baseline-arm64 2025-09-26 12:46:35,176 - lava_callback - ERROR - Error processing callback for node 68d3f423cd36afa834e14406: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:45152 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:46:44,471 - lava_callback - INFO - Received callback for node 68d6887b2f83206171a914f2 INFO: 172.20.0.1:57178 - "POST /node/68d6887b2f83206171a914f2 HTTP/1.0" 202 Accepted 2025-09-26 12:46:44,477 - lava_callback - INFO - Starting async job submit for node 68d6887b2f83206171a914f2 2025-09-26 12:46:44,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:46:44,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6887b2f83206171a914f2 HTTP/1.1" 200 None 2025-09-26 12:46:44,511 - lava_callback - DEBUG - Processing node 68d6887b2f83206171a914f2: baseline-arm-broonie 2025-09-26 12:46:44,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:46:44,854 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:46:44,855 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d6887b2f83206171a914f2/log.txt.gz 2025-09-26 12:46:44,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:46:44,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:46:44,969 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d6887b2f83206171a914f2/lava_callback.json.gz 2025-09-26 12:46:44,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:46:45,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6887b2f83206171a914f2 HTTP/1.1" 200 None 2025-09-26 12:46:45,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:46:45,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8bb2be2da466069ac00 HTTP/1.1" 200 None 2025-09-26 12:46:45,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:46:45,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6887b2f83206171a914f2 HTTP/1.1" 200 None 2025-09-26 12:46:45,075 - lava_callback - INFO - Completed processing callback for node 68d6887b2f83206171a914f2 INFO: 172.20.0.1:57192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57196 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:46:56,356 - lava_callback - INFO - Received callback for node 68d3f426cd36afa834e14409 INFO: 172.20.0.1:36802 - "POST /node/68d3f426cd36afa834e14409 HTTP/1.0" 202 Accepted 2025-09-26 12:46:56,362 - lava_callback - INFO - Starting async job submit for node 68d3f426cd36afa834e14409 2025-09-26 12:46:56,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:46:56,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f426cd36afa834e14409 HTTP/1.1" 200 None 2025-09-26 12:46:56,394 - lava_callback - DEBUG - Processing node 68d3f426cd36afa834e14409: baseline-arm64 INFO: 172.20.0.1:36816 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:46:56,705 - lava_callback - ERROR - Error processing callback for node 68d3f426cd36afa834e14409: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:34106 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:47:12,294 - lava_callback - INFO - Received callback for node 68d689f72f83206171a917fe INFO: 172.20.0.1:57456 - "POST /node/68d689f72f83206171a917fe HTTP/1.0" 202 Accepted 2025-09-26 12:47:12,300 - lava_callback - INFO - Starting async job submit for node 68d689f72f83206171a917fe 2025-09-26 12:47:12,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:47:12,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689f72f83206171a917fe HTTP/1.1" 200 None 2025-09-26 12:47:12,340 - lava_callback - DEBUG - Processing node 68d689f72f83206171a917fe: baseline-arm64-baylibre 2025-09-26 12:47:12,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:47:12,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:47:12,824 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d689f72f83206171a917fe/log.txt.gz 2025-09-26 12:47:12,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:47:12,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:47:12,964 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d689f72f83206171a917fe/lava_callback.json.gz 2025-09-26 12:47:12,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:47:12,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689f72f83206171a917fe HTTP/1.1" 200 None 2025-09-26 12:47:12,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:47:13,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:47:13,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:47:13,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689f72f83206171a917fe HTTP/1.1" 200 None 2025-09-26 12:47:13,046 - lava_callback - INFO - Completed processing callback for node 68d689f72f83206171a917fe INFO: 172.20.0.1:57468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57476 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:47:17,174 - lava_callback - INFO - Received callback for node 68d3f429cd36afa834e1440c INFO: 172.20.0.1:57490 - "POST /node/68d3f429cd36afa834e1440c HTTP/1.0" 202 Accepted 2025-09-26 12:47:17,180 - lava_callback - INFO - Starting async job submit for node 68d3f429cd36afa834e1440c 2025-09-26 12:47:17,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:47:17,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f429cd36afa834e1440c HTTP/1.1" 200 None 2025-09-26 12:47:17,213 - lava_callback - DEBUG - Processing node 68d3f429cd36afa834e1440c: baseline-arm64 2025-09-26 12:47:17,501 - lava_callback - ERROR - Error processing callback for node 68d3f429cd36afa834e1440c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:36918 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:47:25,047 - lava_callback - INFO - Received callback for node 68d3e77ccd36afa834e12df7 INFO: 172.20.0.1:36926 - "POST /node/68d3e77ccd36afa834e12df7 HTTP/1.0" 202 Accepted 2025-09-26 12:47:25,054 - lava_callback - INFO - Starting async job submit for node 68d3e77ccd36afa834e12df7 2025-09-26 12:47:25,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:47:25,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e77ccd36afa834e12df7 HTTP/1.1" 200 None 2025-09-26 12:47:25,094 - lava_callback - DEBUG - Processing node 68d3e77ccd36afa834e12df7: ltp-ipc 2025-09-26 12:47:25,433 - lava_callback - ERROR - Error processing callback for node 68d3e77ccd36afa834e12df7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:36934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44550 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:47:39,447 - lava_callback - INFO - Received callback for node 68d3f43ecd36afa834e144f5 INFO: 172.20.0.1:57200 - "POST /node/68d3f43ecd36afa834e144f5 HTTP/1.0" 202 Accepted 2025-09-26 12:47:39,453 - lava_callback - INFO - Starting async job submit for node 68d3f43ecd36afa834e144f5 2025-09-26 12:47:39,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:47:39,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f43ecd36afa834e144f5 HTTP/1.1" 200 None 2025-09-26 12:47:39,512 - lava_callback - DEBUG - Processing node 68d3f43ecd36afa834e144f5: baseline-arm64 2025-09-26 12:47:39,803 - lava_callback - ERROR - Error processing callback for node 68d3f43ecd36afa834e144f5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:47:41,710 - lava_callback - INFO - Received callback for node 68d42751a5c2c05277bc73b0 INFO: 172.20.0.1:57214 - "POST /node/68d42751a5c2c05277bc73b0 HTTP/1.0" 202 Accepted 2025-09-26 12:47:41,716 - lava_callback - INFO - Starting async job submit for node 68d42751a5c2c05277bc73b0 2025-09-26 12:47:41,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:47:41,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42751a5c2c05277bc73b0 HTTP/1.1" 200 None 2025-09-26 12:47:41,771 - lava_callback - DEBUG - Processing node 68d42751a5c2c05277bc73b0: baseline-arm 2025-09-26 12:47:42,011 - lava_callback - ERROR - Error processing callback for node 68d42751a5c2c05277bc73b0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:57228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57242 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:47:52,427 - lava_callback - INFO - Received callback for node 68d68a172f83206171a9183b INFO: 172.20.0.1:32826 - "POST /node/68d68a172f83206171a9183b HTTP/1.0" 202 Accepted 2025-09-26 12:47:52,432 - lava_callback - INFO - Starting async job submit for node 68d68a172f83206171a9183b 2025-09-26 12:47:52,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:47:52,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a172f83206171a9183b HTTP/1.1" 200 None 2025-09-26 12:47:52,489 - lava_callback - DEBUG - Processing node 68d68a172f83206171a9183b: baseline-arm64-broonie 2025-09-26 12:47:52,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:47:52,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:47:52,863 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d68a172f83206171a9183b/log.txt.gz 2025-09-26 12:47:52,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:47:53,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:47:53,011 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d68a172f83206171a9183b/lava_callback.json.gz 2025-09-26 12:47:53,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:47:53,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a172f83206171a9183b HTTP/1.1" 200 None 2025-09-26 12:47:53,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:47:53,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:47:53,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:47:53,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68a172f83206171a9183b HTTP/1.1" 200 None 2025-09-26 12:47:53,114 - lava_callback - INFO - Completed processing callback for node 68d68a172f83206171a9183b 2025-09-26 12:47:54,735 - lava_callback - INFO - Received callback for node 68d3e86dcd36afa834e13116 INFO: 172.20.0.1:32836 - "POST /node/68d3e86dcd36afa834e13116 HTTP/1.0" 202 Accepted 2025-09-26 12:47:54,741 - lava_callback - INFO - Starting async job submit for node 68d3e86dcd36afa834e13116 2025-09-26 12:47:54,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:47:54,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e86dcd36afa834e13116 HTTP/1.1" 200 None 2025-09-26 12:47:54,765 - lava_callback - DEBUG - Processing node 68d3e86dcd36afa834e13116: ltp-fsx 2025-09-26 12:47:54,765 - lava_callback - ERROR - Error processing callback for node 68d3e86dcd36afa834e13116: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:47:55,524 - lava_callback - INFO - Received callback for node 68d3e873cd36afa834e13145 INFO: 172.20.0.1:32838 - "POST /node/68d3e873cd36afa834e13145 HTTP/1.0" 202 Accepted 2025-09-26 12:47:55,529 - lava_callback - INFO - Starting async job submit for node 68d3e873cd36afa834e13145 2025-09-26 12:47:55,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:47:55,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e873cd36afa834e13145 HTTP/1.1" 200 None 2025-09-26 12:47:55,543 - lava_callback - DEBUG - Processing node 68d3e873cd36afa834e13145: ltp-fs-bind 2025-09-26 12:47:55,543 - lava_callback - ERROR - Error processing callback for node 68d3e873cd36afa834e13145: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:47:56,317 - lava_callback - INFO - Received callback for node 68d3f441cd36afa834e144f8 INFO: 172.20.0.1:32842 - "POST /node/68d3f441cd36afa834e144f8 HTTP/1.0" 202 Accepted 2025-09-26 12:47:56,326 - lava_callback - INFO - Starting async job submit for node 68d3f441cd36afa834e144f8 2025-09-26 12:47:56,326 - lava_callback - INFO - Received callback for node 68d3e879cd36afa834e1314e INFO: 172.20.0.1:32858 - "POST /node/68d3e879cd36afa834e1314e HTTP/1.0" 202 Accepted 2025-09-26 12:47:56,342 - lava_callback - INFO - Starting async job submit for node 68d3e879cd36afa834e1314e 2025-09-26 12:47:56,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:47:56,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:47:56,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e879cd36afa834e1314e HTTP/1.1" 200 None 2025-09-26 12:47:56,363 - lava_callback - DEBUG - Processing node 68d3e879cd36afa834e1314e: ltp-fs-bind 2025-09-26 12:47:56,363 - lava_callback - ERROR - Error processing callback for node 68d3e879cd36afa834e1314e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:47:56,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f441cd36afa834e144f8 HTTP/1.1" 200 None 2025-09-26 12:47:56,364 - lava_callback - DEBUG - Processing node 68d3f441cd36afa834e144f8: baseline-arm64 INFO: 172.20.0.1:32870 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:47:58,003 - lava_callback - ERROR - Error processing callback for node 68d3f441cd36afa834e144f8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:48:05,902 - lava_callback - INFO - Received callback for node 68d689d82f83206171a917d0 INFO: 172.20.0.1:48590 - "POST /node/68d689d82f83206171a917d0 HTTP/1.0" 202 Accepted 2025-09-26 12:48:05,908 - lava_callback - INFO - Starting async job submit for node 68d689d82f83206171a917d0 2025-09-26 12:48:05,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:48:05,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689d82f83206171a917d0 HTTP/1.1" 200 None 2025-09-26 12:48:05,940 - lava_callback - DEBUG - Processing node 68d689d82f83206171a917d0: baseline-arm64 2025-09-26 12:48:06,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:48:06,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 INFO: 172.20.0.1:48596 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:48:06,513 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689d82f83206171a917d0/log.txt.gz 2025-09-26 12:48:06,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:48:06,647 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:48:06,647 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689d82f83206171a917d0/lava_callback.json.gz 2025-09-26 12:48:06,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:48:06,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689d82f83206171a917d0 HTTP/1.1" 200 None 2025-09-26 12:48:06,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:48:06,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:48:06,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:48:06,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689d82f83206171a917d0 HTTP/1.1" 200 None 2025-09-26 12:48:06,718 - lava_callback - INFO - Completed processing callback for node 68d689d82f83206171a917d0 INFO: 172.20.0.1:41266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41270 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:48:16,866 - lava_callback - INFO - Received callback for node 68d3f445cd36afa834e144fb INFO: 172.20.0.1:41286 - "POST /node/68d3f445cd36afa834e144fb HTTP/1.0" 202 Accepted 2025-09-26 12:48:16,872 - lava_callback - INFO - Starting async job submit for node 68d3f445cd36afa834e144fb 2025-09-26 12:48:16,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:48:16,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f445cd36afa834e144fb HTTP/1.1" 200 None 2025-09-26 12:48:16,907 - lava_callback - DEBUG - Processing node 68d3f445cd36afa834e144fb: baseline-arm64 2025-09-26 12:48:17,231 - lava_callback - ERROR - Error processing callback for node 68d3f445cd36afa834e144fb: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:48:17,257 - lava_callback - INFO - Received callback for node 68d689bb2f83206171a91786 INFO: 172.20.0.1:41292 - "POST /node/68d689bb2f83206171a91786 HTTP/1.0" 202 Accepted 2025-09-26 12:48:17,263 - lava_callback - INFO - Starting async job submit for node 68d689bb2f83206171a91786 2025-09-26 12:48:17,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:48:17,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689bb2f83206171a91786 HTTP/1.1" 200 None 2025-09-26 12:48:17,302 - lava_callback - DEBUG - Processing node 68d689bb2f83206171a91786: baseline-arm64 2025-09-26 12:48:17,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:48:17,874 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:48:17,875 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689bb2f83206171a91786/log.txt.gz 2025-09-26 12:48:17,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:48:18,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:48:18,029 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689bb2f83206171a91786/lava_callback.json.gz 2025-09-26 12:48:18,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:48:18,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689bb2f83206171a91786 HTTP/1.1" 200 None 2025-09-26 12:48:18,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:48:18,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:48:18,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:48:18,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689bb2f83206171a91786 HTTP/1.1" 200 None 2025-09-26 12:48:18,124 - lava_callback - INFO - Completed processing callback for node 68d689bb2f83206171a91786 INFO: 172.20.0.1:47128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47136 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:48:32,328 - lava_callback - INFO - Received callback for node 68d3f445cd36afa834e144fe INFO: 172.20.0.1:58298 - "POST /node/68d3f445cd36afa834e144fe HTTP/1.0" 202 Accepted 2025-09-26 12:48:32,334 - lava_callback - INFO - Starting async job submit for node 68d3f445cd36afa834e144fe 2025-09-26 12:48:32,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:48:32,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f445cd36afa834e144fe HTTP/1.1" 200 None 2025-09-26 12:48:32,384 - lava_callback - DEBUG - Processing node 68d3f445cd36afa834e144fe: baseline-arm64 2025-09-26 12:48:32,708 - lava_callback - ERROR - Error processing callback for node 68d3f445cd36afa834e144fe: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:48:34,882 - lava_callback - INFO - Received callback for node 68d3e88dcd36afa834e1315d INFO: 172.20.0.1:58306 - "POST /node/68d3e88dcd36afa834e1315d HTTP/1.0" 202 Accepted 2025-09-26 12:48:34,888 - lava_callback - INFO - Starting async job submit for node 68d3e88dcd36afa834e1315d 2025-09-26 12:48:34,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:48:34,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e88dcd36afa834e1315d HTTP/1.1" 200 None 2025-09-26 12:48:34,909 - lava_callback - DEBUG - Processing node 68d3e88dcd36afa834e1315d: ltp-smoketest 2025-09-26 12:48:34,909 - lava_callback - ERROR - Error processing callback for node 68d3e88dcd36afa834e1315d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:48:35,657 - lava_callback - INFO - Received callback for node 68d3e890cd36afa834e13160 INFO: 172.20.0.1:58314 - "POST /node/68d3e890cd36afa834e13160 HTTP/1.0" 202 Accepted 2025-09-26 12:48:35,663 - lava_callback - INFO - Starting async job submit for node 68d3e890cd36afa834e13160 2025-09-26 12:48:35,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:48:35,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e890cd36afa834e13160 HTTP/1.1" 200 None 2025-09-26 12:48:35,677 - lava_callback - DEBUG - Processing node 68d3e890cd36afa834e13160: ltp-sched 2025-09-26 12:48:35,677 - lava_callback - ERROR - Error processing callback for node 68d3e890cd36afa834e13160: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:48:36,372 - lava_callback - INFO - Received callback for node 68d689402f83206171a91668 INFO: 172.20.0.1:58330 - "POST /node/68d689402f83206171a91668 HTTP/1.0" 202 Accepted 2025-09-26 12:48:36,378 - lava_callback - INFO - Starting async job submit for node 68d689402f83206171a91668 2025-09-26 12:48:36,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:48:36,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689402f83206171a91668 HTTP/1.1" 200 None 2025-09-26 12:48:36,411 - lava_callback - DEBUG - Processing node 68d689402f83206171a91668: baseline-arm-broonie INFO: 172.20.0.1:58344 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:48:36,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:48:36,754 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:48:36,755 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d689402f83206171a91668/log.txt.gz 2025-09-26 12:48:36,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:48:36,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:48:36,867 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d689402f83206171a91668/lava_callback.json.gz 2025-09-26 12:48:36,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:48:36,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689402f83206171a91668 HTTP/1.1" 200 None 2025-09-26 12:48:36,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:48:36,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7530c58dac7d9410bc HTTP/1.1" 200 None 2025-09-26 12:48:36,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:48:36,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689402f83206171a91668 HTTP/1.1" 200 None 2025-09-26 12:48:36,948 - lava_callback - INFO - Completed processing callback for node 68d689402f83206171a91668 INFO: 172.20.0.1:54302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54306 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:48:54,779 - lava_callback - INFO - Received callback for node 68d3e8a8cd36afa834e13179 INFO: 172.20.0.1:43916 - "POST /node/68d3e8a8cd36afa834e13179 HTTP/1.0" 202 Accepted 2025-09-26 12:48:54,785 - lava_callback - INFO - Starting async job submit for node 68d3e8a8cd36afa834e13179 2025-09-26 12:48:54,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:48:54,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e8a8cd36afa834e13179 HTTP/1.1" 200 None 2025-09-26 12:48:54,820 - lava_callback - DEBUG - Processing node 68d3e8a8cd36afa834e13179: ltp-sched 2025-09-26 12:48:54,820 - lava_callback - ERROR - Error processing callback for node 68d3e8a8cd36afa834e13179: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:43930 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:49:06,251 - lava_callback - INFO - Received callback for node 68d3f458cd36afa834e1450d INFO: 172.20.0.1:44348 - "POST /node/68d3f458cd36afa834e1450d HTTP/1.0" 202 Accepted 2025-09-26 12:49:06,257 - lava_callback - INFO - Starting async job submit for node 68d3f458cd36afa834e1450d 2025-09-26 12:49:06,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:49:06,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f458cd36afa834e1450d HTTP/1.1" 200 None 2025-09-26 12:49:06,309 - lava_callback - DEBUG - Processing node 68d3f458cd36afa834e1450d: baseline-arm64 INFO: 172.20.0.1:44360 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:49:06,612 - lava_callback - ERROR - Error processing callback for node 68d3f458cd36afa834e1450d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:41826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41838 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:49:18,097 - lava_callback - INFO - Received callback for node 68d3f455cd36afa834e1450a INFO: 172.20.0.1:41840 - "POST /node/68d3f455cd36afa834e1450a HTTP/1.0" 202 Accepted 2025-09-26 12:49:18,103 - lava_callback - INFO - Starting async job submit for node 68d3f455cd36afa834e1450a 2025-09-26 12:49:18,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:49:18,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f455cd36afa834e1450a HTTP/1.1" 200 None 2025-09-26 12:49:18,136 - lava_callback - DEBUG - Processing node 68d3f455cd36afa834e1450a: baseline-arm64 2025-09-26 12:49:18,445 - lava_callback - ERROR - Error processing callback for node 68d3f455cd36afa834e1450a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:48602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48616 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:49:34,844 - lava_callback - INFO - Received callback for node 68d3e8d7cd36afa834e131cb INFO: 172.20.0.1:44596 - "POST /node/68d3e8d7cd36afa834e131cb HTTP/1.0" 202 Accepted 2025-09-26 12:49:34,849 - lava_callback - INFO - Starting async job submit for node 68d3e8d7cd36afa834e131cb 2025-09-26 12:49:34,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:49:34,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e8d7cd36afa834e131cb HTTP/1.1" 200 None 2025-09-26 12:49:34,863 - lava_callback - DEBUG - Processing node 68d3e8d7cd36afa834e131cb: ltp-smoketest 2025-09-26 12:49:34,863 - lava_callback - ERROR - Error processing callback for node 68d3e8d7cd36afa834e131cb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:44604 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:49:44,963 - lava_callback - INFO - Received callback for node 68d68a1e2f83206171a91864 INFO: 172.20.0.1:36198 - "POST /node/68d68a1e2f83206171a91864 HTTP/1.0" 202 Accepted 2025-09-26 12:49:44,969 - lava_callback - INFO - Starting async job submit for node 68d68a1e2f83206171a91864 2025-09-26 12:49:44,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:49:45,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a1e2f83206171a91864 HTTP/1.1" 200 None 2025-09-26 12:49:45,003 - lava_callback - DEBUG - Processing node 68d68a1e2f83206171a91864: baseline-arm64-broonie 2025-09-26 12:49:45,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:49:45,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:49:45,364 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d68a1e2f83206171a91864/log.txt.gz 2025-09-26 12:49:45,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:49:45,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:49:45,492 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d68a1e2f83206171a91864/lava_callback.json.gz 2025-09-26 12:49:45,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:49:45,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a1e2f83206171a91864 HTTP/1.1" 200 None 2025-09-26 12:49:45,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:49:45,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:49:45,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:49:45,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68a1e2f83206171a91864 HTTP/1.1" 200 None 2025-09-26 12:49:45,580 - lava_callback - INFO - Completed processing callback for node 68d68a1e2f83206171a91864 INFO: 172.20.0.1:36208 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:49:47,354 - lava_callback - INFO - Received callback for node 68d689d92f83206171a917d3 INFO: 172.20.0.1:36224 - "POST /node/68d689d92f83206171a917d3 HTTP/1.0" 202 Accepted 2025-09-26 12:49:47,360 - lava_callback - INFO - Starting async job submit for node 68d689d92f83206171a917d3 2025-09-26 12:49:47,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:49:47,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689d92f83206171a917d3 HTTP/1.1" 200 None 2025-09-26 12:49:47,392 - lava_callback - DEBUG - Processing node 68d689d92f83206171a917d3: baseline-arm64 2025-09-26 12:49:47,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:49:47,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:49:47,883 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689d92f83206171a917d3/log.txt.gz 2025-09-26 12:49:47,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:49:48,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:49:48,013 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689d92f83206171a917d3/lava_callback.json.gz 2025-09-26 12:49:48,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:49:48,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689d92f83206171a917d3 HTTP/1.1" 200 None 2025-09-26 12:49:48,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:49:48,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:49:48,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:49:48,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689d92f83206171a917d3 HTTP/1.1" 200 None 2025-09-26 12:49:48,087 - lava_callback - INFO - Completed processing callback for node 68d689d92f83206171a917d3 INFO: 172.20.0.1:36236 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:49:54,745 - lava_callback - INFO - Received callback for node 68d42753a5c2c05277bc73b3 INFO: 172.20.0.1:41904 - "POST /node/68d42753a5c2c05277bc73b3 HTTP/1.0" 202 Accepted 2025-09-26 12:49:54,751 - lava_callback - INFO - Starting async job submit for node 68d42753a5c2c05277bc73b3 2025-09-26 12:49:54,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:49:54,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42753a5c2c05277bc73b3 HTTP/1.1" 200 None 2025-09-26 12:49:54,783 - lava_callback - DEBUG - Processing node 68d42753a5c2c05277bc73b3: baseline-arm 2025-09-26 12:49:55,000 - lava_callback - ERROR - Error processing callback for node 68d42753a5c2c05277bc73b3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:41912 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:49:59,254 - lava_callback - INFO - Received callback for node 68d3f45ecd36afa834e14513 INFO: 172.20.0.1:41920 - "POST /node/68d3f45ecd36afa834e14513 HTTP/1.0" 202 Accepted 2025-09-26 12:49:59,260 - lava_callback - INFO - Starting async job submit for node 68d3f45ecd36afa834e14513 2025-09-26 12:49:59,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:49:59,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f45ecd36afa834e14513 HTTP/1.1" 200 None 2025-09-26 12:49:59,293 - lava_callback - DEBUG - Processing node 68d3f45ecd36afa834e14513: baseline-arm64 2025-09-26 12:49:59,590 - lava_callback - ERROR - Error processing callback for node 68d3f45ecd36afa834e14513: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:43134 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:50:14,830 - lava_callback - INFO - Received callback for node 68d3e8fccd36afa834e1320d INFO: 172.20.0.1:38204 - "POST /node/68d3e8fccd36afa834e1320d HTTP/1.0" 202 Accepted 2025-09-26 12:50:14,838 - lava_callback - INFO - Starting async job submit for node 68d3e8fccd36afa834e1320d 2025-09-26 12:50:14,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:50:14,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e8fccd36afa834e1320d HTTP/1.1" 200 None 2025-09-26 12:50:14,853 - lava_callback - DEBUG - Processing node 68d3e8fccd36afa834e1320d: ltp-input 2025-09-26 12:50:14,853 - lava_callback - ERROR - Error processing callback for node 68d3e8fccd36afa834e1320d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:38212 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 12:50:15,659 - lava_callback - INFO - Received callback for node 68d3e8fecd36afa834e13210 INFO: 172.20.0.1:38218 - "POST /node/68d3e8fecd36afa834e13210 HTTP/1.0" 202 Accepted 2025-09-26 12:50:15,665 - lava_callback - INFO - Starting async job submit for node 68d3e8fecd36afa834e13210 2025-09-26 12:50:15,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:50:15,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e8fecd36afa834e13210 HTTP/1.1" 200 None 2025-09-26 12:50:15,707 - lava_callback - DEBUG - Processing node 68d3e8fecd36afa834e13210: ltp-fsx 2025-09-26 12:50:15,707 - lava_callback - ERROR - Error processing callback for node 68d3e8fecd36afa834e13210: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:50:16,494 - lava_callback - INFO - Received callback for node 68d3e900cd36afa834e13213 INFO: 172.20.0.1:38220 - "POST /node/68d3e900cd36afa834e13213 HTTP/1.0" 202 Accepted 2025-09-26 12:50:16,500 - lava_callback - INFO - Starting async job submit for node 68d3e900cd36afa834e13213 2025-09-26 12:50:16,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:50:16,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e900cd36afa834e13213 HTTP/1.1" 200 None 2025-09-26 12:50:16,516 - lava_callback - DEBUG - Processing node 68d3e900cd36afa834e13213: ltp-fsx INFO: 172.20.0.1:38228 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:50:16,516 - lava_callback - ERROR - Error processing callback for node 68d3e900cd36afa834e13213: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:50:19,543 - lava_callback - INFO - Received callback for node 68d3f65ccd36afa834e148d5 INFO: 172.20.0.1:58650 - "POST /node/68d3f65ccd36afa834e148d5 HTTP/1.0" 202 Accepted 2025-09-26 12:50:19,549 - lava_callback - INFO - Starting async job submit for node 68d3f65ccd36afa834e148d5 2025-09-26 12:50:19,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:50:19,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f65ccd36afa834e148d5 HTTP/1.1" 200 None 2025-09-26 12:50:19,581 - lava_callback - DEBUG - Processing node 68d3f65ccd36afa834e148d5: baseline-arm64 2025-09-26 12:50:19,906 - lava_callback - ERROR - Error processing callback for node 68d3f65ccd36afa834e148d5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:58658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58662 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:50:34,922 - lava_callback - INFO - Received callback for node 68d3e90fcd36afa834e13222 INFO: 172.20.0.1:35780 - "POST /node/68d3e90fcd36afa834e13222 HTTP/1.0" 202 Accepted 2025-09-26 12:50:34,928 - lava_callback - INFO - Starting async job submit for node 68d3e90fcd36afa834e13222 2025-09-26 12:50:34,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:50:34,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e90fcd36afa834e13222 HTTP/1.1" 200 None 2025-09-26 12:50:34,952 - lava_callback - DEBUG - Processing node 68d3e90fcd36afa834e13222: ltp-smoketest 2025-09-26 12:50:34,952 - lava_callback - ERROR - Error processing callback for node 68d3e90fcd36afa834e13222: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:50:35,715 - lava_callback - INFO - Received callback for node 68d3e911cd36afa834e13225 INFO: 172.20.0.1:35788 - "POST /node/68d3e911cd36afa834e13225 HTTP/1.0" 202 Accepted 2025-09-26 12:50:35,722 - lava_callback - INFO - Starting async job submit for node 68d3e911cd36afa834e13225 2025-09-26 12:50:35,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:50:35,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e911cd36afa834e13225 HTTP/1.1" 200 None 2025-09-26 12:50:35,736 - lava_callback - DEBUG - Processing node 68d3e911cd36afa834e13225: ltp-syscalls-ipc 2025-09-26 12:50:35,736 - lava_callback - ERROR - Error processing callback for node 68d3e911cd36afa834e13225: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:35790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58248 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:50:54,866 - lava_callback - INFO - Received callback for node 68d3e924cd36afa834e1323a INFO: 172.20.0.1:34992 - "POST /node/68d3e924cd36afa834e1323a HTTP/1.0" 202 Accepted 2025-09-26 12:50:54,872 - lava_callback - INFO - Starting async job submit for node 68d3e924cd36afa834e1323a 2025-09-26 12:50:54,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:50:54,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e924cd36afa834e1323a HTTP/1.1" 200 None 2025-09-26 12:50:54,885 - lava_callback - DEBUG - Processing node 68d3e924cd36afa834e1323a: ltp-syscalls 2025-09-26 12:50:54,885 - lava_callback - ERROR - Error processing callback for node 68d3e924cd36afa834e1323a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:50:55,676 - lava_callback - INFO - Received callback for node 68d3e92acd36afa834e13243 INFO: 172.20.0.1:34996 - "POST /node/68d3e92acd36afa834e13243 HTTP/1.0" 202 Accepted 2025-09-26 12:50:55,682 - lava_callback - INFO - Starting async job submit for node 68d3e92acd36afa834e13243 2025-09-26 12:50:55,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:50:55,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e92acd36afa834e13243 HTTP/1.1" 200 None 2025-09-26 12:50:55,695 - lava_callback - DEBUG - Processing node 68d3e92acd36afa834e13243: ltp-syscalls 2025-09-26 12:50:55,695 - lava_callback - ERROR - Error processing callback for node 68d3e92acd36afa834e13243: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:35012 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:51:02,696 - lava_callback - INFO - Received callback for node 68d3f45bcd36afa834e14510 INFO: 172.20.0.1:41626 - "POST /node/68d3f45bcd36afa834e14510 HTTP/1.0" 202 Accepted 2025-09-26 12:51:02,764 - lava_callback - INFO - Starting async job submit for node 68d3f45bcd36afa834e14510 2025-09-26 12:51:02,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:51:02,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f45bcd36afa834e14510 HTTP/1.1" 200 None 2025-09-26 12:51:02,813 - lava_callback - DEBUG - Processing node 68d3f45bcd36afa834e14510: baseline-arm64 INFO: 172.20.0.1:41642 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:51:14,915 - lava_callback - INFO - Received callback for node 68d3e92fcd36afa834e1326e INFO: 172.20.0.1:43072 - "POST /node/68d3e92fcd36afa834e1326e HTTP/1.0" 202 Accepted 2025-09-26 12:51:14,947 - lava_callback - INFO - Starting async job submit for node 68d3e92fcd36afa834e1326e 2025-09-26 12:51:14,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:51:15,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e92fcd36afa834e1326e HTTP/1.1" 200 None 2025-09-26 12:51:15,018 - lava_callback - DEBUG - Processing node 68d3e92fcd36afa834e1326e: ltp-timers 2025-09-26 12:51:15,023 - lava_callback - ERROR - Error processing callback for node 68d3e92fcd36afa834e1326e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:43084 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 12:51:15,707 - lava_callback - INFO - Received callback for node 68d3e932cd36afa834e13271 INFO: 172.20.0.1:43086 - "POST /node/68d3e932cd36afa834e13271 HTTP/1.0" 202 Accepted 2025-09-26 12:51:15,734 - lava_callback - INFO - Starting async job submit for node 68d3e932cd36afa834e13271 2025-09-26 12:51:15,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:51:15,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e932cd36afa834e13271 HTTP/1.1" 200 None 2025-09-26 12:51:15,832 - lava_callback - DEBUG - Processing node 68d3e932cd36afa834e13271: ltp-ipc 2025-09-26 12:51:15,832 - lava_callback - ERROR - Error processing callback for node 68d3e932cd36afa834e13271: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:51:16,491 - lava_callback - INFO - Received callback for node 68d3e93fcd36afa834e13280 INFO: 172.20.0.1:43096 - "POST /node/68d3e93fcd36afa834e13280 HTTP/1.0" 202 Accepted 2025-09-26 12:51:16,507 - lava_callback - INFO - Starting async job submit for node 68d3e93fcd36afa834e13280 2025-09-26 12:51:16,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:43104 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:51:16,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e93fcd36afa834e13280 HTTP/1.1" 200 None 2025-09-26 12:51:16,594 - lava_callback - DEBUG - Processing node 68d3e93fcd36afa834e13280: ltp-syscalls-ipc 2025-09-26 12:51:16,594 - lava_callback - ERROR - Error processing callback for node 68d3e93fcd36afa834e13280: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:51:17,287 - lava_callback - INFO - Received callback for node 68d3e942cd36afa834e13283 INFO: 172.20.0.1:43114 - "POST /node/68d3e942cd36afa834e13283 HTTP/1.0" 202 Accepted 2025-09-26 12:51:17,303 - lava_callback - INFO - Starting async job submit for node 68d3e942cd36afa834e13283 2025-09-26 12:51:17,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:51:17,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e942cd36afa834e13283 HTTP/1.1" 200 None 2025-09-26 12:51:17,404 - lava_callback - DEBUG - Processing node 68d3e942cd36afa834e13283: ltp-input 2025-09-26 12:51:17,404 - lava_callback - ERROR - Error processing callback for node 68d3e942cd36afa834e13283: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:59016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59028 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:51:31,870 - lava_callback - ERROR - Error processing callback for node 68d3f45bcd36afa834e14510: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:51:34,903 - lava_callback - INFO - Received callback for node 68d3e944cd36afa834e13286 INFO: 172.20.0.1:54338 - "POST /node/68d3e944cd36afa834e13286 HTTP/1.0" 202 Accepted 2025-09-26 12:51:34,909 - lava_callback - INFO - Starting async job submit for node 68d3e944cd36afa834e13286 2025-09-26 12:51:34,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:51:34,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e944cd36afa834e13286 HTTP/1.1" 200 None 2025-09-26 12:51:34,923 - lava_callback - DEBUG - Processing node 68d3e944cd36afa834e13286: ltp-syscalls-ipc 2025-09-26 12:51:34,923 - lava_callback - ERROR - Error processing callback for node 68d3e944cd36afa834e13286: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:51:34,974 - lava_callback - INFO - Received callback for node 68d3f6c7cd36afa834e149bb INFO: 172.20.0.1:54346 - "POST /node/68d3f6c7cd36afa834e149bb HTTP/1.0" 202 Accepted 2025-09-26 12:51:34,980 - lava_callback - INFO - Starting async job submit for node 68d3f6c7cd36afa834e149bb 2025-09-26 12:51:35,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:51:35,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f6c7cd36afa834e149bb HTTP/1.1" 200 None 2025-09-26 12:51:35,033 - lava_callback - DEBUG - Processing node 68d3f6c7cd36afa834e149bb: baseline-arm64 2025-09-26 12:51:35,327 - lava_callback - ERROR - Error processing callback for node 68d3f6c7cd36afa834e149bb: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:54362 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:51:43,925 - lava_callback - INFO - Received callback for node 68d3f6c9cd36afa834e149be INFO: 172.20.0.1:41672 - "POST /node/68d3f6c9cd36afa834e149be HTTP/1.0" 202 Accepted 2025-09-26 12:51:43,931 - lava_callback - INFO - Starting async job submit for node 68d3f6c9cd36afa834e149be 2025-09-26 12:51:43,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:51:43,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f6c9cd36afa834e149be HTTP/1.1" 200 None 2025-09-26 12:51:43,964 - lava_callback - DEBUG - Processing node 68d3f6c9cd36afa834e149be: baseline-arm64 2025-09-26 12:51:44,259 - lava_callback - ERROR - Error processing callback for node 68d3f6c9cd36afa834e149be: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:41674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41686 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:51:52,967 - lava_callback - INFO - Received callback for node 68d3e72fcd36afa834e12d70 INFO: 172.20.0.1:58818 - "POST /node/68d3e72fcd36afa834e12d70 HTTP/1.0" 202 Accepted 2025-09-26 12:51:52,974 - lava_callback - INFO - Starting async job submit for node 68d3e72fcd36afa834e12d70 2025-09-26 12:51:53,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:51:53,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e72fcd36afa834e12d70 HTTP/1.1" 200 None 2025-09-26 12:51:53,025 - lava_callback - DEBUG - Processing node 68d3e72fcd36afa834e12d70: ltp-pty 2025-09-26 12:51:53,395 - lava_callback - ERROR - Error processing callback for node 68d3e72fcd36afa834e12d70: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:51:53,434 - lava_callback - INFO - Received callback for node 68d688a22f83206171a9154f INFO: 172.20.0.1:58832 - "POST /node/68d688a22f83206171a9154f HTTP/1.0" 202 Accepted 2025-09-26 12:51:53,439 - lava_callback - INFO - Starting async job submit for node 68d688a22f83206171a9154f 2025-09-26 12:51:53,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:51:53,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688a22f83206171a9154f HTTP/1.1" 200 None 2025-09-26 12:51:53,473 - lava_callback - DEBUG - Processing node 68d688a22f83206171a9154f: baseline-arm 2025-09-26 12:51:53,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:51:53,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:51:53,885 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d688a22f83206171a9154f/log.txt.gz 2025-09-26 12:51:53,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:51:54,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:51:54,054 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d688a22f83206171a9154f/lava_callback.json.gz 2025-09-26 12:51:54,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:51:54,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688a22f83206171a9154f HTTP/1.1" 200 None 2025-09-26 12:51:54,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:51:54,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7b30c58dac7d9410c2 HTTP/1.1" 200 None 2025-09-26 12:51:54,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:51:54,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688a22f83206171a9154f HTTP/1.1" 200 None 2025-09-26 12:51:54,136 - lava_callback - INFO - Completed processing callback for node 68d688a22f83206171a9154f INFO: 172.20.0.1:58846 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:52:00,784 - lava_callback - INFO - Received callback for node 68d42754a5c2c05277bc73b6 INFO: 172.20.0.1:60352 - "POST /node/68d42754a5c2c05277bc73b6 HTTP/1.0" 202 Accepted 2025-09-26 12:52:00,790 - lava_callback - INFO - Starting async job submit for node 68d42754a5c2c05277bc73b6 2025-09-26 12:52:00,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:52:00,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42754a5c2c05277bc73b6 HTTP/1.1" 200 None 2025-09-26 12:52:00,822 - lava_callback - DEBUG - Processing node 68d42754a5c2c05277bc73b6: baseline-arm 2025-09-26 12:52:01,037 - lava_callback - ERROR - Error processing callback for node 68d42754a5c2c05277bc73b6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:60360 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:52:15,107 - lava_callback - INFO - Received callback for node 68d3e976cd36afa834e132e5 INFO: 172.20.0.1:51376 - "POST /node/68d3e976cd36afa834e132e5 HTTP/1.0" 202 Accepted 2025-09-26 12:52:15,113 - lava_callback - INFO - Starting async job submit for node 68d3e976cd36afa834e132e5 2025-09-26 12:52:15,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:52:15,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e976cd36afa834e132e5 HTTP/1.1" 200 None 2025-09-26 12:52:15,135 - lava_callback - DEBUG - Processing node 68d3e976cd36afa834e132e5: ltp-input 2025-09-26 12:52:15,135 - lava_callback - ERROR - Error processing callback for node 68d3e976cd36afa834e132e5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:51392 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 12:52:15,886 - lava_callback - INFO - Received callback for node 68d3e978cd36afa834e132e8 INFO: 172.20.0.1:51394 - "POST /node/68d3e978cd36afa834e132e8 HTTP/1.0" 202 Accepted 2025-09-26 12:52:15,892 - lava_callback - INFO - Starting async job submit for node 68d3e978cd36afa834e132e8 2025-09-26 12:52:15,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:52:15,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e978cd36afa834e132e8 HTTP/1.1" 200 None 2025-09-26 12:52:15,905 - lava_callback - DEBUG - Processing node 68d3e978cd36afa834e132e8: ltp-timers 2025-09-26 12:52:15,906 - lava_callback - ERROR - Error processing callback for node 68d3e978cd36afa834e132e8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:51402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52204 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:52:26,217 - lava_callback - INFO - Received callback for node 68d68a0e2f83206171a9182a INFO: 172.20.0.1:52214 - "POST /node/68d68a0e2f83206171a9182a HTTP/1.0" 202 Accepted 2025-09-26 12:52:26,223 - lava_callback - INFO - Starting async job submit for node 68d68a0e2f83206171a9182a 2025-09-26 12:52:26,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:52:26,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a0e2f83206171a9182a HTTP/1.1" 200 None 2025-09-26 12:52:26,259 - lava_callback - DEBUG - Processing node 68d68a0e2f83206171a9182a: baseline-arm64-broonie INFO: 172.20.0.1:52222 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:52:26,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:52:26,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:52:26,661 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d68a0e2f83206171a9182a/log.txt.gz 2025-09-26 12:52:26,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:52:26,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:52:26,807 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d68a0e2f83206171a9182a/lava_callback.json.gz 2025-09-26 12:52:26,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:52:26,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a0e2f83206171a9182a HTTP/1.1" 200 None 2025-09-26 12:52:26,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:52:26,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:52:26,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:52:26,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68a0e2f83206171a9182a HTTP/1.1" 200 None 2025-09-26 12:52:26,914 - lava_callback - INFO - Completed processing callback for node 68d68a0e2f83206171a9182a 2025-09-26 12:52:32,514 - lava_callback - INFO - Received callback for node 68d3f6d4cd36afa834e149c4 INFO: 172.20.0.1:60858 - "POST /node/68d3f6d4cd36afa834e149c4 HTTP/1.0" 202 Accepted 2025-09-26 12:52:32,520 - lava_callback - INFO - Starting async job submit for node 68d3f6d4cd36afa834e149c4 2025-09-26 12:52:32,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:52:32,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f6d4cd36afa834e149c4 HTTP/1.1" 200 None 2025-09-26 12:52:32,552 - lava_callback - DEBUG - Processing node 68d3f6d4cd36afa834e149c4: baseline-arm64 2025-09-26 12:52:32,839 - lava_callback - ERROR - Error processing callback for node 68d3f6d4cd36afa834e149c4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:60860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48896 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:52:49,547 - lava_callback - INFO - Received callback for node 68d689bb2f83206171a91789 INFO: 172.20.0.1:48912 - "POST /node/68d689bb2f83206171a91789 HTTP/1.0" 202 Accepted 2025-09-26 12:52:49,554 - lava_callback - INFO - Starting async job submit for node 68d689bb2f83206171a91789 2025-09-26 12:52:49,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:52:49,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689bb2f83206171a91789 HTTP/1.1" 200 None 2025-09-26 12:52:49,613 - lava_callback - DEBUG - Processing node 68d689bb2f83206171a91789: baseline-arm64 2025-09-26 12:52:50,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:52:50,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:52:50,316 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689bb2f83206171a91789/log.txt.gz 2025-09-26 12:52:50,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:52:50,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:52:50,440 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689bb2f83206171a91789/lava_callback.json.gz DEBUG: 68d689bb2f83206171a91789 Transitting job node result: pass -> incomplete 2025-09-26 12:52:50,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:52:50,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689bb2f83206171a91789 HTTP/1.1" 200 None 2025-09-26 12:52:50,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:52:50,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:52:50,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:52:50,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689bb2f83206171a91789 HTTP/1.1" 200 None 2025-09-26 12:52:50,529 - lava_callback - INFO - Completed processing callback for node 68d689bb2f83206171a91789 2025-09-26 12:52:52,278 - lava_callback - INFO - Received callback for node 68d3f6d4cd36afa834e149cb INFO: 172.20.0.1:48914 - "POST /node/68d3f6d4cd36afa834e149cb HTTP/1.0" 202 Accepted 2025-09-26 12:52:52,287 - lava_callback - INFO - Starting async job submit for node 68d3f6d4cd36afa834e149cb 2025-09-26 12:52:52,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:52:52,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f6d4cd36afa834e149cb HTTP/1.1" 200 None 2025-09-26 12:52:52,343 - lava_callback - DEBUG - Processing node 68d3f6d4cd36afa834e149cb: baseline-arm64 2025-09-26 12:52:52,710 - lava_callback - ERROR - Error processing callback for node 68d3f6d4cd36afa834e149cb: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:48930 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:52:59,309 - lava_callback - INFO - Received callback for node 68d3f6dfcd36afa834e149d4 INFO: 172.20.0.1:57674 - "POST /node/68d3f6dfcd36afa834e149d4 HTTP/1.0" 202 Accepted 2025-09-26 12:52:59,315 - lava_callback - INFO - Starting async job submit for node 68d3f6dfcd36afa834e149d4 2025-09-26 12:52:59,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:52:59,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f6dfcd36afa834e149d4 HTTP/1.1" 200 None 2025-09-26 12:52:59,347 - lava_callback - DEBUG - Processing node 68d3f6dfcd36afa834e149d4: baseline-arm64 2025-09-26 12:52:59,651 - lava_callback - ERROR - Error processing callback for node 68d3f6dfcd36afa834e149d4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:57684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57504 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:53:35,059 - lava_callback - INFO - Received callback for node 68d3e9becd36afa834e13353 INFO: 172.20.0.1:50158 - "POST /node/68d3e9becd36afa834e13353 HTTP/1.0" 202 Accepted 2025-09-26 12:53:35,065 - lava_callback - INFO - Starting async job submit for node 68d3e9becd36afa834e13353 2025-09-26 12:53:35,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:53:35,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e9becd36afa834e13353 HTTP/1.1" 200 None 2025-09-26 12:53:35,079 - lava_callback - DEBUG - Processing node 68d3e9becd36afa834e13353: ltp-pty 2025-09-26 12:53:35,079 - lava_callback - ERROR - Error processing callback for node 68d3e9becd36afa834e13353: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 12:53:35,840 - lava_callback - INFO - Received callback for node 68d3e9cbcd36afa834e13365 INFO: 172.20.0.1:50160 - "POST /node/68d3e9cbcd36afa834e13365 HTTP/1.0" 202 Accepted 2025-09-26 12:53:35,846 - lava_callback - INFO - Starting async job submit for node 68d3e9cbcd36afa834e13365 2025-09-26 12:53:35,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:53:35,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e9cbcd36afa834e13365 HTTP/1.1" 200 None 2025-09-26 12:53:35,882 - lava_callback - DEBUG - Processing node 68d3e9cbcd36afa834e13365: ltp-timers 2025-09-26 12:53:35,882 - lava_callback - ERROR - Error processing callback for node 68d3e9cbcd36afa834e13365: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:50170 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:53:38,171 - lava_callback - INFO - Received callback for node 68d68a022f83206171a9180e INFO: 172.20.0.1:50174 - "POST /node/68d68a022f83206171a9180e HTTP/1.0" 202 Accepted 2025-09-26 12:53:38,177 - lava_callback - INFO - Starting async job submit for node 68d68a022f83206171a9180e 2025-09-26 12:53:38,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:53:38,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a022f83206171a9180e HTTP/1.1" 200 None 2025-09-26 12:53:38,210 - lava_callback - DEBUG - Processing node 68d68a022f83206171a9180e: baseline-arm64-broonie 2025-09-26 12:53:38,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:53:38,551 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:53:38,552 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d68a022f83206171a9180e/log.txt.gz 2025-09-26 12:53:38,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:53:38,689 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:53:38,690 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d68a022f83206171a9180e/lava_callback.json.gz 2025-09-26 12:53:38,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:53:38,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a022f83206171a9180e HTTP/1.1" 200 None 2025-09-26 12:53:38,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:53:38,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:53:38,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:53:38,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68a022f83206171a9180e HTTP/1.1" 200 None 2025-09-26 12:53:38,785 - lava_callback - INFO - Completed processing callback for node 68d68a022f83206171a9180e INFO: 172.20.0.1:43748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42736 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:53:56,553 - lava_callback - INFO - Received callback for node 68d3f6dfcd36afa834e149d7 INFO: 172.20.0.1:42748 - "POST /node/68d3f6dfcd36afa834e149d7 HTTP/1.0" 202 Accepted 2025-09-26 12:53:56,559 - lava_callback - INFO - Starting async job submit for node 68d3f6dfcd36afa834e149d7 2025-09-26 12:53:56,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:53:56,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f6dfcd36afa834e149d7 HTTP/1.1" 200 None 2025-09-26 12:53:56,613 - lava_callback - DEBUG - Processing node 68d3f6dfcd36afa834e149d7: baseline-arm64 2025-09-26 12:53:56,901 - lava_callback - ERROR - Error processing callback for node 68d3f6dfcd36afa834e149d7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:38150 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:54:12,328 - lava_callback - INFO - Received callback for node 68d3f6efcd36afa834e14a15 INFO: 172.20.0.1:54096 - "POST /node/68d3f6efcd36afa834e14a15 HTTP/1.0" 202 Accepted 2025-09-26 12:54:12,335 - lava_callback - INFO - Starting async job submit for node 68d3f6efcd36afa834e14a15 2025-09-26 12:54:12,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:54:12,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f6efcd36afa834e14a15 HTTP/1.1" 200 None 2025-09-26 12:54:12,369 - lava_callback - DEBUG - Processing node 68d3f6efcd36afa834e14a15: baseline-arm64 2025-09-26 12:54:12,709 - lava_callback - ERROR - Error processing callback for node 68d3f6efcd36afa834e14a15: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:54110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54122 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:54:19,567 - lava_callback - INFO - Received callback for node 68d42757a5c2c05277bc73b9 INFO: 172.20.0.1:37462 - "POST /node/68d42757a5c2c05277bc73b9 HTTP/1.0" 202 Accepted 2025-09-26 12:54:19,573 - lava_callback - INFO - Starting async job submit for node 68d42757a5c2c05277bc73b9 2025-09-26 12:54:19,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:54:19,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42757a5c2c05277bc73b9 HTTP/1.1" 200 None 2025-09-26 12:54:19,605 - lava_callback - DEBUG - Processing node 68d42757a5c2c05277bc73b9: baseline-arm 2025-09-26 12:54:19,831 - lava_callback - ERROR - Error processing callback for node 68d42757a5c2c05277bc73b9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:54:22,310 - lava_callback - INFO - Received callback for node 68d3f6f0cd36afa834e14a18 INFO: 172.20.0.1:37472 - "POST /node/68d3f6f0cd36afa834e14a18 HTTP/1.0" 202 Accepted 2025-09-26 12:54:22,316 - lava_callback - INFO - Starting async job submit for node 68d3f6f0cd36afa834e14a18 2025-09-26 12:54:22,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:54:22,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f6f0cd36afa834e14a18 HTTP/1.1" 200 None 2025-09-26 12:54:22,387 - lava_callback - DEBUG - Processing node 68d3f6f0cd36afa834e14a18: baseline-arm64 2025-09-26 12:54:22,811 - lava_callback - ERROR - Error processing callback for node 68d3f6f0cd36afa834e14a18: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:37486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37488 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:54:30,948 - lava_callback - INFO - Received callback for node 68d689b02f83206171a91760 INFO: 172.20.0.1:38190 - "POST /node/68d689b02f83206171a91760 HTTP/1.0" 202 Accepted 2025-09-26 12:54:30,955 - lava_callback - INFO - Starting async job submit for node 68d689b02f83206171a91760 2025-09-26 12:54:30,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:54:31,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689b02f83206171a91760 HTTP/1.1" 200 None 2025-09-26 12:54:31,005 - lava_callback - DEBUG - Processing node 68d689b02f83206171a91760: baseline-arm64 2025-09-26 12:54:31,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:54:32,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:54:32,098 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689b02f83206171a91760/log.txt.gz 2025-09-26 12:54:32,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:54:32,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:54:32,303 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689b02f83206171a91760/lava_callback.json.gz DEBUG: Setup failed for 68d689b02f83206171a91760. Transitting job node result: incomplete -> fail 2025-09-26 12:54:32,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:54:32,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689b02f83206171a91760 HTTP/1.1" 200 None 2025-09-26 12:54:32,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:54:32,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:54:32,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:54:32,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689b02f83206171a91760 HTTP/1.1" 200 None 2025-09-26 12:54:32,437 - lava_callback - INFO - Completed processing callback for node 68d689b02f83206171a91760 INFO: 172.20.0.1:38204 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:54:44,193 - lava_callback - INFO - Received callback for node 68d689b12f83206171a91763 INFO: 172.20.0.1:36064 - "POST /node/68d689b12f83206171a91763 HTTP/1.0" 202 Accepted 2025-09-26 12:54:44,201 - lava_callback - INFO - Starting async job submit for node 68d689b12f83206171a91763 2025-09-26 12:54:44,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:54:44,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689b12f83206171a91763 HTTP/1.1" 200 None 2025-09-26 12:54:44,253 - lava_callback - DEBUG - Processing node 68d689b12f83206171a91763: baseline-arm64 2025-09-26 12:54:45,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:54:45,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:54:45,327 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689b12f83206171a91763/log.txt.gz 2025-09-26 12:54:45,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:54:45,508 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:54:45,509 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689b12f83206171a91763/lava_callback.json.gz DEBUG: Setup failed for 68d689b12f83206171a91763. Transitting job node result: incomplete -> fail 2025-09-26 12:54:45,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:54:45,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689b12f83206171a91763 HTTP/1.1" 200 None 2025-09-26 12:54:45,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:54:45,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:54:45,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:54:45,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689b12f83206171a91763 HTTP/1.1" 200 None 2025-09-26 12:54:45,670 - lava_callback - INFO - Completed processing callback for node 68d689b12f83206171a91763 INFO: 172.20.0.1:36076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44544 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:55:06,354 - lava_callback - INFO - Received callback for node 68d68ca32f83206171a91953 INFO: 172.20.0.1:55986 - "POST /node/68d68ca32f83206171a91953 HTTP/1.0" 202 Accepted 2025-09-26 12:55:06,360 - lava_callback - INFO - Starting async job submit for node 68d68ca32f83206171a91953 2025-09-26 12:55:06,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:55:06,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68ca32f83206171a91953 HTTP/1.1" 200 None 2025-09-26 12:55:06,392 - lava_callback - DEBUG - Processing node 68d68ca32f83206171a91953: baseline-arm64 INFO: 172.20.0.1:55996 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:55:06,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:55:06,878 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:55:06,879 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68ca32f83206171a91953/log.txt.gz 2025-09-26 12:55:06,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:55:07,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:55:07,017 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68ca32f83206171a91953/lava_callback.json.gz 2025-09-26 12:55:07,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:55:07,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68ca32f83206171a91953 HTTP/1.1" 200 None 2025-09-26 12:55:07,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:55:07,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:55:07,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:55:07,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68ca32f83206171a91953 HTTP/1.1" 200 None 2025-09-26 12:55:07,090 - lava_callback - INFO - Completed processing callback for node 68d68ca32f83206171a91953 INFO: 172.20.0.1:52968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52976 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:55:20,126 - lava_callback - INFO - Received callback for node 68d3f703cd36afa834e14a2a INFO: 172.20.0.1:45964 - "POST /node/68d3f703cd36afa834e14a2a HTTP/1.0" 202 Accepted 2025-09-26 12:55:20,132 - lava_callback - INFO - Starting async job submit for node 68d3f703cd36afa834e14a2a 2025-09-26 12:55:20,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:55:20,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f703cd36afa834e14a2a HTTP/1.1" 200 None 2025-09-26 12:55:20,165 - lava_callback - DEBUG - Processing node 68d3f703cd36afa834e14a2a: baseline-arm64 2025-09-26 12:55:20,459 - lava_callback - ERROR - Error processing callback for node 68d3f703cd36afa834e14a2a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:45968 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:55:25,695 - lava_callback - INFO - Received callback for node 68d689cf2f83206171a917bd INFO: 172.20.0.1:45982 - "POST /node/68d689cf2f83206171a917bd HTTP/1.0" 202 Accepted 2025-09-26 12:55:25,703 - lava_callback - INFO - Starting async job submit for node 68d689cf2f83206171a917bd 2025-09-26 12:55:25,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:55:25,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689cf2f83206171a917bd HTTP/1.1" 200 None 2025-09-26 12:55:25,753 - lava_callback - DEBUG - Processing node 68d689cf2f83206171a917bd: baseline-arm64 INFO: 172.20.0.1:45994 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:55:26,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:55:26,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:55:26,996 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689cf2f83206171a917bd/log.txt.gz 2025-09-26 12:55:27,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 12:55:27,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 12:55:27,184 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689cf2f83206171a917bd/lava_callback.json.gz DEBUG: Setup failed for 68d689cf2f83206171a917bd. Transitting job node result: incomplete -> fail 2025-09-26 12:55:27,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:55:27,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689cf2f83206171a917bd HTTP/1.1" 200 None 2025-09-26 12:55:27,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:55:27,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 12:55:27,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:55:27,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689cf2f83206171a917bd HTTP/1.1" 200 None 2025-09-26 12:55:27,332 - lava_callback - INFO - Completed processing callback for node 68d689cf2f83206171a917bd 2025-09-26 12:55:32,260 - lava_callback - INFO - Received callback for node 68d3f704cd36afa834e14a2d INFO: 172.20.0.1:37052 - "POST /node/68d3f704cd36afa834e14a2d HTTP/1.0" 202 Accepted 2025-09-26 12:55:32,266 - lava_callback - INFO - Starting async job submit for node 68d3f704cd36afa834e14a2d 2025-09-26 12:55:32,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:55:32,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f704cd36afa834e14a2d HTTP/1.1" 200 None 2025-09-26 12:55:32,305 - lava_callback - DEBUG - Processing node 68d3f704cd36afa834e14a2d: baseline-arm64 2025-09-26 12:55:32,597 - lava_callback - ERROR - Error processing callback for node 68d3f704cd36afa834e14a2d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:37056 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:55:40,792 - lava_callback - INFO - Received callback for node 68d3f70ccd36afa834e14a33 INFO: 172.20.0.1:43604 - "POST /node/68d3f70ccd36afa834e14a33 HTTP/1.0" 202 Accepted 2025-09-26 12:55:40,799 - lava_callback - INFO - Starting async job submit for node 68d3f70ccd36afa834e14a33 2025-09-26 12:55:40,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:55:40,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f70ccd36afa834e14a33 HTTP/1.1" 200 None 2025-09-26 12:55:40,861 - lava_callback - DEBUG - Processing node 68d3f70ccd36afa834e14a33: baseline-arm64 2025-09-26 12:55:41,154 - lava_callback - ERROR - Error processing callback for node 68d3f70ccd36afa834e14a33: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:43612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47698 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:56:12,979 - lava_callback - INFO - Received callback for node 68d3e964cd36afa834e132a7 INFO: 172.20.0.1:51452 - "POST /node/68d3e964cd36afa834e132a7 HTTP/1.0" 202 Accepted 2025-09-26 12:56:12,989 - lava_callback - INFO - Starting async job submit for node 68d3e964cd36afa834e132a7 2025-09-26 12:56:13,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:56:13,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e964cd36afa834e132a7 HTTP/1.1" 200 None 2025-09-26 12:56:13,037 - lava_callback - DEBUG - Processing node 68d3e964cd36afa834e132a7: ltp-watchqueue 2025-09-26 12:56:13,454 - lava_callback - ERROR - Error processing callback for node 68d3e964cd36afa834e132a7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:51454 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 12:56:15,348 - lava_callback - INFO - Received callback for node 68d3ea5ccd36afa834e13447 INFO: 172.20.0.1:51466 - "POST /node/68d3ea5ccd36afa834e13447 HTTP/1.0" 202 Accepted 2025-09-26 12:56:15,354 - lava_callback - INFO - Starting async job submit for node 68d3ea5ccd36afa834e13447 2025-09-26 12:56:15,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:56:15,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ea5ccd36afa834e13447 HTTP/1.1" 200 None 2025-09-26 12:56:15,367 - lava_callback - DEBUG - Processing node 68d3ea5ccd36afa834e13447: ltp-ipc 2025-09-26 12:56:15,367 - lava_callback - ERROR - Error processing callback for node 68d3ea5ccd36afa834e13447: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:51472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44428 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:56:40,858 - lava_callback - INFO - Received callback for node 68d42758a5c2c05277bc73bc INFO: 172.20.0.1:36874 - "POST /node/68d42758a5c2c05277bc73bc HTTP/1.0" 202 Accepted 2025-09-26 12:56:40,864 - lava_callback - INFO - Starting async job submit for node 68d42758a5c2c05277bc73bc 2025-09-26 12:56:40,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:56:40,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42758a5c2c05277bc73bc HTTP/1.1" 200 None 2025-09-26 12:56:40,897 - lava_callback - DEBUG - Processing node 68d42758a5c2c05277bc73bc: baseline-arm 2025-09-26 12:56:41,116 - lava_callback - ERROR - Error processing callback for node 68d42758a5c2c05277bc73bc: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:36882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48956 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:56:59,229 - lava_callback - INFO - Received callback for node 68d3f71ccd36afa834e14a42 INFO: 172.20.0.1:48964 - "POST /node/68d3f71ccd36afa834e14a42 HTTP/1.0" 202 Accepted 2025-09-26 12:56:59,235 - lava_callback - INFO - Starting async job submit for node 68d3f71ccd36afa834e14a42 2025-09-26 12:56:59,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:56:59,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f71ccd36afa834e14a42 HTTP/1.1" 200 None 2025-09-26 12:56:59,268 - lava_callback - DEBUG - Processing node 68d3f71ccd36afa834e14a42: baseline-arm64 2025-09-26 12:56:59,579 - lava_callback - ERROR - Error processing callback for node 68d3f71ccd36afa834e14a42: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:57:01,718 - lava_callback - INFO - Received callback for node 68d3f70fcd36afa834e14a36 INFO: 172.20.0.1:38940 - "POST /node/68d3f70fcd36afa834e14a36 HTTP/1.0" 202 Accepted 2025-09-26 12:57:01,724 - lava_callback - INFO - Starting async job submit for node 68d3f70fcd36afa834e14a36 2025-09-26 12:57:01,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:57:01,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f70fcd36afa834e14a36 HTTP/1.1" 200 None 2025-09-26 12:57:01,756 - lava_callback - DEBUG - Processing node 68d3f70fcd36afa834e14a36: baseline-arm64 2025-09-26 12:57:02,052 - lava_callback - ERROR - Error processing callback for node 68d3f70fcd36afa834e14a36: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:57:03,279 - lava_callback - INFO - Received callback for node 68d3f71bcd36afa834e14a3f INFO: 172.20.0.1:38950 - "POST /node/68d3f71bcd36afa834e14a3f HTTP/1.0" 202 Accepted 2025-09-26 12:57:03,285 - lava_callback - INFO - Starting async job submit for node 68d3f71bcd36afa834e14a3f 2025-09-26 12:57:03,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:57:03,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f71bcd36afa834e14a3f HTTP/1.1" 200 None 2025-09-26 12:57:03,338 - lava_callback - DEBUG - Processing node 68d3f71bcd36afa834e14a3f: baseline-arm64 2025-09-26 12:57:03,631 - lava_callback - ERROR - Error processing callback for node 68d3f71bcd36afa834e14a3f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:38952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50630 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 12:57:15,350 - lava_callback - INFO - Received callback for node 68d3ea96cd36afa834e134ae INFO: 172.20.0.1:50634 - "POST /node/68d3ea96cd36afa834e134ae HTTP/1.0" 202 Accepted 2025-09-26 12:57:15,356 - lava_callback - INFO - Starting async job submit for node 68d3ea96cd36afa834e134ae 2025-09-26 12:57:15,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:57:15,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ea96cd36afa834e134ae HTTP/1.1" 200 None 2025-09-26 12:57:15,370 - lava_callback - DEBUG - Processing node 68d3ea96cd36afa834e134ae: ltp-sched 2025-09-26 12:57:15,370 - lava_callback - ERROR - Error processing callback for node 68d3ea96cd36afa834e134ae: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:50642 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:57:21,121 - lava_callback - INFO - Received callback for node 68d3e860cd36afa834e13107 INFO: 172.20.0.1:47712 - "POST /node/68d3e860cd36afa834e13107 HTTP/1.0" 202 Accepted 2025-09-26 12:57:21,127 - lava_callback - INFO - Starting async job submit for node 68d3e860cd36afa834e13107 2025-09-26 12:57:21,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:57:21,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e860cd36afa834e13107 HTTP/1.1" 200 None 2025-09-26 12:57:21,184 - lava_callback - DEBUG - Processing node 68d3e860cd36afa834e13107: ltp-pty 2025-09-26 12:57:21,566 - lava_callback - ERROR - Error processing callback for node 68d3e860cd36afa834e13107: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:47728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54506 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:58:13,382 - lava_callback - INFO - Received callback for node 68d3ea1dcd36afa834e133de INFO: 172.20.0.1:46934 - "POST /node/68d3ea1dcd36afa834e133de HTTP/1.0" 202 Accepted 2025-09-26 12:58:13,389 - lava_callback - INFO - Starting async job submit for node 68d3ea1dcd36afa834e133de 2025-09-26 12:58:13,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:58:13,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ea1dcd36afa834e133de HTTP/1.1" 200 None 2025-09-26 12:58:13,431 - lava_callback - DEBUG - Processing node 68d3ea1dcd36afa834e133de: ltp-ipc 2025-09-26 12:58:13,782 - lava_callback - ERROR - Error processing callback for node 68d3ea1dcd36afa834e133de: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:46940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46950 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:58:22,192 - lava_callback - INFO - Received callback for node 68d3f72ecd36afa834e14a80 INFO: 172.20.0.1:44812 - "POST /node/68d3f72ecd36afa834e14a80 HTTP/1.0" 202 Accepted 2025-09-26 12:58:22,198 - lava_callback - INFO - Starting async job submit for node 68d3f72ecd36afa834e14a80 2025-09-26 12:58:22,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:58:22,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f72ecd36afa834e14a80 HTTP/1.1" 200 None 2025-09-26 12:58:22,231 - lava_callback - DEBUG - Processing node 68d3f72ecd36afa834e14a80: baseline-arm64 2025-09-26 12:58:22,538 - lava_callback - ERROR - Error processing callback for node 68d3f72ecd36afa834e14a80: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:44820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44330 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:58:36,742 - lava_callback - INFO - Received callback for node 68d3f747cd36afa834e14a96 INFO: 172.20.0.1:44336 - "POST /node/68d3f747cd36afa834e14a96 HTTP/1.0" 202 Accepted 2025-09-26 12:58:36,749 - lava_callback - INFO - Starting async job submit for node 68d3f747cd36afa834e14a96 2025-09-26 12:58:36,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:58:36,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f747cd36afa834e14a96 HTTP/1.1" 200 None 2025-09-26 12:58:36,798 - lava_callback - DEBUG - Processing node 68d3f747cd36afa834e14a96: baseline-arm64 2025-09-26 12:58:37,098 - lava_callback - ERROR - Error processing callback for node 68d3f747cd36afa834e14a96: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 12:58:38,093 - lava_callback - INFO - Received callback for node 68d3f72bcd36afa834e14a70 INFO: 172.20.0.1:44346 - "POST /node/68d3f72bcd36afa834e14a70 HTTP/1.0" 202 Accepted 2025-09-26 12:58:38,099 - lava_callback - INFO - Starting async job submit for node 68d3f72bcd36afa834e14a70 2025-09-26 12:58:38,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:58:38,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f72bcd36afa834e14a70 HTTP/1.1" 200 None 2025-09-26 12:58:38,133 - lava_callback - DEBUG - Processing node 68d3f72bcd36afa834e14a70: baseline-arm64 2025-09-26 12:58:38,457 - lava_callback - ERROR - Error processing callback for node 68d3f72bcd36afa834e14a70: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:41602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58998 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:59:02,122 - lava_callback - INFO - Received callback for node 68d427f4a5c2c05277bc74d3 INFO: 172.20.0.1:49496 - "POST /node/68d427f4a5c2c05277bc74d3 HTTP/1.0" 202 Accepted 2025-09-26 12:59:02,127 - lava_callback - INFO - Starting async job submit for node 68d427f4a5c2c05277bc74d3 2025-09-26 12:59:02,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:59:02,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d427f4a5c2c05277bc74d3 HTTP/1.1" 200 None 2025-09-26 12:59:02,162 - lava_callback - DEBUG - Processing node 68d427f4a5c2c05277bc74d3: baseline-arm 2025-09-26 12:59:02,380 - lava_callback - ERROR - Error processing callback for node 68d427f4a5c2c05277bc74d3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:49500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45934 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:59:39,589 - lava_callback - INFO - Received callback for node 68d3f74acd36afa834e14a99 INFO: 172.20.0.1:49400 - "POST /node/68d3f74acd36afa834e14a99 HTTP/1.0" 202 Accepted 2025-09-26 12:59:39,594 - lava_callback - INFO - Starting async job submit for node 68d3f74acd36afa834e14a99 2025-09-26 12:59:39,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:59:39,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f74acd36afa834e14a99 HTTP/1.1" 200 None 2025-09-26 12:59:39,627 - lava_callback - DEBUG - Processing node 68d3f74acd36afa834e14a99: baseline-arm64 2025-09-26 12:59:39,916 - lava_callback - ERROR - Error processing callback for node 68d3f74acd36afa834e14a99: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:49406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38106 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:59:56,063 - lava_callback - INFO - Received callback for node 68d3f752cd36afa834e14a9f INFO: 172.20.0.1:38110 - "POST /node/68d3f752cd36afa834e14a9f HTTP/1.0" 202 Accepted 2025-09-26 12:59:56,069 - lava_callback - INFO - Starting async job submit for node 68d3f752cd36afa834e14a9f 2025-09-26 12:59:56,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:59:56,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f752cd36afa834e14a9f HTTP/1.1" 200 None 2025-09-26 12:59:56,112 - lava_callback - DEBUG - Processing node 68d3f752cd36afa834e14a9f: baseline-arm64 2025-09-26 12:59:56,423 - lava_callback - ERROR - Error processing callback for node 68d3f752cd36afa834e14a9f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:38126 - "GET / HTTP/1.0" 200 OK 2025-09-26 12:59:57,417 - lava_callback - INFO - Received callback for node 68d3f753cd36afa834e14aa2 INFO: 172.20.0.1:38136 - "POST /node/68d3f753cd36afa834e14aa2 HTTP/1.0" 202 Accepted 2025-09-26 12:59:57,423 - lava_callback - INFO - Starting async job submit for node 68d3f753cd36afa834e14aa2 2025-09-26 12:59:57,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 12:59:57,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f753cd36afa834e14aa2 HTTP/1.1" 200 None 2025-09-26 12:59:57,457 - lava_callback - DEBUG - Processing node 68d3f753cd36afa834e14aa2: baseline-arm64 2025-09-26 12:59:57,795 - lava_callback - ERROR - Error processing callback for node 68d3f753cd36afa834e14aa2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:33394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57650 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:00:54,805 - lava_callback - INFO - Received callback for node 68d689b72f83206171a9177c INFO: 172.20.0.1:57656 - "POST /node/68d689b72f83206171a9177c HTTP/1.0" 202 Accepted 2025-09-26 13:00:54,812 - lava_callback - INFO - Starting async job submit for node 68d689b72f83206171a9177c 2025-09-26 13:00:54,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:00:54,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689b72f83206171a9177c HTTP/1.1" 200 None 2025-09-26 13:00:54,865 - lava_callback - DEBUG - Processing node 68d689b72f83206171a9177c: baseline-arm64 2025-09-26 13:00:55,532 - lava_callback - INFO - Received callback for node 68d3eb81cd36afa834e1362a INFO: 172.20.0.1:57662 - "POST /node/68d3eb81cd36afa834e1362a HTTP/1.0" 202 Accepted 2025-09-26 13:00:55,558 - lava_callback - INFO - Starting async job submit for node 68d3eb81cd36afa834e1362a 2025-09-26 13:00:55,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:00:55,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eb81cd36afa834e1362a HTTP/1.1" 200 None 2025-09-26 13:00:55,650 - lava_callback - DEBUG - Processing node 68d3eb81cd36afa834e1362a: ltp-watchqueue 2025-09-26 13:00:55,651 - lava_callback - ERROR - Error processing callback for node 68d3eb81cd36afa834e1362a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 13:00:55,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:00:56,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:00:56,095 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689b72f83206171a9177c/log.txt.gz 2025-09-26 13:00:56,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:00:56,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:00:56,302 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689b72f83206171a9177c/lava_callback.json.gz DEBUG: Setup failed for 68d689b72f83206171a9177c. Transitting job node result: incomplete -> fail 2025-09-26 13:00:56,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:00:56,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689b72f83206171a9177c HTTP/1.1" 200 None 2025-09-26 13:00:56,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:00:56,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:00:56,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:00:56,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689b72f83206171a9177c HTTP/1.1" 200 None 2025-09-26 13:00:56,444 - lava_callback - INFO - Completed processing callback for node 68d689b72f83206171a9177c INFO: 172.20.0.1:57672 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:00:58,623 - lava_callback - INFO - Received callback for node 68d3f77dcd36afa834e14af7 INFO: 172.20.0.1:57682 - "POST /node/68d3f77dcd36afa834e14af7 HTTP/1.0" 202 Accepted 2025-09-26 13:00:58,629 - lava_callback - INFO - Starting async job submit for node 68d3f77dcd36afa834e14af7 2025-09-26 13:00:58,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:00:58,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f77dcd36afa834e14af7 HTTP/1.1" 200 None 2025-09-26 13:00:58,709 - lava_callback - DEBUG - Processing node 68d3f77dcd36afa834e14af7: baseline-arm64 2025-09-26 13:00:59,111 - lava_callback - ERROR - Error processing callback for node 68d3f77dcd36afa834e14af7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:55164 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:01:08,434 - lava_callback - INFO - Received callback for node 68d689b82f83206171a9177f INFO: 172.20.0.1:55166 - "POST /node/68d689b82f83206171a9177f HTTP/1.0" 202 Accepted 2025-09-26 13:01:08,442 - lava_callback - INFO - Starting async job submit for node 68d689b82f83206171a9177f 2025-09-26 13:01:08,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:01:08,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689b82f83206171a9177f HTTP/1.1" 200 None 2025-09-26 13:01:08,499 - lava_callback - DEBUG - Processing node 68d689b82f83206171a9177f: baseline-arm64 2025-09-26 13:01:09,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:01:09,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:01:09,636 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689b82f83206171a9177f/log.txt.gz 2025-09-26 13:01:09,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:01:09,817 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:01:09,818 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689b82f83206171a9177f/lava_callback.json.gz DEBUG: Setup failed for 68d689b82f83206171a9177f. Transitting job node result: incomplete -> fail 2025-09-26 13:01:09,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:01:09,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689b82f83206171a9177f HTTP/1.1" 200 None 2025-09-26 13:01:09,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:01:09,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:01:09,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:01:09,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689b82f83206171a9177f HTTP/1.1" 200 None 2025-09-26 13:01:09,955 - lava_callback - INFO - Completed processing callback for node 68d689b82f83206171a9177f 2025-09-26 13:01:12,900 - lava_callback - INFO - Received callback for node 68d689d62f83206171a917cd INFO: 172.20.0.1:55276 - "POST /node/68d689d62f83206171a917cd HTTP/1.0" 202 Accepted 2025-09-26 13:01:12,907 - lava_callback - INFO - Starting async job submit for node 68d689d62f83206171a917cd 2025-09-26 13:01:12,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:01:12,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689d62f83206171a917cd HTTP/1.1" 200 None 2025-09-26 13:01:12,963 - lava_callback - DEBUG - Processing node 68d689d62f83206171a917cd: baseline-arm64 2025-09-26 13:01:13,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:01:13,945 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:01:13,946 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689d62f83206171a917cd/log.txt.gz 2025-09-26 13:01:13,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:01:14,079 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:01:14,080 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689d62f83206171a917cd/lava_callback.json.gz DEBUG: Setup failed for 68d689d62f83206171a917cd. Transitting job node result: incomplete -> fail 2025-09-26 13:01:14,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:01:14,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689d62f83206171a917cd HTTP/1.1" 200 None 2025-09-26 13:01:14,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:01:14,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:01:14,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:01:14,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689d62f83206171a917cd HTTP/1.1" 200 None 2025-09-26 13:01:14,206 - lava_callback - INFO - Completed processing callback for node 68d689d62f83206171a917cd INFO: 172.20.0.1:55288 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 13:01:16,263 - lava_callback - INFO - Received callback for node 68d427f5a5c2c05277bc74d6 INFO: 172.20.0.1:55302 - "POST /node/68d427f5a5c2c05277bc74d6 HTTP/1.0" 202 Accepted 2025-09-26 13:01:16,271 - lava_callback - INFO - Starting async job submit for node 68d427f5a5c2c05277bc74d6 2025-09-26 13:01:16,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:01:16,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d427f5a5c2c05277bc74d6 HTTP/1.1" 200 None 2025-09-26 13:01:16,306 - lava_callback - DEBUG - Processing node 68d427f5a5c2c05277bc74d6: baseline-arm INFO: 172.20.0.1:55316 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:01:16,602 - lava_callback - ERROR - Error processing callback for node 68d427f5a5c2c05277bc74d6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:01:17,843 - lava_callback - INFO - Received callback for node 68d3f773cd36afa834e14aee INFO: 172.20.0.1:55320 - "POST /node/68d3f773cd36afa834e14aee HTTP/1.0" 202 Accepted 2025-09-26 13:01:17,849 - lava_callback - INFO - Starting async job submit for node 68d3f773cd36afa834e14aee 2025-09-26 13:01:17,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:01:17,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f773cd36afa834e14aee HTTP/1.1" 200 None 2025-09-26 13:01:17,882 - lava_callback - DEBUG - Processing node 68d3f773cd36afa834e14aee: baseline-arm64 2025-09-26 13:01:18,168 - lava_callback - ERROR - Error processing callback for node 68d3f773cd36afa834e14aee: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:01:19,821 - lava_callback - INFO - Received callback for node 68d3f773cd36afa834e14aeb INFO: 172.20.0.1:48644 - "POST /node/68d3f773cd36afa834e14aeb HTTP/1.0" 202 Accepted 2025-09-26 13:01:19,827 - lava_callback - INFO - Starting async job submit for node 68d3f773cd36afa834e14aeb 2025-09-26 13:01:19,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:01:19,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f773cd36afa834e14aeb HTTP/1.1" 200 None 2025-09-26 13:01:19,867 - lava_callback - DEBUG - Processing node 68d3f773cd36afa834e14aeb: baseline-arm64 2025-09-26 13:01:20,159 - lava_callback - ERROR - Error processing callback for node 68d3f773cd36afa834e14aeb: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:48652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48666 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:01:28,984 - lava_callback - INFO - Received callback for node 68d689ce2f83206171a917b6 INFO: 172.20.0.1:48680 - "POST /node/68d689ce2f83206171a917b6 HTTP/1.0" 202 Accepted 2025-09-26 13:01:28,991 - lava_callback - INFO - Starting async job submit for node 68d689ce2f83206171a917b6 2025-09-26 13:01:29,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:01:29,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689ce2f83206171a917b6 HTTP/1.1" 200 None 2025-09-26 13:01:29,066 - lava_callback - DEBUG - Processing node 68d689ce2f83206171a917b6: baseline-arm64 2025-09-26 13:01:30,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:01:30,286 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:01:30,287 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689ce2f83206171a917b6/log.txt.gz 2025-09-26 13:01:30,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:01:30,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:01:30,473 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689ce2f83206171a917b6/lava_callback.json.gz DEBUG: Setup failed for 68d689ce2f83206171a917b6. Transitting job node result: incomplete -> fail 2025-09-26 13:01:30,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:01:30,556 - lava_callback - INFO - Received callback for node 68d689d52f83206171a917ca INFO: 172.20.0.1:41240 - "POST /node/68d689d52f83206171a917ca HTTP/1.0" 202 Accepted 2025-09-26 13:01:30,564 - lava_callback - INFO - Starting async job submit for node 68d689d52f83206171a917ca 2025-09-26 13:01:30,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689ce2f83206171a917b6 HTTP/1.1" 200 None 2025-09-26 13:01:30,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:01:30,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:01:30,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:01:30,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:01:30,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689d52f83206171a917ca HTTP/1.1" 200 None 2025-09-26 13:01:30,626 - lava_callback - DEBUG - Processing node 68d689d52f83206171a917ca: baseline-arm64 2025-09-26 13:01:30,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689ce2f83206171a917b6 HTTP/1.1" 200 None 2025-09-26 13:01:30,711 - lava_callback - INFO - Completed processing callback for node 68d689ce2f83206171a917b6 2025-09-26 13:01:31,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:01:32,364 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:01:32,364 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689d52f83206171a917ca/log.txt.gz 2025-09-26 13:01:32,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:01:32,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:01:32,856 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d689d52f83206171a917ca/lava_callback.json.gz DEBUG: Setup failed for 68d689d52f83206171a917ca. Transitting job node result: incomplete -> fail 2025-09-26 13:01:32,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:01:32,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689d52f83206171a917ca HTTP/1.1" 200 None 2025-09-26 13:01:32,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:01:32,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:01:32,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:01:33,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689d52f83206171a917ca HTTP/1.1" 200 None 2025-09-26 13:01:33,013 - lava_callback - INFO - Completed processing callback for node 68d689d52f83206171a917ca 2025-09-26 13:01:35,639 - lava_callback - INFO - Received callback for node 68d3eba9cd36afa834e1367c INFO: 172.20.0.1:41254 - "POST /node/68d3eba9cd36afa834e1367c HTTP/1.0" 202 Accepted 2025-09-26 13:01:35,646 - lava_callback - INFO - Starting async job submit for node 68d3eba9cd36afa834e1367c 2025-09-26 13:01:35,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:01:35,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eba9cd36afa834e1367c HTTP/1.1" 200 None 2025-09-26 13:01:35,660 - lava_callback - DEBUG - Processing node 68d3eba9cd36afa834e1367c: ltp-smoketest 2025-09-26 13:01:35,660 - lava_callback - ERROR - Error processing callback for node 68d3eba9cd36afa834e1367c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:41266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54318 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:01:55,662 - lava_callback - INFO - Received callback for node 68d3ebb5cd36afa834e1368b INFO: 172.20.0.1:54334 - "POST /node/68d3ebb5cd36afa834e1368b HTTP/1.0" 202 Accepted 2025-09-26 13:01:55,668 - lava_callback - INFO - Starting async job submit for node 68d3ebb5cd36afa834e1368b 2025-09-26 13:01:55,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:01:55,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ebb5cd36afa834e1368b HTTP/1.1" 200 None 2025-09-26 13:01:55,682 - lava_callback - DEBUG - Processing node 68d3ebb5cd36afa834e1368b: ltp-sched 2025-09-26 13:01:55,682 - lava_callback - ERROR - Error processing callback for node 68d3ebb5cd36afa834e1368b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 13:01:56,509 - lava_callback - INFO - Received callback for node 68d3ebc0cd36afa834e1369e INFO: 172.20.0.1:54348 - "POST /node/68d3ebc0cd36afa834e1369e HTTP/1.0" 202 Accepted 2025-09-26 13:01:56,515 - lava_callback - INFO - Starting async job submit for node 68d3ebc0cd36afa834e1369e 2025-09-26 13:01:56,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:54364 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:01:56,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ebc0cd36afa834e1369e HTTP/1.1" 200 None 2025-09-26 13:01:56,530 - lava_callback - DEBUG - Processing node 68d3ebc0cd36afa834e1369e: ltp-sched 2025-09-26 13:01:56,530 - lava_callback - ERROR - Error processing callback for node 68d3ebc0cd36afa834e1369e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 13:02:04,578 - lava_callback - INFO - Received callback for node 68d3f77ecd36afa834e14afa INFO: 172.20.0.1:33436 - "POST /node/68d3f77ecd36afa834e14afa HTTP/1.0" 202 Accepted 2025-09-26 13:02:04,585 - lava_callback - INFO - Starting async job submit for node 68d3f77ecd36afa834e14afa 2025-09-26 13:02:04,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:02:04,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f77ecd36afa834e14afa HTTP/1.1" 200 None 2025-09-26 13:02:04,701 - lava_callback - DEBUG - Processing node 68d3f77ecd36afa834e14afa: baseline-arm64 2025-09-26 13:02:05,257 - lava_callback - ERROR - Error processing callback for node 68d3f77ecd36afa834e14afa: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:33448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49618 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 13:02:15,366 - lava_callback - INFO - Received callback for node 68d3ebc9cd36afa834e136b0 INFO: 172.20.0.1:49626 - "POST /node/68d3ebc9cd36afa834e136b0 HTTP/1.0" 202 Accepted 2025-09-26 13:02:15,372 - lava_callback - INFO - Starting async job submit for node 68d3ebc9cd36afa834e136b0 2025-09-26 13:02:15,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:02:15,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ebc9cd36afa834e136b0 HTTP/1.1" 200 None 2025-09-26 13:02:15,393 - lava_callback - DEBUG - Processing node 68d3ebc9cd36afa834e136b0: ltp-syscalls 2025-09-26 13:02:15,393 - lava_callback - ERROR - Error processing callback for node 68d3ebc9cd36afa834e136b0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:49636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36470 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:02:35,664 - lava_callback - INFO - Received callback for node 68d3ebd8cd36afa834e136c3 INFO: 172.20.0.1:41042 - "POST /node/68d3ebd8cd36afa834e136c3 HTTP/1.0" 202 Accepted 2025-09-26 13:02:35,670 - lava_callback - INFO - Starting async job submit for node 68d3ebd8cd36afa834e136c3 2025-09-26 13:02:35,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:02:35,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ebd8cd36afa834e136c3 HTTP/1.1" 200 None 2025-09-26 13:02:35,690 - lava_callback - DEBUG - Processing node 68d3ebd8cd36afa834e136c3: ltp-watchqueue 2025-09-26 13:02:35,690 - lava_callback - ERROR - Error processing callback for node 68d3ebd8cd36afa834e136c3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 13:02:36,429 - lava_callback - INFO - Received callback for node 68d3ebdacd36afa834e136c6 INFO: 172.20.0.1:41044 - "POST /node/68d3ebdacd36afa834e136c6 HTTP/1.0" 202 Accepted 2025-09-26 13:02:36,435 - lava_callback - INFO - Starting async job submit for node 68d3ebdacd36afa834e136c6 2025-09-26 13:02:36,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:02:36,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ebdacd36afa834e136c6 HTTP/1.1" 200 None 2025-09-26 13:02:36,448 - lava_callback - DEBUG - Processing node 68d3ebdacd36afa834e136c6: ltp-smoketest 2025-09-26 13:02:36,449 - lava_callback - ERROR - Error processing callback for node 68d3ebdacd36afa834e136c6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:41054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47874 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:03:20,104 - lava_callback - INFO - Received callback for node 68d427f8a5c2c05277bc74ed INFO: 172.20.0.1:56260 - "POST /node/68d427f8a5c2c05277bc74ed HTTP/1.0" 202 Accepted 2025-09-26 13:03:20,110 - lava_callback - INFO - Starting async job submit for node 68d427f8a5c2c05277bc74ed 2025-09-26 13:03:20,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:03:20,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d427f8a5c2c05277bc74ed HTTP/1.1" 200 None 2025-09-26 13:03:20,165 - lava_callback - DEBUG - Processing node 68d427f8a5c2c05277bc74ed: baseline-arm 2025-09-26 13:03:20,384 - lava_callback - ERROR - Error processing callback for node 68d427f8a5c2c05277bc74ed: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55864 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:04:03,313 - lava_callback - INFO - Received callback for node 68d68a142f83206171a91838 INFO: 172.20.0.1:57388 - "POST /node/68d68a142f83206171a91838 HTTP/1.0" 202 Accepted 2025-09-26 13:04:03,319 - lava_callback - INFO - Starting async job submit for node 68d68a142f83206171a91838 2025-09-26 13:04:03,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:04:03,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a142f83206171a91838 HTTP/1.1" 200 None 2025-09-26 13:04:03,360 - lava_callback - DEBUG - Processing node 68d68a142f83206171a91838: baseline-arm64-broonie 2025-09-26 13:04:03,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:04:03,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:04:03,915 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d68a142f83206171a91838/log.txt.gz 2025-09-26 13:04:03,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:04:04,066 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:04:04,067 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d68a142f83206171a91838/lava_callback.json.gz 2025-09-26 13:04:04,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:04:04,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a142f83206171a91838 HTTP/1.1" 200 None 2025-09-26 13:04:04,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:04:04,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:04:04,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:04:04,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68a142f83206171a91838 HTTP/1.1" 200 None 2025-09-26 13:04:04,153 - lava_callback - INFO - Completed processing callback for node 68d68a142f83206171a91838 INFO: 172.20.0.1:57398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36374 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 13:04:15,511 - lava_callback - INFO - Received callback for node 68d68ca22f83206171a91950 INFO: 172.20.0.1:36386 - "POST /node/68d68ca22f83206171a91950 HTTP/1.0" 202 Accepted 2025-09-26 13:04:15,517 - lava_callback - INFO - Starting async job submit for node 68d68ca22f83206171a91950 2025-09-26 13:04:15,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:04:15,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68ca22f83206171a91950 HTTP/1.1" 200 None 2025-09-26 13:04:15,553 - lava_callback - DEBUG - Processing node 68d68ca22f83206171a91950: baseline-arm64 2025-09-26 13:04:16,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:04:16,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:04:16,245 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68ca22f83206171a91950/log.txt.gz 2025-09-26 13:04:16,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:04:16,368 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:04:16,369 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68ca22f83206171a91950/lava_callback.json.gz 2025-09-26 13:04:16,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:04:16,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68ca22f83206171a91950 HTTP/1.1" 200 None 2025-09-26 13:04:16,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:04:16,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:04:16,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:04:16,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68ca22f83206171a91950 HTTP/1.1" 200 None 2025-09-26 13:04:16,448 - lava_callback - INFO - Completed processing callback for node 68d68ca22f83206171a91950 INFO: 172.20.0.1:36396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41408 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:04:35,533 - lava_callback - INFO - Received callback for node 68d3ec60cd36afa834e137ab INFO: 172.20.0.1:56764 - "POST /node/68d3ec60cd36afa834e137ab HTTP/1.0" 202 Accepted 2025-09-26 13:04:35,539 - lava_callback - INFO - Starting async job submit for node 68d3ec60cd36afa834e137ab 2025-09-26 13:04:35,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:04:35,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ec60cd36afa834e137ab HTTP/1.1" 200 None 2025-09-26 13:04:35,552 - lava_callback - DEBUG - Processing node 68d3ec60cd36afa834e137ab: ltp-syscalls-ipc 2025-09-26 13:04:35,552 - lava_callback - ERROR - Error processing callback for node 68d3ec60cd36afa834e137ab: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:56766 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:04:43,479 - lava_callback - INFO - Received callback for node 68d3f08acd36afa834e13de5 INFO: 172.20.0.1:33662 - "POST /node/68d3f08acd36afa834e13de5 HTTP/1.0" 202 Accepted 2025-09-26 13:04:43,485 - lava_callback - INFO - Starting async job submit for node 68d3f08acd36afa834e13de5 2025-09-26 13:04:43,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:04:43,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f08acd36afa834e13de5 HTTP/1.1" 200 None 2025-09-26 13:04:43,526 - lava_callback - DEBUG - Processing node 68d3f08acd36afa834e13de5: baseline-arm 2025-09-26 13:04:43,790 - lava_callback - ERROR - Error processing callback for node 68d3f08acd36afa834e13de5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:33674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60048 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:04:53,176 - lava_callback - INFO - Received callback for node 68d68a0b2f83206171a91823 INFO: 172.20.0.1:60054 - "POST /node/68d68a0b2f83206171a91823 HTTP/1.0" 202 Accepted 2025-09-26 13:04:53,182 - lava_callback - INFO - Starting async job submit for node 68d68a0b2f83206171a91823 2025-09-26 13:04:53,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:04:53,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a0b2f83206171a91823 HTTP/1.1" 200 None 2025-09-26 13:04:53,216 - lava_callback - DEBUG - Processing node 68d68a0b2f83206171a91823: baseline-arm64-broonie 2025-09-26 13:04:53,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:04:53,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:04:53,578 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d68a0b2f83206171a91823/log.txt.gz 2025-09-26 13:04:53,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:04:53,698 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:04:53,699 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d68a0b2f83206171a91823/lava_callback.json.gz 2025-09-26 13:04:53,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:04:53,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a0b2f83206171a91823 HTTP/1.1" 200 None 2025-09-26 13:04:53,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:04:53,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:04:53,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:04:53,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68a0b2f83206171a91823 HTTP/1.1" 200 None 2025-09-26 13:04:53,798 - lava_callback - INFO - Completed processing callback for node 68d68a0b2f83206171a91823 2025-09-26 13:04:55,629 - lava_callback - INFO - Received callback for node 68d3ec70cd36afa834e137cc INFO: 172.20.0.1:60056 - "POST /node/68d3ec70cd36afa834e137cc HTTP/1.0" 202 Accepted 2025-09-26 13:04:55,635 - lava_callback - INFO - Starting async job submit for node 68d3ec70cd36afa834e137cc 2025-09-26 13:04:55,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:04:55,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ec70cd36afa834e137cc HTTP/1.1" 200 None 2025-09-26 13:04:55,648 - lava_callback - DEBUG - Processing node 68d3ec70cd36afa834e137cc: ltp-syscalls 2025-09-26 13:04:55,648 - lava_callback - ERROR - Error processing callback for node 68d3ec70cd36afa834e137cc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60064 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:04:59,578 - lava_callback - INFO - Received callback for node 68d3f65acd36afa834e148ce INFO: 172.20.0.1:36128 - "POST /node/68d3f65acd36afa834e148ce HTTP/1.0" 202 Accepted 2025-09-26 13:04:59,586 - lava_callback - INFO - Starting async job submit for node 68d3f65acd36afa834e148ce 2025-09-26 13:04:59,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:04:59,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f65acd36afa834e148ce HTTP/1.1" 200 None 2025-09-26 13:04:59,636 - lava_callback - DEBUG - Processing node 68d3f65acd36afa834e148ce: baseline-arm64 2025-09-26 13:05:00,670 - lava_callback - ERROR - Error processing callback for node 68d3f65acd36afa834e148ce: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:36140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48424 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 13:05:15,640 - lava_callback - INFO - Received callback for node 68d3ec7dcd36afa834e137df INFO: 172.20.0.1:48426 - "POST /node/68d3ec7dcd36afa834e137df HTTP/1.0" 202 Accepted 2025-09-26 13:05:15,648 - lava_callback - INFO - Starting async job submit for node 68d3ec7dcd36afa834e137df 2025-09-26 13:05:15,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:05:15,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ec7dcd36afa834e137df HTTP/1.1" 200 None 2025-09-26 13:05:15,665 - lava_callback - DEBUG - Processing node 68d3ec7dcd36afa834e137df: ltp-syscalls 2025-09-26 13:05:15,665 - lava_callback - ERROR - Error processing callback for node 68d3ec7dcd36afa834e137df: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 13:05:16,395 - lava_callback - INFO - Received callback for node 68d3ec89cd36afa834e137ee INFO: 172.20.0.1:48438 - "POST /node/68d3ec89cd36afa834e137ee HTTP/1.0" 202 Accepted 2025-09-26 13:05:16,401 - lava_callback - INFO - Starting async job submit for node 68d3ec89cd36afa834e137ee 2025-09-26 13:05:16,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:05:16,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ec89cd36afa834e137ee HTTP/1.1" 200 None 2025-09-26 13:05:16,414 - lava_callback - DEBUG - Processing node 68d3ec89cd36afa834e137ee: ltp-timers 2025-09-26 13:05:16,414 - lava_callback - ERROR - Error processing callback for node 68d3ec89cd36afa834e137ee: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:48450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32858 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:05:35,734 - lava_callback - INFO - Received callback for node 68d3ec8ccd36afa834e137f1 INFO: 172.20.0.1:33572 - "POST /node/68d3ec8ccd36afa834e137f1 HTTP/1.0" 202 Accepted 2025-09-26 13:05:35,740 - lava_callback - INFO - Starting async job submit for node 68d3ec8ccd36afa834e137f1 2025-09-26 13:05:35,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:05:35,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ec8ccd36afa834e137f1 HTTP/1.1" 200 None 2025-09-26 13:05:35,754 - lava_callback - DEBUG - Processing node 68d3ec8ccd36afa834e137f1: ltp-syscalls-ipc 2025-09-26 13:05:35,755 - lava_callback - ERROR - Error processing callback for node 68d3ec8ccd36afa834e137f1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:33582 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:05:36,513 - lava_callback - INFO - Received callback for node 68d3ec93cd36afa834e137fe INFO: 172.20.0.1:33598 - "POST /node/68d3ec93cd36afa834e137fe HTTP/1.0" 202 Accepted 2025-09-26 13:05:36,519 - lava_callback - INFO - Starting async job submit for node 68d3ec93cd36afa834e137fe 2025-09-26 13:05:36,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:05:36,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ec93cd36afa834e137fe HTTP/1.1" 200 None 2025-09-26 13:05:36,532 - lava_callback - DEBUG - Processing node 68d3ec93cd36afa834e137fe: ltp-syscalls-ipc 2025-09-26 13:05:36,532 - lava_callback - ERROR - Error processing callback for node 68d3ec93cd36afa834e137fe: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 13:05:42,848 - lava_callback - INFO - Received callback for node 68d427faa5c2c05277bc74f0 INFO: 172.20.0.1:55856 - "POST /node/68d427faa5c2c05277bc74f0 HTTP/1.0" 202 Accepted 2025-09-26 13:05:42,854 - lava_callback - INFO - Starting async job submit for node 68d427faa5c2c05277bc74f0 2025-09-26 13:05:42,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:05:42,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d427faa5c2c05277bc74f0 HTTP/1.1" 200 None 2025-09-26 13:05:42,888 - lava_callback - DEBUG - Processing node 68d427faa5c2c05277bc74f0: baseline-arm 2025-09-26 13:05:43,105 - lava_callback - ERROR - Error processing callback for node 68d427faa5c2c05277bc74f0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:55860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60532 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 13:06:15,716 - lava_callback - INFO - Received callback for node 68d3ecb3cd36afa834e13841 INFO: 172.20.0.1:60546 - "POST /node/68d3ecb3cd36afa834e13841 HTTP/1.0" 202 Accepted 2025-09-26 13:06:15,727 - lava_callback - INFO - Starting async job submit for node 68d3ecb3cd36afa834e13841 2025-09-26 13:06:15,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:15,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ecb3cd36afa834e13841 HTTP/1.1" 200 None 2025-09-26 13:06:15,759 - lava_callback - DEBUG - Processing node 68d3ecb3cd36afa834e13841: ltp-watchqueue 2025-09-26 13:06:15,759 - lava_callback - ERROR - Error processing callback for node 68d3ecb3cd36afa834e13841: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52004 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:06:30,537 - lava_callback - INFO - Received callback for node 68d68f8f2f83206171a919c8 INFO: 172.20.0.1:56420 - "POST /node/68d68f8f2f83206171a919c8 HTTP/1.0" 202 Accepted 2025-09-26 13:06:30,543 - lava_callback - INFO - Starting async job submit for node 68d68f8f2f83206171a919c8 2025-09-26 13:06:30,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:30,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68f8f2f83206171a919c8 HTTP/1.1" 200 None 2025-09-26 13:06:30,595 - lava_callback - DEBUG - Processing node 68d68f8f2f83206171a919c8: baseline-arm64 2025-09-26 13:06:30,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:06:31,066 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:06:31,066 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68f8f2f83206171a919c8/log.txt.gz 2025-09-26 13:06:31,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:06:31,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:06:31,225 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68f8f2f83206171a919c8/lava_callback.json.gz 2025-09-26 13:06:31,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:31,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68f8f2f83206171a919c8 HTTP/1.1" 200 None 2025-09-26 13:06:31,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:31,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:06:31,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:31,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68f8f2f83206171a919c8 HTTP/1.1" 200 None 2025-09-26 13:06:31,323 - lava_callback - INFO - Completed processing callback for node 68d68f8f2f83206171a919c8 2025-09-26 13:06:32,303 - lava_callback - INFO - Received callback for node 68d68f8e2f83206171a919c5 INFO: 172.20.0.1:56430 - "POST /node/68d68f8e2f83206171a919c5 HTTP/1.0" 202 Accepted 2025-09-26 13:06:32,311 - lava_callback - INFO - Starting async job submit for node 68d68f8e2f83206171a919c5 2025-09-26 13:06:32,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:32,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68f8e2f83206171a919c5 HTTP/1.1" 200 None 2025-09-26 13:06:32,351 - lava_callback - DEBUG - Processing node 68d68f8e2f83206171a919c5: baseline-arm64 2025-09-26 13:06:32,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:06:32,801 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:06:32,802 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68f8e2f83206171a919c5/log.txt.gz 2025-09-26 13:06:32,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:06:32,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:06:32,955 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68f8e2f83206171a919c5/lava_callback.json.gz 2025-09-26 13:06:32,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:32,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68f8e2f83206171a919c5 HTTP/1.1" 200 None 2025-09-26 13:06:32,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:33,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:06:33,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:33,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68f8e2f83206171a919c5 HTTP/1.1" 200 None 2025-09-26 13:06:33,044 - lava_callback - INFO - Completed processing callback for node 68d68f8e2f83206171a919c5 INFO: 172.20.0.1:56434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37912 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:06:48,856 - lava_callback - INFO - Received callback for node 68d68f882f83206171a919bc INFO: 172.20.0.1:37924 - "POST /node/68d68f882f83206171a919bc HTTP/1.0" 202 Accepted 2025-09-26 13:06:48,863 - lava_callback - INFO - Starting async job submit for node 68d68f882f83206171a919bc 2025-09-26 13:06:48,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:48,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68f882f83206171a919bc HTTP/1.1" 200 None 2025-09-26 13:06:48,907 - lava_callback - DEBUG - Processing node 68d68f882f83206171a919bc: baseline-arm64 2025-09-26 13:06:49,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:06:49,342 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:06:49,343 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68f882f83206171a919bc/log.txt.gz 2025-09-26 13:06:49,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:06:49,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:06:49,516 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68f882f83206171a919bc/lava_callback.json.gz 2025-09-26 13:06:49,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:49,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68f882f83206171a919bc HTTP/1.1" 200 None 2025-09-26 13:06:49,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:49,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:06:49,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:49,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68f882f83206171a919bc HTTP/1.1" 200 None 2025-09-26 13:06:49,591 - lava_callback - INFO - Completed processing callback for node 68d68f882f83206171a919bc 2025-09-26 13:06:50,135 - lava_callback - INFO - Received callback for node 68d68f8c2f83206171a919c2 INFO: 172.20.0.1:50724 - "POST /node/68d68f8c2f83206171a919c2 HTTP/1.0" 202 Accepted 2025-09-26 13:06:50,141 - lava_callback - INFO - Starting async job submit for node 68d68f8c2f83206171a919c2 2025-09-26 13:06:50,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:50,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68f8c2f83206171a919c2 HTTP/1.1" 200 None 2025-09-26 13:06:50,176 - lava_callback - DEBUG - Processing node 68d68f8c2f83206171a919c2: baseline-arm64 2025-09-26 13:06:50,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:06:50,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:06:50,580 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68f8c2f83206171a919c2/log.txt.gz 2025-09-26 13:06:50,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:06:50,708 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:06:50,709 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68f8c2f83206171a919c2/lava_callback.json.gz 2025-09-26 13:06:50,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:50,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68f8c2f83206171a919c2 HTTP/1.1" 200 None 2025-09-26 13:06:50,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:50,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:06:50,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:50,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68f8c2f83206171a919c2 HTTP/1.1" 200 None 2025-09-26 13:06:50,803 - lava_callback - INFO - Completed processing callback for node 68d68f8c2f83206171a919c2 INFO: 172.20.0.1:50732 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:06:54,931 - lava_callback - INFO - Received callback for node 68d68f872f83206171a919b7 INFO: 172.20.0.1:50738 - "POST /node/68d68f872f83206171a919b7 HTTP/1.0" 202 Accepted 2025-09-26 13:06:54,939 - lava_callback - INFO - Starting async job submit for node 68d68f872f83206171a919b7 2025-09-26 13:06:54,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:54,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68f872f83206171a919b7 HTTP/1.1" 200 None 2025-09-26 13:06:54,978 - lava_callback - DEBUG - Processing node 68d68f872f83206171a919b7: baseline-arm64 2025-09-26 13:06:55,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:06:55,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:06:55,420 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68f872f83206171a919b7/log.txt.gz 2025-09-26 13:06:55,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:06:55,558 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:06:55,559 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68f872f83206171a919b7/lava_callback.json.gz 2025-09-26 13:06:55,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:55,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68f872f83206171a919b7 HTTP/1.1" 200 None 2025-09-26 13:06:55,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:55,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:06:55,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:55,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68f872f83206171a919b7 HTTP/1.1" 200 None 2025-09-26 13:06:55,639 - lava_callback - INFO - Completed processing callback for node 68d68f872f83206171a919b7 2025-09-26 13:06:55,778 - lava_callback - INFO - Received callback for node 68d3ece2cd36afa834e1387c INFO: 172.20.0.1:50744 - "POST /node/68d3ece2cd36afa834e1387c HTTP/1.0" 202 Accepted 2025-09-26 13:06:55,788 - lava_callback - INFO - Starting async job submit for node 68d3ece2cd36afa834e1387c 2025-09-26 13:06:55,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:55,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ece2cd36afa834e1387c HTTP/1.1" 200 None 2025-09-26 13:06:55,801 - lava_callback - DEBUG - Processing node 68d3ece2cd36afa834e1387c: ltp-timers 2025-09-26 13:06:55,801 - lava_callback - ERROR - Error processing callback for node 68d3ece2cd36afa834e1387c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:50756 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:06:58,781 - lava_callback - INFO - Received callback for node 68d68f8b2f83206171a919bf INFO: 172.20.0.1:50760 - "POST /node/68d68f8b2f83206171a919bf HTTP/1.0" 202 Accepted 2025-09-26 13:06:58,789 - lava_callback - INFO - Starting async job submit for node 68d68f8b2f83206171a919bf 2025-09-26 13:06:58,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:58,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68f8b2f83206171a919bf HTTP/1.1" 200 None 2025-09-26 13:06:58,849 - lava_callback - DEBUG - Processing node 68d68f8b2f83206171a919bf: baseline-arm64 2025-09-26 13:06:59,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:06:59,291 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:06:59,292 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68f8b2f83206171a919bf/log.txt.gz 2025-09-26 13:06:59,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:06:59,446 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:06:59,446 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68f8b2f83206171a919bf/lava_callback.json.gz 2025-09-26 13:06:59,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:59,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68f8b2f83206171a919bf HTTP/1.1" 200 None 2025-09-26 13:06:59,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:59,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:06:59,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:06:59,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68f8b2f83206171a919bf HTTP/1.1" 200 None 2025-09-26 13:06:59,524 - lava_callback - INFO - Completed processing callback for node 68d68f8b2f83206171a919bf 2025-09-26 13:07:00,357 - lava_callback - INFO - Received callback for node 68d68f922f83206171a919cb INFO: 172.20.0.1:55164 - "POST /node/68d68f922f83206171a919cb HTTP/1.0" 202 Accepted 2025-09-26 13:07:00,410 - lava_callback - INFO - Starting async job submit for node 68d68f922f83206171a919cb 2025-09-26 13:07:00,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:07:00,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68f922f83206171a919cb HTTP/1.1" 200 None 2025-09-26 13:07:00,450 - lava_callback - DEBUG - Processing node 68d68f922f83206171a919cb: baseline-arm64 2025-09-26 13:07:00,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:07:00,863 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:07:00,864 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68f922f83206171a919cb/log.txt.gz 2025-09-26 13:07:00,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:07:01,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:07:01,013 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68f922f83206171a919cb/lava_callback.json.gz 2025-09-26 13:07:01,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:07:01,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68f922f83206171a919cb HTTP/1.1" 200 None 2025-09-26 13:07:01,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:07:01,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:07:01,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:07:01,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68f922f83206171a919cb HTTP/1.1" 200 None 2025-09-26 13:07:01,117 - lava_callback - INFO - Completed processing callback for node 68d68f922f83206171a919cb 2025-09-26 13:07:01,552 - lava_callback - INFO - Received callback for node 68d68f922f83206171a919ce INFO: 172.20.0.1:55172 - "POST /node/68d68f922f83206171a919ce HTTP/1.0" 202 Accepted 2025-09-26 13:07:01,560 - lava_callback - INFO - Starting async job submit for node 68d68f922f83206171a919ce 2025-09-26 13:07:01,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:07:01,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68f922f83206171a919ce HTTP/1.1" 200 None 2025-09-26 13:07:01,598 - lava_callback - DEBUG - Processing node 68d68f922f83206171a919ce: baseline-arm64 2025-09-26 13:07:01,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:07:02,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:07:02,050 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68f922f83206171a919ce/log.txt.gz 2025-09-26 13:07:02,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:07:02,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:07:02,182 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68f922f83206171a919ce/lava_callback.json.gz 2025-09-26 13:07:02,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:07:02,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68f922f83206171a919ce HTTP/1.1" 200 None 2025-09-26 13:07:02,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:07:02,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:07:02,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:07:02,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68f922f83206171a919ce HTTP/1.1" 200 None 2025-09-26 13:07:02,300 - lava_callback - INFO - Completed processing callback for node 68d68f922f83206171a919ce INFO: 172.20.0.1:55176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52642 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:07:53,419 - lava_callback - INFO - Received callback for node 68d3ead3cd36afa834e1350f INFO: 172.20.0.1:45544 - "POST /node/68d3ead3cd36afa834e1350f HTTP/1.0" 202 Accepted 2025-09-26 13:07:53,433 - lava_callback - INFO - Starting async job submit for node 68d3ead3cd36afa834e1350f 2025-09-26 13:07:53,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:07:53,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ead3cd36afa834e1350f HTTP/1.1" 200 None 2025-09-26 13:07:53,514 - lava_callback - DEBUG - Processing node 68d3ead3cd36afa834e1350f: ltp-pty 2025-09-26 13:07:53,932 - lava_callback - ERROR - Error processing callback for node 68d3ead3cd36afa834e1350f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:45560 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:07:55,268 - lava_callback - INFO - Received callback for node 68d427fca5c2c05277bc74f3 INFO: 172.20.0.1:45562 - "POST /node/68d427fca5c2c05277bc74f3 HTTP/1.0" 202 Accepted 2025-09-26 13:07:55,274 - lava_callback - INFO - Starting async job submit for node 68d427fca5c2c05277bc74f3 2025-09-26 13:07:55,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:07:55,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d427fca5c2c05277bc74f3 HTTP/1.1" 200 None 2025-09-26 13:07:55,316 - lava_callback - DEBUG - Processing node 68d427fca5c2c05277bc74f3: baseline-arm 2025-09-26 13:07:55,586 - lava_callback - ERROR - Error processing callback for node 68d427fca5c2c05277bc74f3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:45568 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:07:59,855 - lava_callback - INFO - Received callback for node 68d68fdf2f83206171a91a38 INFO: 172.20.0.1:59230 - "POST /node/68d68fdf2f83206171a91a38 HTTP/1.0" 202 Accepted 2025-09-26 13:07:59,861 - lava_callback - INFO - Starting async job submit for node 68d68fdf2f83206171a91a38 2025-09-26 13:07:59,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:07:59,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fdf2f83206171a91a38 HTTP/1.1" 200 None 2025-09-26 13:07:59,895 - lava_callback - DEBUG - Processing node 68d68fdf2f83206171a91a38: baseline-arm64 2025-09-26 13:08:00,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:00,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:00,383 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fdf2f83206171a91a38/log.txt.gz 2025-09-26 13:08:00,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:00,605 - lava_callback - INFO - Received callback for node 68d68fe62f83206171a91a44 INFO: 172.20.0.1:59244 - "POST /node/68d68fe62f83206171a91a44 HTTP/1.0" 202 Accepted 2025-09-26 13:08:00,612 - lava_callback - INFO - Starting async job submit for node 68d68fe62f83206171a91a44 2025-09-26 13:08:00,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:00,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fe62f83206171a91a44 HTTP/1.1" 200 None 2025-09-26 13:08:00,651 - lava_callback - DEBUG - Processing node 68d68fe62f83206171a91a44: baseline-arm64 2025-09-26 13:08:00,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:00,906 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fdf2f83206171a91a38/lava_callback.json.gz 2025-09-26 13:08:00,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:00,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:00,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fdf2f83206171a91a38 HTTP/1.1" 200 None 2025-09-26 13:08:00,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:01,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:08:01,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:01,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68fdf2f83206171a91a38 HTTP/1.1" 200 None 2025-09-26 13:08:01,066 - lava_callback - INFO - Completed processing callback for node 68d68fdf2f83206171a91a38 2025-09-26 13:08:01,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:01,161 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fe62f83206171a91a44/log.txt.gz 2025-09-26 13:08:01,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:01,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:01,325 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fe62f83206171a91a44/lava_callback.json.gz 2025-09-26 13:08:01,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:01,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fe62f83206171a91a44 HTTP/1.1" 200 None 2025-09-26 13:08:01,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:01,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:08:01,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:01,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68fe62f83206171a91a44 HTTP/1.1" 200 None 2025-09-26 13:08:01,436 - lava_callback - INFO - Completed processing callback for node 68d68fe62f83206171a91a44 2025-09-26 13:08:04,003 - lava_callback - INFO - Received callback for node 68d68fd92f83206171a91a2f INFO: 172.20.0.1:59246 - "POST /node/68d68fd92f83206171a91a2f HTTP/1.0" 202 Accepted 2025-09-26 13:08:04,009 - lava_callback - INFO - Starting async job submit for node 68d68fd92f83206171a91a2f 2025-09-26 13:08:04,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:04,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fd92f83206171a91a2f HTTP/1.1" 200 None 2025-09-26 13:08:04,047 - lava_callback - DEBUG - Processing node 68d68fd92f83206171a91a2f: baseline-arm64 2025-09-26 13:08:04,344 - lava_callback - INFO - Received callback for node 68d68fd52f83206171a91a1e INFO: 172.20.0.1:59262 - "POST /node/68d68fd52f83206171a91a1e HTTP/1.0" 202 Accepted 2025-09-26 13:08:04,368 - lava_callback - INFO - Starting async job submit for node 68d68fd52f83206171a91a1e 2025-09-26 13:08:04,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:04,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:04,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fd52f83206171a91a1e HTTP/1.1" 200 None 2025-09-26 13:08:04,431 - lava_callback - DEBUG - Processing node 68d68fd52f83206171a91a1e: baseline-arm64 2025-09-26 13:08:04,644 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:04,691 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fd92f83206171a91a2f/log.txt.gz 2025-09-26 13:08:04,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:04,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:04,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:04,964 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fd92f83206171a91a2f/lava_callback.json.gz 2025-09-26 13:08:04,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:05,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fd92f83206171a91a2f HTTP/1.1" 200 None 2025-09-26 13:08:05,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:05,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:08:05,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:05,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:05,032 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fd52f83206171a91a1e/log.txt.gz 2025-09-26 13:08:05,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:05,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68fd92f83206171a91a2f HTTP/1.1" 200 None 2025-09-26 13:08:05,063 - lava_callback - INFO - Completed processing callback for node 68d68fd92f83206171a91a2f 2025-09-26 13:08:05,233 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:05,234 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fd52f83206171a91a1e/lava_callback.json.gz 2025-09-26 13:08:05,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:05,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fd52f83206171a91a1e HTTP/1.1" 200 None 2025-09-26 13:08:05,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:05,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:08:05,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:05,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68fd52f83206171a91a1e HTTP/1.1" 200 None 2025-09-26 13:08:05,336 - lava_callback - INFO - Completed processing callback for node 68d68fd52f83206171a91a1e INFO: 172.20.0.1:59270 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:08:06,651 - lava_callback - INFO - Received callback for node 68d68fd32f83206171a91a1b INFO: 172.20.0.1:59276 - "POST /node/68d68fd32f83206171a91a1b HTTP/1.0" 202 Accepted 2025-09-26 13:08:06,658 - lava_callback - INFO - Starting async job submit for node 68d68fd32f83206171a91a1b 2025-09-26 13:08:06,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:06,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fd32f83206171a91a1b HTTP/1.1" 200 None 2025-09-26 13:08:06,692 - lava_callback - DEBUG - Processing node 68d68fd32f83206171a91a1b: baseline-arm64 2025-09-26 13:08:07,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:07,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:07,269 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fd32f83206171a91a1b/log.txt.gz 2025-09-26 13:08:07,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:07,401 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:07,402 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fd32f83206171a91a1b/lava_callback.json.gz 2025-09-26 13:08:07,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:07,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fd32f83206171a91a1b HTTP/1.1" 200 None 2025-09-26 13:08:07,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:07,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:08:07,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:07,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68fd32f83206171a91a1b HTTP/1.1" 200 None 2025-09-26 13:08:07,490 - lava_callback - INFO - Completed processing callback for node 68d68fd32f83206171a91a1b 2025-09-26 13:08:07,556 - lava_callback - INFO - Received callback for node 68d68fd62f83206171a91a21 INFO: 172.20.0.1:59278 - "POST /node/68d68fd62f83206171a91a21 HTTP/1.0" 202 Accepted 2025-09-26 13:08:07,565 - lava_callback - INFO - Starting async job submit for node 68d68fd62f83206171a91a21 2025-09-26 13:08:07,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:07,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fd62f83206171a91a21 HTTP/1.1" 200 None 2025-09-26 13:08:07,610 - lava_callback - DEBUG - Processing node 68d68fd62f83206171a91a21: baseline-arm64 2025-09-26 13:08:08,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:08,161 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:08,161 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fd62f83206171a91a21/log.txt.gz 2025-09-26 13:08:08,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:08,323 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:08,324 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fd62f83206171a91a21/lava_callback.json.gz 2025-09-26 13:08:08,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:08,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fd62f83206171a91a21 HTTP/1.1" 200 None 2025-09-26 13:08:08,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:08,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:08:08,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:08,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68fd62f83206171a91a21 HTTP/1.1" 200 None 2025-09-26 13:08:08,429 - lava_callback - INFO - Completed processing callback for node 68d68fd62f83206171a91a21 2025-09-26 13:08:13,682 - lava_callback - INFO - Received callback for node 68d3eb71cd36afa834e13617 INFO: 172.20.0.1:37618 - "POST /node/68d3eb71cd36afa834e13617 HTTP/1.0" 202 Accepted 2025-09-26 13:08:13,690 - lava_callback - INFO - Starting async job submit for node 68d3eb71cd36afa834e13617 2025-09-26 13:08:13,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:13,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eb71cd36afa834e13617 HTTP/1.1" 200 None 2025-09-26 13:08:13,755 - lava_callback - DEBUG - Processing node 68d3eb71cd36afa834e13617: ltp-pty 2025-09-26 13:08:13,899 - lava_callback - INFO - Received callback for node 68d68fd92f83206171a91a2c INFO: 172.20.0.1:37634 - "POST /node/68d68fd92f83206171a91a2c HTTP/1.0" 202 Accepted 2025-09-26 13:08:13,916 - lava_callback - INFO - Starting async job submit for node 68d68fd92f83206171a91a2c 2025-09-26 13:08:13,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:14,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fd92f83206171a91a2c HTTP/1.1" 200 None 2025-09-26 13:08:14,036 - lava_callback - DEBUG - Processing node 68d68fd92f83206171a91a2c: baseline-arm64 2025-09-26 13:08:14,484 - lava_callback - ERROR - Error processing callback for node 68d3eb71cd36afa834e13617: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:08:14,540 - lava_callback - INFO - Received callback for node 68d68ff32f83206171a91a68 INFO: 172.20.0.1:37650 - "POST /node/68d68ff32f83206171a91a68 HTTP/1.0" 202 Accepted 2025-09-26 13:08:14,552 - lava_callback - INFO - Starting async job submit for node 68d68ff32f83206171a91a68 2025-09-26 13:08:14,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:14,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68ff32f83206171a91a68 HTTP/1.1" 200 None 2025-09-26 13:08:14,681 - lava_callback - DEBUG - Processing node 68d68ff32f83206171a91a68: baseline-arm64 2025-09-26 13:08:14,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:14,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:14,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:14,948 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fd92f83206171a91a2c/log.txt.gz 2025-09-26 13:08:14,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:15,099 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:15,100 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68ff32f83206171a91a68/log.txt.gz 2025-09-26 13:08:15,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:15,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:15,119 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fd92f83206171a91a2c/lava_callback.json.gz 2025-09-26 13:08:15,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:37654 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 13:08:15,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fd92f83206171a91a2c HTTP/1.1" 200 None 2025-09-26 13:08:15,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:15,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:08:15,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:15,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68fd92f83206171a91a2c HTTP/1.1" 200 None 2025-09-26 13:08:15,218 - lava_callback - INFO - Completed processing callback for node 68d68fd92f83206171a91a2c 2025-09-26 13:08:15,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:15,275 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68ff32f83206171a91a68/lava_callback.json.gz 2025-09-26 13:08:15,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:15,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68ff32f83206171a91a68 HTTP/1.1" 200 None 2025-09-26 13:08:15,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:15,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:08:15,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:15,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68ff32f83206171a91a68 HTTP/1.1" 200 None 2025-09-26 13:08:15,387 - lava_callback - INFO - Completed processing callback for node 68d68ff32f83206171a91a68 2025-09-26 13:08:16,269 - lava_callback - INFO - Received callback for node 68d68ff32f83206171a91a6f INFO: 172.20.0.1:37660 - "POST /node/68d68ff32f83206171a91a6f HTTP/1.0" 202 Accepted 2025-09-26 13:08:16,279 - lava_callback - INFO - Starting async job submit for node 68d68ff32f83206171a91a6f 2025-09-26 13:08:16,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:16,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68ff32f83206171a91a6f HTTP/1.1" 200 None 2025-09-26 13:08:16,339 - lava_callback - DEBUG - Processing node 68d68ff32f83206171a91a6f: baseline-arm64 INFO: 172.20.0.1:37672 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:08:16,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:16,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:16,892 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68ff32f83206171a91a6f/log.txt.gz 2025-09-26 13:08:16,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:17,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:17,050 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68ff32f83206171a91a6f/lava_callback.json.gz 2025-09-26 13:08:17,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:17,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68ff32f83206171a91a6f HTTP/1.1" 200 None 2025-09-26 13:08:17,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:17,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:08:17,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:17,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68ff32f83206171a91a6f HTTP/1.1" 200 None 2025-09-26 13:08:17,168 - lava_callback - INFO - Completed processing callback for node 68d68ff32f83206171a91a6f 2025-09-26 13:08:18,242 - lava_callback - INFO - Received callback for node 68d68fe02f83206171a91a3b INFO: 172.20.0.1:37684 - "POST /node/68d68fe02f83206171a91a3b HTTP/1.0" 202 Accepted 2025-09-26 13:08:18,250 - lava_callback - INFO - Starting async job submit for node 68d68fe02f83206171a91a3b 2025-09-26 13:08:18,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:18,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fe02f83206171a91a3b HTTP/1.1" 200 None 2025-09-26 13:08:18,288 - lava_callback - DEBUG - Processing node 68d68fe02f83206171a91a3b: baseline-arm64 2025-09-26 13:08:18,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:18,801 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:18,802 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fe02f83206171a91a3b/log.txt.gz 2025-09-26 13:08:18,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:18,942 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:18,942 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fe02f83206171a91a3b/lava_callback.json.gz 2025-09-26 13:08:18,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:18,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fe02f83206171a91a3b HTTP/1.1" 200 None 2025-09-26 13:08:18,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:18,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:08:18,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:19,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68fe02f83206171a91a3b HTTP/1.1" 200 None 2025-09-26 13:08:19,046 - lava_callback - INFO - Completed processing callback for node 68d68fe02f83206171a91a3b INFO: 172.20.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57006 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:08:31,486 - lava_callback - INFO - Received callback for node 68d68fed2f83206171a91a5b INFO: 172.20.0.1:60274 - "POST /node/68d68fed2f83206171a91a5b HTTP/1.0" 202 Accepted 2025-09-26 13:08:31,495 - lava_callback - INFO - Starting async job submit for node 68d68fed2f83206171a91a5b 2025-09-26 13:08:31,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:31,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fed2f83206171a91a5b HTTP/1.1" 200 None 2025-09-26 13:08:31,539 - lava_callback - DEBUG - Processing node 68d68fed2f83206171a91a5b: baseline-arm64 2025-09-26 13:08:31,700 - lava_callback - INFO - Received callback for node 68d68fe22f83206171a91a3e INFO: 172.20.0.1:60282 - "POST /node/68d68fe22f83206171a91a3e HTTP/1.0" 202 Accepted 2025-09-26 13:08:31,732 - lava_callback - INFO - Starting async job submit for node 68d68fe22f83206171a91a3e 2025-09-26 13:08:31,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:31,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fe22f83206171a91a3e HTTP/1.1" 200 None 2025-09-26 13:08:31,884 - lava_callback - DEBUG - Processing node 68d68fe22f83206171a91a3e: baseline-arm64 2025-09-26 13:08:32,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:32,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:32,377 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fed2f83206171a91a5b/log.txt.gz 2025-09-26 13:08:32,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:32,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:32,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:32,589 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fed2f83206171a91a5b/lava_callback.json.gz 2025-09-26 13:08:32,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:32,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:32,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fed2f83206171a91a5b HTTP/1.1" 200 None 2025-09-26 13:08:32,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:32,638 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fe22f83206171a91a3e/log.txt.gz 2025-09-26 13:08:32,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:32,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:08:32,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:32,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68fed2f83206171a91a5b HTTP/1.1" 200 None 2025-09-26 13:08:32,693 - lava_callback - INFO - Completed processing callback for node 68d68fed2f83206171a91a5b 2025-09-26 13:08:32,858 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:32,859 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fe22f83206171a91a3e/lava_callback.json.gz 2025-09-26 13:08:32,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:32,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fe22f83206171a91a3e HTTP/1.1" 200 None 2025-09-26 13:08:32,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:32,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:08:32,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:32,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68fe22f83206171a91a3e HTTP/1.1" 200 None 2025-09-26 13:08:32,967 - lava_callback - INFO - Completed processing callback for node 68d68fe22f83206171a91a3e INFO: 172.20.0.1:60288 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:08:37,596 - lava_callback - INFO - Received callback for node 68d68ff02f83206171a91a62 INFO: 172.20.0.1:60296 - "POST /node/68d68ff02f83206171a91a62 HTTP/1.0" 202 Accepted 2025-09-26 13:08:37,602 - lava_callback - INFO - Starting async job submit for node 68d68ff02f83206171a91a62 2025-09-26 13:08:37,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:37,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68ff02f83206171a91a62 HTTP/1.1" 200 None 2025-09-26 13:08:37,641 - lava_callback - DEBUG - Processing node 68d68ff02f83206171a91a62: baseline-arm64 2025-09-26 13:08:37,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:38,047 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:38,048 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68ff02f83206171a91a62/log.txt.gz 2025-09-26 13:08:38,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:38,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:38,177 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68ff02f83206171a91a62/lava_callback.json.gz 2025-09-26 13:08:38,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:38,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68ff02f83206171a91a62 HTTP/1.1" 200 None 2025-09-26 13:08:38,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:38,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:08:38,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:38,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68ff02f83206171a91a62 HTTP/1.1" 200 None 2025-09-26 13:08:38,269 - lava_callback - INFO - Completed processing callback for node 68d68ff02f83206171a91a62 2025-09-26 13:08:40,021 - lava_callback - INFO - Received callback for node 68d68fe32f83206171a91a41 INFO: 172.20.0.1:46044 - "POST /node/68d68fe32f83206171a91a41 HTTP/1.0" 202 Accepted 2025-09-26 13:08:40,031 - lava_callback - INFO - Starting async job submit for node 68d68fe32f83206171a91a41 2025-09-26 13:08:40,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:40,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fe32f83206171a91a41 HTTP/1.1" 200 None 2025-09-26 13:08:40,076 - lava_callback - DEBUG - Processing node 68d68fe32f83206171a91a41: baseline-arm64 2025-09-26 13:08:40,226 - lava_callback - INFO - Received callback for node 68d68ff62f83206171a91a7a INFO: 172.20.0.1:46060 - "POST /node/68d68ff62f83206171a91a7a HTTP/1.0" 202 Accepted 2025-09-26 13:08:40,247 - lava_callback - INFO - Starting async job submit for node 68d68ff62f83206171a91a7a 2025-09-26 13:08:40,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:40,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68ff62f83206171a91a7a HTTP/1.1" 200 None 2025-09-26 13:08:40,385 - lava_callback - DEBUG - Processing node 68d68ff62f83206171a91a7a: baseline-arm64 2025-09-26 13:08:40,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:40,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:40,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:40,870 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fe32f83206171a91a41/log.txt.gz 2025-09-26 13:08:40,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:41,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:41,001 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68ff62f83206171a91a7a/log.txt.gz 2025-09-26 13:08:41,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:41,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:41,023 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fe32f83206171a91a41/lava_callback.json.gz 2025-09-26 13:08:41,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:41,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fe32f83206171a91a41 HTTP/1.1" 200 None 2025-09-26 13:08:41,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:41,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:08:41,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:41,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68fe32f83206171a91a41 HTTP/1.1" 200 None 2025-09-26 13:08:41,142 - lava_callback - INFO - Completed processing callback for node 68d68fe32f83206171a91a41 2025-09-26 13:08:41,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:41,154 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68ff62f83206171a91a7a/lava_callback.json.gz 2025-09-26 13:08:41,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:41,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68ff62f83206171a91a7a HTTP/1.1" 200 None 2025-09-26 13:08:41,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:41,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:08:41,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:41,273 - lava_callback - INFO - Received callback for node 68d68ff72f83206171a91a7d INFO: 172.20.0.1:46074 - "POST /node/68d68ff72f83206171a91a7d HTTP/1.0" 202 Accepted 2025-09-26 13:08:41,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68ff62f83206171a91a7a HTTP/1.1" 200 None 2025-09-26 13:08:41,287 - lava_callback - INFO - Starting async job submit for node 68d68ff72f83206171a91a7d 2025-09-26 13:08:41,298 - lava_callback - INFO - Completed processing callback for node 68d68ff62f83206171a91a7a 2025-09-26 13:08:41,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:41,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68ff72f83206171a91a7d HTTP/1.1" 200 None 2025-09-26 13:08:41,354 - lava_callback - DEBUG - Processing node 68d68ff72f83206171a91a7d: baseline-arm64 2025-09-26 13:08:41,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:41,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:41,807 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68ff72f83206171a91a7d/log.txt.gz 2025-09-26 13:08:41,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:41,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:41,932 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68ff72f83206171a91a7d/lava_callback.json.gz 2025-09-26 13:08:41,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:41,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68ff72f83206171a91a7d HTTP/1.1" 200 None 2025-09-26 13:08:41,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:41,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:08:41,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:42,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68ff72f83206171a91a7d HTTP/1.1" 200 None 2025-09-26 13:08:42,019 - lava_callback - INFO - Completed processing callback for node 68d68ff72f83206171a91a7d 2025-09-26 13:08:45,606 - lava_callback - INFO - Received callback for node 68d68fec2f83206171a91a58 INFO: 172.20.0.1:46080 - "POST /node/68d68fec2f83206171a91a58 HTTP/1.0" 202 Accepted 2025-09-26 13:08:45,615 - lava_callback - INFO - Starting async job submit for node 68d68fec2f83206171a91a58 2025-09-26 13:08:45,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:45,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fec2f83206171a91a58 HTTP/1.1" 200 None 2025-09-26 13:08:45,673 - lava_callback - DEBUG - Processing node 68d68fec2f83206171a91a58: baseline-arm64 2025-09-26 13:08:45,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:46,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:46,086 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fec2f83206171a91a58/log.txt.gz 2025-09-26 13:08:46,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:08:46,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:08:46,340 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fec2f83206171a91a58/lava_callback.json.gz 2025-09-26 13:08:46,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:46,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fec2f83206171a91a58 HTTP/1.1" 200 None 2025-09-26 13:08:46,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:46,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:08:46,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:08:46,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68fec2f83206171a91a58 HTTP/1.1" 200 None 2025-09-26 13:08:46,432 - lava_callback - INFO - Completed processing callback for node 68d68fec2f83206171a91a58 INFO: 172.20.0.1:46084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52206 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:09:01,049 - lava_callback - INFO - Received callback for node 68d68ff02f83206171a91a65 INFO: 172.20.0.1:59430 - "POST /node/68d68ff02f83206171a91a65 HTTP/1.0" 202 Accepted 2025-09-26 13:09:01,056 - lava_callback - INFO - Starting async job submit for node 68d68ff02f83206171a91a65 2025-09-26 13:09:01,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:01,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68ff02f83206171a91a65 HTTP/1.1" 200 None 2025-09-26 13:09:01,090 - lava_callback - DEBUG - Processing node 68d68ff02f83206171a91a65: baseline-arm64 2025-09-26 13:09:01,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:09:01,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:09:01,478 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68ff02f83206171a91a65/log.txt.gz 2025-09-26 13:09:01,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:09:01,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:09:01,594 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68ff02f83206171a91a65/lava_callback.json.gz 2025-09-26 13:09:01,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:01,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68ff02f83206171a91a65 HTTP/1.1" 200 None 2025-09-26 13:09:01,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:01,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:09:01,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:01,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68ff02f83206171a91a65 HTTP/1.1" 200 None 2025-09-26 13:09:01,723 - lava_callback - INFO - Completed processing callback for node 68d68ff02f83206171a91a65 INFO: 172.20.0.1:59442 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:09:06,873 - lava_callback - INFO - Received callback for node 68d6901c2f83206171a91ad3 INFO: 172.20.0.1:59456 - "POST /node/68d6901c2f83206171a91ad3 HTTP/1.0" 202 Accepted 2025-09-26 13:09:06,881 - lava_callback - INFO - Starting async job submit for node 68d6901c2f83206171a91ad3 2025-09-26 13:09:06,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:06,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6901c2f83206171a91ad3 HTTP/1.1" 200 None 2025-09-26 13:09:06,916 - lava_callback - DEBUG - Processing node 68d6901c2f83206171a91ad3: baseline-arm64 2025-09-26 13:09:07,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:09:07,389 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:09:07,390 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6901c2f83206171a91ad3/log.txt.gz 2025-09-26 13:09:07,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:09:07,556 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:09:07,556 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6901c2f83206171a91ad3/lava_callback.json.gz 2025-09-26 13:09:07,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:07,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6901c2f83206171a91ad3 HTTP/1.1" 200 None 2025-09-26 13:09:07,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:07,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:09:07,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:07,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6901c2f83206171a91ad3 HTTP/1.1" 200 None 2025-09-26 13:09:07,647 - lava_callback - INFO - Completed processing callback for node 68d6901c2f83206171a91ad3 INFO: 172.20.0.1:45802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45810 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:09:22,639 - lava_callback - INFO - Received callback for node 68d690202f83206171a91ad9 INFO: 172.20.0.1:50662 - "POST /node/68d690202f83206171a91ad9 HTTP/1.0" 202 Accepted 2025-09-26 13:09:22,646 - lava_callback - INFO - Starting async job submit for node 68d690202f83206171a91ad9 2025-09-26 13:09:22,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:22,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690202f83206171a91ad9 HTTP/1.1" 200 None 2025-09-26 13:09:22,698 - lava_callback - DEBUG - Processing node 68d690202f83206171a91ad9: baseline-arm64 2025-09-26 13:09:23,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:09:23,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:09:23,151 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690202f83206171a91ad9/log.txt.gz 2025-09-26 13:09:23,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:09:23,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:09:23,285 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690202f83206171a91ad9/lava_callback.json.gz 2025-09-26 13:09:23,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:23,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690202f83206171a91ad9 HTTP/1.1" 200 None 2025-09-26 13:09:23,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:23,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:09:23,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:23,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690202f83206171a91ad9 HTTP/1.1" 200 None 2025-09-26 13:09:23,373 - lava_callback - INFO - Completed processing callback for node 68d690202f83206171a91ad9 INFO: 172.20.0.1:50674 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:09:23,902 - lava_callback - INFO - Received callback for node 68d68d092f83206171a91960 INFO: 172.20.0.1:50682 - "POST /node/68d68d092f83206171a91960 HTTP/1.0" 202 Accepted 2025-09-26 13:09:23,910 - lava_callback - INFO - Starting async job submit for node 68d68d092f83206171a91960 2025-09-26 13:09:23,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:23,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68d092f83206171a91960 HTTP/1.1" 200 None 2025-09-26 13:09:23,973 - lava_callback - DEBUG - Processing node 68d68d092f83206171a91960: baseline-arm64 2025-09-26 13:09:25,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:09:25,328 - lava_callback - INFO - Received callback for node 68d6901f2f83206171a91ad6 INFO: 172.20.0.1:50696 - "POST /node/68d6901f2f83206171a91ad6 HTTP/1.0" 202 Accepted 2025-09-26 13:09:25,338 - lava_callback - INFO - Starting async job submit for node 68d6901f2f83206171a91ad6 2025-09-26 13:09:25,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:25,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6901f2f83206171a91ad6 HTTP/1.1" 200 None 2025-09-26 13:09:25,387 - lava_callback - DEBUG - Processing node 68d6901f2f83206171a91ad6: baseline-arm64 2025-09-26 13:09:25,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:09:25,512 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68d092f83206171a91960/log.txt.gz 2025-09-26 13:09:25,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:09:25,786 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:09:25,797 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68d092f83206171a91960/lava_callback.json.gz DEBUG: Setup failed for 68d68d092f83206171a91960. Transitting job node result: incomplete -> fail 2025-09-26 13:09:25,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:25,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:09:25,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68d092f83206171a91960 HTTP/1.1" 200 None 2025-09-26 13:09:25,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:25,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:09:25,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:25,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68d092f83206171a91960 HTTP/1.1" 200 None 2025-09-26 13:09:25,934 - lava_callback - INFO - Completed processing callback for node 68d68d092f83206171a91960 2025-09-26 13:09:26,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:09:26,029 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6901f2f83206171a91ad6/log.txt.gz 2025-09-26 13:09:26,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:09:26,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:09:26,145 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6901f2f83206171a91ad6/lava_callback.json.gz 2025-09-26 13:09:26,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:26,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6901f2f83206171a91ad6 HTTP/1.1" 200 None 2025-09-26 13:09:26,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:26,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:09:26,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:26,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6901f2f83206171a91ad6 HTTP/1.1" 200 None 2025-09-26 13:09:26,223 - lava_callback - INFO - Completed processing callback for node 68d6901f2f83206171a91ad6 INFO: 172.20.0.1:50710 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:09:27,024 - lava_callback - INFO - Received callback for node 68d68fe92f83206171a91a4a INFO: 172.20.0.1:50718 - "POST /node/68d68fe92f83206171a91a4a HTTP/1.0" 202 Accepted 2025-09-26 13:09:27,032 - lava_callback - INFO - Starting async job submit for node 68d68fe92f83206171a91a4a 2025-09-26 13:09:27,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:27,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fe92f83206171a91a4a HTTP/1.1" 200 None 2025-09-26 13:09:27,080 - lava_callback - DEBUG - Processing node 68d68fe92f83206171a91a4a: baseline-arm64 2025-09-26 13:09:27,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:09:27,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:09:27,494 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fe92f83206171a91a4a/log.txt.gz 2025-09-26 13:09:27,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:09:27,623 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:09:27,623 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fe92f83206171a91a4a/lava_callback.json.gz 2025-09-26 13:09:27,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:27,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fe92f83206171a91a4a HTTP/1.1" 200 None 2025-09-26 13:09:27,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:27,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:09:27,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:27,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68fe92f83206171a91a4a HTTP/1.1" 200 None 2025-09-26 13:09:27,713 - lava_callback - INFO - Completed processing callback for node 68d68fe92f83206171a91a4a 2025-09-26 13:09:28,463 - lava_callback - INFO - Received callback for node 68d6901b2f83206171a91ad0 INFO: 172.20.0.1:50724 - "POST /node/68d6901b2f83206171a91ad0 HTTP/1.0" 202 Accepted 2025-09-26 13:09:28,471 - lava_callback - INFO - Starting async job submit for node 68d6901b2f83206171a91ad0 2025-09-26 13:09:28,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:28,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6901b2f83206171a91ad0 HTTP/1.1" 200 None 2025-09-26 13:09:28,545 - lava_callback - DEBUG - Processing node 68d6901b2f83206171a91ad0: baseline-arm64 2025-09-26 13:09:28,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:09:29,006 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:09:29,007 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6901b2f83206171a91ad0/log.txt.gz 2025-09-26 13:09:29,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:09:29,148 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:09:29,149 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6901b2f83206171a91ad0/lava_callback.json.gz 2025-09-26 13:09:29,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:29,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6901b2f83206171a91ad0 HTTP/1.1" 200 None 2025-09-26 13:09:29,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:29,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:09:29,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:29,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6901b2f83206171a91ad0 HTTP/1.1" 200 None 2025-09-26 13:09:29,230 - lava_callback - INFO - Completed processing callback for node 68d6901b2f83206171a91ad0 INFO: 172.20.0.1:57868 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:09:42,584 - lava_callback - INFO - Received callback for node 68d690142f83206171a91ac4 INFO: 172.20.0.1:33812 - "POST /node/68d690142f83206171a91ac4 HTTP/1.0" 202 Accepted 2025-09-26 13:09:42,590 - lava_callback - INFO - Starting async job submit for node 68d690142f83206171a91ac4 2025-09-26 13:09:42,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:42,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690142f83206171a91ac4 HTTP/1.1" 200 None 2025-09-26 13:09:42,622 - lava_callback - DEBUG - Processing node 68d690142f83206171a91ac4: baseline-arm64 2025-09-26 13:09:42,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:09:43,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:09:43,038 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690142f83206171a91ac4/log.txt.gz 2025-09-26 13:09:43,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:09:43,156 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:09:43,157 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690142f83206171a91ac4/lava_callback.json.gz 2025-09-26 13:09:43,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:43,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690142f83206171a91ac4 HTTP/1.1" 200 None 2025-09-26 13:09:43,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:43,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:09:43,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:43,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690142f83206171a91ac4 HTTP/1.1" 200 None 2025-09-26 13:09:43,229 - lava_callback - INFO - Completed processing callback for node 68d690142f83206171a91ac4 INFO: 172.20.0.1:33826 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:09:47,264 - lava_callback - INFO - Received callback for node 68d68fdd2f83206171a91a35 INFO: 172.20.0.1:33840 - "POST /node/68d68fdd2f83206171a91a35 HTTP/1.0" 202 Accepted 2025-09-26 13:09:47,270 - lava_callback - INFO - Starting async job submit for node 68d68fdd2f83206171a91a35 2025-09-26 13:09:47,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:47,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fdd2f83206171a91a35 HTTP/1.1" 200 None 2025-09-26 13:09:47,302 - lava_callback - DEBUG - Processing node 68d68fdd2f83206171a91a35: baseline-arm64 2025-09-26 13:09:47,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:09:48,178 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:09:48,179 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fdd2f83206171a91a35/log.txt.gz 2025-09-26 13:09:48,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:09:48,304 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:09:48,304 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fdd2f83206171a91a35/lava_callback.json.gz 2025-09-26 13:09:48,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:48,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fdd2f83206171a91a35 HTTP/1.1" 200 None 2025-09-26 13:09:48,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:48,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:09:48,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:09:48,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68fdd2f83206171a91a35 HTTP/1.1" 200 None 2025-09-26 13:09:48,388 - lava_callback - INFO - Completed processing callback for node 68d68fdd2f83206171a91a35 INFO: 172.20.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40094 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:10:04,176 - lava_callback - INFO - Received callback for node 68d42800a5c2c05277bc74f6 INFO: 172.20.0.1:47894 - "POST /node/68d42800a5c2c05277bc74f6 HTTP/1.0" 202 Accepted 2025-09-26 13:10:04,182 - lava_callback - INFO - Starting async job submit for node 68d42800a5c2c05277bc74f6 2025-09-26 13:10:04,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:04,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42800a5c2c05277bc74f6 HTTP/1.1" 200 None 2025-09-26 13:10:04,215 - lava_callback - DEBUG - Processing node 68d42800a5c2c05277bc74f6: baseline-arm 2025-09-26 13:10:04,440 - lava_callback - ERROR - Error processing callback for node 68d42800a5c2c05277bc74f6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:47904 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:10:06,535 - lava_callback - INFO - Received callback for node 68d68d152f83206171a91966 INFO: 172.20.0.1:47918 - "POST /node/68d68d152f83206171a91966 HTTP/1.0" 202 Accepted 2025-09-26 13:10:06,542 - lava_callback - INFO - Starting async job submit for node 68d68d152f83206171a91966 2025-09-26 13:10:06,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:06,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68d152f83206171a91966 HTTP/1.1" 200 None 2025-09-26 13:10:06,596 - lava_callback - DEBUG - Processing node 68d68d152f83206171a91966: baseline-arm64 2025-09-26 13:10:07,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:10:07,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:10:07,687 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68d152f83206171a91966/log.txt.gz 2025-09-26 13:10:07,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:10:07,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:10:07,889 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68d152f83206171a91966/lava_callback.json.gz DEBUG: Setup failed for 68d68d152f83206171a91966. Transitting job node result: incomplete -> fail 2025-09-26 13:10:07,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:07,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68d152f83206171a91966 HTTP/1.1" 200 None 2025-09-26 13:10:07,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:07,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:10:07,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:08,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68d152f83206171a91966 HTTP/1.1" 200 None 2025-09-26 13:10:08,017 - lava_callback - INFO - Completed processing callback for node 68d68d152f83206171a91966 2025-09-26 13:10:10,876 - lava_callback - INFO - Received callback for node 68d690852f83206171a91ba3 INFO: 172.20.0.1:57786 - "POST /node/68d690852f83206171a91ba3 HTTP/1.0" 202 Accepted 2025-09-26 13:10:10,884 - lava_callback - INFO - Starting async job submit for node 68d690852f83206171a91ba3 2025-09-26 13:10:10,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:10,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690852f83206171a91ba3 HTTP/1.1" 200 None 2025-09-26 13:10:10,919 - lava_callback - DEBUG - Processing node 68d690852f83206171a91ba3: baseline-arm64-pengutronix 2025-09-26 13:10:11,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:10:11,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:10:11,244 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d690852f83206171a91ba3/log.txt.gz 2025-09-26 13:10:11,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:10:11,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:10:11,363 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d690852f83206171a91ba3/lava_callback.json.gz 2025-09-26 13:10:11,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:11,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690852f83206171a91ba3 HTTP/1.1" 200 None 2025-09-26 13:10:11,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:11,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:10:11,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:11,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690852f83206171a91ba3 HTTP/1.1" 200 None 2025-09-26 13:10:11,468 - lava_callback - INFO - Completed processing callback for node 68d690852f83206171a91ba3 2025-09-26 13:10:14,288 - lava_callback - INFO - Received callback for node 68d690512f83206171a91b4a INFO: 172.20.0.1:57788 - "POST /node/68d690512f83206171a91b4a HTTP/1.0" 202 Accepted 2025-09-26 13:10:14,294 - lava_callback - INFO - Starting async job submit for node 68d690512f83206171a91b4a 2025-09-26 13:10:14,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:14,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690512f83206171a91b4a HTTP/1.1" 200 None 2025-09-26 13:10:14,327 - lava_callback - DEBUG - Processing node 68d690512f83206171a91b4a: baseline-arm64-broonie 2025-09-26 13:10:14,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:10:14,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:10:14,668 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d690512f83206171a91b4a/log.txt.gz 2025-09-26 13:10:14,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:10:14,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:10:14,781 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d690512f83206171a91b4a/lava_callback.json.gz 2025-09-26 13:10:14,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:14,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690512f83206171a91b4a HTTP/1.1" 200 None 2025-09-26 13:10:14,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:14,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:10:14,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:14,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690512f83206171a91b4a HTTP/1.1" 200 None 2025-09-26 13:10:14,857 - lava_callback - INFO - Completed processing callback for node 68d690512f83206171a91b4a INFO: 172.20.0.1:57796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57810 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:10:19,450 - lava_callback - INFO - Received callback for node 68d690892f83206171a91bb5 INFO: 172.20.0.1:50566 - "POST /node/68d690892f83206171a91bb5 HTTP/1.0" 202 Accepted 2025-09-26 13:10:19,456 - lava_callback - INFO - Starting async job submit for node 68d690892f83206171a91bb5 2025-09-26 13:10:19,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:19,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690892f83206171a91bb5 HTTP/1.1" 200 None 2025-09-26 13:10:19,488 - lava_callback - DEBUG - Processing node 68d690892f83206171a91bb5: baseline-arm64-pengutronix 2025-09-26 13:10:19,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:10:19,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:10:19,803 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d690892f83206171a91bb5/log.txt.gz 2025-09-26 13:10:19,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:10:19,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:10:19,921 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d690892f83206171a91bb5/lava_callback.json.gz 2025-09-26 13:10:19,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:19,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690892f83206171a91bb5 HTTP/1.1" 200 None 2025-09-26 13:10:19,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:19,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:10:19,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:19,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690892f83206171a91bb5 HTTP/1.1" 200 None 2025-09-26 13:10:19,993 - lava_callback - INFO - Completed processing callback for node 68d690892f83206171a91bb5 INFO: 172.20.0.1:50568 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:10:25,141 - lava_callback - INFO - Received callback for node 68d688a22f83206171a91552 INFO: 172.20.0.1:50576 - "POST /node/68d688a22f83206171a91552 HTTP/1.0" 202 Accepted 2025-09-26 13:10:25,148 - lava_callback - INFO - Starting async job submit for node 68d688a22f83206171a91552 2025-09-26 13:10:25,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:25,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688a22f83206171a91552 HTTP/1.1" 200 None 2025-09-26 13:10:25,240 - lava_callback - DEBUG - Processing node 68d688a22f83206171a91552: ltp-smoketest 2025-09-26 13:10:25,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:10:25,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:10:25,881 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d688a22f83206171a91552/log.txt.gz 2025-09-26 13:10:25,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:10:26,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:10:26,029 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d688a22f83206171a91552/lava_callback.json.gz 2025-09-26 13:10:26,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:26,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688a22f83206171a91552 HTTP/1.1" 200 None 2025-09-26 13:10:26,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:26,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7b30c58dac7d9410c2 HTTP/1.1" 200 None 2025-09-26 13:10:26,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:26,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688a22f83206171a91552 HTTP/1.1" 200 None 2025-09-26 13:10:26,193 - lava_callback - INFO - Completed processing callback for node 68d688a22f83206171a91552 INFO: 172.20.0.1:50592 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:10:28,573 - lava_callback - INFO - Received callback for node 68d6908e2f83206171a91bbb INFO: 172.20.0.1:50608 - "POST /node/68d6908e2f83206171a91bbb HTTP/1.0" 202 Accepted 2025-09-26 13:10:28,580 - lava_callback - INFO - Starting async job submit for node 68d6908e2f83206171a91bbb 2025-09-26 13:10:28,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:28,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6908e2f83206171a91bbb HTTP/1.1" 200 None 2025-09-26 13:10:28,622 - lava_callback - DEBUG - Processing node 68d6908e2f83206171a91bbb: baseline-arm64-foundriesio 2025-09-26 13:10:28,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:10:29,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:10:29,082 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6908e2f83206171a91bbb/log.txt.gz 2025-09-26 13:10:29,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:10:29,198 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:10:29,199 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6908e2f83206171a91bbb/lava_callback.json.gz 2025-09-26 13:10:29,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:29,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6908e2f83206171a91bbb HTTP/1.1" 200 None 2025-09-26 13:10:29,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:29,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:10:29,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:29,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6908e2f83206171a91bbb HTTP/1.1" 200 None 2025-09-26 13:10:29,280 - lava_callback - INFO - Completed processing callback for node 68d6908e2f83206171a91bbb 2025-09-26 13:10:34,716 - lava_callback - INFO - Received callback for node 68d6908c2f83206171a91bb8 INFO: 172.20.0.1:51378 - "POST /node/68d6908c2f83206171a91bb8 HTTP/1.0" 202 Accepted 2025-09-26 13:10:34,722 - lava_callback - INFO - Starting async job submit for node 68d6908c2f83206171a91bb8 2025-09-26 13:10:34,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:34,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6908c2f83206171a91bb8 HTTP/1.1" 200 None 2025-09-26 13:10:34,755 - lava_callback - DEBUG - Processing node 68d6908c2f83206171a91bb8: baseline-arm64-foundriesio 2025-09-26 13:10:34,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:10:35,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:10:35,077 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6908c2f83206171a91bb8/log.txt.gz 2025-09-26 13:10:35,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:10:35,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:10:35,197 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6908c2f83206171a91bb8/lava_callback.json.gz 2025-09-26 13:10:35,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:35,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6908c2f83206171a91bb8 HTTP/1.1" 200 None 2025-09-26 13:10:35,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:35,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:10:35,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:35,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6908c2f83206171a91bb8 HTTP/1.1" 200 None 2025-09-26 13:10:35,274 - lava_callback - INFO - Completed processing callback for node 68d6908c2f83206171a91bb8 INFO: 172.20.0.1:51392 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:10:37,075 - lava_callback - INFO - Received callback for node 68d690352f83206171a91b04 INFO: 172.20.0.1:51398 - "POST /node/68d690352f83206171a91b04 HTTP/1.0" 202 Accepted 2025-09-26 13:10:37,081 - lava_callback - INFO - Starting async job submit for node 68d690352f83206171a91b04 2025-09-26 13:10:37,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:37,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690352f83206171a91b04 HTTP/1.1" 200 None 2025-09-26 13:10:37,114 - lava_callback - DEBUG - Processing node 68d690352f83206171a91b04: baseline-arm64-baylibre 2025-09-26 13:10:37,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:10:37,462 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:10:37,463 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d690352f83206171a91b04/log.txt.gz 2025-09-26 13:10:37,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:10:37,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:10:37,579 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d690352f83206171a91b04/lava_callback.json.gz 2025-09-26 13:10:37,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:37,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690352f83206171a91b04 HTTP/1.1" 200 None 2025-09-26 13:10:37,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:37,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:10:37,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:37,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690352f83206171a91b04 HTTP/1.1" 200 None 2025-09-26 13:10:37,671 - lava_callback - INFO - Completed processing callback for node 68d690352f83206171a91b04 2025-09-26 13:10:39,524 - lava_callback - INFO - Received callback for node 68d68fe92f83206171a91a51 INFO: 172.20.0.1:58690 - "POST /node/68d68fe92f83206171a91a51 HTTP/1.0" 202 Accepted 2025-09-26 13:10:39,530 - lava_callback - INFO - Starting async job submit for node 68d68fe92f83206171a91a51 2025-09-26 13:10:39,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:39,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fe92f83206171a91a51 HTTP/1.1" 200 None 2025-09-26 13:10:39,563 - lava_callback - DEBUG - Processing node 68d68fe92f83206171a91a51: baseline-arm64 2025-09-26 13:10:39,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:10:39,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:10:39,951 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fe92f83206171a91a51/log.txt.gz 2025-09-26 13:10:39,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:10:40,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:10:40,070 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fe92f83206171a91a51/lava_callback.json.gz 2025-09-26 13:10:40,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:40,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fe92f83206171a91a51 HTTP/1.1" 200 None 2025-09-26 13:10:40,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:40,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:10:40,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:40,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68fe92f83206171a91a51 HTTP/1.1" 200 None 2025-09-26 13:10:40,146 - lava_callback - INFO - Completed processing callback for node 68d68fe92f83206171a91a51 2025-09-26 13:10:43,076 - lava_callback - INFO - Received callback for node 68d690702f83206171a91b80 INFO: 172.20.0.1:58704 - "POST /node/68d690702f83206171a91b80 HTTP/1.0" 202 Accepted 2025-09-26 13:10:43,082 - lava_callback - INFO - Starting async job submit for node 68d690702f83206171a91b80 2025-09-26 13:10:43,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:43,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690702f83206171a91b80 HTTP/1.1" 200 None 2025-09-26 13:10:43,116 - lava_callback - DEBUG - Processing node 68d690702f83206171a91b80: baseline-arm64-clabbe 2025-09-26 13:10:43,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:10:43,556 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:10:43,556 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d690702f83206171a91b80/log.txt.gz 2025-09-26 13:10:43,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:10:43,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:10:43,688 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d690702f83206171a91b80/lava_callback.json.gz 2025-09-26 13:10:43,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:43,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690702f83206171a91b80 HTTP/1.1" 200 None 2025-09-26 13:10:43,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:43,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:10:43,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:43,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690702f83206171a91b80 HTTP/1.1" 200 None 2025-09-26 13:10:43,779 - lava_callback - INFO - Completed processing callback for node 68d690702f83206171a91b80 INFO: 172.20.0.1:58712 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:10:53,475 - lava_callback - INFO - Received callback for node 68d6905d2f83206171a91b66 INFO: 172.20.0.1:46132 - "POST /node/68d6905d2f83206171a91b66 HTTP/1.0" 202 Accepted 2025-09-26 13:10:53,481 - lava_callback - INFO - Starting async job submit for node 68d6905d2f83206171a91b66 2025-09-26 13:10:53,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:53,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6905d2f83206171a91b66 HTTP/1.1" 200 None 2025-09-26 13:10:53,519 - lava_callback - DEBUG - Processing node 68d6905d2f83206171a91b66: baseline-arm64-broonie 2025-09-26 13:10:53,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:10:53,952 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:10:53,953 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6905d2f83206171a91b66/log.txt.gz 2025-09-26 13:10:53,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:10:54,069 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:10:54,070 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6905d2f83206171a91b66/lava_callback.json.gz 2025-09-26 13:10:54,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:54,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6905d2f83206171a91b66 HTTP/1.1" 200 None 2025-09-26 13:10:54,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:54,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:10:54,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:54,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6905d2f83206171a91b66 HTTP/1.1" 200 None 2025-09-26 13:10:54,144 - lava_callback - INFO - Completed processing callback for node 68d6905d2f83206171a91b66 INFO: 172.20.0.1:46134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46136 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:10:58,363 - lava_callback - INFO - Received callback for node 68d690812f83206171a91b99 INFO: 172.20.0.1:46150 - "POST /node/68d690812f83206171a91b99 HTTP/1.0" 202 Accepted 2025-09-26 13:10:58,369 - lava_callback - INFO - Starting async job submit for node 68d690812f83206171a91b99 2025-09-26 13:10:58,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:58,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690812f83206171a91b99 HTTP/1.1" 200 None 2025-09-26 13:10:58,402 - lava_callback - DEBUG - Processing node 68d690812f83206171a91b99: baseline-arm64-clabbe 2025-09-26 13:10:58,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:10:58,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:10:58,750 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d690812f83206171a91b99/log.txt.gz 2025-09-26 13:10:58,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:10:58,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:10:58,889 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d690812f83206171a91b99/lava_callback.json.gz 2025-09-26 13:10:58,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:58,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690812f83206171a91b99 HTTP/1.1" 200 None 2025-09-26 13:10:58,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:58,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:10:58,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:10:58,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690812f83206171a91b99 HTTP/1.1" 200 None 2025-09-26 13:10:58,974 - lava_callback - INFO - Completed processing callback for node 68d690812f83206171a91b99 INFO: 172.20.0.1:55284 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:11:07,387 - lava_callback - INFO - Received callback for node 68d6902c2f83206171a91aeb INFO: 172.20.0.1:55292 - "POST /node/68d6902c2f83206171a91aeb HTTP/1.0" 202 Accepted 2025-09-26 13:11:07,393 - lava_callback - INFO - Starting async job submit for node 68d6902c2f83206171a91aeb 2025-09-26 13:11:07,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:07,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6902c2f83206171a91aeb HTTP/1.1" 200 None 2025-09-26 13:11:07,426 - lava_callback - DEBUG - Processing node 68d6902c2f83206171a91aeb: baseline-arm64-baylibre 2025-09-26 13:11:07,557 - lava_callback - INFO - Received callback for node 68d68fd22f83206171a91a18 INFO: 172.20.0.1:55302 - "POST /node/68d68fd22f83206171a91a18 HTTP/1.0" 202 Accepted 2025-09-26 13:11:07,584 - lava_callback - INFO - Starting async job submit for node 68d68fd22f83206171a91a18 2025-09-26 13:11:07,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:07,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fd22f83206171a91a18 HTTP/1.1" 200 None 2025-09-26 13:11:07,701 - lava_callback - DEBUG - Processing node 68d68fd22f83206171a91a18: baseline-arm64 2025-09-26 13:11:07,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:11:08,005 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:11:08,042 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6902c2f83206171a91aeb/log.txt.gz 2025-09-26 13:11:08,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:11:08,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:11:08,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:11:08,337 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6902c2f83206171a91aeb/lava_callback.json.gz 2025-09-26 13:11:08,354 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:11:08,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:08,359 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fd22f83206171a91a18/log.txt.gz 2025-09-26 13:11:08,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:11:08,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6902c2f83206171a91aeb HTTP/1.1" 200 None 2025-09-26 13:11:08,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:08,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:11:08,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:08,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6902c2f83206171a91aeb HTTP/1.1" 200 None 2025-09-26 13:11:08,433 - lava_callback - INFO - Completed processing callback for node 68d6902c2f83206171a91aeb 2025-09-26 13:11:08,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:11:08,534 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fd22f83206171a91a18/lava_callback.json.gz 2025-09-26 13:11:08,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:08,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fd22f83206171a91a18 HTTP/1.1" 200 None 2025-09-26 13:11:08,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:08,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:11:08,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:08,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68fd22f83206171a91a18 HTTP/1.1" 200 None 2025-09-26 13:11:08,628 - lava_callback - INFO - Completed processing callback for node 68d68fd22f83206171a91a18 2025-09-26 13:11:10,148 - lava_callback - INFO - Received callback for node 68d690482f83206171a91b39 INFO: 172.20.0.1:37308 - "POST /node/68d690482f83206171a91b39 HTTP/1.0" 202 Accepted 2025-09-26 13:11:10,154 - lava_callback - INFO - Starting async job submit for node 68d690482f83206171a91b39 2025-09-26 13:11:10,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:10,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690482f83206171a91b39 HTTP/1.1" 200 None 2025-09-26 13:11:10,210 - lava_callback - DEBUG - Processing node 68d690482f83206171a91b39: baseline-arm64-broonie 2025-09-26 13:11:10,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:11:10,541 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:11:10,542 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d690482f83206171a91b39/log.txt.gz 2025-09-26 13:11:10,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:11:10,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:11:10,676 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d690482f83206171a91b39/lava_callback.json.gz 2025-09-26 13:11:10,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:10,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690482f83206171a91b39 HTTP/1.1" 200 None 2025-09-26 13:11:10,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:10,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:11:10,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:10,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690482f83206171a91b39 HTTP/1.1" 200 None 2025-09-26 13:11:10,753 - lava_callback - INFO - Completed processing callback for node 68d690482f83206171a91b39 INFO: 172.20.0.1:37316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37326 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:11:16,813 - lava_callback - INFO - Received callback for node 68d690692f83206171a91b76 INFO: 172.20.0.1:37336 - "POST /node/68d690692f83206171a91b76 HTTP/1.0" 202 Accepted 2025-09-26 13:11:16,818 - lava_callback - INFO - Starting async job submit for node 68d690692f83206171a91b76 2025-09-26 13:11:16,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:16,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690692f83206171a91b76 HTTP/1.1" 200 None 2025-09-26 13:11:16,878 - lava_callback - DEBUG - Processing node 68d690692f83206171a91b76: baseline-arm64-broonie 2025-09-26 13:11:17,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:11:17,260 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:11:17,260 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d690692f83206171a91b76/log.txt.gz 2025-09-26 13:11:17,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:11:17,371 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:11:17,372 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d690692f83206171a91b76/lava_callback.json.gz 2025-09-26 13:11:17,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:17,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690692f83206171a91b76 HTTP/1.1" 200 None 2025-09-26 13:11:17,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:17,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:11:17,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:17,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690692f83206171a91b76 HTTP/1.1" 200 None 2025-09-26 13:11:17,472 - lava_callback - INFO - Completed processing callback for node 68d690692f83206171a91b76 2025-09-26 13:11:19,232 - lava_callback - INFO - Received callback for node 68d690322f83206171a91af9 INFO: 172.20.0.1:37342 - "POST /node/68d690322f83206171a91af9 HTTP/1.0" 202 Accepted 2025-09-26 13:11:19,238 - lava_callback - INFO - Starting async job submit for node 68d690322f83206171a91af9 2025-09-26 13:11:19,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:19,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690322f83206171a91af9 HTTP/1.1" 200 None 2025-09-26 13:11:19,271 - lava_callback - DEBUG - Processing node 68d690322f83206171a91af9: baseline-arm64-baylibre 2025-09-26 13:11:19,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:11:19,690 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:11:19,691 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d690322f83206171a91af9/log.txt.gz 2025-09-26 13:11:19,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:11:19,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:11:19,811 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d690322f83206171a91af9/lava_callback.json.gz 2025-09-26 13:11:19,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:19,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690322f83206171a91af9 HTTP/1.1" 200 None 2025-09-26 13:11:19,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:19,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:11:19,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:19,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690322f83206171a91af9 HTTP/1.1" 200 None 2025-09-26 13:11:19,888 - lava_callback - INFO - Completed processing callback for node 68d690322f83206171a91af9 2025-09-26 13:11:23,297 - lava_callback - INFO - Received callback for node 68d690152f83206171a91ac7 INFO: 172.20.0.1:58090 - "POST /node/68d690152f83206171a91ac7 HTTP/1.0" 202 Accepted 2025-09-26 13:11:23,303 - lava_callback - INFO - Starting async job submit for node 68d690152f83206171a91ac7 2025-09-26 13:11:23,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:23,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690152f83206171a91ac7 HTTP/1.1" 200 None 2025-09-26 13:11:23,335 - lava_callback - DEBUG - Processing node 68d690152f83206171a91ac7: baseline-arm64 INFO: 172.20.0.1:58098 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:11:23,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:11:23,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:11:23,695 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690152f83206171a91ac7/log.txt.gz 2025-09-26 13:11:23,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:11:23,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:11:23,804 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690152f83206171a91ac7/lava_callback.json.gz 2025-09-26 13:11:23,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:23,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690152f83206171a91ac7 HTTP/1.1" 200 None 2025-09-26 13:11:23,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:23,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:11:23,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:23,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690152f83206171a91ac7 HTTP/1.1" 200 None 2025-09-26 13:11:23,884 - lava_callback - INFO - Completed processing callback for node 68d690152f83206171a91ac7 INFO: 172.20.0.1:58102 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:11:27,980 - lava_callback - INFO - Received callback for node 68d690182f83206171a91aca INFO: 172.20.0.1:58116 - "POST /node/68d690182f83206171a91aca HTTP/1.0" 202 Accepted 2025-09-26 13:11:27,986 - lava_callback - INFO - Starting async job submit for node 68d690182f83206171a91aca 2025-09-26 13:11:28,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:28,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690182f83206171a91aca HTTP/1.1" 200 None 2025-09-26 13:11:28,019 - lava_callback - DEBUG - Processing node 68d690182f83206171a91aca: baseline-arm64 2025-09-26 13:11:28,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:11:28,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:11:28,389 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690182f83206171a91aca/log.txt.gz 2025-09-26 13:11:28,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:11:28,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:11:28,520 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690182f83206171a91aca/lava_callback.json.gz 2025-09-26 13:11:28,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:28,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690182f83206171a91aca HTTP/1.1" 200 None 2025-09-26 13:11:28,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:28,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:11:28,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:28,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690182f83206171a91aca HTTP/1.1" 200 None 2025-09-26 13:11:28,612 - lava_callback - INFO - Completed processing callback for node 68d690182f83206171a91aca 2025-09-26 13:11:29,647 - lava_callback - INFO - Received callback for node 68d6902f2f83206171a91aee INFO: 172.20.0.1:37462 - "POST /node/68d6902f2f83206171a91aee HTTP/1.0" 202 Accepted 2025-09-26 13:11:29,653 - lava_callback - INFO - Starting async job submit for node 68d6902f2f83206171a91aee 2025-09-26 13:11:29,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:29,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6902f2f83206171a91aee HTTP/1.1" 200 None 2025-09-26 13:11:29,691 - lava_callback - DEBUG - Processing node 68d6902f2f83206171a91aee: baseline-arm64-baylibre 2025-09-26 13:11:29,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:11:30,103 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:11:30,104 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6902f2f83206171a91aee/log.txt.gz 2025-09-26 13:11:30,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:11:30,219 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:11:30,220 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6902f2f83206171a91aee/lava_callback.json.gz 2025-09-26 13:11:30,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:30,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6902f2f83206171a91aee HTTP/1.1" 200 None 2025-09-26 13:11:30,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:30,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:11:30,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:30,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6902f2f83206171a91aee HTTP/1.1" 200 None 2025-09-26 13:11:30,297 - lava_callback - INFO - Completed processing callback for node 68d6902f2f83206171a91aee INFO: 172.20.0.1:37468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51712 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:11:53,391 - lava_callback - INFO - Received callback for node 68d68a212f83206171a9186b INFO: 172.20.0.1:54790 - "POST /node/68d68a212f83206171a9186b HTTP/1.0" 202 Accepted 2025-09-26 13:11:53,397 - lava_callback - INFO - Starting async job submit for node 68d68a212f83206171a9186b 2025-09-26 13:11:53,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:53,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a212f83206171a9186b HTTP/1.1" 200 None 2025-09-26 13:11:53,432 - lava_callback - DEBUG - Processing node 68d68a212f83206171a9186b: baseline-arm64-broonie 2025-09-26 13:11:53,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:11:53,796 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:11:53,797 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d68a212f83206171a9186b/log.txt.gz 2025-09-26 13:11:53,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:11:53,918 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:11:53,918 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d68a212f83206171a9186b/lava_callback.json.gz 2025-09-26 13:11:53,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:53,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a212f83206171a9186b HTTP/1.1" 200 None 2025-09-26 13:11:53,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:53,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:11:53,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:53,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68a212f83206171a9186b HTTP/1.1" 200 None 2025-09-26 13:11:53,993 - lava_callback - INFO - Completed processing callback for node 68d68a212f83206171a9186b INFO: 172.20.0.1:54802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54804 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:11:59,873 - lava_callback - INFO - Received callback for node 68d690222f83206171a91adc INFO: 172.20.0.1:40940 - "POST /node/68d690222f83206171a91adc HTTP/1.0" 202 Accepted 2025-09-26 13:11:59,879 - lava_callback - INFO - Starting async job submit for node 68d690222f83206171a91adc 2025-09-26 13:11:59,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:11:59,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690222f83206171a91adc HTTP/1.1" 200 None 2025-09-26 13:11:59,911 - lava_callback - DEBUG - Processing node 68d690222f83206171a91adc: baseline-arm64 2025-09-26 13:12:00,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:12:00,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:12:00,256 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690222f83206171a91adc/log.txt.gz 2025-09-26 13:12:00,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:12:00,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:12:00,385 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690222f83206171a91adc/lava_callback.json.gz 2025-09-26 13:12:00,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:12:00,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690222f83206171a91adc HTTP/1.1" 200 None 2025-09-26 13:12:00,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:12:00,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:12:00,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:12:00,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690222f83206171a91adc HTTP/1.1" 200 None 2025-09-26 13:12:00,460 - lava_callback - INFO - Completed processing callback for node 68d690222f83206171a91adc INFO: 172.20.0.1:40942 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:12:13,820 - lava_callback - INFO - Received callback for node 68d3ed2dcd36afa834e138e1 INFO: 172.20.0.1:59416 - "POST /node/68d3ed2dcd36afa834e138e1 HTTP/1.0" 202 Accepted 2025-09-26 13:12:13,827 - lava_callback - INFO - Starting async job submit for node 68d3ed2dcd36afa834e138e1 2025-09-26 13:12:13,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:12:14,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ed2dcd36afa834e138e1 HTTP/1.1" 200 None 2025-09-26 13:12:14,001 - lava_callback - DEBUG - Processing node 68d3ed2dcd36afa834e138e1: ltp-timers 2025-09-26 13:12:14,341 - lava_callback - ERROR - Error processing callback for node 68d3ed2dcd36afa834e138e1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:59418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59430 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:12:21,103 - lava_callback - INFO - Received callback for node 68d42804a5c2c05277bc74f9 INFO: 172.20.0.1:48352 - "POST /node/68d42804a5c2c05277bc74f9 HTTP/1.0" 202 Accepted 2025-09-26 13:12:21,109 - lava_callback - INFO - Starting async job submit for node 68d42804a5c2c05277bc74f9 2025-09-26 13:12:21,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:12:21,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42804a5c2c05277bc74f9 HTTP/1.1" 200 None 2025-09-26 13:12:21,143 - lava_callback - DEBUG - Processing node 68d42804a5c2c05277bc74f9: baseline-arm 2025-09-26 13:12:21,366 - lava_callback - ERROR - Error processing callback for node 68d42804a5c2c05277bc74f9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:12:23,063 - lava_callback - INFO - Received callback for node 68d690542f83206171a91b4d INFO: 172.20.0.1:48364 - "POST /node/68d690542f83206171a91b4d HTTP/1.0" 202 Accepted 2025-09-26 13:12:23,069 - lava_callback - INFO - Starting async job submit for node 68d690542f83206171a91b4d 2025-09-26 13:12:23,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:12:23,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690542f83206171a91b4d HTTP/1.1" 200 None 2025-09-26 13:12:23,110 - lava_callback - DEBUG - Processing node 68d690542f83206171a91b4d: baseline-arm64-broonie 2025-09-26 13:12:23,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:12:23,506 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:12:23,506 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d690542f83206171a91b4d/log.txt.gz 2025-09-26 13:12:23,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:48380 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:12:23,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:12:23,652 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d690542f83206171a91b4d/lava_callback.json.gz 2025-09-26 13:12:23,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:12:23,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690542f83206171a91b4d HTTP/1.1" 200 None 2025-09-26 13:12:23,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:12:23,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:12:23,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:12:23,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690542f83206171a91b4d HTTP/1.1" 200 None 2025-09-26 13:12:23,725 - lava_callback - INFO - Completed processing callback for node 68d690542f83206171a91b4d INFO: 172.20.0.1:48382 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:12:29,570 - lava_callback - INFO - Received callback for node 68d690382f83206171a91b0f INFO: 172.20.0.1:55886 - "POST /node/68d690382f83206171a91b0f HTTP/1.0" 202 Accepted 2025-09-26 13:12:29,576 - lava_callback - INFO - Starting async job submit for node 68d690382f83206171a91b0f 2025-09-26 13:12:29,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:12:29,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690382f83206171a91b0f HTTP/1.1" 200 None 2025-09-26 13:12:29,624 - lava_callback - DEBUG - Processing node 68d690382f83206171a91b0f: baseline-arm64-baylibre 2025-09-26 13:12:29,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:12:29,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:12:29,997 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d690382f83206171a91b0f/log.txt.gz 2025-09-26 13:12:30,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:12:30,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:12:30,131 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d690382f83206171a91b0f/lava_callback.json.gz 2025-09-26 13:12:30,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:12:30,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690382f83206171a91b0f HTTP/1.1" 200 None 2025-09-26 13:12:30,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:12:30,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:12:30,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:12:30,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690382f83206171a91b0f HTTP/1.1" 200 None 2025-09-26 13:12:30,244 - lava_callback - INFO - Completed processing callback for node 68d690382f83206171a91b0f 2025-09-26 13:12:31,214 - lava_callback - INFO - Received callback for node 68d6903e2f83206171a91b15 INFO: 172.20.0.1:55900 - "POST /node/68d6903e2f83206171a91b15 HTTP/1.0" 202 Accepted 2025-09-26 13:12:31,220 - lava_callback - INFO - Starting async job submit for node 68d6903e2f83206171a91b15 2025-09-26 13:12:31,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:12:31,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6903e2f83206171a91b15 HTTP/1.1" 200 None 2025-09-26 13:12:31,252 - lava_callback - DEBUG - Processing node 68d6903e2f83206171a91b15: baseline-arm64-baylibre 2025-09-26 13:12:31,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:12:31,627 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:12:31,628 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6903e2f83206171a91b15/log.txt.gz 2025-09-26 13:12:31,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:12:31,750 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:12:31,751 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6903e2f83206171a91b15/lava_callback.json.gz 2025-09-26 13:12:31,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:12:31,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6903e2f83206171a91b15 HTTP/1.1" 200 None 2025-09-26 13:12:31,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:12:31,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:12:31,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:12:31,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6903e2f83206171a91b15 HTTP/1.1" 200 None 2025-09-26 13:12:31,828 - lava_callback - INFO - Completed processing callback for node 68d6903e2f83206171a91b15 INFO: 172.20.0.1:55910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58466 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:12:58,763 - lava_callback - INFO - Received callback for node 68d690182f83206171a91acd INFO: 172.20.0.1:58480 - "POST /node/68d690182f83206171a91acd HTTP/1.0" 202 Accepted 2025-09-26 13:12:58,769 - lava_callback - INFO - Starting async job submit for node 68d690182f83206171a91acd 2025-09-26 13:12:58,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:12:58,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690182f83206171a91acd HTTP/1.1" 200 None 2025-09-26 13:12:58,816 - lava_callback - DEBUG - Processing node 68d690182f83206171a91acd: baseline-arm64 2025-09-26 13:12:59,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:12:59,190 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:12:59,191 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690182f83206171a91acd/log.txt.gz 2025-09-26 13:12:59,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:12:59,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:12:59,326 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690182f83206171a91acd/lava_callback.json.gz 2025-09-26 13:12:59,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:12:59,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690182f83206171a91acd HTTP/1.1" 200 None 2025-09-26 13:12:59,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:12:59,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:12:59,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:12:59,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690182f83206171a91acd HTTP/1.1" 200 None 2025-09-26 13:12:59,409 - lava_callback - INFO - Completed processing callback for node 68d690182f83206171a91acd INFO: 172.20.0.1:44640 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:13:08,421 - lava_callback - INFO - Received callback for node 68d6903b2f83206171a91b12 INFO: 172.20.0.1:44656 - "POST /node/68d6903b2f83206171a91b12 HTTP/1.0" 202 Accepted 2025-09-26 13:13:08,427 - lava_callback - INFO - Starting async job submit for node 68d6903b2f83206171a91b12 2025-09-26 13:13:08,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:13:08,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6903b2f83206171a91b12 HTTP/1.1" 200 None 2025-09-26 13:13:08,464 - lava_callback - DEBUG - Processing node 68d6903b2f83206171a91b12: baseline-arm64-baylibre 2025-09-26 13:13:08,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:13:08,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:13:08,862 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6903b2f83206171a91b12/log.txt.gz 2025-09-26 13:13:08,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:13:08,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:13:08,996 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6903b2f83206171a91b12/lava_callback.json.gz 2025-09-26 13:13:09,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:13:09,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6903b2f83206171a91b12 HTTP/1.1" 200 None 2025-09-26 13:13:09,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:13:09,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:13:09,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:13:09,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6903b2f83206171a91b12 HTTP/1.1" 200 None 2025-09-26 13:13:09,072 - lava_callback - INFO - Completed processing callback for node 68d6903b2f83206171a91b12 INFO: 172.20.0.1:51302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51316 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:13:19,444 - lava_callback - INFO - Received callback for node 68d690232f83206171a91adf INFO: 172.20.0.1:35882 - "POST /node/68d690232f83206171a91adf HTTP/1.0" 202 Accepted 2025-09-26 13:13:19,450 - lava_callback - INFO - Starting async job submit for node 68d690232f83206171a91adf 2025-09-26 13:13:19,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:13:19,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690232f83206171a91adf HTTP/1.1" 200 None 2025-09-26 13:13:19,488 - lava_callback - DEBUG - Processing node 68d690232f83206171a91adf: baseline-arm64 2025-09-26 13:13:19,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:13:19,863 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:13:19,863 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690232f83206171a91adf/log.txt.gz 2025-09-26 13:13:19,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:13:19,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:13:19,976 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690232f83206171a91adf/lava_callback.json.gz 2025-09-26 13:13:19,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:13:20,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690232f83206171a91adf HTTP/1.1" 200 None 2025-09-26 13:13:20,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:13:20,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:13:20,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:13:20,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690232f83206171a91adf HTTP/1.1" 200 None 2025-09-26 13:13:20,048 - lava_callback - INFO - Completed processing callback for node 68d690232f83206171a91adf INFO: 172.20.0.1:35890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50494 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:14:13,871 - lava_callback - INFO - Received callback for node 68d3edfdcd36afa834e139ef INFO: 172.20.0.1:48190 - "POST /node/68d3edfdcd36afa834e139ef HTTP/1.0" 202 Accepted 2025-09-26 13:14:13,879 - lava_callback - INFO - Starting async job submit for node 68d3edfdcd36afa834e139ef 2025-09-26 13:14:13,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:14:13,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3edfdcd36afa834e139ef HTTP/1.1" 200 None 2025-09-26 13:14:13,990 - lava_callback - DEBUG - Processing node 68d3edfdcd36afa834e139ef: ltp-containers 2025-09-26 13:14:14,748 - lava_callback - ERROR - Error processing callback for node 68d3edfdcd36afa834e139ef: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:48204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42960 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:14:38,721 - lava_callback - INFO - Received callback for node 68d42805a5c2c05277bc74fc INFO: 172.20.0.1:42972 - "POST /node/68d42805a5c2c05277bc74fc HTTP/1.0" 202 Accepted 2025-09-26 13:14:38,726 - lava_callback - INFO - Starting async job submit for node 68d42805a5c2c05277bc74fc 2025-09-26 13:14:38,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:14:38,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42805a5c2c05277bc74fc HTTP/1.1" 200 None 2025-09-26 13:14:38,772 - lava_callback - DEBUG - Processing node 68d42805a5c2c05277bc74fc: baseline-arm 2025-09-26 13:14:39,019 - lava_callback - ERROR - Error processing callback for node 68d42805a5c2c05277bc74fc: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:14:39,932 - lava_callback - INFO - Received callback for node 68d690262f83206171a91ae2 INFO: 172.20.0.1:43248 - "POST /node/68d690262f83206171a91ae2 HTTP/1.0" 202 Accepted 2025-09-26 13:14:39,938 - lava_callback - INFO - Starting async job submit for node 68d690262f83206171a91ae2 2025-09-26 13:14:39,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:14:39,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690262f83206171a91ae2 HTTP/1.1" 200 None 2025-09-26 13:14:39,989 - lava_callback - DEBUG - Processing node 68d690262f83206171a91ae2: baseline-arm64 2025-09-26 13:14:40,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:14:40,378 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:14:40,378 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690262f83206171a91ae2/log.txt.gz 2025-09-26 13:14:40,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:14:40,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:14:40,536 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690262f83206171a91ae2/lava_callback.json.gz 2025-09-26 13:14:40,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:14:40,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690262f83206171a91ae2 HTTP/1.1" 200 None 2025-09-26 13:14:40,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:14:40,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:14:40,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:14:40,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690262f83206171a91ae2 HTTP/1.1" 200 None 2025-09-26 13:14:40,610 - lava_callback - INFO - Completed processing callback for node 68d690262f83206171a91ae2 2025-09-26 13:14:43,458 - lava_callback - INFO - Received callback for node 68d68fe62f83206171a91a47 INFO: 172.20.0.1:43252 - "POST /node/68d68fe62f83206171a91a47 HTTP/1.0" 202 Accepted 2025-09-26 13:14:43,464 - lava_callback - INFO - Starting async job submit for node 68d68fe62f83206171a91a47 2025-09-26 13:14:43,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:14:43,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fe62f83206171a91a47 HTTP/1.1" 200 None 2025-09-26 13:14:43,501 - lava_callback - DEBUG - Processing node 68d68fe62f83206171a91a47: baseline-arm64 2025-09-26 13:14:43,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:14:43,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:14:43,906 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fe62f83206171a91a47/log.txt.gz 2025-09-26 13:14:43,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:14:44,048 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:14:44,049 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fe62f83206171a91a47/lava_callback.json.gz 2025-09-26 13:14:44,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:14:44,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fe62f83206171a91a47 HTTP/1.1" 200 None 2025-09-26 13:14:44,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:14:44,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:14:44,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:14:44,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68fe62f83206171a91a47 HTTP/1.1" 200 None 2025-09-26 13:14:44,124 - lava_callback - INFO - Completed processing callback for node 68d68fe62f83206171a91a47 2025-09-26 13:14:46,072 - lava_callback - INFO - Received callback for node 68d68fdc2f83206171a91a32 INFO: 172.20.0.1:43266 - "POST /node/68d68fdc2f83206171a91a32 HTTP/1.0" 202 Accepted 2025-09-26 13:14:46,078 - lava_callback - INFO - Starting async job submit for node 68d68fdc2f83206171a91a32 2025-09-26 13:14:46,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:14:46,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fdc2f83206171a91a32 HTTP/1.1" 200 None 2025-09-26 13:14:46,117 - lava_callback - DEBUG - Processing node 68d68fdc2f83206171a91a32: baseline-arm64 2025-09-26 13:14:46,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:14:46,522 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:14:46,523 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fdc2f83206171a91a32/log.txt.gz INFO: 172.20.0.1:43270 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:14:46,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:14:46,545 - lava_callback - INFO - Received callback for node 68d690632f83206171a91b70 INFO: 172.20.0.1:43282 - "POST /node/68d690632f83206171a91b70 HTTP/1.0" 202 Accepted 2025-09-26 13:14:46,550 - lava_callback - INFO - Starting async job submit for node 68d690632f83206171a91b70 2025-09-26 13:14:46,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:14:46,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690632f83206171a91b70 HTTP/1.1" 200 None 2025-09-26 13:14:46,598 - lava_callback - DEBUG - Processing node 68d690632f83206171a91b70: baseline-arm64-broonie 2025-09-26 13:14:46,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:14:46,765 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fdc2f83206171a91a32/lava_callback.json.gz 2025-09-26 13:14:46,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:14:46,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:14:46,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fdc2f83206171a91a32 HTTP/1.1" 200 None 2025-09-26 13:14:46,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:14:46,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:14:46,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:14:46,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68fdc2f83206171a91a32 HTTP/1.1" 200 None 2025-09-26 13:14:46,901 - lava_callback - INFO - Completed processing callback for node 68d68fdc2f83206171a91a32 2025-09-26 13:14:46,997 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:14:46,998 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d690632f83206171a91b70/log.txt.gz 2025-09-26 13:14:47,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:14:47,133 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:14:47,133 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d690632f83206171a91b70/lava_callback.json.gz 2025-09-26 13:14:47,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:14:47,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690632f83206171a91b70 HTTP/1.1" 200 None 2025-09-26 13:14:47,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:14:47,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:14:47,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:14:47,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690632f83206171a91b70 HTTP/1.1" 200 None 2025-09-26 13:14:47,233 - lava_callback - INFO - Completed processing callback for node 68d690632f83206171a91b70 2025-09-26 13:14:54,033 - lava_callback - INFO - Received callback for node 68d68d082f83206171a9195d INFO: 172.20.0.1:40072 - "POST /node/68d68d082f83206171a9195d HTTP/1.0" 202 Accepted 2025-09-26 13:14:54,041 - lava_callback - INFO - Starting async job submit for node 68d68d082f83206171a9195d 2025-09-26 13:14:54,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:14:54,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68d082f83206171a9195d HTTP/1.1" 200 None 2025-09-26 13:14:54,094 - lava_callback - DEBUG - Processing node 68d68d082f83206171a9195d: baseline-arm64 2025-09-26 13:14:55,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:14:55,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:14:55,208 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68d082f83206171a9195d/log.txt.gz 2025-09-26 13:14:55,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:14:55,380 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:14:55,380 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68d082f83206171a9195d/lava_callback.json.gz DEBUG: Setup failed for 68d68d082f83206171a9195d. Transitting job node result: incomplete -> fail 2025-09-26 13:14:55,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:14:55,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68d082f83206171a9195d HTTP/1.1" 200 None 2025-09-26 13:14:55,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:14:55,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:14:55,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:14:55,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68d082f83206171a9195d HTTP/1.1" 200 None 2025-09-26 13:14:55,524 - lava_callback - INFO - Completed processing callback for node 68d68d082f83206171a9195d INFO: 172.20.0.1:40084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59386 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:15:13,566 - lava_callback - INFO - Received callback for node 68d690662f83206171a91b73 INFO: 172.20.0.1:55294 - "POST /node/68d690662f83206171a91b73 HTTP/1.0" 202 Accepted 2025-09-26 13:15:13,572 - lava_callback - INFO - Starting async job submit for node 68d690662f83206171a91b73 2025-09-26 13:15:13,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:15:13,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690662f83206171a91b73 HTTP/1.1" 200 None 2025-09-26 13:15:13,606 - lava_callback - DEBUG - Processing node 68d690662f83206171a91b73: baseline-arm64-broonie 2025-09-26 13:15:13,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:15:13,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:15:13,969 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d690662f83206171a91b73/log.txt.gz 2025-09-26 13:15:13,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:15:14,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:15:14,090 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d690662f83206171a91b73/lava_callback.json.gz 2025-09-26 13:15:14,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:15:14,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690662f83206171a91b73 HTTP/1.1" 200 None 2025-09-26 13:15:14,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:15:14,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:15:14,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:15:14,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690662f83206171a91b73 HTTP/1.1" 200 None 2025-09-26 13:15:14,184 - lava_callback - INFO - Completed processing callback for node 68d690662f83206171a91b73 INFO: 172.20.0.1:55306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43802 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:15:58,553 - lava_callback - INFO - Received callback for node 68d690262f83206171a91ae5 INFO: 172.20.0.1:43808 - "POST /node/68d690262f83206171a91ae5 HTTP/1.0" 202 Accepted 2025-09-26 13:15:58,558 - lava_callback - INFO - Starting async job submit for node 68d690262f83206171a91ae5 2025-09-26 13:15:58,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:15:58,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690262f83206171a91ae5 HTTP/1.1" 200 None 2025-09-26 13:15:58,593 - lava_callback - DEBUG - Processing node 68d690262f83206171a91ae5: baseline-arm64 2025-09-26 13:15:58,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:15:58,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:15:58,968 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690262f83206171a91ae5/log.txt.gz 2025-09-26 13:15:58,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:15:59,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:15:59,113 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690262f83206171a91ae5/lava_callback.json.gz 2025-09-26 13:15:59,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:15:59,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690262f83206171a91ae5 HTTP/1.1" 200 None 2025-09-26 13:15:59,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:15:59,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:15:59,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:15:59,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690262f83206171a91ae5 HTTP/1.1" 200 None 2025-09-26 13:15:59,190 - lava_callback - INFO - Completed processing callback for node 68d690262f83206171a91ae5 INFO: 172.20.0.1:49564 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:16:08,194 - lava_callback - INFO - Received callback for node 68d3ec4fcd36afa834e1378c INFO: 172.20.0.1:49568 - "POST /node/68d3ec4fcd36afa834e1378c HTTP/1.0" 202 Accepted 2025-09-26 13:16:08,201 - lava_callback - INFO - Starting async job submit for node 68d3ec4fcd36afa834e1378c 2025-09-26 13:16:08,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:16:08,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ec4fcd36afa834e1378c HTTP/1.1" 200 None 2025-09-26 13:16:08,249 - lava_callback - DEBUG - Processing node 68d3ec4fcd36afa834e1378c: ltp-smoketest 2025-09-26 13:16:08,693 - lava_callback - ERROR - Error processing callback for node 68d3ec4fcd36afa834e1378c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:16:15,126 - lava_callback - INFO - Received callback for node 68d68d162f83206171a91969 INFO: 172.20.0.1:56800 - "POST /node/68d68d162f83206171a91969 HTTP/1.0" 202 Accepted 2025-09-26 13:16:15,133 - lava_callback - INFO - Starting async job submit for node 68d68d162f83206171a91969 2025-09-26 13:16:15,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:56808 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 13:16:15,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68d162f83206171a91969 HTTP/1.1" 200 None 2025-09-26 13:16:15,206 - lava_callback - DEBUG - Processing node 68d68d162f83206171a91969: baseline-arm64 2025-09-26 13:16:16,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:16:16,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:16:16,449 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68d162f83206171a91969/log.txt.gz 2025-09-26 13:16:16,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:56816 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:16:16,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:16:16,630 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68d162f83206171a91969/lava_callback.json.gz DEBUG: Setup failed for 68d68d162f83206171a91969. Transitting job node result: incomplete -> fail 2025-09-26 13:16:16,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:16:16,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68d162f83206171a91969 HTTP/1.1" 200 None 2025-09-26 13:16:16,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:16:16,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:16:16,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:16:16,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68d162f83206171a91969 HTTP/1.1" 200 None 2025-09-26 13:16:16,883 - lava_callback - INFO - Completed processing callback for node 68d68d162f83206171a91969 INFO: 172.20.0.1:49114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49128 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:16:33,707 - lava_callback - INFO - Received callback for node 68d3eee1cd36afa834e13b24 INFO: 172.20.0.1:59550 - "POST /node/68d3eee1cd36afa834e13b24 HTTP/1.0" 202 Accepted 2025-09-26 13:16:33,714 - lava_callback - INFO - Starting async job submit for node 68d3eee1cd36afa834e13b24 2025-09-26 13:16:33,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:16:33,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3eee1cd36afa834e13b24 HTTP/1.1" 200 None 2025-09-26 13:16:33,760 - lava_callback - DEBUG - Processing node 68d3eee1cd36afa834e13b24: ltp-watchqueue 2025-09-26 13:16:34,161 - lava_callback - ERROR - Error processing callback for node 68d3eee1cd36afa834e13b24: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:16:35,165 - lava_callback - INFO - Received callback for node 68d68a082f83206171a91820 INFO: 172.20.0.1:59556 - "POST /node/68d68a082f83206171a91820 HTTP/1.0" 202 Accepted 2025-09-26 13:16:35,171 - lava_callback - INFO - Starting async job submit for node 68d68a082f83206171a91820 2025-09-26 13:16:35,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:16:35,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a082f83206171a91820 HTTP/1.1" 200 None 2025-09-26 13:16:35,210 - lava_callback - DEBUG - Processing node 68d68a082f83206171a91820: baseline-arm64-broonie 2025-09-26 13:16:35,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:16:35,575 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:16:35,576 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d68a082f83206171a91820/log.txt.gz 2025-09-26 13:16:35,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:16:35,694 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:16:35,695 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d68a082f83206171a91820/lava_callback.json.gz 2025-09-26 13:16:35,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:16:35,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a082f83206171a91820 HTTP/1.1" 200 None 2025-09-26 13:16:35,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:16:35,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:16:35,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:16:35,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68a082f83206171a91820 HTTP/1.1" 200 None 2025-09-26 13:16:35,776 - lava_callback - INFO - Completed processing callback for node 68d68a082f83206171a91820 INFO: 172.20.0.1:59562 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:16:42,973 - lava_callback - INFO - Received callback for node 68d42807a5c2c05277bc74ff INFO: 172.20.0.1:41856 - "POST /node/68d42807a5c2c05277bc74ff HTTP/1.0" 202 Accepted 2025-09-26 13:16:42,979 - lava_callback - INFO - Starting async job submit for node 68d42807a5c2c05277bc74ff 2025-09-26 13:16:42,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:16:43,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42807a5c2c05277bc74ff HTTP/1.1" 200 None 2025-09-26 13:16:43,017 - lava_callback - DEBUG - Processing node 68d42807a5c2c05277bc74ff: baseline-arm 2025-09-26 13:16:43,238 - lava_callback - ERROR - Error processing callback for node 68d42807a5c2c05277bc74ff: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:41858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56426 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:17:06,263 - lava_callback - INFO - Received callback for node 68d692252f83206171a91c6a INFO: 172.20.0.1:56726 - "POST /node/68d692252f83206171a91c6a HTTP/1.0" 202 Accepted 2025-09-26 13:17:06,270 - lava_callback - INFO - Starting async job submit for node 68d692252f83206171a91c6a 2025-09-26 13:17:06,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:17:06,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d692252f83206171a91c6a HTTP/1.1" 200 None 2025-09-26 13:17:06,305 - lava_callback - DEBUG - Processing node 68d692252f83206171a91c6a: baseline-x86 2025-09-26 13:17:06,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:56742 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:17:06,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:17:06,632 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d692252f83206171a91c6a/log.txt.gz 2025-09-26 13:17:06,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:17:06,769 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:17:06,770 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d692252f83206171a91c6a/lava_callback.json.gz 2025-09-26 13:17:06,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:17:06,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d692252f83206171a91c6a HTTP/1.1" 200 None 2025-09-26 13:17:06,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:17:06,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637585d233c363a761c30 HTTP/1.1" 200 None 2025-09-26 13:17:06,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:17:06,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d692252f83206171a91c6a HTTP/1.1" 200 None 2025-09-26 13:17:06,850 - lava_callback - INFO - Completed processing callback for node 68d692252f83206171a91c6a INFO: 172.20.0.1:59632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48840 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:17:25,966 - lava_callback - INFO - Received callback for node 68d68f952f83206171a919d1 INFO: 172.20.0.1:48852 - "POST /node/68d68f952f83206171a919d1 HTTP/1.0" 202 Accepted 2025-09-26 13:17:25,972 - lava_callback - INFO - Starting async job submit for node 68d68f952f83206171a919d1 2025-09-26 13:17:25,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:17:26,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68f952f83206171a919d1 HTTP/1.1" 200 None 2025-09-26 13:17:26,006 - lava_callback - DEBUG - Processing node 68d68f952f83206171a919d1: baseline-arm64 2025-09-26 13:17:26,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:17:26,462 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:17:26,462 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68f952f83206171a919d1/log.txt.gz 2025-09-26 13:17:26,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:48868 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:17:26,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:17:26,592 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68f952f83206171a919d1/lava_callback.json.gz 2025-09-26 13:17:26,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:17:26,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68f952f83206171a919d1 HTTP/1.1" 200 None 2025-09-26 13:17:26,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:17:26,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:17:26,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:17:26,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68f952f83206171a919d1 HTTP/1.1" 200 None 2025-09-26 13:17:26,676 - lava_callback - INFO - Completed processing callback for node 68d68f952f83206171a919d1 2025-09-26 13:17:36,374 - lava_callback - INFO - Received callback for node 68d6900f2f83206171a91abb INFO: 172.20.0.1:49704 - "POST /node/68d6900f2f83206171a91abb HTTP/1.0" 202 Accepted 2025-09-26 13:17:36,380 - lava_callback - INFO - Starting async job submit for node 68d6900f2f83206171a91abb 2025-09-26 13:17:36,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:17:36,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6900f2f83206171a91abb HTTP/1.1" 200 None 2025-09-26 13:17:36,412 - lava_callback - DEBUG - Processing node 68d6900f2f83206171a91abb: baseline-arm64 INFO: 172.20.0.1:49720 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:17:36,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:17:36,901 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:17:36,902 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6900f2f83206171a91abb/log.txt.gz 2025-09-26 13:17:36,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:17:37,025 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:17:37,026 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6900f2f83206171a91abb/lava_callback.json.gz 2025-09-26 13:17:37,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:17:37,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6900f2f83206171a91abb HTTP/1.1" 200 None 2025-09-26 13:17:37,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:17:37,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:17:37,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:17:37,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6900f2f83206171a91abb HTTP/1.1" 200 None 2025-09-26 13:17:37,102 - lava_callback - INFO - Completed processing callback for node 68d6900f2f83206171a91abb INFO: 172.20.0.1:58612 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:17:46,846 - lava_callback - INFO - Received callback for node 68d6900e2f83206171a91ab8 INFO: 172.20.0.1:58614 - "POST /node/68d6900e2f83206171a91ab8 HTTP/1.0" 202 Accepted 2025-09-26 13:17:46,852 - lava_callback - INFO - Starting async job submit for node 68d6900e2f83206171a91ab8 2025-09-26 13:17:46,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:17:46,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6900e2f83206171a91ab8 HTTP/1.1" 200 None 2025-09-26 13:17:46,883 - lava_callback - DEBUG - Processing node 68d6900e2f83206171a91ab8: baseline-arm64 2025-09-26 13:17:47,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:17:47,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:17:47,373 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6900e2f83206171a91ab8/log.txt.gz 2025-09-26 13:17:47,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:17:47,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:17:47,515 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6900e2f83206171a91ab8/lava_callback.json.gz 2025-09-26 13:17:47,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:17:47,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6900e2f83206171a91ab8 HTTP/1.1" 200 None 2025-09-26 13:17:47,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:17:47,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:17:47,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:17:47,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6900e2f83206171a91ab8 HTTP/1.1" 200 None 2025-09-26 13:17:47,592 - lava_callback - INFO - Completed processing callback for node 68d6900e2f83206171a91ab8 INFO: 172.20.0.1:57936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40776 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:18:07,400 - lava_callback - INFO - Received callback for node 68d6905a2f83206171a91b63 INFO: 172.20.0.1:40778 - "POST /node/68d6905a2f83206171a91b63 HTTP/1.0" 202 Accepted 2025-09-26 13:18:07,407 - lava_callback - INFO - Starting async job submit for node 68d6905a2f83206171a91b63 2025-09-26 13:18:07,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:18:07,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6905a2f83206171a91b63 HTTP/1.1" 200 None 2025-09-26 13:18:07,463 - lava_callback - DEBUG - Processing node 68d6905a2f83206171a91b63: baseline-arm64-broonie 2025-09-26 13:18:08,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:18:08,222 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:18:08,223 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6905a2f83206171a91b63/log.txt.gz 2025-09-26 13:18:08,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:18:08,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:18:08,349 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6905a2f83206171a91b63/lava_callback.json.gz 2025-09-26 13:18:08,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:18:08,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6905a2f83206171a91b63 HTTP/1.1" 200 None 2025-09-26 13:18:08,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:18:08,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:18:08,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:18:08,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6905a2f83206171a91b63 HTTP/1.1" 200 None 2025-09-26 13:18:08,434 - lava_callback - INFO - Completed processing callback for node 68d6905a2f83206171a91b63 INFO: 172.20.0.1:58360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47924 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:18:45,932 - lava_callback - INFO - Received callback for node 68d68f952f83206171a919d4 INFO: 172.20.0.1:41440 - "POST /node/68d68f952f83206171a919d4 HTTP/1.0" 202 Accepted 2025-09-26 13:18:45,938 - lava_callback - INFO - Starting async job submit for node 68d68f952f83206171a919d4 2025-09-26 13:18:45,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:18:45,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68f952f83206171a919d4 HTTP/1.1" 200 None 2025-09-26 13:18:45,971 - lava_callback - DEBUG - Processing node 68d68f952f83206171a919d4: baseline-arm64 2025-09-26 13:18:46,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:18:46,414 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:18:46,415 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68f952f83206171a919d4/log.txt.gz 2025-09-26 13:18:46,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:41450 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:18:46,584 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:18:46,584 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68f952f83206171a919d4/lava_callback.json.gz 2025-09-26 13:18:46,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:18:46,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68f952f83206171a919d4 HTTP/1.1" 200 None 2025-09-26 13:18:46,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:18:46,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:18:46,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:18:46,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68f952f83206171a919d4 HTTP/1.1" 200 None 2025-09-26 13:18:46,657 - lava_callback - INFO - Completed processing callback for node 68d68f952f83206171a919d4 INFO: 172.20.0.1:48748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48760 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:18:58,370 - lava_callback - INFO - Received callback for node 68d42809a5c2c05277bc7502 INFO: 172.20.0.1:48764 - "POST /node/68d42809a5c2c05277bc7502 HTTP/1.0" 202 Accepted 2025-09-26 13:18:58,375 - lava_callback - INFO - Starting async job submit for node 68d42809a5c2c05277bc7502 2025-09-26 13:18:58,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:18:58,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42809a5c2c05277bc7502 HTTP/1.1" 200 None 2025-09-26 13:18:58,411 - lava_callback - DEBUG - Processing node 68d42809a5c2c05277bc7502: baseline-arm 2025-09-26 13:18:58,647 - lava_callback - ERROR - Error processing callback for node 68d42809a5c2c05277bc7502: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:19:05,547 - lava_callback - INFO - Received callback for node 68d690112f83206171a91abe INFO: 172.20.0.1:46544 - "POST /node/68d690112f83206171a91abe HTTP/1.0" 202 Accepted 2025-09-26 13:19:05,553 - lava_callback - INFO - Starting async job submit for node 68d690112f83206171a91abe 2025-09-26 13:19:05,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:19:05,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690112f83206171a91abe HTTP/1.1" 200 None 2025-09-26 13:19:05,598 - lava_callback - DEBUG - Processing node 68d690112f83206171a91abe: baseline-arm64 2025-09-26 13:19:05,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:19:06,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:19:06,042 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690112f83206171a91abe/log.txt.gz 2025-09-26 13:19:06,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:19:06,157 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:19:06,157 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690112f83206171a91abe/lava_callback.json.gz 2025-09-26 13:19:06,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:19:06,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690112f83206171a91abe HTTP/1.1" 200 None 2025-09-26 13:19:06,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:19:06,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:19:06,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:19:06,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690112f83206171a91abe HTTP/1.1" 200 None 2025-09-26 13:19:06,236 - lava_callback - INFO - Completed processing callback for node 68d690112f83206171a91abe INFO: 172.20.0.1:46558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43078 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:19:26,823 - lava_callback - INFO - Received callback for node 68d690122f83206171a91ac1 INFO: 172.20.0.1:43082 - "POST /node/68d690122f83206171a91ac1 HTTP/1.0" 202 Accepted 2025-09-26 13:19:26,828 - lava_callback - INFO - Starting async job submit for node 68d690122f83206171a91ac1 2025-09-26 13:19:26,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:19:26,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690122f83206171a91ac1 HTTP/1.1" 200 None 2025-09-26 13:19:26,860 - lava_callback - DEBUG - Processing node 68d690122f83206171a91ac1: baseline-arm64 2025-09-26 13:19:27,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:19:27,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:19:27,335 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690122f83206171a91ac1/log.txt.gz 2025-09-26 13:19:27,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:19:27,490 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:19:27,491 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690122f83206171a91ac1/lava_callback.json.gz 2025-09-26 13:19:27,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:19:27,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690122f83206171a91ac1 HTTP/1.1" 200 None 2025-09-26 13:19:27,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:19:27,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:19:27,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:19:27,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690122f83206171a91ac1 HTTP/1.1" 200 None 2025-09-26 13:19:27,606 - lava_callback - INFO - Completed processing callback for node 68d690122f83206171a91ac1 INFO: 172.20.0.1:37988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54222 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:20:05,987 - lava_callback - INFO - Received callback for node 68d68f982f83206171a919d7 INFO: 172.20.0.1:41156 - "POST /node/68d68f982f83206171a919d7 HTTP/1.0" 202 Accepted 2025-09-26 13:20:05,993 - lava_callback - INFO - Starting async job submit for node 68d68f982f83206171a919d7 2025-09-26 13:20:06,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:20:06,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68f982f83206171a919d7 HTTP/1.1" 200 None 2025-09-26 13:20:06,038 - lava_callback - DEBUG - Processing node 68d68f982f83206171a919d7: baseline-arm64 2025-09-26 13:20:06,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:20:06,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:20:06,500 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68f982f83206171a919d7/log.txt.gz 2025-09-26 13:20:06,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:41166 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:20:06,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:20:06,640 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68f982f83206171a919d7/lava_callback.json.gz 2025-09-26 13:20:06,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:20:06,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68f982f83206171a919d7 HTTP/1.1" 200 None 2025-09-26 13:20:06,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:20:06,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:20:06,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:20:06,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68f982f83206171a919d7 HTTP/1.1" 200 None 2025-09-26 13:20:06,735 - lava_callback - INFO - Completed processing callback for node 68d68f982f83206171a919d7 INFO: 172.20.0.1:60158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34696 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:20:32,976 - lava_callback - INFO - Received callback for node 68d691c72f83206171a91c51 INFO: 172.20.0.1:44590 - "POST /node/68d691c72f83206171a91c51 HTTP/1.0" 202 Accepted 2025-09-26 13:20:32,985 - lava_callback - INFO - Starting async job submit for node 68d691c72f83206171a91c51 2025-09-26 13:20:33,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:20:33,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d691c72f83206171a91c51 HTTP/1.1" 200 None 2025-09-26 13:20:33,036 - lava_callback - DEBUG - Processing node 68d691c72f83206171a91c51: baseline-arm64-broonie 2025-09-26 13:20:33,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:20:33,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:20:33,353 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d691c72f83206171a91c51/log.txt.gz 2025-09-26 13:20:33,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:20:33,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:20:33,501 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d691c72f83206171a91c51/lava_callback.json.gz 2025-09-26 13:20:33,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:20:33,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d691c72f83206171a91c51 HTTP/1.1" 200 None 2025-09-26 13:20:33,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:20:33,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:20:33,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:20:33,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d691c72f83206171a91c51 HTTP/1.1" 200 None 2025-09-26 13:20:33,607 - lava_callback - INFO - Completed processing callback for node 68d691c72f83206171a91c51 INFO: 172.20.0.1:44606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38508 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:20:48,802 - lava_callback - INFO - Received callback for node 68d46a1da5c2c05277bcba21 INFO: 172.20.0.1:38520 - "POST /node/68d46a1da5c2c05277bcba21 HTTP/1.0" 202 Accepted 2025-09-26 13:20:48,807 - lava_callback - INFO - Starting async job submit for node 68d46a1da5c2c05277bcba21 2025-09-26 13:20:48,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:20:48,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d46a1da5c2c05277bcba21 HTTP/1.1" 200 None 2025-09-26 13:20:48,837 - lava_callback - DEBUG - Processing node 68d46a1da5c2c05277bcba21: baseline-arm64-broonie 2025-09-26 13:20:49,147 - lava_callback - ERROR - Error processing callback for node 68d46a1da5c2c05277bcba21: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:20:53,821 - lava_callback - INFO - Received callback for node 68d6904e2f83206171a91b3f INFO: 172.20.0.1:37456 - "POST /node/68d6904e2f83206171a91b3f HTTP/1.0" 202 Accepted 2025-09-26 13:20:53,827 - lava_callback - INFO - Starting async job submit for node 68d6904e2f83206171a91b3f 2025-09-26 13:20:53,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:20:53,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6904e2f83206171a91b3f HTTP/1.1" 200 None 2025-09-26 13:20:53,861 - lava_callback - DEBUG - Processing node 68d6904e2f83206171a91b3f: baseline-arm64-broonie 2025-09-26 13:20:54,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:20:54,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:20:54,221 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6904e2f83206171a91b3f/log.txt.gz 2025-09-26 13:20:54,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:20:54,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:20:54,338 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6904e2f83206171a91b3f/lava_callback.json.gz 2025-09-26 13:20:54,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:20:54,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6904e2f83206171a91b3f HTTP/1.1" 200 None 2025-09-26 13:20:54,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:20:54,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:20:54,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:20:54,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6904e2f83206171a91b3f HTTP/1.1" 200 None 2025-09-26 13:20:54,420 - lava_callback - INFO - Completed processing callback for node 68d6904e2f83206171a91b3f 2025-09-26 13:20:56,282 - lava_callback - INFO - Received callback for node 68d4280ba5c2c05277bc7505 INFO: 172.20.0.1:37468 - "POST /node/68d4280ba5c2c05277bc7505 HTTP/1.0" 202 Accepted 2025-09-26 13:20:56,287 - lava_callback - INFO - Starting async job submit for node 68d4280ba5c2c05277bc7505 2025-09-26 13:20:56,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:20:56,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4280ba5c2c05277bc7505 HTTP/1.1" 200 None 2025-09-26 13:20:56,319 - lava_callback - DEBUG - Processing node 68d4280ba5c2c05277bc7505: baseline-arm INFO: 172.20.0.1:37480 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:20:56,569 - lava_callback - ERROR - Error processing callback for node 68d4280ba5c2c05277bc7505: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40552 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:21:25,898 - lava_callback - INFO - Received callback for node 68d68f992f83206171a919da INFO: 172.20.0.1:40568 - "POST /node/68d68f992f83206171a919da HTTP/1.0" 202 Accepted 2025-09-26 13:21:25,904 - lava_callback - INFO - Starting async job submit for node 68d68f992f83206171a919da 2025-09-26 13:21:25,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:21:25,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68f992f83206171a919da HTTP/1.1" 200 None 2025-09-26 13:21:25,941 - lava_callback - DEBUG - Processing node 68d68f992f83206171a919da: baseline-arm64 2025-09-26 13:21:26,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:21:26,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:21:26,477 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68f992f83206171a919da/log.txt.gz 2025-09-26 13:21:26,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:40582 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:21:26,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:21:26,627 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68f992f83206171a919da/lava_callback.json.gz 2025-09-26 13:21:26,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:21:26,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68f992f83206171a919da HTTP/1.1" 200 None 2025-09-26 13:21:26,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:21:26,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:21:26,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:21:26,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68f992f83206171a919da HTTP/1.1" 200 None 2025-09-26 13:21:26,725 - lava_callback - INFO - Completed processing callback for node 68d68f992f83206171a919da INFO: 172.20.0.1:51386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59786 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:22:07,810 - lava_callback - INFO - Received callback for node 68d68d3f2f83206171a91974 INFO: 172.20.0.1:59796 - "POST /node/68d68d3f2f83206171a91974 HTTP/1.0" 202 Accepted 2025-09-26 13:22:07,818 - lava_callback - INFO - Starting async job submit for node 68d68d3f2f83206171a91974 2025-09-26 13:22:07,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:22:07,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68d3f2f83206171a91974 HTTP/1.1" 200 None 2025-09-26 13:22:07,871 - lava_callback - DEBUG - Processing node 68d68d3f2f83206171a91974: baseline-arm64 2025-09-26 13:22:08,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:22:09,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:22:09,113 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68d3f2f83206171a91974/log.txt.gz 2025-09-26 13:22:09,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:22:09,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:22:09,311 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68d3f2f83206171a91974/lava_callback.json.gz DEBUG: Setup failed for 68d68d3f2f83206171a91974. Transitting job node result: incomplete -> fail 2025-09-26 13:22:09,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:22:09,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68d3f2f83206171a91974 HTTP/1.1" 200 None 2025-09-26 13:22:09,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:22:09,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:22:09,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:22:09,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68d3f2f83206171a91974 HTTP/1.1" 200 None 2025-09-26 13:22:09,443 - lava_callback - INFO - Completed processing callback for node 68d68d3f2f83206171a91974 INFO: 172.20.0.1:55898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49370 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:22:46,113 - lava_callback - INFO - Received callback for node 68d68ffa2f83206171a91a80 INFO: 172.20.0.1:60648 - "POST /node/68d68ffa2f83206171a91a80 HTTP/1.0" 202 Accepted 2025-09-26 13:22:46,124 - lava_callback - INFO - Starting async job submit for node 68d68ffa2f83206171a91a80 2025-09-26 13:22:46,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:22:46,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68ffa2f83206171a91a80 HTTP/1.1" 200 None 2025-09-26 13:22:46,162 - lava_callback - DEBUG - Processing node 68d68ffa2f83206171a91a80: baseline-arm64 INFO: 172.20.0.1:60660 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:22:46,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:22:46,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:22:46,722 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68ffa2f83206171a91a80/log.txt.gz 2025-09-26 13:22:46,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:22:46,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:22:46,868 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68ffa2f83206171a91a80/lava_callback.json.gz 2025-09-26 13:22:46,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:22:46,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68ffa2f83206171a91a80 HTTP/1.1" 200 None 2025-09-26 13:22:46,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:22:46,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:22:46,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:22:46,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68ffa2f83206171a91a80 HTTP/1.1" 200 None 2025-09-26 13:22:46,958 - lava_callback - INFO - Completed processing callback for node 68d68ffa2f83206171a91a80 2025-09-26 13:22:53,968 - lava_callback - INFO - Received callback for node 68d4280ca5c2c05277bc7508 INFO: 172.20.0.1:35108 - "POST /node/68d4280ca5c2c05277bc7508 HTTP/1.0" 202 Accepted 2025-09-26 13:22:53,975 - lava_callback - INFO - Starting async job submit for node 68d4280ca5c2c05277bc7508 2025-09-26 13:22:54,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:22:54,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4280ca5c2c05277bc7508 HTTP/1.1" 200 None 2025-09-26 13:22:54,013 - lava_callback - DEBUG - Processing node 68d4280ca5c2c05277bc7508: baseline-arm 2025-09-26 13:22:54,295 - lava_callback - ERROR - Error processing callback for node 68d4280ca5c2c05277bc7508: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:35110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34246 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:23:09,477 - lava_callback - INFO - Received callback for node 68d3f0afcd36afa834e13e0c INFO: 172.20.0.1:52726 - "POST /node/68d3f0afcd36afa834e13e0c HTTP/1.0" 202 Accepted 2025-09-26 13:23:09,483 - lava_callback - INFO - Starting async job submit for node 68d3f0afcd36afa834e13e0c 2025-09-26 13:23:09,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:23:09,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f0afcd36afa834e13e0c HTTP/1.1" 200 None 2025-09-26 13:23:09,497 - lava_callback - DEBUG - Processing node 68d3f0afcd36afa834e13e0c: baseline-arm64-baylibre 2025-09-26 13:23:09,497 - lava_callback - ERROR - Error processing callback for node 68d3f0afcd36afa834e13e0c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:52728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51704 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:23:29,487 - lava_callback - INFO - Received callback for node 68d3f0c2cd36afa834e13e41 INFO: 172.20.0.1:50282 - "POST /node/68d3f0c2cd36afa834e13e41 HTTP/1.0" 202 Accepted 2025-09-26 13:23:29,492 - lava_callback - INFO - Starting async job submit for node 68d3f0c2cd36afa834e13e41 2025-09-26 13:23:29,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:23:29,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f0c2cd36afa834e13e41 HTTP/1.1" 200 None 2025-09-26 13:23:29,506 - lava_callback - DEBUG - Processing node 68d3f0c2cd36afa834e13e41: baseline-arm64-baylibre 2025-09-26 13:23:29,507 - lava_callback - ERROR - Error processing callback for node 68d3f0c2cd36afa834e13e41: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:50284 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:23:39,106 - lava_callback - INFO - Received callback for node 68d68ffa2f83206171a91a83 INFO: 172.20.0.1:50300 - "POST /node/68d68ffa2f83206171a91a83 HTTP/1.0" 202 Accepted 2025-09-26 13:23:39,113 - lava_callback - INFO - Starting async job submit for node 68d68ffa2f83206171a91a83 2025-09-26 13:23:39,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:23:39,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68ffa2f83206171a91a83 HTTP/1.1" 200 None 2025-09-26 13:23:39,156 - lava_callback - DEBUG - Processing node 68d68ffa2f83206171a91a83: baseline-arm64 2025-09-26 13:23:39,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:23:39,728 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:23:39,728 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68ffa2f83206171a91a83/log.txt.gz 2025-09-26 13:23:39,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:23:39,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:23:39,849 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68ffa2f83206171a91a83/lava_callback.json.gz 2025-09-26 13:23:39,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:23:39,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68ffa2f83206171a91a83 HTTP/1.1" 200 None 2025-09-26 13:23:39,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:23:39,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:23:39,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:23:39,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68ffa2f83206171a91a83 HTTP/1.1" 200 None 2025-09-26 13:23:39,956 - lava_callback - INFO - Completed processing callback for node 68d68ffa2f83206171a91a83 2025-09-26 13:23:45,956 - lava_callback - INFO - Received callback for node 68d46a30a5c2c05277bcba48 INFO: 172.20.0.1:47886 - "POST /node/68d46a30a5c2c05277bcba48 HTTP/1.0" 202 Accepted 2025-09-26 13:23:45,963 - lava_callback - INFO - Starting async job submit for node 68d46a30a5c2c05277bcba48 2025-09-26 13:23:45,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:23:45,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d46a30a5c2c05277bcba48 HTTP/1.1" 200 None 2025-09-26 13:23:45,998 - lava_callback - DEBUG - Processing node 68d46a30a5c2c05277bcba48: baseline-arm64-broonie 2025-09-26 13:23:46,393 - lava_callback - ERROR - Error processing callback for node 68d46a30a5c2c05277bcba48: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:47900 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:23:47,559 - lava_callback - INFO - Received callback for node 68d68e882f83206171a9197d INFO: 172.20.0.1:47912 - "POST /node/68d68e882f83206171a9197d HTTP/1.0" 202 Accepted 2025-09-26 13:23:47,567 - lava_callback - INFO - Starting async job submit for node 68d68e882f83206171a9197d 2025-09-26 13:23:47,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:23:47,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68e882f83206171a9197d HTTP/1.1" 200 None 2025-09-26 13:23:47,627 - lava_callback - DEBUG - Processing node 68d68e882f83206171a9197d: baseline-arm64 2025-09-26 13:23:48,316 - lava_callback - INFO - Received callback for node 68d693922f83206171a91d2f INFO: 172.20.0.1:47918 - "POST /node/68d693922f83206171a91d2f HTTP/1.0" 202 Accepted 2025-09-26 13:23:48,343 - lava_callback - INFO - Starting async job submit for node 68d693922f83206171a91d2f 2025-09-26 13:23:48,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:23:48,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693922f83206171a91d2f HTTP/1.1" 200 None 2025-09-26 13:23:48,466 - lava_callback - DEBUG - Processing node 68d693922f83206171a91d2f: baseline-arm64 2025-09-26 13:23:49,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:23:49,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:23:49,472 - lava_callback - INFO - Received callback for node 68d3f0d4cd36afa834e13e50 INFO: 172.20.0.1:46320 - "POST /node/68d3f0d4cd36afa834e13e50 HTTP/1.0" 202 Accepted 2025-09-26 13:23:49,480 - lava_callback - INFO - Starting async job submit for node 68d3f0d4cd36afa834e13e50 2025-09-26 13:23:49,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:23:49,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f0d4cd36afa834e13e50 HTTP/1.1" 200 None 2025-09-26 13:23:49,497 - lava_callback - DEBUG - Processing node 68d3f0d4cd36afa834e13e50: baseline-arm64-baylibre 2025-09-26 13:23:49,497 - lava_callback - ERROR - Error processing callback for node 68d3f0d4cd36afa834e13e50: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 13:23:49,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:23:49,533 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693922f83206171a91d2f/log.txt.gz 2025-09-26 13:23:49,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:23:49,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:23:49,611 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68e882f83206171a9197d/log.txt.gz 2025-09-26 13:23:49,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:23:49,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:23:49,676 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693922f83206171a91d2f/lava_callback.json.gz 2025-09-26 13:23:49,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:23:49,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693922f83206171a91d2f HTTP/1.1" 200 None 2025-09-26 13:23:49,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:23:49,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:23:49,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:23:49,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693922f83206171a91d2f HTTP/1.1" 200 None 2025-09-26 13:23:49,780 - lava_callback - INFO - Completed processing callback for node 68d693922f83206171a91d2f 2025-09-26 13:23:49,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:23:49,836 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68e882f83206171a9197d/lava_callback.json.gz DEBUG: Setup failed for 68d68e882f83206171a9197d. Transitting job node result: incomplete -> fail 2025-09-26 13:23:49,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:23:49,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68e882f83206171a9197d HTTP/1.1" 200 None 2025-09-26 13:23:49,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:23:49,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:23:49,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:23:50,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68e882f83206171a9197d HTTP/1.1" 200 None 2025-09-26 13:23:50,031 - lava_callback - INFO - Completed processing callback for node 68d68e882f83206171a9197d 2025-09-26 13:23:50,055 - lava_callback - INFO - Received callback for node 68d693952f83206171a91d38 INFO: 172.20.0.1:46324 - "POST /node/68d693952f83206171a91d38 HTTP/1.0" 202 Accepted 2025-09-26 13:23:50,067 - lava_callback - INFO - Starting async job submit for node 68d693952f83206171a91d38 2025-09-26 13:23:50,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:23:50,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693952f83206171a91d38 HTTP/1.1" 200 None 2025-09-26 13:23:50,135 - lava_callback - DEBUG - Processing node 68d693952f83206171a91d38: baseline-arm64 2025-09-26 13:23:50,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:23:50,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:23:50,635 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693952f83206171a91d38/log.txt.gz 2025-09-26 13:23:50,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:23:50,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:23:50,828 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693952f83206171a91d38/lava_callback.json.gz 2025-09-26 13:23:50,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:23:50,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693952f83206171a91d38 HTTP/1.1" 200 None 2025-09-26 13:23:50,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:23:50,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:23:50,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:23:50,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693952f83206171a91d38 HTTP/1.1" 200 None 2025-09-26 13:23:50,921 - lava_callback - INFO - Completed processing callback for node 68d693952f83206171a91d38 INFO: 172.20.0.1:46336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46348 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:24:02,255 - lava_callback - INFO - Received callback for node 68d693952f83206171a91d35 INFO: 172.20.0.1:59256 - "POST /node/68d693952f83206171a91d35 HTTP/1.0" 202 Accepted 2025-09-26 13:24:02,262 - lava_callback - INFO - Starting async job submit for node 68d693952f83206171a91d35 2025-09-26 13:24:02,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:02,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693952f83206171a91d35 HTTP/1.1" 200 None 2025-09-26 13:24:02,303 - lava_callback - DEBUG - Processing node 68d693952f83206171a91d35: baseline-arm64 2025-09-26 13:24:02,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:24:02,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:24:02,863 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693952f83206171a91d35/log.txt.gz 2025-09-26 13:24:02,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:24:02,980 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:24:02,981 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693952f83206171a91d35/lava_callback.json.gz 2025-09-26 13:24:03,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:03,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693952f83206171a91d35 HTTP/1.1" 200 None 2025-09-26 13:24:03,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:03,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:24:03,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:03,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693952f83206171a91d35 HTTP/1.1" 200 None 2025-09-26 13:24:03,056 - lava_callback - INFO - Completed processing callback for node 68d693952f83206171a91d35 2025-09-26 13:24:06,239 - lava_callback - INFO - Received callback for node 68d68ffd2f83206171a91a86 INFO: 172.20.0.1:59266 - "POST /node/68d68ffd2f83206171a91a86 HTTP/1.0" 202 Accepted 2025-09-26 13:24:06,247 - lava_callback - INFO - Starting async job submit for node 68d68ffd2f83206171a91a86 2025-09-26 13:24:06,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:06,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68ffd2f83206171a91a86 HTTP/1.1" 200 None 2025-09-26 13:24:06,287 - lava_callback - DEBUG - Processing node 68d68ffd2f83206171a91a86: baseline-arm64 INFO: 172.20.0.1:59274 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:24:06,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:24:06,801 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:24:06,802 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68ffd2f83206171a91a86/log.txt.gz 2025-09-26 13:24:06,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:24:06,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:24:06,938 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68ffd2f83206171a91a86/lava_callback.json.gz 2025-09-26 13:24:06,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:06,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68ffd2f83206171a91a86 HTTP/1.1" 200 None 2025-09-26 13:24:06,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:06,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:24:06,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:07,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68ffd2f83206171a91a86 HTTP/1.1" 200 None 2025-09-26 13:24:07,024 - lava_callback - INFO - Completed processing callback for node 68d68ffd2f83206171a91a86 2025-09-26 13:24:14,478 - lava_callback - INFO - Received callback for node 68d3ef45cd36afa834e13bad INFO: 172.20.0.1:51664 - "POST /node/68d3ef45cd36afa834e13bad HTTP/1.0" 202 Accepted 2025-09-26 13:24:14,485 - lava_callback - INFO - Starting async job submit for node 68d3ef45cd36afa834e13bad 2025-09-26 13:24:14,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:14,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ef45cd36afa834e13bad HTTP/1.1" 200 None 2025-09-26 13:24:14,553 - lava_callback - DEBUG - Processing node 68d3ef45cd36afa834e13bad: ltp-watchqueue 2025-09-26 13:24:15,114 - lava_callback - ERROR - Error processing callback for node 68d3ef45cd36afa834e13bad: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:51680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51688 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:24:18,308 - lava_callback - INFO - Received callback for node 68d693922f83206171a91d32 INFO: 172.20.0.1:51698 - "POST /node/68d693922f83206171a91d32 HTTP/1.0" 202 Accepted 2025-09-26 13:24:18,317 - lava_callback - INFO - Starting async job submit for node 68d693922f83206171a91d32 2025-09-26 13:24:18,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:18,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693922f83206171a91d32 HTTP/1.1" 200 None 2025-09-26 13:24:18,355 - lava_callback - DEBUG - Processing node 68d693922f83206171a91d32: baseline-arm64 2025-09-26 13:24:18,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:24:18,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:24:18,877 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693922f83206171a91d32/log.txt.gz 2025-09-26 13:24:18,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:24:19,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:24:19,019 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693922f83206171a91d32/lava_callback.json.gz 2025-09-26 13:24:19,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:19,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693922f83206171a91d32 HTTP/1.1" 200 None 2025-09-26 13:24:19,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:19,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:24:19,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:19,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693922f83206171a91d32 HTTP/1.1" 200 None 2025-09-26 13:24:19,105 - lava_callback - INFO - Completed processing callback for node 68d693922f83206171a91d32 INFO: 172.20.0.1:34804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34810 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:24:30,319 - lava_callback - INFO - Received callback for node 68d3ff76cd36afa834e1596f INFO: 172.20.0.1:57570 - "POST /node/68d3ff76cd36afa834e1596f HTTP/1.0" 202 Accepted 2025-09-26 13:24:30,325 - lava_callback - INFO - Starting async job submit for node 68d3ff76cd36afa834e1596f 2025-09-26 13:24:30,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:30,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ff76cd36afa834e1596f HTTP/1.1" 200 None 2025-09-26 13:24:30,368 - lava_callback - DEBUG - Processing node 68d3ff76cd36afa834e1596f: baseline-arm 2025-09-26 13:24:30,657 - lava_callback - ERROR - Error processing callback for node 68d3ff76cd36afa834e1596f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:57584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58076 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:24:48,901 - lava_callback - INFO - Received callback for node 68d693cb2f83206171a91da9 INFO: 172.20.0.1:58086 - "POST /node/68d693cb2f83206171a91da9 HTTP/1.0" 202 Accepted 2025-09-26 13:24:48,907 - lava_callback - INFO - Starting async job submit for node 68d693cb2f83206171a91da9 2025-09-26 13:24:48,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:48,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693cb2f83206171a91da9 HTTP/1.1" 200 None 2025-09-26 13:24:48,951 - lava_callback - DEBUG - Processing node 68d693cb2f83206171a91da9: baseline-arm64 2025-09-26 13:24:49,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:24:49,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:24:49,384 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693cb2f83206171a91da9/log.txt.gz 2025-09-26 13:24:49,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:24:49,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:24:49,524 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693cb2f83206171a91da9/lava_callback.json.gz 2025-09-26 13:24:49,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:49,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693cb2f83206171a91da9 HTTP/1.1" 200 None 2025-09-26 13:24:49,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:49,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:24:49,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:49,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693cb2f83206171a91da9 HTTP/1.1" 200 None 2025-09-26 13:24:49,599 - lava_callback - INFO - Completed processing callback for node 68d693cb2f83206171a91da9 2025-09-26 13:24:49,700 - lava_callback - INFO - Received callback for node 68d693ce2f83206171a91daf INFO: 172.20.0.1:53116 - "POST /node/68d693ce2f83206171a91daf HTTP/1.0" 202 Accepted 2025-09-26 13:24:49,710 - lava_callback - INFO - Starting async job submit for node 68d693ce2f83206171a91daf 2025-09-26 13:24:49,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:49,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693ce2f83206171a91daf HTTP/1.1" 200 None 2025-09-26 13:24:49,744 - lava_callback - DEBUG - Processing node 68d693ce2f83206171a91daf: baseline-arm64 2025-09-26 13:24:50,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:24:50,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:24:50,209 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693ce2f83206171a91daf/log.txt.gz 2025-09-26 13:24:50,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:24:50,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:24:50,386 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693ce2f83206171a91daf/lava_callback.json.gz 2025-09-26 13:24:50,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:50,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693ce2f83206171a91daf HTTP/1.1" 200 None 2025-09-26 13:24:50,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:50,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:24:50,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:50,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693ce2f83206171a91daf HTTP/1.1" 200 None 2025-09-26 13:24:50,474 - lava_callback - INFO - Completed processing callback for node 68d693ce2f83206171a91daf 2025-09-26 13:24:55,338 - lava_callback - INFO - Received callback for node 68d68e8a2f83206171a91980 INFO: 172.20.0.1:53132 - "POST /node/68d68e8a2f83206171a91980 HTTP/1.0" 202 Accepted 2025-09-26 13:24:55,345 - lava_callback - INFO - Starting async job submit for node 68d68e8a2f83206171a91980 2025-09-26 13:24:55,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:55,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68e8a2f83206171a91980 HTTP/1.1" 200 None 2025-09-26 13:24:55,395 - lava_callback - DEBUG - Processing node 68d68e8a2f83206171a91980: baseline-arm64 2025-09-26 13:24:56,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:24:56,188 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:24:56,189 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68e8a2f83206171a91980/log.txt.gz 2025-09-26 13:24:56,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:24:56,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:24:56,334 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68e8a2f83206171a91980/lava_callback.json.gz DEBUG: Setup failed for 68d68e8a2f83206171a91980. Transitting job node result: incomplete -> fail 2025-09-26 13:24:56,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:56,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68e8a2f83206171a91980 HTTP/1.1" 200 None 2025-09-26 13:24:56,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:56,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:24:56,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:56,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68e8a2f83206171a91980 HTTP/1.1" 200 None 2025-09-26 13:24:56,473 - lava_callback - INFO - Completed processing callback for node 68d68e8a2f83206171a91980 INFO: 172.20.0.1:53148 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:24:56,840 - lava_callback - INFO - Received callback for node 68d68e962f83206171a91986 INFO: 172.20.0.1:53160 - "POST /node/68d68e962f83206171a91986 HTTP/1.0" 202 Accepted 2025-09-26 13:24:56,848 - lava_callback - INFO - Starting async job submit for node 68d68e962f83206171a91986 2025-09-26 13:24:56,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:56,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68e962f83206171a91986 HTTP/1.1" 200 None 2025-09-26 13:24:56,901 - lava_callback - DEBUG - Processing node 68d68e962f83206171a91986: baseline-arm64 2025-09-26 13:24:58,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:24:58,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:24:58,374 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68e962f83206171a91986/log.txt.gz 2025-09-26 13:24:58,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:24:58,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:24:58,563 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68e962f83206171a91986/lava_callback.json.gz INFO: 172.20.0.1:53166 - "GET / HTTP/1.0" 200 OK DEBUG: Setup failed for 68d68e962f83206171a91986. Transitting job node result: incomplete -> fail 2025-09-26 13:24:58,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:58,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68e962f83206171a91986 HTTP/1.1" 200 None 2025-09-26 13:24:58,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:58,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:24:58,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:58,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68e962f83206171a91986 HTTP/1.1" 200 None 2025-09-26 13:24:58,740 - lava_callback - INFO - Completed processing callback for node 68d68e962f83206171a91986 2025-09-26 13:24:59,008 - lava_callback - INFO - Received callback for node 68d68ffd2f83206171a91a89 INFO: 172.20.0.1:53182 - "POST /node/68d68ffd2f83206171a91a89 HTTP/1.0" 202 Accepted 2025-09-26 13:24:59,016 - lava_callback - INFO - Starting async job submit for node 68d68ffd2f83206171a91a89 2025-09-26 13:24:59,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:59,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68ffd2f83206171a91a89 HTTP/1.1" 200 None 2025-09-26 13:24:59,054 - lava_callback - DEBUG - Processing node 68d68ffd2f83206171a91a89: baseline-arm64 2025-09-26 13:24:59,166 - lava_callback - INFO - Received callback for node 68d4280ea5c2c05277bc750b INFO: 172.20.0.1:53190 - "POST /node/68d4280ea5c2c05277bc750b HTTP/1.0" 202 Accepted 2025-09-26 13:24:59,189 - lava_callback - INFO - Starting async job submit for node 68d4280ea5c2c05277bc750b 2025-09-26 13:24:59,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:24:59,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4280ea5c2c05277bc750b HTTP/1.1" 200 None 2025-09-26 13:24:59,340 - lava_callback - DEBUG - Processing node 68d4280ea5c2c05277bc750b: baseline-arm 2025-09-26 13:24:59,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:24:59,799 - lava_callback - ERROR - Error processing callback for node 68d4280ea5c2c05277bc750b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:24:59,924 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:24:59,925 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68ffd2f83206171a91a89/log.txt.gz 2025-09-26 13:24:59,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:25:00,056 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:25:00,056 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68ffd2f83206171a91a89/lava_callback.json.gz 2025-09-26 13:25:00,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:00,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68ffd2f83206171a91a89 HTTP/1.1" 200 None 2025-09-26 13:25:00,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:00,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:25:00,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:00,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68ffd2f83206171a91a89 HTTP/1.1" 200 None 2025-09-26 13:25:00,144 - lava_callback - INFO - Completed processing callback for node 68d68ffd2f83206171a91a89 2025-09-26 13:25:01,367 - lava_callback - INFO - Received callback for node 68d693cf2f83206171a91db2 INFO: 172.20.0.1:39822 - "POST /node/68d693cf2f83206171a91db2 HTTP/1.0" 202 Accepted 2025-09-26 13:25:01,374 - lava_callback - INFO - Starting async job submit for node 68d693cf2f83206171a91db2 2025-09-26 13:25:01,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:01,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693cf2f83206171a91db2 HTTP/1.1" 200 None 2025-09-26 13:25:01,412 - lava_callback - DEBUG - Processing node 68d693cf2f83206171a91db2: baseline-arm64 2025-09-26 13:25:01,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:25:01,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:25:01,908 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693cf2f83206171a91db2/log.txt.gz 2025-09-26 13:25:01,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:25:02,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:25:02,042 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693cf2f83206171a91db2/lava_callback.json.gz 2025-09-26 13:25:02,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:02,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693cf2f83206171a91db2 HTTP/1.1" 200 None 2025-09-26 13:25:02,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:02,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:25:02,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:02,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693cf2f83206171a91db2 HTTP/1.1" 200 None 2025-09-26 13:25:02,122 - lava_callback - INFO - Completed processing callback for node 68d693cf2f83206171a91db2 2025-09-26 13:25:04,058 - lava_callback - INFO - Received callback for node 68d693cb2f83206171a91dac INFO: 172.20.0.1:39832 - "POST /node/68d693cb2f83206171a91dac HTTP/1.0" 202 Accepted 2025-09-26 13:25:04,064 - lava_callback - INFO - Starting async job submit for node 68d693cb2f83206171a91dac 2025-09-26 13:25:04,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:04,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693cb2f83206171a91dac HTTP/1.1" 200 None 2025-09-26 13:25:04,101 - lava_callback - DEBUG - Processing node 68d693cb2f83206171a91dac: baseline-arm64 2025-09-26 13:25:04,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:25:04,507 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:25:04,507 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693cb2f83206171a91dac/log.txt.gz 2025-09-26 13:25:04,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:25:04,620 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:25:04,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693cb2f83206171a91dac/lava_callback.json.gz 2025-09-26 13:25:04,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:04,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693cb2f83206171a91dac HTTP/1.1" 200 None 2025-09-26 13:25:04,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:04,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:25:04,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:04,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693cb2f83206171a91dac HTTP/1.1" 200 None 2025-09-26 13:25:04,704 - lava_callback - INFO - Completed processing callback for node 68d693cb2f83206171a91dac INFO: 172.20.0.1:39846 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:25:11,690 - lava_callback - INFO - Received callback for node 68d693fe2f83206171a91dff INFO: 172.20.0.1:35962 - "POST /node/68d693fe2f83206171a91dff HTTP/1.0" 202 Accepted 2025-09-26 13:25:11,696 - lava_callback - INFO - Starting async job submit for node 68d693fe2f83206171a91dff 2025-09-26 13:25:11,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:11,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693fe2f83206171a91dff HTTP/1.1" 200 None 2025-09-26 13:25:11,727 - lava_callback - DEBUG - Processing node 68d693fe2f83206171a91dff: baseline-arm64-pengutronix 2025-09-26 13:25:11,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:25:12,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:25:12,077 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d693fe2f83206171a91dff/log.txt.gz 2025-09-26 13:25:12,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:25:12,242 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:25:12,243 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d693fe2f83206171a91dff/lava_callback.json.gz 2025-09-26 13:25:12,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:12,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693fe2f83206171a91dff HTTP/1.1" 200 None 2025-09-26 13:25:12,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:12,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:25:12,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:12,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693fe2f83206171a91dff HTTP/1.1" 200 None 2025-09-26 13:25:12,314 - lava_callback - INFO - Completed processing callback for node 68d693fe2f83206171a91dff INFO: 172.20.0.1:35978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35990 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:25:18,934 - lava_callback - INFO - Received callback for node 68d694072f83206171a91e0c INFO: 172.20.0.1:36000 - "POST /node/68d694072f83206171a91e0c HTTP/1.0" 202 Accepted 2025-09-26 13:25:18,941 - lava_callback - INFO - Starting async job submit for node 68d694072f83206171a91e0c 2025-09-26 13:25:18,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:18,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694072f83206171a91e0c HTTP/1.1" 200 None 2025-09-26 13:25:18,984 - lava_callback - DEBUG - Processing node 68d694072f83206171a91e0c: baseline-arm64-foundriesio 2025-09-26 13:25:19,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:25:19,339 - lava_callback - INFO - Received callback for node 68d694012f83206171a91e02 INFO: 172.20.0.1:54518 - "POST /node/68d694012f83206171a91e02 HTTP/1.0" 202 Accepted 2025-09-26 13:25:19,345 - lava_callback - INFO - Starting async job submit for node 68d694012f83206171a91e02 2025-09-26 13:25:19,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:19,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694012f83206171a91e02 HTTP/1.1" 200 None 2025-09-26 13:25:19,379 - lava_callback - DEBUG - Processing node 68d694012f83206171a91e02: baseline-arm64-pengutronix 2025-09-26 13:25:19,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:25:19,537 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d694072f83206171a91e0c/log.txt.gz 2025-09-26 13:25:19,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:25:19,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:25:19,715 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:25:19,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:25:19,717 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d694072f83206171a91e0c/lava_callback.json.gz 2025-09-26 13:25:19,722 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d694012f83206171a91e02/log.txt.gz 2025-09-26 13:25:19,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:19,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:25:19,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694072f83206171a91e0c HTTP/1.1" 200 None 2025-09-26 13:25:19,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:19,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:25:19,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:19,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694072f83206171a91e0c HTTP/1.1" 200 None 2025-09-26 13:25:19,825 - lava_callback - INFO - Completed processing callback for node 68d694072f83206171a91e0c 2025-09-26 13:25:19,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:25:19,909 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d694012f83206171a91e02/lava_callback.json.gz 2025-09-26 13:25:19,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:19,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694012f83206171a91e02 HTTP/1.1" 200 None 2025-09-26 13:25:19,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:19,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:25:19,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:20,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694012f83206171a91e02 HTTP/1.1" 200 None 2025-09-26 13:25:20,000 - lava_callback - INFO - Completed processing callback for node 68d694012f83206171a91e02 INFO: 172.20.0.1:54524 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:25:24,767 - lava_callback - INFO - Received callback for node 68d694042f83206171a91e09 INFO: 172.20.0.1:54530 - "POST /node/68d694042f83206171a91e09 HTTP/1.0" 202 Accepted 2025-09-26 13:25:24,773 - lava_callback - INFO - Starting async job submit for node 68d694042f83206171a91e09 2025-09-26 13:25:24,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:24,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694042f83206171a91e09 HTTP/1.1" 200 None 2025-09-26 13:25:24,807 - lava_callback - DEBUG - Processing node 68d694042f83206171a91e09: baseline-arm64-foundriesio 2025-09-26 13:25:25,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:25:25,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:25:25,136 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d694042f83206171a91e09/log.txt.gz 2025-09-26 13:25:25,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:25:25,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:25:25,268 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d694042f83206171a91e09/lava_callback.json.gz 2025-09-26 13:25:25,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:25,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694042f83206171a91e09 HTTP/1.1" 200 None 2025-09-26 13:25:25,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:25,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:25:25,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:25,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694042f83206171a91e09 HTTP/1.1" 200 None 2025-09-26 13:25:25,344 - lava_callback - INFO - Completed processing callback for node 68d694042f83206171a91e09 INFO: 172.20.0.1:54546 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:25:29,471 - lava_callback - INFO - Received callback for node 68d692912f83206171a91c8b INFO: 172.20.0.1:48332 - "POST /node/68d692912f83206171a91c8b HTTP/1.0" 202 Accepted 2025-09-26 13:25:29,477 - lava_callback - INFO - Starting async job submit for node 68d692912f83206171a91c8b 2025-09-26 13:25:29,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:29,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d692912f83206171a91c8b HTTP/1.1" 200 None 2025-09-26 13:25:29,530 - lava_callback - DEBUG - Processing node 68d692912f83206171a91c8b: baseline-arm64-broonie 2025-09-26 13:25:30,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:25:30,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:25:30,193 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d692912f83206171a91c8b/log.txt.gz 2025-09-26 13:25:30,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:25:30,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:25:30,337 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d692912f83206171a91c8b/lava_callback.json.gz 2025-09-26 13:25:30,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:30,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d692912f83206171a91c8b HTTP/1.1" 200 None 2025-09-26 13:25:30,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:30,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:25:30,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:30,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d692912f83206171a91c8b HTTP/1.1" 200 None 2025-09-26 13:25:30,444 - lava_callback - INFO - Completed processing callback for node 68d692912f83206171a91c8b 2025-09-26 13:25:33,297 - lava_callback - INFO - Received callback for node 68d3f98ecd36afa834e14ed3 INFO: 172.20.0.1:48334 - "POST /node/68d3f98ecd36afa834e14ed3 HTTP/1.0" 202 Accepted 2025-09-26 13:25:33,303 - lava_callback - INFO - Starting async job submit for node 68d3f98ecd36afa834e14ed3 2025-09-26 13:25:33,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:33,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f98ecd36afa834e14ed3 HTTP/1.1" 200 None 2025-09-26 13:25:33,351 - lava_callback - DEBUG - Processing node 68d3f98ecd36afa834e14ed3: baseline-arm64 2025-09-26 13:25:33,640 - lava_callback - ERROR - Error processing callback for node 68d3f98ecd36afa834e14ed3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:25:33,979 - lava_callback - INFO - Received callback for node 68d693e32f83206171a91dd1 INFO: 172.20.0.1:48338 - "POST /node/68d693e32f83206171a91dd1 HTTP/1.0" 202 Accepted 2025-09-26 13:25:33,984 - lava_callback - INFO - Starting async job submit for node 68d693e32f83206171a91dd1 2025-09-26 13:25:34,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:34,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693e32f83206171a91dd1 HTTP/1.1" 200 None 2025-09-26 13:25:34,024 - lava_callback - DEBUG - Processing node 68d693e32f83206171a91dd1: baseline-arm64-broonie 2025-09-26 13:25:34,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:25:34,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:25:34,387 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d693e32f83206171a91dd1/log.txt.gz 2025-09-26 13:25:34,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:25:34,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:25:34,519 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d693e32f83206171a91dd1/lava_callback.json.gz 2025-09-26 13:25:34,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:34,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693e32f83206171a91dd1 HTTP/1.1" 200 None 2025-09-26 13:25:34,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:34,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:25:34,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:34,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693e32f83206171a91dd1 HTTP/1.1" 200 None 2025-09-26 13:25:34,594 - lava_callback - INFO - Completed processing callback for node 68d693e32f83206171a91dd1 INFO: 172.20.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37186 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:25:54,081 - lava_callback - INFO - Received callback for node 68d693e02f83206171a91dce INFO: 172.20.0.1:55804 - "POST /node/68d693e02f83206171a91dce HTTP/1.0" 202 Accepted 2025-09-26 13:25:54,087 - lava_callback - INFO - Starting async job submit for node 68d693e02f83206171a91dce 2025-09-26 13:25:54,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:54,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693e02f83206171a91dce HTTP/1.1" 200 None 2025-09-26 13:25:54,121 - lava_callback - DEBUG - Processing node 68d693e02f83206171a91dce: baseline-arm64-broonie 2025-09-26 13:25:54,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:25:54,541 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:25:54,542 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d693e02f83206171a91dce/log.txt.gz 2025-09-26 13:25:54,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:25:54,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:25:54,707 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d693e02f83206171a91dce/lava_callback.json.gz 2025-09-26 13:25:54,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:54,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693e02f83206171a91dce HTTP/1.1" 200 None 2025-09-26 13:25:54,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:54,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:25:54,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:54,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693e02f83206171a91dce HTTP/1.1" 200 None 2025-09-26 13:25:54,785 - lava_callback - INFO - Completed processing callback for node 68d693e02f83206171a91dce 2025-09-26 13:25:55,481 - lava_callback - INFO - Received callback for node 68d693f82f83206171a91df9 INFO: 172.20.0.1:55808 - "POST /node/68d693f82f83206171a91df9 HTTP/1.0" 202 Accepted 2025-09-26 13:25:55,486 - lava_callback - INFO - Starting async job submit for node 68d693f82f83206171a91df9 2025-09-26 13:25:55,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:55,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693f82f83206171a91df9 HTTP/1.1" 200 None 2025-09-26 13:25:55,519 - lava_callback - DEBUG - Processing node 68d693f82f83206171a91df9: baseline-arm64-broonie 2025-09-26 13:25:55,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:25:55,871 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:25:55,872 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d693f82f83206171a91df9/log.txt.gz 2025-09-26 13:25:55,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:25:55,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:25:55,987 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d693f82f83206171a91df9/lava_callback.json.gz 2025-09-26 13:25:56,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:56,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693f82f83206171a91df9 HTTP/1.1" 200 None 2025-09-26 13:25:56,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:56,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:25:56,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:25:56,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693f82f83206171a91df9 HTTP/1.1" 200 None 2025-09-26 13:25:56,065 - lava_callback - INFO - Completed processing callback for node 68d693f82f83206171a91df9 INFO: 172.20.0.1:55818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57758 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:26:10,644 - lava_callback - INFO - Received callback for node 68d3f185cd36afa834e13f56 INFO: 172.20.0.1:45656 - "POST /node/68d3f185cd36afa834e13f56 HTTP/1.0" 202 Accepted 2025-09-26 13:26:10,651 - lava_callback - INFO - Starting async job submit for node 68d3f185cd36afa834e13f56 2025-09-26 13:26:10,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:26:10,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f185cd36afa834e13f56 HTTP/1.1" 200 None 2025-09-26 13:26:10,766 - lava_callback - DEBUG - Processing node 68d3f185cd36afa834e13f56: ltp-containers 2025-09-26 13:26:11,538 - lava_callback - ERROR - Error processing callback for node 68d3f185cd36afa834e13f56: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:26:13,982 - lava_callback - INFO - Received callback for node 68d693ef2f83206171a91de8 INFO: 172.20.0.1:45672 - "POST /node/68d693ef2f83206171a91de8 HTTP/1.0" 202 Accepted 2025-09-26 13:26:13,987 - lava_callback - INFO - Starting async job submit for node 68d693ef2f83206171a91de8 2025-09-26 13:26:14,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:26:14,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693ef2f83206171a91de8 HTTP/1.1" 200 None 2025-09-26 13:26:14,021 - lava_callback - DEBUG - Processing node 68d693ef2f83206171a91de8: baseline-arm64-broonie 2025-09-26 13:26:14,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:26:14,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:26:14,393 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d693ef2f83206171a91de8/log.txt.gz 2025-09-26 13:26:14,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:26:14,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:26:14,512 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d693ef2f83206171a91de8/lava_callback.json.gz 2025-09-26 13:26:14,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:26:14,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693ef2f83206171a91de8 HTTP/1.1" 200 None 2025-09-26 13:26:14,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:26:14,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:26:14,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:26:14,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693ef2f83206171a91de8 HTTP/1.1" 200 None 2025-09-26 13:26:14,602 - lava_callback - INFO - Completed processing callback for node 68d693ef2f83206171a91de8 INFO: 172.20.0.1:45684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54844 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:26:30,404 - lava_callback - INFO - Received callback for node 68d693fb2f83206171a91dfc INFO: 172.20.0.1:40338 - "POST /node/68d693fb2f83206171a91dfc HTTP/1.0" 202 Accepted 2025-09-26 13:26:30,412 - lava_callback - INFO - Starting async job submit for node 68d693fb2f83206171a91dfc 2025-09-26 13:26:30,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:26:30,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693fb2f83206171a91dfc HTTP/1.1" 200 None 2025-09-26 13:26:30,457 - lava_callback - DEBUG - Processing node 68d693fb2f83206171a91dfc: baseline-arm64-broonie 2025-09-26 13:26:30,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:26:31,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:26:31,001 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d693fb2f83206171a91dfc/log.txt.gz 2025-09-26 13:26:31,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:26:31,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:26:31,133 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d693fb2f83206171a91dfc/lava_callback.json.gz 2025-09-26 13:26:31,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:26:31,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693fb2f83206171a91dfc HTTP/1.1" 200 None 2025-09-26 13:26:31,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:26:31,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:26:31,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:26:31,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693fb2f83206171a91dfc HTTP/1.1" 200 None 2025-09-26 13:26:31,276 - lava_callback - INFO - Completed processing callback for node 68d693fb2f83206171a91dfc 2025-09-26 13:26:33,918 - lava_callback - INFO - Received callback for node 68d40077cd36afa834e15a92 INFO: 172.20.0.1:40342 - "POST /node/68d40077cd36afa834e15a92 HTTP/1.0" 202 Accepted 2025-09-26 13:26:33,924 - lava_callback - INFO - Starting async job submit for node 68d40077cd36afa834e15a92 2025-09-26 13:26:33,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:26:33,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40077cd36afa834e15a92 HTTP/1.1" 200 None 2025-09-26 13:26:33,969 - lava_callback - DEBUG - Processing node 68d40077cd36afa834e15a92: baseline-arm-broonie 2025-09-26 13:26:34,232 - lava_callback - ERROR - Error processing callback for node 68d40077cd36afa834e15a92: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:26:36,260 - lava_callback - INFO - Received callback for node 68d693542f83206171a91cbb INFO: 172.20.0.1:40352 - "POST /node/68d693542f83206171a91cbb HTTP/1.0" 202 Accepted 2025-09-26 13:26:36,267 - lava_callback - INFO - Starting async job submit for node 68d693542f83206171a91cbb 2025-09-26 13:26:36,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:26:36,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693542f83206171a91cbb HTTP/1.1" 200 None 2025-09-26 13:26:36,305 - lava_callback - DEBUG - Processing node 68d693542f83206171a91cbb: baseline-arm64 INFO: 172.20.0.1:40364 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:26:36,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:26:36,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:26:36,733 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693542f83206171a91cbb/log.txt.gz 2025-09-26 13:26:36,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:26:36,894 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:26:36,895 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693542f83206171a91cbb/lava_callback.json.gz 2025-09-26 13:26:36,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:26:36,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693542f83206171a91cbb HTTP/1.1" 200 None 2025-09-26 13:26:36,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:26:36,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:26:36,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:26:36,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693542f83206171a91cbb HTTP/1.1" 200 None 2025-09-26 13:26:36,979 - lava_callback - INFO - Completed processing callback for node 68d693542f83206171a91cbb INFO: 172.20.0.1:39726 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:26:55,119 - lava_callback - INFO - Received callback for node 68d693db2f83206171a91dc4 INFO: 172.20.0.1:59810 - "POST /node/68d693db2f83206171a91dc4 HTTP/1.0" 202 Accepted 2025-09-26 13:26:55,127 - lava_callback - INFO - Starting async job submit for node 68d693db2f83206171a91dc4 2025-09-26 13:26:55,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:26:55,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693db2f83206171a91dc4 HTTP/1.1" 200 None 2025-09-26 13:26:55,165 - lava_callback - DEBUG - Processing node 68d693db2f83206171a91dc4: baseline-arm64-broonie 2025-09-26 13:26:55,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:26:55,611 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:26:55,611 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d693db2f83206171a91dc4/log.txt.gz 2025-09-26 13:26:55,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:26:55,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:26:55,783 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d693db2f83206171a91dc4/lava_callback.json.gz 2025-09-26 13:26:55,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:26:55,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693db2f83206171a91dc4 HTTP/1.1" 200 None 2025-09-26 13:26:55,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:26:55,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:26:55,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:26:55,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693db2f83206171a91dc4 HTTP/1.1" 200 None 2025-09-26 13:26:55,871 - lava_callback - INFO - Completed processing callback for node 68d693db2f83206171a91dc4 INFO: 172.20.0.1:59812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59814 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:27:00,250 - lava_callback - INFO - Received callback for node 68d42810a5c2c05277bc750e INFO: 172.20.0.1:56258 - "POST /node/68d42810a5c2c05277bc750e HTTP/1.0" 202 Accepted 2025-09-26 13:27:00,256 - lava_callback - INFO - Starting async job submit for node 68d42810a5c2c05277bc750e 2025-09-26 13:27:00,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:27:00,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42810a5c2c05277bc750e HTTP/1.1" 200 None 2025-09-26 13:27:00,288 - lava_callback - DEBUG - Processing node 68d42810a5c2c05277bc750e: baseline-arm 2025-09-26 13:27:00,561 - lava_callback - ERROR - Error processing callback for node 68d42810a5c2c05277bc750e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:27:00,715 - lava_callback - INFO - Received callback for node 68d3f990cd36afa834e14ed6 INFO: 172.20.0.1:56262 - "POST /node/68d3f990cd36afa834e14ed6 HTTP/1.0" 202 Accepted 2025-09-26 13:27:00,721 - lava_callback - INFO - Starting async job submit for node 68d3f990cd36afa834e14ed6 2025-09-26 13:27:00,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:27:00,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f990cd36afa834e14ed6 HTTP/1.1" 200 None 2025-09-26 13:27:00,759 - lava_callback - DEBUG - Processing node 68d3f990cd36afa834e14ed6: baseline-arm64 2025-09-26 13:27:01,107 - lava_callback - ERROR - Error processing callback for node 68d3f990cd36afa834e14ed6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:56276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48716 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:27:51,696 - lava_callback - INFO - Received callback for node 68d693552f83206171a91cbe INFO: 172.20.0.1:41956 - "POST /node/68d693552f83206171a91cbe HTTP/1.0" 202 Accepted 2025-09-26 13:27:51,706 - lava_callback - INFO - Starting async job submit for node 68d693552f83206171a91cbe 2025-09-26 13:27:51,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:27:51,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693552f83206171a91cbe HTTP/1.1" 200 None 2025-09-26 13:27:51,759 - lava_callback - DEBUG - Processing node 68d693552f83206171a91cbe: baseline-arm64 2025-09-26 13:27:52,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:27:52,216 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:27:52,217 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693552f83206171a91cbe/log.txt.gz 2025-09-26 13:27:52,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:27:52,358 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:27:52,359 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693552f83206171a91cbe/lava_callback.json.gz 2025-09-26 13:27:52,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:27:52,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693552f83206171a91cbe HTTP/1.1" 200 None 2025-09-26 13:27:52,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:27:52,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:27:52,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:27:52,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693552f83206171a91cbe HTTP/1.1" 200 None 2025-09-26 13:27:52,432 - lava_callback - INFO - Completed processing callback for node 68d693552f83206171a91cbe 2025-09-26 13:27:52,666 - lava_callback - INFO - Received callback for node 68d693e72f83206171a91ddf INFO: 172.20.0.1:41970 - "POST /node/68d693e72f83206171a91ddf HTTP/1.0" 202 Accepted 2025-09-26 13:27:52,672 - lava_callback - INFO - Starting async job submit for node 68d693e72f83206171a91ddf 2025-09-26 13:27:52,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:27:52,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693e72f83206171a91ddf HTTP/1.1" 200 None 2025-09-26 13:27:52,711 - lava_callback - DEBUG - Processing node 68d693e72f83206171a91ddf: baseline-arm64-broonie 2025-09-26 13:27:53,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:27:53,188 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:27:53,188 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d693e72f83206171a91ddf/log.txt.gz 2025-09-26 13:27:53,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:27:53,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:27:53,333 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d693e72f83206171a91ddf/lava_callback.json.gz 2025-09-26 13:27:53,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:27:53,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693e72f83206171a91ddf HTTP/1.1" 200 None 2025-09-26 13:27:53,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:27:53,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:27:53,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:27:53,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693e72f83206171a91ddf HTTP/1.1" 200 None 2025-09-26 13:27:53,423 - lava_callback - INFO - Completed processing callback for node 68d693e72f83206171a91ddf INFO: 172.20.0.1:41982 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:27:57,454 - lava_callback - INFO - Received callback for node 68d693ec2f83206171a91de5 INFO: 172.20.0.1:41998 - "POST /node/68d693ec2f83206171a91de5 HTTP/1.0" 202 Accepted 2025-09-26 13:27:57,462 - lava_callback - INFO - Starting async job submit for node 68d693ec2f83206171a91de5 2025-09-26 13:27:57,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:27:57,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693ec2f83206171a91de5 HTTP/1.1" 200 None 2025-09-26 13:27:57,506 - lava_callback - DEBUG - Processing node 68d693ec2f83206171a91de5: baseline-arm64-broonie 2025-09-26 13:27:58,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:27:58,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:27:58,202 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d693ec2f83206171a91de5/log.txt.gz 2025-09-26 13:27:58,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:27:58,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:27:58,406 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d693ec2f83206171a91de5/lava_callback.json.gz 2025-09-26 13:27:58,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:27:58,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693ec2f83206171a91de5 HTTP/1.1" 200 None 2025-09-26 13:27:58,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:27:58,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:27:58,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:27:58,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693ec2f83206171a91de5 HTTP/1.1" 200 None 2025-09-26 13:27:58,486 - lava_callback - INFO - Completed processing callback for node 68d693ec2f83206171a91de5 INFO: 172.20.0.1:54632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54642 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:28:12,319 - lava_callback - INFO - Received callback for node 68d694962f83206171a91ec2 INFO: 172.20.0.1:38498 - "POST /node/68d694962f83206171a91ec2 HTTP/1.0" 202 Accepted 2025-09-26 13:28:12,326 - lava_callback - INFO - Starting async job submit for node 68d694962f83206171a91ec2 2025-09-26 13:28:12,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:28:12,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694962f83206171a91ec2 HTTP/1.1" 200 None 2025-09-26 13:28:12,365 - lava_callback - DEBUG - Processing node 68d694962f83206171a91ec2: baseline-arm64 2025-09-26 13:28:12,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:28:12,862 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:28:12,863 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694962f83206171a91ec2/log.txt.gz 2025-09-26 13:28:12,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:28:12,997 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:28:12,998 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694962f83206171a91ec2/lava_callback.json.gz 2025-09-26 13:28:13,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:28:13,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694962f83206171a91ec2 HTTP/1.1" 200 None 2025-09-26 13:28:13,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:28:13,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:28:13,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:28:13,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694962f83206171a91ec2 HTTP/1.1" 200 None 2025-09-26 13:28:13,083 - lava_callback - INFO - Completed processing callback for node 68d694962f83206171a91ec2 INFO: 172.20.0.1:38504 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 13:28:15,393 - lava_callback - INFO - Received callback for node 68d688aa2f83206171a9155d INFO: 172.20.0.1:38518 - "POST /node/68d688aa2f83206171a9155d HTTP/1.0" 202 Accepted 2025-09-26 13:28:15,400 - lava_callback - INFO - Starting async job submit for node 68d688aa2f83206171a9155d 2025-09-26 13:28:15,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:28:15,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688aa2f83206171a9155d HTTP/1.1" 200 None 2025-09-26 13:28:15,486 - lava_callback - DEBUG - Processing node 68d688aa2f83206171a9155d: ltp-smoketest 2025-09-26 13:28:16,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:28:16,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:28:16,248 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d688aa2f83206171a9155d/log.txt.gz 2025-09-26 13:28:16,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:28:16,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:28:16,412 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d688aa2f83206171a9155d/lava_callback.json.gz INFO: 172.20.0.1:38528 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:28:16,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:28:16,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d688aa2f83206171a9155d HTTP/1.1" 200 None 2025-09-26 13:28:16,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:28:16,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c3cc1bc82a30b37a90d HTTP/1.1" 200 None 2025-09-26 13:28:16,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:28:16,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d688aa2f83206171a9155d HTTP/1.1" 200 None 2025-09-26 13:28:16,629 - lava_callback - INFO - Completed processing callback for node 68d688aa2f83206171a9155d INFO: 172.20.0.1:38242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38256 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:28:31,216 - lava_callback - INFO - Received callback for node 68d694b32f83206171a91eff INFO: 172.20.0.1:40400 - "POST /node/68d694b32f83206171a91eff HTTP/1.0" 202 Accepted 2025-09-26 13:28:31,222 - lava_callback - INFO - Starting async job submit for node 68d694b32f83206171a91eff 2025-09-26 13:28:31,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:28:31,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694b32f83206171a91eff HTTP/1.1" 200 None 2025-09-26 13:28:31,261 - lava_callback - DEBUG - Processing node 68d694b32f83206171a91eff: baseline-arm64 2025-09-26 13:28:31,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:28:31,770 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:28:31,770 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694b32f83206171a91eff/log.txt.gz 2025-09-26 13:28:31,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:28:31,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:28:31,905 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694b32f83206171a91eff/lava_callback.json.gz 2025-09-26 13:28:31,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:28:31,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694b32f83206171a91eff HTTP/1.1" 200 None 2025-09-26 13:28:31,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:28:31,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:28:31,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:28:31,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694b32f83206171a91eff HTTP/1.1" 200 None 2025-09-26 13:28:31,991 - lava_callback - INFO - Completed processing callback for node 68d694b32f83206171a91eff 2025-09-26 13:28:32,933 - lava_callback - INFO - Received callback for node 68d3f999cd36afa834e14edf INFO: 172.20.0.1:40414 - "POST /node/68d3f999cd36afa834e14edf HTTP/1.0" 202 Accepted 2025-09-26 13:28:32,940 - lava_callback - INFO - Starting async job submit for node 68d3f999cd36afa834e14edf 2025-09-26 13:28:32,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:28:32,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f999cd36afa834e14edf HTTP/1.1" 200 None 2025-09-26 13:28:32,981 - lava_callback - DEBUG - Processing node 68d3f999cd36afa834e14edf: baseline-arm64 2025-09-26 13:28:33,382 - lava_callback - ERROR - Error processing callback for node 68d3f999cd36afa834e14edf: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:40420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37484 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:28:47,913 - lava_callback - INFO - Received callback for node 68d694b32f83206171a91efc INFO: 172.20.0.1:37496 - "POST /node/68d694b32f83206171a91efc HTTP/1.0" 202 Accepted 2025-09-26 13:28:47,920 - lava_callback - INFO - Starting async job submit for node 68d694b32f83206171a91efc 2025-09-26 13:28:47,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:28:47,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694b32f83206171a91efc HTTP/1.1" 200 None 2025-09-26 13:28:47,961 - lava_callback - DEBUG - Processing node 68d694b32f83206171a91efc: baseline-arm64 2025-09-26 13:28:48,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:28:48,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:28:48,487 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694b32f83206171a91efc/log.txt.gz 2025-09-26 13:28:48,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:28:48,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:28:48,608 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694b32f83206171a91efc/lava_callback.json.gz 2025-09-26 13:28:48,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:28:48,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694b32f83206171a91efc HTTP/1.1" 200 None 2025-09-26 13:28:48,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:28:48,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:28:48,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:28:48,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694b32f83206171a91efc HTTP/1.1" 200 None 2025-09-26 13:28:48,689 - lava_callback - INFO - Completed processing callback for node 68d694b32f83206171a91efc INFO: 172.20.0.1:59622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41342 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:29:00,791 - lava_callback - INFO - Received callback for node 68d694972f83206171a91ec5 INFO: 172.20.0.1:41344 - "POST /node/68d694972f83206171a91ec5 HTTP/1.0" 202 Accepted 2025-09-26 13:29:00,798 - lava_callback - INFO - Starting async job submit for node 68d694972f83206171a91ec5 2025-09-26 13:29:00,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:00,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694972f83206171a91ec5 HTTP/1.1" 200 None 2025-09-26 13:29:00,831 - lava_callback - DEBUG - Processing node 68d694972f83206171a91ec5: baseline-arm64 2025-09-26 13:29:01,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:29:01,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:29:01,325 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694972f83206171a91ec5/log.txt.gz 2025-09-26 13:29:01,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:29:01,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:29:01,457 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694972f83206171a91ec5/lava_callback.json.gz 2025-09-26 13:29:01,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:01,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694972f83206171a91ec5 HTTP/1.1" 200 None 2025-09-26 13:29:01,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:01,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:29:01,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:01,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694972f83206171a91ec5 HTTP/1.1" 200 None 2025-09-26 13:29:01,538 - lava_callback - INFO - Completed processing callback for node 68d694972f83206171a91ec5 INFO: 172.20.0.1:41358 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:29:08,810 - lava_callback - INFO - Received callback for node 68d694bf2f83206171a91f3c INFO: 172.20.0.1:41374 - "POST /node/68d694bf2f83206171a91f3c HTTP/1.0" 202 Accepted 2025-09-26 13:29:08,818 - lava_callback - INFO - Starting async job submit for node 68d694bf2f83206171a91f3c 2025-09-26 13:29:08,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:08,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694bf2f83206171a91f3c HTTP/1.1" 200 None 2025-09-26 13:29:08,855 - lava_callback - DEBUG - Processing node 68d694bf2f83206171a91f3c: baseline-arm64-baylibre 2025-09-26 13:29:09,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:29:09,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:29:09,334 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d694bf2f83206171a91f3c/log.txt.gz 2025-09-26 13:29:09,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:29:09,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:29:09,480 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d694bf2f83206171a91f3c/lava_callback.json.gz 2025-09-26 13:29:09,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:09,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694bf2f83206171a91f3c HTTP/1.1" 200 None 2025-09-26 13:29:09,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:09,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:29:09,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:09,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694bf2f83206171a91f3c HTTP/1.1" 200 None 2025-09-26 13:29:09,566 - lava_callback - INFO - Completed processing callback for node 68d694bf2f83206171a91f3c 2025-09-26 13:29:10,800 - lava_callback - INFO - Received callback for node 68d68eab2f83206171a9199b INFO: 172.20.0.1:48630 - "POST /node/68d68eab2f83206171a9199b HTTP/1.0" 202 Accepted 2025-09-26 13:29:10,808 - lava_callback - INFO - Starting async job submit for node 68d68eab2f83206171a9199b 2025-09-26 13:29:10,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:10,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68eab2f83206171a9199b HTTP/1.1" 200 None 2025-09-26 13:29:10,868 - lava_callback - DEBUG - Processing node 68d68eab2f83206171a9199b: baseline-arm64 2025-09-26 13:29:11,427 - lava_callback - INFO - Received callback for node 68d693572f83206171a91cc5 INFO: 172.20.0.1:48636 - "POST /node/68d693572f83206171a91cc5 HTTP/1.0" 202 Accepted 2025-09-26 13:29:11,457 - lava_callback - INFO - Starting async job submit for node 68d693572f83206171a91cc5 2025-09-26 13:29:11,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:11,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693572f83206171a91cc5 HTTP/1.1" 200 None 2025-09-26 13:29:11,654 - lava_callback - DEBUG - Processing node 68d693572f83206171a91cc5: baseline-arm64 2025-09-26 13:29:12,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:29:12,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:29:12,701 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693572f83206171a91cc5/log.txt.gz 2025-09-26 13:29:12,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:29:12,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:29:12,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:29:12,888 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68eab2f83206171a9199b/log.txt.gz 2025-09-26 13:29:12,893 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:29:12,894 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693572f83206171a91cc5/lava_callback.json.gz 2025-09-26 13:29:12,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:29:12,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:12,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693572f83206171a91cc5 HTTP/1.1" 200 None 2025-09-26 13:29:12,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:12,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:29:12,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:13,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693572f83206171a91cc5 HTTP/1.1" 200 None 2025-09-26 13:29:13,027 - lava_callback - INFO - Completed processing callback for node 68d693572f83206171a91cc5 2025-09-26 13:29:13,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:29:13,170 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68eab2f83206171a9199b/lava_callback.json.gz DEBUG: Setup failed for 68d68eab2f83206171a9199b. Transitting job node result: incomplete -> fail 2025-09-26 13:29:13,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:13,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68eab2f83206171a9199b HTTP/1.1" 200 None 2025-09-26 13:29:13,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:13,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:29:13,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:13,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68eab2f83206171a9199b HTTP/1.1" 200 None 2025-09-26 13:29:13,340 - lava_callback - INFO - Completed processing callback for node 68d68eab2f83206171a9199b 2025-09-26 13:29:15,025 - lava_callback - INFO - Received callback for node 68d42812a5c2c05277bc7511 INFO: 172.20.0.1:48652 - "POST /node/68d42812a5c2c05277bc7511 HTTP/1.0" 202 Accepted 2025-09-26 13:29:15,033 - lava_callback - INFO - Starting async job submit for node 68d42812a5c2c05277bc7511 2025-09-26 13:29:15,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:15,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42812a5c2c05277bc7511 HTTP/1.1" 200 None 2025-09-26 13:29:15,088 - lava_callback - DEBUG - Processing node 68d42812a5c2c05277bc7511: baseline-arm INFO: 172.20.0.1:48668 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 13:29:15,372 - lava_callback - ERROR - Error processing callback for node 68d42812a5c2c05277bc7511: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:48678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43810 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:29:53,144 - lava_callback - INFO - Received callback for node 68d695162f83206171a91faf INFO: 172.20.0.1:51958 - "POST /node/68d695162f83206171a91faf HTTP/1.0" 202 Accepted 2025-09-26 13:29:53,151 - lava_callback - INFO - Starting async job submit for node 68d695162f83206171a91faf 2025-09-26 13:29:53,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:53,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695162f83206171a91faf HTTP/1.1" 200 None 2025-09-26 13:29:53,191 - lava_callback - DEBUG - Processing node 68d695162f83206171a91faf: baseline-arm64-pengutronix 2025-09-26 13:29:53,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:29:53,521 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:29:53,522 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d695162f83206171a91faf/log.txt.gz 2025-09-26 13:29:53,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:29:53,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:29:53,657 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d695162f83206171a91faf/lava_callback.json.gz 2025-09-26 13:29:53,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:53,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695162f83206171a91faf HTTP/1.1" 200 None 2025-09-26 13:29:53,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:53,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:29:53,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:53,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695162f83206171a91faf HTTP/1.1" 200 None 2025-09-26 13:29:53,780 - lava_callback - INFO - Completed processing callback for node 68d695162f83206171a91faf 2025-09-26 13:29:54,087 - lava_callback - INFO - Received callback for node 68d694e32f83206171a91f6c INFO: 172.20.0.1:51964 - "POST /node/68d694e32f83206171a91f6c HTTP/1.0" 202 Accepted 2025-09-26 13:29:54,096 - lava_callback - INFO - Starting async job submit for node 68d694e32f83206171a91f6c 2025-09-26 13:29:54,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:54,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694e32f83206171a91f6c HTTP/1.1" 200 None 2025-09-26 13:29:54,159 - lava_callback - DEBUG - Processing node 68d694e32f83206171a91f6c: baseline-arm64-broonie 2025-09-26 13:29:54,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:29:54,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:29:54,563 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d694e32f83206171a91f6c/log.txt.gz 2025-09-26 13:29:54,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:29:54,730 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:29:54,731 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d694e32f83206171a91f6c/lava_callback.json.gz 2025-09-26 13:29:54,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:54,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694e32f83206171a91f6c HTTP/1.1" 200 None 2025-09-26 13:29:54,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:54,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:29:54,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:54,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694e32f83206171a91f6c HTTP/1.1" 200 None 2025-09-26 13:29:54,814 - lava_callback - INFO - Completed processing callback for node 68d694e32f83206171a91f6c 2025-09-26 13:29:56,197 - lava_callback - INFO - Received callback for node 68d3f99bcd36afa834e14ee2 INFO: 172.20.0.1:51972 - "POST /node/68d3f99bcd36afa834e14ee2 HTTP/1.0" 202 Accepted 2025-09-26 13:29:56,203 - lava_callback - INFO - Starting async job submit for node 68d3f99bcd36afa834e14ee2 2025-09-26 13:29:56,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:56,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f99bcd36afa834e14ee2 HTTP/1.1" 200 None 2025-09-26 13:29:56,241 - lava_callback - DEBUG - Processing node 68d3f99bcd36afa834e14ee2: baseline-arm64 INFO: 172.20.0.1:51976 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:29:56,591 - lava_callback - ERROR - Error processing callback for node 68d3f99bcd36afa834e14ee2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:29:59,169 - lava_callback - INFO - Received callback for node 68d6951f2f83206171a91fbc INFO: 172.20.0.1:51980 - "POST /node/68d6951f2f83206171a91fbc HTTP/1.0" 202 Accepted 2025-09-26 13:29:59,179 - lava_callback - INFO - Starting async job submit for node 68d6951f2f83206171a91fbc 2025-09-26 13:29:59,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:29:59,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6951f2f83206171a91fbc HTTP/1.1" 200 None 2025-09-26 13:29:59,227 - lava_callback - DEBUG - Processing node 68d6951f2f83206171a91fbc: baseline-arm64-foundriesio 2025-09-26 13:29:59,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:29:59,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:29:59,794 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6951f2f83206171a91fbc/log.txt.gz 2025-09-26 13:29:59,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:29:59,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:29:59,965 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6951f2f83206171a91fbc/lava_callback.json.gz INFO: 172.20.0.1:46118 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:30:00,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:00,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6951f2f83206171a91fbc HTTP/1.1" 200 None 2025-09-26 13:30:00,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:00,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:30:00,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:00,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6951f2f83206171a91fbc HTTP/1.1" 200 None 2025-09-26 13:30:00,082 - lava_callback - INFO - Completed processing callback for node 68d6951f2f83206171a91fbc 2025-09-26 13:30:00,558 - lava_callback - INFO - Received callback for node 68d695192f83206171a91fb2 INFO: 172.20.0.1:46120 - "POST /node/68d695192f83206171a91fb2 HTTP/1.0" 202 Accepted 2025-09-26 13:30:00,564 - lava_callback - INFO - Starting async job submit for node 68d695192f83206171a91fb2 2025-09-26 13:30:00,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:00,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695192f83206171a91fb2 HTTP/1.1" 200 None 2025-09-26 13:30:00,603 - lava_callback - DEBUG - Processing node 68d695192f83206171a91fb2: baseline-arm64-pengutronix 2025-09-26 13:30:00,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:01,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:01,010 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d695192f83206171a91fb2/log.txt.gz 2025-09-26 13:30:01,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:01,145 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:01,146 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d695192f83206171a91fb2/lava_callback.json.gz 2025-09-26 13:30:01,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:01,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695192f83206171a91fb2 HTTP/1.1" 200 None 2025-09-26 13:30:01,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:01,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:30:01,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:01,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695192f83206171a91fb2 HTTP/1.1" 200 None 2025-09-26 13:30:01,232 - lava_callback - INFO - Completed processing callback for node 68d695192f83206171a91fb2 2025-09-26 13:30:02,276 - lava_callback - INFO - Received callback for node 68d695012f83206171a91f96 INFO: 172.20.0.1:46132 - "POST /node/68d695012f83206171a91f96 HTTP/1.0" 202 Accepted 2025-09-26 13:30:02,282 - lava_callback - INFO - Starting async job submit for node 68d695012f83206171a91f96 2025-09-26 13:30:02,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:02,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695012f83206171a91f96 HTTP/1.1" 200 None 2025-09-26 13:30:02,318 - lava_callback - DEBUG - Processing node 68d695012f83206171a91f96: baseline-arm64-clabbe 2025-09-26 13:30:02,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:02,757 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:02,758 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d695012f83206171a91f96/log.txt.gz 2025-09-26 13:30:02,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:02,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:02,889 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d695012f83206171a91f96/lava_callback.json.gz 2025-09-26 13:30:02,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:02,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695012f83206171a91f96 HTTP/1.1" 200 None 2025-09-26 13:30:02,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:02,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:30:02,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:03,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695012f83206171a91f96 HTTP/1.1" 200 None 2025-09-26 13:30:03,005 - lava_callback - INFO - Completed processing callback for node 68d695012f83206171a91f96 2025-09-26 13:30:05,033 - lava_callback - INFO - Received callback for node 68d6951c2f83206171a91fb5 INFO: 172.20.0.1:46144 - "POST /node/68d6951c2f83206171a91fb5 HTTP/1.0" 202 Accepted 2025-09-26 13:30:05,041 - lava_callback - INFO - Starting async job submit for node 68d6951c2f83206171a91fb5 2025-09-26 13:30:05,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:05,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6951c2f83206171a91fb5 HTTP/1.1" 200 None 2025-09-26 13:30:05,082 - lava_callback - DEBUG - Processing node 68d6951c2f83206171a91fb5: baseline-arm64-foundriesio 2025-09-26 13:30:05,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:05,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:05,494 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6951c2f83206171a91fb5/log.txt.gz 2025-09-26 13:30:05,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:05,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:05,625 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6951c2f83206171a91fb5/lava_callback.json.gz 2025-09-26 13:30:05,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:05,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6951c2f83206171a91fb5 HTTP/1.1" 200 None 2025-09-26 13:30:05,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:05,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:30:05,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:05,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6951c2f83206171a91fb5 HTTP/1.1" 200 None 2025-09-26 13:30:05,715 - lava_callback - INFO - Completed processing callback for node 68d6951c2f83206171a91fb5 2025-09-26 13:30:05,762 - lava_callback - INFO - Received callback for node 68d695272f83206171a91fd5 INFO: 172.20.0.1:46160 - "POST /node/68d695272f83206171a91fd5 HTTP/1.0" 202 Accepted 2025-09-26 13:30:05,770 - lava_callback - INFO - Starting async job submit for node 68d695272f83206171a91fd5 2025-09-26 13:30:05,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:05,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695272f83206171a91fd5 HTTP/1.1" 200 None 2025-09-26 13:30:05,823 - lava_callback - DEBUG - Processing node 68d695272f83206171a91fd5: baseline-arm 2025-09-26 13:30:06,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:06,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:06,352 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d695272f83206171a91fd5/log.txt.gz 2025-09-26 13:30:06,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:06,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:06,479 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d695272f83206171a91fd5/lava_callback.json.gz 2025-09-26 13:30:06,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:46164 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:30:06,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695272f83206171a91fd5 HTTP/1.1" 200 None 2025-09-26 13:30:06,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:06,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 13:30:06,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:06,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695272f83206171a91fd5 HTTP/1.1" 200 None 2025-09-26 13:30:06,586 - lava_callback - INFO - Completed processing callback for node 68d695272f83206171a91fd5 2025-09-26 13:30:10,647 - lava_callback - INFO - Received callback for node 68d695282f83206171a91fd8 INFO: 172.20.0.1:39256 - "POST /node/68d695282f83206171a91fd8 HTTP/1.0" 202 Accepted 2025-09-26 13:30:10,654 - lava_callback - INFO - Starting async job submit for node 68d695282f83206171a91fd8 2025-09-26 13:30:10,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:10,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695282f83206171a91fd8 HTTP/1.1" 200 None 2025-09-26 13:30:10,704 - lava_callback - DEBUG - Processing node 68d695282f83206171a91fd8: baseline-arm 2025-09-26 13:30:11,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:11,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:11,230 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d695282f83206171a91fd8/log.txt.gz 2025-09-26 13:30:11,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:11,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:11,353 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d695282f83206171a91fd8/lava_callback.json.gz 2025-09-26 13:30:11,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:11,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695282f83206171a91fd8 HTTP/1.1" 200 None 2025-09-26 13:30:11,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:11,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 13:30:11,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:11,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695282f83206171a91fd8 HTTP/1.1" 200 None 2025-09-26 13:30:11,426 - lava_callback - INFO - Completed processing callback for node 68d695282f83206171a91fd8 2025-09-26 13:30:14,135 - lava_callback - INFO - Received callback for node 68d694e02f83206171a91f69 INFO: 172.20.0.1:39268 - "POST /node/68d694e02f83206171a91f69 HTTP/1.0" 202 Accepted 2025-09-26 13:30:14,143 - lava_callback - INFO - Starting async job submit for node 68d694e02f83206171a91f69 2025-09-26 13:30:14,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:14,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694e02f83206171a91f69 HTTP/1.1" 200 None 2025-09-26 13:30:14,179 - lava_callback - DEBUG - Processing node 68d694e02f83206171a91f69: baseline-arm64-broonie 2025-09-26 13:30:14,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:14,670 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:14,671 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d694e02f83206171a91f69/log.txt.gz 2025-09-26 13:30:14,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:14,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:14,853 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d694e02f83206171a91f69/lava_callback.json.gz 2025-09-26 13:30:14,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:14,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694e02f83206171a91f69 HTTP/1.1" 200 None 2025-09-26 13:30:14,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:14,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:30:14,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:14,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694e02f83206171a91f69 HTTP/1.1" 200 None 2025-09-26 13:30:14,945 - lava_callback - INFO - Completed processing callback for node 68d694e02f83206171a91f69 INFO: 172.20.0.1:39270 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 13:30:15,623 - lava_callback - INFO - Received callback for node 68d694ef2f83206171a91f7c INFO: 172.20.0.1:39276 - "POST /node/68d694ef2f83206171a91f7c HTTP/1.0" 202 Accepted 2025-09-26 13:30:15,631 - lava_callback - INFO - Starting async job submit for node 68d694ef2f83206171a91f7c 2025-09-26 13:30:15,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:15,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694ef2f83206171a91f7c HTTP/1.1" 200 None 2025-09-26 13:30:15,670 - lava_callback - DEBUG - Processing node 68d694ef2f83206171a91f7c: baseline-arm64-broonie 2025-09-26 13:30:15,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:16,126 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:16,127 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d694ef2f83206171a91f7c/log.txt.gz 2025-09-26 13:30:16,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:16,255 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:16,256 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d694ef2f83206171a91f7c/lava_callback.json.gz 2025-09-26 13:30:16,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:16,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694ef2f83206171a91f7c HTTP/1.1" 200 None 2025-09-26 13:30:16,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:16,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:30:16,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:16,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694ef2f83206171a91f7c HTTP/1.1" 200 None 2025-09-26 13:30:16,341 - lava_callback - INFO - Completed processing callback for node 68d694ef2f83206171a91f7c INFO: 172.20.0.1:39282 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:30:17,020 - lava_callback - INFO - Received callback for node 68d694f72f83206171a91f89 INFO: 172.20.0.1:39298 - "POST /node/68d694f72f83206171a91f89 HTTP/1.0" 202 Accepted 2025-09-26 13:30:17,030 - lava_callback - INFO - Starting async job submit for node 68d694f72f83206171a91f89 2025-09-26 13:30:17,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:17,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694f72f83206171a91f89 HTTP/1.1" 200 None 2025-09-26 13:30:17,084 - lava_callback - DEBUG - Processing node 68d694f72f83206171a91f89: baseline-arm64-broonie 2025-09-26 13:30:17,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:17,486 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:17,486 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d694f72f83206171a91f89/log.txt.gz 2025-09-26 13:30:17,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:17,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:17,619 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d694f72f83206171a91f89/lava_callback.json.gz 2025-09-26 13:30:17,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:17,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694f72f83206171a91f89 HTTP/1.1" 200 None 2025-09-26 13:30:17,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:17,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:30:17,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:17,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694f72f83206171a91f89 HTTP/1.1" 200 None 2025-09-26 13:30:17,712 - lava_callback - INFO - Completed processing callback for node 68d694f72f83206171a91f89 2025-09-26 13:30:21,333 - lava_callback - INFO - Received callback for node 68d694c92f83206171a91f45 INFO: 172.20.0.1:55762 - "POST /node/68d694c92f83206171a91f45 HTTP/1.0" 202 Accepted 2025-09-26 13:30:21,339 - lava_callback - INFO - Starting async job submit for node 68d694c92f83206171a91f45 2025-09-26 13:30:21,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:21,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694c92f83206171a91f45 HTTP/1.1" 200 None 2025-09-26 13:30:21,379 - lava_callback - DEBUG - Processing node 68d694c92f83206171a91f45: baseline-arm64-baylibre 2025-09-26 13:30:21,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:21,870 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:21,871 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d694c92f83206171a91f45/log.txt.gz 2025-09-26 13:30:21,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:22,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:22,011 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d694c92f83206171a91f45/lava_callback.json.gz 2025-09-26 13:30:22,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:22,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694c92f83206171a91f45 HTTP/1.1" 200 None 2025-09-26 13:30:22,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:22,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:30:22,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:22,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694c92f83206171a91f45 HTTP/1.1" 200 None 2025-09-26 13:30:22,143 - lava_callback - INFO - Completed processing callback for node 68d694c92f83206171a91f45 INFO: 172.20.0.1:55770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55776 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:30:29,353 - lava_callback - INFO - Received callback for node 68d695132f83206171a91fac INFO: 172.20.0.1:37050 - "POST /node/68d695132f83206171a91fac HTTP/1.0" 202 Accepted 2025-09-26 13:30:29,359 - lava_callback - INFO - Starting async job submit for node 68d695132f83206171a91fac 2025-09-26 13:30:29,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:29,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695132f83206171a91fac HTTP/1.1" 200 None 2025-09-26 13:30:29,393 - lava_callback - DEBUG - Processing node 68d695132f83206171a91fac: baseline-arm64-clabbe 2025-09-26 13:30:29,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:29,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:29,784 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d695132f83206171a91fac/log.txt.gz 2025-09-26 13:30:29,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:29,926 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:29,926 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d695132f83206171a91fac/lava_callback.json.gz 2025-09-26 13:30:29,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:29,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695132f83206171a91fac HTTP/1.1" 200 None 2025-09-26 13:30:29,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:29,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:30:29,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:30,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695132f83206171a91fac HTTP/1.1" 200 None 2025-09-26 13:30:30,029 - lava_callback - INFO - Completed processing callback for node 68d695132f83206171a91fac 2025-09-26 13:30:30,335 - lava_callback - INFO - Received callback for node 68d4008acd36afa834e15abc INFO: 172.20.0.1:37058 - "POST /node/68d4008acd36afa834e15abc HTTP/1.0" 202 Accepted 2025-09-26 13:30:30,343 - lava_callback - INFO - Starting async job submit for node 68d4008acd36afa834e15abc 2025-09-26 13:30:30,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:30,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4008acd36afa834e15abc HTTP/1.1" 200 None 2025-09-26 13:30:30,389 - lava_callback - DEBUG - Processing node 68d4008acd36afa834e15abc: ltp-cap-bounds 2025-09-26 13:30:30,770 - lava_callback - ERROR - Error processing callback for node 68d4008acd36afa834e15abc: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:30:34,848 - lava_callback - INFO - Received callback for node 68d693582f83206171a91cc8 INFO: 172.20.0.1:37068 - "POST /node/68d693582f83206171a91cc8 HTTP/1.0" 202 Accepted 2025-09-26 13:30:34,855 - lava_callback - INFO - Starting async job submit for node 68d693582f83206171a91cc8 2025-09-26 13:30:34,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:34,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693582f83206171a91cc8 HTTP/1.1" 200 None 2025-09-26 13:30:34,900 - lava_callback - DEBUG - Processing node 68d693582f83206171a91cc8: baseline-arm64 2025-09-26 13:30:35,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:35,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:35,360 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693582f83206171a91cc8/log.txt.gz 2025-09-26 13:30:35,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:35,388 - lava_callback - INFO - Received callback for node 68d693f52f83206171a91df2 INFO: 172.20.0.1:37084 - "POST /node/68d693f52f83206171a91df2 HTTP/1.0" 202 Accepted 2025-09-26 13:30:35,398 - lava_callback - INFO - Starting async job submit for node 68d693f52f83206171a91df2 2025-09-26 13:30:35,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:35,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693f52f83206171a91df2 HTTP/1.1" 200 None 2025-09-26 13:30:35,472 - lava_callback - DEBUG - Processing node 68d693f52f83206171a91df2: baseline-arm64-broonie 2025-09-26 13:30:35,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:35,567 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693582f83206171a91cc8/lava_callback.json.gz 2025-09-26 13:30:35,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:35,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693582f83206171a91cc8 HTTP/1.1" 200 None 2025-09-26 13:30:35,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:35,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:35,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:30:35,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:35,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693582f83206171a91cc8 HTTP/1.1" 200 None 2025-09-26 13:30:35,793 - lava_callback - INFO - Completed processing callback for node 68d693582f83206171a91cc8 2025-09-26 13:30:35,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:35,909 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d693f52f83206171a91df2/log.txt.gz 2025-09-26 13:30:35,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:36,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:36,073 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d693f52f83206171a91df2/lava_callback.json.gz 2025-09-26 13:30:36,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:36,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693f52f83206171a91df2 HTTP/1.1" 200 None 2025-09-26 13:30:36,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:36,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:30:36,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:36,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693f52f83206171a91df2 HTTP/1.1" 200 None 2025-09-26 13:30:36,190 - lava_callback - INFO - Completed processing callback for node 68d693f52f83206171a91df2 INFO: 172.20.0.1:37094 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:30:38,397 - lava_callback - INFO - Received callback for node 68d694db2f83206171a91f5f INFO: 172.20.0.1:37106 - "POST /node/68d694db2f83206171a91f5f HTTP/1.0" 202 Accepted 2025-09-26 13:30:38,404 - lava_callback - INFO - Starting async job submit for node 68d694db2f83206171a91f5f 2025-09-26 13:30:38,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:38,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694db2f83206171a91f5f HTTP/1.1" 200 None 2025-09-26 13:30:38,439 - lava_callback - DEBUG - Processing node 68d694db2f83206171a91f5f: baseline-arm64-broonie 2025-09-26 13:30:38,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:38,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:38,905 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d694db2f83206171a91f5f/log.txt.gz 2025-09-26 13:30:38,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:39,036 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:39,037 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d694db2f83206171a91f5f/lava_callback.json.gz 2025-09-26 13:30:39,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:39,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694db2f83206171a91f5f HTTP/1.1" 200 None 2025-09-26 13:30:39,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:39,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:30:39,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:39,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694db2f83206171a91f5f HTTP/1.1" 200 None 2025-09-26 13:30:39,140 - lava_callback - INFO - Completed processing callback for node 68d694db2f83206171a91f5f 2025-09-26 13:30:41,170 - lava_callback - INFO - Received callback for node 68d695212f83206171a91fc2 INFO: 172.20.0.1:51748 - "POST /node/68d695212f83206171a91fc2 HTTP/1.0" 202 Accepted 2025-09-26 13:30:41,176 - lava_callback - INFO - Starting async job submit for node 68d695212f83206171a91fc2 2025-09-26 13:30:41,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:41,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695212f83206171a91fc2 HTTP/1.1" 200 None 2025-09-26 13:30:41,217 - lava_callback - DEBUG - Processing node 68d695212f83206171a91fc2: baseline-arm 2025-09-26 13:30:41,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:41,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:41,564 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d695212f83206171a91fc2/log.txt.gz 2025-09-26 13:30:41,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:41,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:41,692 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d695212f83206171a91fc2/lava_callback.json.gz 2025-09-26 13:30:41,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:41,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695212f83206171a91fc2 HTTP/1.1" 200 None 2025-09-26 13:30:41,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:41,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 13:30:41,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:41,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695212f83206171a91fc2 HTTP/1.1" 200 None 2025-09-26 13:30:41,766 - lava_callback - INFO - Completed processing callback for node 68d695212f83206171a91fc2 2025-09-26 13:30:42,215 - lava_callback - INFO - Received callback for node 68d6952a2f83206171a91fe2 INFO: 172.20.0.1:51756 - "POST /node/68d6952a2f83206171a91fe2 HTTP/1.0" 202 Accepted 2025-09-26 13:30:42,221 - lava_callback - INFO - Starting async job submit for node 68d6952a2f83206171a91fe2 2025-09-26 13:30:42,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:42,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6952a2f83206171a91fe2 HTTP/1.1" 200 None 2025-09-26 13:30:42,255 - lava_callback - DEBUG - Processing node 68d6952a2f83206171a91fe2: baseline-arm 2025-09-26 13:30:42,367 - lava_callback - INFO - Received callback for node 68d695212f83206171a91fbf INFO: 172.20.0.1:51764 - "POST /node/68d695212f83206171a91fbf HTTP/1.0" 202 Accepted 2025-09-26 13:30:42,388 - lava_callback - INFO - Starting async job submit for node 68d695212f83206171a91fbf 2025-09-26 13:30:42,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:42,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695212f83206171a91fbf HTTP/1.1" 200 None 2025-09-26 13:30:42,530 - lava_callback - DEBUG - Processing node 68d695212f83206171a91fbf: baseline-arm 2025-09-26 13:30:42,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:42,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:42,820 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d6952a2f83206171a91fe2/log.txt.gz 2025-09-26 13:30:42,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:42,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:43,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:43,024 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d695212f83206171a91fbf/log.txt.gz 2025-09-26 13:30:43,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:43,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:43,044 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d6952a2f83206171a91fe2/lava_callback.json.gz 2025-09-26 13:30:43,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:43,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6952a2f83206171a91fe2 HTTP/1.1" 200 None 2025-09-26 13:30:43,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:43,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 13:30:43,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:43,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6952a2f83206171a91fe2 HTTP/1.1" 200 None 2025-09-26 13:30:43,122 - lava_callback - INFO - Completed processing callback for node 68d6952a2f83206171a91fe2 2025-09-26 13:30:43,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:43,174 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d695212f83206171a91fbf/lava_callback.json.gz 2025-09-26 13:30:43,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:43,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695212f83206171a91fbf HTTP/1.1" 200 None 2025-09-26 13:30:43,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:43,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 13:30:43,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:43,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695212f83206171a91fbf HTTP/1.1" 200 None 2025-09-26 13:30:43,272 - lava_callback - INFO - Completed processing callback for node 68d695212f83206171a91fbf INFO: 172.20.0.1:51772 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:30:47,757 - lava_callback - INFO - Received callback for node 68d68d402f83206171a91977 INFO: 172.20.0.1:51778 - "POST /node/68d68d402f83206171a91977 HTTP/1.0" 202 Accepted 2025-09-26 13:30:47,765 - lava_callback - INFO - Starting async job submit for node 68d68d402f83206171a91977 2025-09-26 13:30:47,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:47,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68d402f83206171a91977 HTTP/1.1" 200 None 2025-09-26 13:30:47,840 - lava_callback - DEBUG - Processing node 68d68d402f83206171a91977: baseline-arm64 2025-09-26 13:30:48,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:49,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:49,075 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68d402f83206171a91977/log.txt.gz 2025-09-26 13:30:49,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:49,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:49,275 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68d402f83206171a91977/lava_callback.json.gz DEBUG: Setup failed for 68d68d402f83206171a91977. Transitting job node result: incomplete -> fail 2025-09-26 13:30:49,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:49,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68d402f83206171a91977 HTTP/1.1" 200 None 2025-09-26 13:30:49,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:49,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:30:49,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:49,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68d402f83206171a91977 HTTP/1.1" 200 None 2025-09-26 13:30:49,420 - lava_callback - INFO - Completed processing callback for node 68d68d402f83206171a91977 2025-09-26 13:30:49,447 - lava_callback - INFO - Received callback for node 68d68e962f83206171a91989 INFO: 172.20.0.1:45484 - "POST /node/68d68e962f83206171a91989 HTTP/1.0" 202 Accepted 2025-09-26 13:30:49,456 - lava_callback - INFO - Starting async job submit for node 68d68e962f83206171a91989 2025-09-26 13:30:49,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:49,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68e962f83206171a91989 HTTP/1.1" 200 None 2025-09-26 13:30:49,520 - lava_callback - DEBUG - Processing node 68d68e962f83206171a91989: baseline-arm64 2025-09-26 13:30:50,829 - lava_callback - INFO - Received callback for node 68d693a52f83206171a91d53 INFO: 172.20.0.1:45494 - "POST /node/68d693a52f83206171a91d53 HTTP/1.0" 202 Accepted 2025-09-26 13:30:50,836 - lava_callback - INFO - Starting async job submit for node 68d693a52f83206171a91d53 2025-09-26 13:30:50,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:50,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:50,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693a52f83206171a91d53 HTTP/1.1" 200 None 2025-09-26 13:30:50,875 - lava_callback - DEBUG - Processing node 68d693a52f83206171a91d53: baseline-arm64 2025-09-26 13:30:50,997 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:50,998 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68e962f83206171a91989/log.txt.gz 2025-09-26 13:30:51,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:51,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:51,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:51,335 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693a52f83206171a91d53/log.txt.gz 2025-09-26 13:30:51,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:51,362 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:51,363 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68e962f83206171a91989/lava_callback.json.gz DEBUG: Setup failed for 68d68e962f83206171a91989. Transitting job node result: incomplete -> fail 2025-09-26 13:30:51,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:51,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68e962f83206171a91989 HTTP/1.1" 200 None 2025-09-26 13:30:51,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:51,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:30:51,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:51,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68e962f83206171a91989 HTTP/1.1" 200 None 2025-09-26 13:30:51,546 - lava_callback - INFO - Completed processing callback for node 68d68e962f83206171a91989 2025-09-26 13:30:51,590 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:51,591 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693a52f83206171a91d53/lava_callback.json.gz 2025-09-26 13:30:51,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:51,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693a52f83206171a91d53 HTTP/1.1" 200 None 2025-09-26 13:30:51,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:51,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:30:51,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:51,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693a52f83206171a91d53 HTTP/1.1" 200 None 2025-09-26 13:30:51,701 - lava_callback - INFO - Completed processing callback for node 68d693a52f83206171a91d53 2025-09-26 13:30:53,466 - lava_callback - INFO - Received callback for node 68d695632f83206171a9205e INFO: 172.20.0.1:45498 - "POST /node/68d695632f83206171a9205e HTTP/1.0" 202 Accepted 2025-09-26 13:30:53,515 - lava_callback - INFO - Starting async job submit for node 68d695632f83206171a9205e 2025-09-26 13:30:53,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:53,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695632f83206171a9205e HTTP/1.1" 200 None 2025-09-26 13:30:53,561 - lava_callback - DEBUG - Processing node 68d695632f83206171a9205e: baseline-arm-pengutronix 2025-09-26 13:30:53,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:53,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:53,892 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d695632f83206171a9205e/log.txt.gz 2025-09-26 13:30:53,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:53,997 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:53,997 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d695632f83206171a9205e/lava_callback.json.gz 2025-09-26 13:30:54,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:54,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695632f83206171a9205e HTTP/1.1" 200 None 2025-09-26 13:30:54,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:54,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 13:30:54,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:54,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695632f83206171a9205e HTTP/1.1" 200 None 2025-09-26 13:30:54,080 - lava_callback - INFO - Completed processing callback for node 68d695632f83206171a9205e 2025-09-26 13:30:56,002 - lava_callback - INFO - Received callback for node 68d694c32f83206171a91f3f INFO: 172.20.0.1:45500 - "POST /node/68d694c32f83206171a91f3f HTTP/1.0" 202 Accepted 2025-09-26 13:30:56,010 - lava_callback - INFO - Starting async job submit for node 68d694c32f83206171a91f3f 2025-09-26 13:30:56,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:56,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694c32f83206171a91f3f HTTP/1.1" 200 None 2025-09-26 13:30:56,054 - lava_callback - DEBUG - Processing node 68d694c32f83206171a91f3f: baseline-arm64-baylibre 2025-09-26 13:30:56,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:56,466 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:56,467 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d694c32f83206171a91f3f/log.txt.gz 2025-09-26 13:30:56,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:45508 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:30:56,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:56,584 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d694c32f83206171a91f3f/lava_callback.json.gz 2025-09-26 13:30:56,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:56,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694c32f83206171a91f3f HTTP/1.1" 200 None 2025-09-26 13:30:56,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:56,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:30:56,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:56,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694c32f83206171a91f3f HTTP/1.1" 200 None 2025-09-26 13:30:56,661 - lava_callback - INFO - Completed processing callback for node 68d694c32f83206171a91f3f 2025-09-26 13:30:58,971 - lava_callback - INFO - Received callback for node 68d6955f2f83206171a92058 INFO: 172.20.0.1:45520 - "POST /node/68d6955f2f83206171a92058 HTTP/1.0" 202 Accepted 2025-09-26 13:30:58,976 - lava_callback - INFO - Starting async job submit for node 68d6955f2f83206171a92058 2025-09-26 13:30:58,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:59,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6955f2f83206171a92058 HTTP/1.1" 200 None 2025-09-26 13:30:59,005 - lava_callback - DEBUG - Processing node 68d6955f2f83206171a92058: baseline-arm-pengutronix 2025-09-26 13:30:59,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:59,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:59,253 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d6955f2f83206171a92058/log.txt.gz 2025-09-26 13:30:59,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:30:59,406 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:30:59,406 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d6955f2f83206171a92058/lava_callback.json.gz 2025-09-26 13:30:59,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:59,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6955f2f83206171a92058 HTTP/1.1" 200 None 2025-09-26 13:30:59,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:59,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 13:30:59,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:30:59,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6955f2f83206171a92058 HTTP/1.1" 200 None 2025-09-26 13:30:59,512 - lava_callback - INFO - Completed processing callback for node 68d6955f2f83206171a92058 2025-09-26 13:31:00,151 - lava_callback - INFO - Received callback for node 68d695612f83206171a9205b INFO: 172.20.0.1:33208 - "POST /node/68d695612f83206171a9205b HTTP/1.0" 202 Accepted 2025-09-26 13:31:00,157 - lava_callback - INFO - Starting async job submit for node 68d695612f83206171a9205b 2025-09-26 13:31:00,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:00,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695612f83206171a9205b HTTP/1.1" 200 None 2025-09-26 13:31:00,187 - lava_callback - DEBUG - Processing node 68d695612f83206171a9205b: baseline-arm-pengutronix INFO: 172.20.0.1:33218 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:31:00,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:31:00,446 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:31:00,446 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d695612f83206171a9205b/log.txt.gz 2025-09-26 13:31:00,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:31:00,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:31:00,565 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d695612f83206171a9205b/lava_callback.json.gz 2025-09-26 13:31:00,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:00,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695612f83206171a9205b HTTP/1.1" 200 None 2025-09-26 13:31:00,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:00,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 13:31:00,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:00,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695612f83206171a9205b HTTP/1.1" 200 None 2025-09-26 13:31:00,637 - lava_callback - INFO - Completed processing callback for node 68d695612f83206171a9205b INFO: 172.20.0.1:33234 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:31:09,803 - lava_callback - INFO - Received callback for node 68d695302f83206171a91ff7 INFO: 172.20.0.1:42198 - "POST /node/68d695302f83206171a91ff7 HTTP/1.0" 202 Accepted 2025-09-26 13:31:09,809 - lava_callback - INFO - Starting async job submit for node 68d695302f83206171a91ff7 2025-09-26 13:31:09,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:09,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695302f83206171a91ff7 HTTP/1.1" 200 None 2025-09-26 13:31:09,841 - lava_callback - DEBUG - Processing node 68d695302f83206171a91ff7: baseline-arm 2025-09-26 13:31:10,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:31:10,292 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:31:10,293 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d695302f83206171a91ff7/log.txt.gz 2025-09-26 13:31:10,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:31:10,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:31:10,435 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d695302f83206171a91ff7/lava_callback.json.gz 2025-09-26 13:31:10,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:10,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695302f83206171a91ff7 HTTP/1.1" 200 None 2025-09-26 13:31:10,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:10,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 13:31:10,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:10,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695302f83206171a91ff7 HTTP/1.1" 200 None 2025-09-26 13:31:10,509 - lava_callback - INFO - Completed processing callback for node 68d695302f83206171a91ff7 2025-09-26 13:31:12,330 - lava_callback - INFO - Received callback for node 68d695302f83206171a91ff4 INFO: 172.20.0.1:42210 - "POST /node/68d695302f83206171a91ff4 HTTP/1.0" 202 Accepted 2025-09-26 13:31:12,336 - lava_callback - INFO - Starting async job submit for node 68d695302f83206171a91ff4 2025-09-26 13:31:12,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:12,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695302f83206171a91ff4 HTTP/1.1" 200 None 2025-09-26 13:31:12,367 - lava_callback - DEBUG - Processing node 68d695302f83206171a91ff4: baseline-arm 2025-09-26 13:31:12,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:31:12,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:31:12,787 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d695302f83206171a91ff4/log.txt.gz 2025-09-26 13:31:12,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:31:12,918 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:31:12,919 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d695302f83206171a91ff4/lava_callback.json.gz 2025-09-26 13:31:12,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:12,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695302f83206171a91ff4 HTTP/1.1" 200 None 2025-09-26 13:31:12,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:12,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 13:31:12,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:12,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695302f83206171a91ff4 HTTP/1.1" 200 None 2025-09-26 13:31:13,000 - lava_callback - INFO - Completed processing callback for node 68d695302f83206171a91ff4 INFO: 172.20.0.1:42226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42242 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:31:20,798 - lava_callback - INFO - Received callback for node 68d42812a5c2c05277bc7514 INFO: 172.20.0.1:39606 - "POST /node/68d42812a5c2c05277bc7514 HTTP/1.0" 202 Accepted 2025-09-26 13:31:20,804 - lava_callback - INFO - Starting async job submit for node 68d42812a5c2c05277bc7514 2025-09-26 13:31:20,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:20,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42812a5c2c05277bc7514 HTTP/1.1" 200 None 2025-09-26 13:31:20,843 - lava_callback - DEBUG - Processing node 68d42812a5c2c05277bc7514: baseline-arm 2025-09-26 13:31:21,063 - lava_callback - ERROR - Error processing callback for node 68d42812a5c2c05277bc7514: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:39618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39626 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:31:29,262 - lava_callback - INFO - Received callback for node 68d46d2ca5c2c05277bcc319 INFO: 172.20.0.1:39640 - "POST /node/68d46d2ca5c2c05277bcc319 HTTP/1.0" 202 Accepted 2025-09-26 13:31:29,268 - lava_callback - INFO - Starting async job submit for node 68d46d2ca5c2c05277bcc319 2025-09-26 13:31:29,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:29,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d46d2ca5c2c05277bcc319 HTTP/1.1" 200 None 2025-09-26 13:31:29,309 - lava_callback - DEBUG - Processing node 68d46d2ca5c2c05277bcc319: baseline-arm64-broonie 2025-09-26 13:31:29,626 - lava_callback - ERROR - Error processing callback for node 68d46d2ca5c2c05277bcc319: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:31:29,684 - lava_callback - INFO - Received callback for node 68d695522f83206171a9202b INFO: 172.20.0.1:40408 - "POST /node/68d695522f83206171a9202b HTTP/1.0" 202 Accepted 2025-09-26 13:31:29,691 - lava_callback - INFO - Starting async job submit for node 68d695522f83206171a9202b 2025-09-26 13:31:29,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:29,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695522f83206171a9202b HTTP/1.1" 200 None 2025-09-26 13:31:29,724 - lava_callback - DEBUG - Processing node 68d695522f83206171a9202b: baseline-arm-clabbe 2025-09-26 13:31:29,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:31:30,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:31:30,042 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d695522f83206171a9202b/log.txt.gz 2025-09-26 13:31:30,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:31:30,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:31:30,182 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d695522f83206171a9202b/lava_callback.json.gz 2025-09-26 13:31:30,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:30,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695522f83206171a9202b HTTP/1.1" 200 None 2025-09-26 13:31:30,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:30,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 13:31:30,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:30,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695522f83206171a9202b HTTP/1.1" 200 None 2025-09-26 13:31:30,263 - lava_callback - INFO - Completed processing callback for node 68d695522f83206171a9202b INFO: 172.20.0.1:40416 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:31:43,676 - lava_callback - INFO - Received callback for node 68d6952a2f83206171a91fe5 INFO: 172.20.0.1:44230 - "POST /node/68d6952a2f83206171a91fe5 HTTP/1.0" 202 Accepted 2025-09-26 13:31:43,682 - lava_callback - INFO - Starting async job submit for node 68d6952a2f83206171a91fe5 2025-09-26 13:31:43,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:43,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6952a2f83206171a91fe5 HTTP/1.1" 200 None 2025-09-26 13:31:43,714 - lava_callback - DEBUG - Processing node 68d6952a2f83206171a91fe5: baseline-arm 2025-09-26 13:31:43,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:31:44,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:31:44,029 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d6952a2f83206171a91fe5/log.txt.gz 2025-09-26 13:31:44,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:31:44,142 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:31:44,143 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d6952a2f83206171a91fe5/lava_callback.json.gz 2025-09-26 13:31:44,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:44,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6952a2f83206171a91fe5 HTTP/1.1" 200 None 2025-09-26 13:31:44,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:44,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 13:31:44,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:44,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6952a2f83206171a91fe5 HTTP/1.1" 200 None 2025-09-26 13:31:44,231 - lava_callback - INFO - Completed processing callback for node 68d6952a2f83206171a91fe5 2025-09-26 13:31:45,609 - lava_callback - INFO - Received callback for node 68d3f9a5cd36afa834e14f02 INFO: 172.20.0.1:44240 - "POST /node/68d3f9a5cd36afa834e14f02 HTTP/1.0" 202 Accepted 2025-09-26 13:31:45,616 - lava_callback - INFO - Starting async job submit for node 68d3f9a5cd36afa834e14f02 2025-09-26 13:31:45,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:45,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f9a5cd36afa834e14f02 HTTP/1.1" 200 None 2025-09-26 13:31:45,669 - lava_callback - DEBUG - Processing node 68d3f9a5cd36afa834e14f02: baseline-arm64 2025-09-26 13:31:46,444 - lava_callback - ERROR - Error processing callback for node 68d3f9a5cd36afa834e14f02: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:44242 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:31:47,177 - lava_callback - INFO - Received callback for node 68d68eaa2f83206171a91998 INFO: 172.20.0.1:44258 - "POST /node/68d68eaa2f83206171a91998 HTTP/1.0" 202 Accepted 2025-09-26 13:31:47,184 - lava_callback - INFO - Starting async job submit for node 68d68eaa2f83206171a91998 2025-09-26 13:31:47,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:47,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68eaa2f83206171a91998 HTTP/1.1" 200 None 2025-09-26 13:31:47,239 - lava_callback - DEBUG - Processing node 68d68eaa2f83206171a91998: baseline-arm64 2025-09-26 13:31:48,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:31:48,504 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:31:48,505 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68eaa2f83206171a91998/log.txt.gz 2025-09-26 13:31:48,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:31:48,683 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:31:48,684 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68eaa2f83206171a91998/lava_callback.json.gz DEBUG: Setup failed for 68d68eaa2f83206171a91998. Transitting job node result: incomplete -> fail 2025-09-26 13:31:48,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:48,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68eaa2f83206171a91998 HTTP/1.1" 200 None 2025-09-26 13:31:48,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:48,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:31:48,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:48,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68eaa2f83206171a91998 HTTP/1.1" 200 None 2025-09-26 13:31:48,844 - lava_callback - INFO - Completed processing callback for node 68d68eaa2f83206171a91998 2025-09-26 13:31:48,970 - lava_callback - INFO - Received callback for node 68d694e62f83206171a91f6f INFO: 172.20.0.1:44268 - "POST /node/68d694e62f83206171a91f6f HTTP/1.0" 202 Accepted 2025-09-26 13:31:48,976 - lava_callback - INFO - Starting async job submit for node 68d694e62f83206171a91f6f 2025-09-26 13:31:49,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:49,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694e62f83206171a91f6f HTTP/1.1" 200 None 2025-09-26 13:31:49,048 - lava_callback - DEBUG - Processing node 68d694e62f83206171a91f6f: baseline-arm64-broonie 2025-09-26 13:31:49,154 - lava_callback - INFO - Received callback for node 68d695342f83206171a91ffd INFO: 172.20.0.1:44284 - "POST /node/68d695342f83206171a91ffd HTTP/1.0" 202 Accepted 2025-09-26 13:31:49,177 - lava_callback - INFO - Starting async job submit for node 68d695342f83206171a91ffd 2025-09-26 13:31:49,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:49,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695342f83206171a91ffd HTTP/1.1" 200 None 2025-09-26 13:31:49,276 - lava_callback - DEBUG - Processing node 68d695342f83206171a91ffd: baseline-arm-baylibre 2025-09-26 13:31:49,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:31:49,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:31:49,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:31:49,786 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d694e62f83206171a91f6f/log.txt.gz 2025-09-26 13:31:49,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:31:49,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:31:49,847 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d695342f83206171a91ffd/log.txt.gz 2025-09-26 13:31:49,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:31:49,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:31:49,920 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d694e62f83206171a91f6f/lava_callback.json.gz 2025-09-26 13:31:49,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:49,966 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:31:49,967 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d695342f83206171a91ffd/lava_callback.json.gz 2025-09-26 13:31:49,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:49,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695342f83206171a91ffd HTTP/1.1" 200 None 2025-09-26 13:31:50,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:50,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694e62f83206171a91f6f HTTP/1.1" 200 None 2025-09-26 13:31:50,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:50,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 13:31:50,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:50,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:31:50,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:50,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695342f83206171a91ffd HTTP/1.1" 200 None 2025-09-26 13:31:50,069 - lava_callback - INFO - Completed processing callback for node 68d695342f83206171a91ffd 2025-09-26 13:31:50,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694e62f83206171a91f6f HTTP/1.1" 200 None 2025-09-26 13:31:50,113 - lava_callback - INFO - Completed processing callback for node 68d694e62f83206171a91f6f 2025-09-26 13:31:51,655 - lava_callback - INFO - Received callback for node 68d693a52f83206171a91d56 INFO: 172.20.0.1:44776 - "POST /node/68d693a52f83206171a91d56 HTTP/1.0" 202 Accepted 2025-09-26 13:31:51,663 - lava_callback - INFO - Starting async job submit for node 68d693a52f83206171a91d56 2025-09-26 13:31:51,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:51,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693a52f83206171a91d56 HTTP/1.1" 200 None 2025-09-26 13:31:51,705 - lava_callback - DEBUG - Processing node 68d693a52f83206171a91d56: baseline-arm64 2025-09-26 13:31:52,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:31:52,162 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:31:52,163 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693a52f83206171a91d56/log.txt.gz 2025-09-26 13:31:52,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:31:52,320 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:31:52,320 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693a52f83206171a91d56/lava_callback.json.gz 2025-09-26 13:31:52,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:52,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693a52f83206171a91d56 HTTP/1.1" 200 None 2025-09-26 13:31:52,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:52,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:31:52,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:52,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693a52f83206171a91d56 HTTP/1.1" 200 None 2025-09-26 13:31:52,401 - lava_callback - INFO - Completed processing callback for node 68d693a52f83206171a91d56 2025-09-26 13:31:56,073 - lava_callback - INFO - Received callback for node 68d3f9a8cd36afa834e14f1a INFO: 172.20.0.1:44788 - "POST /node/68d3f9a8cd36afa834e14f1a HTTP/1.0" 202 Accepted 2025-09-26 13:31:56,079 - lava_callback - INFO - Starting async job submit for node 68d3f9a8cd36afa834e14f1a 2025-09-26 13:31:56,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:56,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f9a8cd36afa834e14f1a HTTP/1.1" 200 None 2025-09-26 13:31:56,113 - lava_callback - DEBUG - Processing node 68d3f9a8cd36afa834e14f1a: baseline-arm64 2025-09-26 13:31:56,398 - lava_callback - ERROR - Error processing callback for node 68d3f9a8cd36afa834e14f1a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:44804 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:31:58,006 - lava_callback - INFO - Received callback for node 68d695402f83206171a92012 INFO: 172.20.0.1:44808 - "POST /node/68d695402f83206171a92012 HTTP/1.0" 202 Accepted 2025-09-26 13:31:58,012 - lava_callback - INFO - Starting async job submit for node 68d695402f83206171a92012 2025-09-26 13:31:58,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:58,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695402f83206171a92012 HTTP/1.1" 200 None 2025-09-26 13:31:58,066 - lava_callback - DEBUG - Processing node 68d695402f83206171a92012: baseline-arm-broonie 2025-09-26 13:31:58,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:31:58,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:31:58,425 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d695402f83206171a92012/log.txt.gz 2025-09-26 13:31:58,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:31:58,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:31:58,535 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d695402f83206171a92012/lava_callback.json.gz 2025-09-26 13:31:58,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:58,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695402f83206171a92012 HTTP/1.1" 200 None 2025-09-26 13:31:58,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:58,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 13:31:58,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:31:58,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695402f83206171a92012 HTTP/1.1" 200 None 2025-09-26 13:31:58,611 - lava_callback - INFO - Completed processing callback for node 68d695402f83206171a92012 INFO: 172.20.0.1:50944 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:32:01,157 - lava_callback - INFO - Received callback for node 68d694cc2f83206171a91f48 INFO: 172.20.0.1:50954 - "POST /node/68d694cc2f83206171a91f48 HTTP/1.0" 202 Accepted 2025-09-26 13:32:01,163 - lava_callback - INFO - Starting async job submit for node 68d694cc2f83206171a91f48 2025-09-26 13:32:01,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:01,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694cc2f83206171a91f48 HTTP/1.1" 200 None 2025-09-26 13:32:01,199 - lava_callback - DEBUG - Processing node 68d694cc2f83206171a91f48: baseline-arm64-baylibre 2025-09-26 13:32:01,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:01,531 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:01,532 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d694cc2f83206171a91f48/log.txt.gz 2025-09-26 13:32:01,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:01,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:01,646 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d694cc2f83206171a91f48/lava_callback.json.gz 2025-09-26 13:32:01,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:01,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694cc2f83206171a91f48 HTTP/1.1" 200 None 2025-09-26 13:32:01,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:01,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:32:01,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:01,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694cc2f83206171a91f48 HTTP/1.1" 200 None 2025-09-26 13:32:01,745 - lava_callback - INFO - Completed processing callback for node 68d694cc2f83206171a91f48 2025-09-26 13:32:05,834 - lava_callback - INFO - Received callback for node 68d694d22f83206171a91f4e INFO: 172.20.0.1:50962 - "POST /node/68d694d22f83206171a91f4e HTTP/1.0" 202 Accepted 2025-09-26 13:32:05,839 - lava_callback - INFO - Starting async job submit for node 68d694d22f83206171a91f4e 2025-09-26 13:32:05,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:05,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694d22f83206171a91f4e HTTP/1.1" 200 None 2025-09-26 13:32:05,872 - lava_callback - DEBUG - Processing node 68d694d22f83206171a91f4e: baseline-arm64-baylibre 2025-09-26 13:32:06,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:06,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:06,228 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d694d22f83206171a91f4e/log.txt.gz 2025-09-26 13:32:06,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:06,354 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:06,355 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d694d22f83206171a91f4e/lava_callback.json.gz 2025-09-26 13:32:06,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:06,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694d22f83206171a91f4e HTTP/1.1" 200 None 2025-09-26 13:32:06,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:06,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:32:06,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:06,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694d22f83206171a91f4e HTTP/1.1" 200 None 2025-09-26 13:32:06,459 - lava_callback - INFO - Completed processing callback for node 68d694d22f83206171a91f4e INFO: 172.20.0.1:50972 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:32:10,176 - lava_callback - INFO - Received callback for node 68d695362f83206171a92000 INFO: 172.20.0.1:40566 - "POST /node/68d695362f83206171a92000 HTTP/1.0" 202 Accepted 2025-09-26 13:32:10,181 - lava_callback - INFO - Starting async job submit for node 68d695362f83206171a92000 2025-09-26 13:32:10,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:10,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695362f83206171a92000 HTTP/1.1" 200 None 2025-09-26 13:32:10,214 - lava_callback - DEBUG - Processing node 68d695362f83206171a92000: baseline-arm-baylibre 2025-09-26 13:32:10,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:10,510 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:10,511 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d695362f83206171a92000/log.txt.gz 2025-09-26 13:32:10,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:10,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:10,624 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d695362f83206171a92000/lava_callback.json.gz 2025-09-26 13:32:10,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:10,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695362f83206171a92000 HTTP/1.1" 200 None 2025-09-26 13:32:10,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:10,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 13:32:10,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:10,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695362f83206171a92000 HTTP/1.1" 200 None 2025-09-26 13:32:10,706 - lava_callback - INFO - Completed processing callback for node 68d695362f83206171a92000 2025-09-26 13:32:14,205 - lava_callback - INFO - Received callback for node 68d694fa2f83206171a91f8c INFO: 172.20.0.1:40574 - "POST /node/68d694fa2f83206171a91f8c HTTP/1.0" 202 Accepted 2025-09-26 13:32:14,211 - lava_callback - INFO - Starting async job submit for node 68d694fa2f83206171a91f8c 2025-09-26 13:32:14,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:14,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694fa2f83206171a91f8c HTTP/1.1" 200 None 2025-09-26 13:32:14,248 - lava_callback - DEBUG - Processing node 68d694fa2f83206171a91f8c: baseline-arm64-broonie 2025-09-26 13:32:14,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:14,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:14,623 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d694fa2f83206171a91f8c/log.txt.gz 2025-09-26 13:32:14,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:14,770 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:14,770 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d694fa2f83206171a91f8c/lava_callback.json.gz 2025-09-26 13:32:14,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:14,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694fa2f83206171a91f8c HTTP/1.1" 200 None 2025-09-26 13:32:14,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:14,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:32:14,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:14,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694fa2f83206171a91f8c HTTP/1.1" 200 None 2025-09-26 13:32:14,847 - lava_callback - INFO - Completed processing callback for node 68d694fa2f83206171a91f8c INFO: 172.20.0.1:40586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40596 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:32:18,055 - lava_callback - INFO - Received callback for node 68d694c62f83206171a91f42 INFO: 172.20.0.1:40600 - "POST /node/68d694c62f83206171a91f42 HTTP/1.0" 202 Accepted 2025-09-26 13:32:18,061 - lava_callback - INFO - Starting async job submit for node 68d694c62f83206171a91f42 2025-09-26 13:32:18,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:18,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694c62f83206171a91f42 HTTP/1.1" 200 None 2025-09-26 13:32:18,093 - lava_callback - DEBUG - Processing node 68d694c62f83206171a91f42: baseline-arm64-baylibre 2025-09-26 13:32:18,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:18,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:18,488 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d694c62f83206171a91f42/log.txt.gz 2025-09-26 13:32:18,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:18,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:18,624 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d694c62f83206171a91f42/lava_callback.json.gz 2025-09-26 13:32:18,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:18,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694c62f83206171a91f42 HTTP/1.1" 200 None 2025-09-26 13:32:18,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:18,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:32:18,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:18,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694c62f83206171a91f42 HTTP/1.1" 200 None 2025-09-26 13:32:18,699 - lava_callback - INFO - Completed processing callback for node 68d694c62f83206171a91f42 2025-09-26 13:32:21,471 - lava_callback - INFO - Received callback for node 68d693a82f83206171a91d5d INFO: 172.20.0.1:51252 - "POST /node/68d693a82f83206171a91d5d HTTP/1.0" 202 Accepted 2025-09-26 13:32:21,477 - lava_callback - INFO - Starting async job submit for node 68d693a82f83206171a91d5d 2025-09-26 13:32:21,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:21,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693a82f83206171a91d5d HTTP/1.1" 200 None 2025-09-26 13:32:21,513 - lava_callback - DEBUG - Processing node 68d693a82f83206171a91d5d: baseline-arm64 2025-09-26 13:32:21,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:21,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:21,905 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693a82f83206171a91d5d/log.txt.gz 2025-09-26 13:32:21,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:22,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:22,058 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693a82f83206171a91d5d/lava_callback.json.gz 2025-09-26 13:32:22,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:22,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693a82f83206171a91d5d HTTP/1.1" 200 None 2025-09-26 13:32:22,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:22,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:32:22,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:22,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693a82f83206171a91d5d HTTP/1.1" 200 None 2025-09-26 13:32:22,139 - lava_callback - INFO - Completed processing callback for node 68d693a82f83206171a91d5d INFO: 172.20.0.1:51268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51278 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:32:31,001 - lava_callback - INFO - Received callback for node 68d694f42f83206171a91f86 INFO: 172.20.0.1:46070 - "POST /node/68d694f42f83206171a91f86 HTTP/1.0" 202 Accepted 2025-09-26 13:32:31,007 - lava_callback - INFO - Starting async job submit for node 68d694f42f83206171a91f86 2025-09-26 13:32:31,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:31,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694f42f83206171a91f86 HTTP/1.1" 200 None 2025-09-26 13:32:31,057 - lava_callback - DEBUG - Processing node 68d694f42f83206171a91f86: baseline-arm64-broonie 2025-09-26 13:32:31,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:31,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:31,397 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d694f42f83206171a91f86/log.txt.gz 2025-09-26 13:32:31,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:31,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:31,538 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d694f42f83206171a91f86/lava_callback.json.gz 2025-09-26 13:32:31,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:31,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694f42f83206171a91f86 HTTP/1.1" 200 None 2025-09-26 13:32:31,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:31,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:32:31,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:31,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694f42f83206171a91f86 HTTP/1.1" 200 None 2025-09-26 13:32:31,635 - lava_callback - INFO - Completed processing callback for node 68d694f42f83206171a91f86 2025-09-26 13:32:34,373 - lava_callback - INFO - Received callback for node 68d695422f83206171a92015 INFO: 172.20.0.1:46076 - "POST /node/68d695422f83206171a92015 HTTP/1.0" 202 Accepted 2025-09-26 13:32:34,379 - lava_callback - INFO - Starting async job submit for node 68d695422f83206171a92015 2025-09-26 13:32:34,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:34,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695422f83206171a92015 HTTP/1.1" 200 None 2025-09-26 13:32:34,414 - lava_callback - DEBUG - Processing node 68d695422f83206171a92015: baseline-arm-broonie 2025-09-26 13:32:34,573 - lava_callback - INFO - Received callback for node 68d4008bcd36afa834e15ac3 INFO: 172.20.0.1:46090 - "POST /node/68d4008bcd36afa834e15ac3 HTTP/1.0" 202 Accepted 2025-09-26 13:32:34,595 - lava_callback - INFO - Starting async job submit for node 68d4008bcd36afa834e15ac3 2025-09-26 13:32:34,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:34,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:34,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4008bcd36afa834e15ac3 HTTP/1.1" 200 None 2025-09-26 13:32:34,737 - lava_callback - DEBUG - Processing node 68d4008bcd36afa834e15ac3: ltp-containers 2025-09-26 13:32:34,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:35,017 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d695422f83206171a92015/log.txt.gz 2025-09-26 13:32:35,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:35,302 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:35,344 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d695422f83206171a92015/lava_callback.json.gz 2025-09-26 13:32:35,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:35,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695422f83206171a92015 HTTP/1.1" 200 None 2025-09-26 13:32:35,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:35,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 13:32:35,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:35,595 - lava_callback - ERROR - Error processing callback for node 68d4008bcd36afa834e15ac3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:32:35,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695422f83206171a92015 HTTP/1.1" 200 None 2025-09-26 13:32:35,625 - lava_callback - INFO - Completed processing callback for node 68d695422f83206171a92015 2025-09-26 13:32:36,347 - lava_callback - INFO - Received callback for node 68d693a92f83206171a91d60 INFO: 172.20.0.1:46096 - "POST /node/68d693a92f83206171a91d60 HTTP/1.0" 202 Accepted 2025-09-26 13:32:36,353 - lava_callback - INFO - Starting async job submit for node 68d693a92f83206171a91d60 2025-09-26 13:32:36,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:36,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693a92f83206171a91d60 HTTP/1.1" 200 None 2025-09-26 13:32:36,385 - lava_callback - DEBUG - Processing node 68d693a92f83206171a91d60: baseline-arm64 INFO: 172.20.0.1:46098 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:32:36,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:36,756 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:36,757 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693a92f83206171a91d60/log.txt.gz 2025-09-26 13:32:36,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:36,882 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:36,883 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693a92f83206171a91d60/lava_callback.json.gz 2025-09-26 13:32:36,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:36,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693a92f83206171a91d60 HTTP/1.1" 200 None 2025-09-26 13:32:36,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:36,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:32:36,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:36,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693a92f83206171a91d60 HTTP/1.1" 200 None 2025-09-26 13:32:36,961 - lava_callback - INFO - Completed processing callback for node 68d693a92f83206171a91d60 INFO: 172.20.0.1:46110 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:32:44,160 - lava_callback - INFO - Received callback for node 68d694cf2f83206171a91f4b INFO: 172.20.0.1:52200 - "POST /node/68d694cf2f83206171a91f4b HTTP/1.0" 202 Accepted 2025-09-26 13:32:44,166 - lava_callback - INFO - Starting async job submit for node 68d694cf2f83206171a91f4b 2025-09-26 13:32:44,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:44,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694cf2f83206171a91f4b HTTP/1.1" 200 None 2025-09-26 13:32:44,198 - lava_callback - DEBUG - Processing node 68d694cf2f83206171a91f4b: baseline-arm64-baylibre 2025-09-26 13:32:44,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:44,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:44,566 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d694cf2f83206171a91f4b/log.txt.gz 2025-09-26 13:32:44,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:44,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:44,686 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d694cf2f83206171a91f4b/lava_callback.json.gz 2025-09-26 13:32:44,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:44,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694cf2f83206171a91f4b HTTP/1.1" 200 None 2025-09-26 13:32:44,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:44,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:32:44,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:44,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694cf2f83206171a91f4b HTTP/1.1" 200 None 2025-09-26 13:32:44,760 - lava_callback - INFO - Completed processing callback for node 68d694cf2f83206171a91f4b INFO: 172.20.0.1:52202 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:32:47,306 - lava_callback - INFO - Received callback for node 68d695382f83206171a92003 INFO: 172.20.0.1:52204 - "POST /node/68d695382f83206171a92003 HTTP/1.0" 202 Accepted 2025-09-26 13:32:47,312 - lava_callback - INFO - Starting async job submit for node 68d695382f83206171a92003 2025-09-26 13:32:47,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:47,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695382f83206171a92003 HTTP/1.1" 200 None 2025-09-26 13:32:47,347 - lava_callback - DEBUG - Processing node 68d695382f83206171a92003: baseline-arm-baylibre 2025-09-26 13:32:47,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:47,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:47,637 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d695382f83206171a92003/log.txt.gz 2025-09-26 13:32:47,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:47,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:47,775 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d695382f83206171a92003/lava_callback.json.gz 2025-09-26 13:32:47,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:47,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695382f83206171a92003 HTTP/1.1" 200 None 2025-09-26 13:32:47,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:47,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 13:32:47,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:47,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695382f83206171a92003 HTTP/1.1" 200 None 2025-09-26 13:32:47,860 - lava_callback - INFO - Completed processing callback for node 68d695382f83206171a92003 2025-09-26 13:32:48,960 - lava_callback - INFO - Received callback for node 68d6953b2f83206171a92009 INFO: 172.20.0.1:52220 - "POST /node/68d6953b2f83206171a92009 HTTP/1.0" 202 Accepted 2025-09-26 13:32:48,966 - lava_callback - INFO - Starting async job submit for node 68d6953b2f83206171a92009 2025-09-26 13:32:48,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:49,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6953b2f83206171a92009 HTTP/1.1" 200 None 2025-09-26 13:32:49,002 - lava_callback - DEBUG - Processing node 68d6953b2f83206171a92009: baseline-arm-baylibre 2025-09-26 13:32:49,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:49,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:49,340 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d6953b2f83206171a92009/log.txt.gz 2025-09-26 13:32:49,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:49,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:49,468 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d6953b2f83206171a92009/lava_callback.json.gz 2025-09-26 13:32:49,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:49,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6953b2f83206171a92009 HTTP/1.1" 200 None 2025-09-26 13:32:49,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:49,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 13:32:49,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:49,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6953b2f83206171a92009 HTTP/1.1" 200 None 2025-09-26 13:32:49,556 - lava_callback - INFO - Completed processing callback for node 68d6953b2f83206171a92009 2025-09-26 13:32:53,123 - lava_callback - INFO - Received callback for node 68d6953d2f83206171a9200c INFO: 172.20.0.1:60892 - "POST /node/68d6953d2f83206171a9200c HTTP/1.0" 202 Accepted 2025-09-26 13:32:53,129 - lava_callback - INFO - Starting async job submit for node 68d6953d2f83206171a9200c 2025-09-26 13:32:53,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:53,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6953d2f83206171a9200c HTTP/1.1" 200 None 2025-09-26 13:32:53,162 - lava_callback - DEBUG - Processing node 68d6953d2f83206171a9200c: baseline-arm-baylibre 2025-09-26 13:32:53,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:53,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:53,505 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d6953d2f83206171a9200c/log.txt.gz 2025-09-26 13:32:53,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:32:53,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:32:53,641 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d6953d2f83206171a9200c/lava_callback.json.gz 2025-09-26 13:32:53,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:53,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6953d2f83206171a9200c HTTP/1.1" 200 None 2025-09-26 13:32:53,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:53,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 13:32:53,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:32:53,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6953d2f83206171a9200c HTTP/1.1" 200 None 2025-09-26 13:32:53,710 - lava_callback - INFO - Completed processing callback for node 68d6953d2f83206171a9200c INFO: 172.20.0.1:60906 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:33:00,684 - lava_callback - INFO - Received callback for node 68d695592f83206171a92043 INFO: 172.20.0.1:58392 - "POST /node/68d695592f83206171a92043 HTTP/1.0" 202 Accepted 2025-09-26 13:33:00,690 - lava_callback - INFO - Starting async job submit for node 68d695592f83206171a92043 2025-09-26 13:33:00,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:00,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695592f83206171a92043 HTTP/1.1" 200 None 2025-09-26 13:33:00,722 - lava_callback - DEBUG - Processing node 68d695592f83206171a92043: baseline-arm-clabbe INFO: 172.20.0.1:58406 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:33:00,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:33:01,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:33:01,075 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d695592f83206171a92043/log.txt.gz 2025-09-26 13:33:01,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:33:01,207 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:33:01,208 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d695592f83206171a92043/lava_callback.json.gz 2025-09-26 13:33:01,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:01,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695592f83206171a92043 HTTP/1.1" 200 None 2025-09-26 13:33:01,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:01,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 13:33:01,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:01,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695592f83206171a92043 HTTP/1.1" 200 None 2025-09-26 13:33:01,285 - lava_callback - INFO - Completed processing callback for node 68d695592f83206171a92043 2025-09-26 13:33:06,298 - lava_callback - INFO - Received callback for node 68d6956c2f83206171a9207d INFO: 172.20.0.1:58422 - "POST /node/68d6956c2f83206171a9207d HTTP/1.0" 202 Accepted 2025-09-26 13:33:06,305 - lava_callback - INFO - Starting async job submit for node 68d6956c2f83206171a9207d 2025-09-26 13:33:06,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:06,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6956c2f83206171a9207d HTTP/1.1" 200 None 2025-09-26 13:33:06,379 - lava_callback - DEBUG - Processing node 68d6956c2f83206171a9207d: ltp-dio INFO: 172.20.0.1:58438 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:33:06,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:33:06,919 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:33:06,920 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-68d6956c2f83206171a9207d/log.txt.gz 2025-09-26 13:33:06,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:33:07,054 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:33:07,055 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-68d6956c2f83206171a9207d/lava_callback.json.gz 2025-09-26 13:33:07,072 - lava_callback - INFO - Received callback for node 68d695392f83206171a92006 INFO: 172.20.0.1:58440 - "POST /node/68d695392f83206171a92006 HTTP/1.0" 202 Accepted 2025-09-26 13:33:07,103 - lava_callback - INFO - Starting async job submit for node 68d695392f83206171a92006 2025-09-26 13:33:07,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:07,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:07,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6956c2f83206171a9207d HTTP/1.1" 200 None 2025-09-26 13:33:07,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:07,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 13:33:07,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:07,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6956c2f83206171a9207d HTTP/1.1" 200 None 2025-09-26 13:33:07,227 - lava_callback - INFO - Completed processing callback for node 68d6956c2f83206171a9207d 2025-09-26 13:33:07,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695392f83206171a92006 HTTP/1.1" 200 None 2025-09-26 13:33:07,241 - lava_callback - DEBUG - Processing node 68d695392f83206171a92006: baseline-arm-baylibre 2025-09-26 13:33:07,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:33:07,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:33:07,636 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d695392f83206171a92006/log.txt.gz 2025-09-26 13:33:07,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:33:07,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:33:07,776 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-baylibre-68d695392f83206171a92006/lava_callback.json.gz 2025-09-26 13:33:07,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:07,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695392f83206171a92006 HTTP/1.1" 200 None 2025-09-26 13:33:07,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:07,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 13:33:07,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:07,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695392f83206171a92006 HTTP/1.1" 200 None 2025-09-26 13:33:07,858 - lava_callback - INFO - Completed processing callback for node 68d695392f83206171a92006 2025-09-26 13:33:12,536 - lava_callback - INFO - Received callback for node 68d694832f83206171a91e99 INFO: 172.20.0.1:60238 - "POST /node/68d694832f83206171a91e99 HTTP/1.0" 202 Accepted 2025-09-26 13:33:12,542 - lava_callback - INFO - Starting async job submit for node 68d694832f83206171a91e99 2025-09-26 13:33:12,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:12,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694832f83206171a91e99 HTTP/1.1" 200 None 2025-09-26 13:33:12,576 - lava_callback - DEBUG - Processing node 68d694832f83206171a91e99: baseline-arm64 2025-09-26 13:33:12,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:33:12,939 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:33:12,939 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694832f83206171a91e99/log.txt.gz 2025-09-26 13:33:12,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:33:13,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:33:13,062 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694832f83206171a91e99/lava_callback.json.gz 2025-09-26 13:33:13,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:13,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694832f83206171a91e99 HTTP/1.1" 200 None 2025-09-26 13:33:13,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:13,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:33:13,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:13,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694832f83206171a91e99 HTTP/1.1" 200 None 2025-09-26 13:33:13,141 - lava_callback - INFO - Completed processing callback for node 68d694832f83206171a91e99 2025-09-26 13:33:14,138 - lava_callback - INFO - Received callback for node 68d694822f83206171a91e96 INFO: 172.20.0.1:60242 - "POST /node/68d694822f83206171a91e96 HTTP/1.0" 202 Accepted 2025-09-26 13:33:14,144 - lava_callback - INFO - Starting async job submit for node 68d694822f83206171a91e96 2025-09-26 13:33:14,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:14,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694822f83206171a91e96 HTTP/1.1" 200 None 2025-09-26 13:33:14,178 - lava_callback - DEBUG - Processing node 68d694822f83206171a91e96: baseline-arm64 2025-09-26 13:33:14,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:33:14,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:33:14,589 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694822f83206171a91e96/log.txt.gz 2025-09-26 13:33:14,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:33:14,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:33:14,713 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694822f83206171a91e96/lava_callback.json.gz 2025-09-26 13:33:14,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:14,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694822f83206171a91e96 HTTP/1.1" 200 None 2025-09-26 13:33:14,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:14,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:33:14,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:14,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694822f83206171a91e96 HTTP/1.1" 200 None 2025-09-26 13:33:14,791 - lava_callback - INFO - Completed processing callback for node 68d694822f83206171a91e96 INFO: 172.20.0.1:60250 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 13:33:15,662 - lava_callback - INFO - Received callback for node 68d3f9b2cd36afa834e14f23 INFO: 172.20.0.1:60262 - "POST /node/68d3f9b2cd36afa834e14f23 HTTP/1.0" 202 Accepted 2025-09-26 13:33:15,669 - lava_callback - INFO - Starting async job submit for node 68d3f9b2cd36afa834e14f23 2025-09-26 13:33:15,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:15,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f9b2cd36afa834e14f23 HTTP/1.1" 200 None 2025-09-26 13:33:15,699 - lava_callback - DEBUG - Processing node 68d3f9b2cd36afa834e14f23: baseline-arm64 2025-09-26 13:33:16,502 - lava_callback - ERROR - Error processing callback for node 68d3f9b2cd36afa834e14f23: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:60272 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:33:17,106 - lava_callback - INFO - Received callback for node 68d3f9b3cd36afa834e14f2a INFO: 172.20.0.1:60288 - "POST /node/68d3f9b3cd36afa834e14f2a HTTP/1.0" 202 Accepted 2025-09-26 13:33:17,112 - lava_callback - INFO - Starting async job submit for node 68d3f9b3cd36afa834e14f2a 2025-09-26 13:33:17,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:17,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f9b3cd36afa834e14f2a HTTP/1.1" 200 None 2025-09-26 13:33:17,144 - lava_callback - DEBUG - Processing node 68d3f9b3cd36afa834e14f2a: baseline-arm64 2025-09-26 13:33:17,431 - lava_callback - ERROR - Error processing callback for node 68d3f9b3cd36afa834e14f2a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:40432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34288 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:33:41,297 - lava_callback - INFO - Received callback for node 68d42814a5c2c05277bc7517 INFO: 172.20.0.1:53242 - "POST /node/68d42814a5c2c05277bc7517 HTTP/1.0" 202 Accepted 2025-09-26 13:33:41,302 - lava_callback - INFO - Starting async job submit for node 68d42814a5c2c05277bc7517 2025-09-26 13:33:41,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:41,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42814a5c2c05277bc7517 HTTP/1.1" 200 None 2025-09-26 13:33:41,335 - lava_callback - DEBUG - Processing node 68d42814a5c2c05277bc7517: baseline-arm 2025-09-26 13:33:41,557 - lava_callback - ERROR - Error processing callback for node 68d42814a5c2c05277bc7517: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:53258 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:33:50,106 - lava_callback - INFO - Received callback for node 68d694a02f83206171a91ed8 INFO: 172.20.0.1:55550 - "POST /node/68d694a02f83206171a91ed8 HTTP/1.0" 202 Accepted 2025-09-26 13:33:50,112 - lava_callback - INFO - Starting async job submit for node 68d694a02f83206171a91ed8 2025-09-26 13:33:50,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:50,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694a02f83206171a91ed8 HTTP/1.1" 200 None 2025-09-26 13:33:50,145 - lava_callback - DEBUG - Processing node 68d694a02f83206171a91ed8: baseline-arm64 2025-09-26 13:33:50,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:33:50,539 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:33:50,540 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694a02f83206171a91ed8/log.txt.gz 2025-09-26 13:33:50,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:33:50,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:33:50,692 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694a02f83206171a91ed8/lava_callback.json.gz 2025-09-26 13:33:50,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:50,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694a02f83206171a91ed8 HTTP/1.1" 200 None 2025-09-26 13:33:50,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:50,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:33:50,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:50,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694a02f83206171a91ed8 HTTP/1.1" 200 None 2025-09-26 13:33:50,807 - lava_callback - INFO - Completed processing callback for node 68d694a02f83206171a91ed8 2025-09-26 13:33:56,481 - lava_callback - INFO - Received callback for node 68d694a02f83206171a91edb INFO: 172.20.0.1:55564 - "POST /node/68d694a02f83206171a91edb HTTP/1.0" 202 Accepted 2025-09-26 13:33:56,487 - lava_callback - INFO - Starting async job submit for node 68d694a02f83206171a91edb 2025-09-26 13:33:56,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:55580 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:33:56,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694a02f83206171a91edb HTTP/1.1" 200 None 2025-09-26 13:33:56,519 - lava_callback - DEBUG - Processing node 68d694a02f83206171a91edb: baseline-arm64 2025-09-26 13:33:56,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:33:56,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:33:56,889 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694a02f83206171a91edb/log.txt.gz 2025-09-26 13:33:56,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:33:57,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:33:57,029 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694a02f83206171a91edb/lava_callback.json.gz 2025-09-26 13:33:57,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:57,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694a02f83206171a91edb HTTP/1.1" 200 None 2025-09-26 13:33:57,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:57,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:33:57,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:33:57,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694a02f83206171a91edb HTTP/1.1" 200 None 2025-09-26 13:33:57,100 - lava_callback - INFO - Completed processing callback for node 68d694a02f83206171a91edb INFO: 172.20.0.1:49216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38714 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:34:29,038 - lava_callback - INFO - Received callback for node 68d68a112f83206171a91831 INFO: 172.20.0.1:38730 - "POST /node/68d68a112f83206171a91831 HTTP/1.0" 202 Accepted 2025-09-26 13:34:29,044 - lava_callback - INFO - Starting async job submit for node 68d68a112f83206171a91831 2025-09-26 13:34:29,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:34:29,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a112f83206171a91831 HTTP/1.1" 200 None 2025-09-26 13:34:29,078 - lava_callback - DEBUG - Processing node 68d68a112f83206171a91831: baseline-arm64-broonie 2025-09-26 13:34:29,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:34:29,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:34:29,421 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d68a112f83206171a91831/log.txt.gz 2025-09-26 13:34:29,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:34:29,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:34:29,551 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d68a112f83206171a91831/lava_callback.json.gz 2025-09-26 13:34:29,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:34:29,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68a112f83206171a91831 HTTP/1.1" 200 None 2025-09-26 13:34:29,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:34:29,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:34:29,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:34:29,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68a112f83206171a91831 HTTP/1.1" 200 None 2025-09-26 13:34:29,636 - lava_callback - INFO - Completed processing callback for node 68d68a112f83206171a91831 INFO: 172.20.0.1:43526 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:34:36,768 - lava_callback - INFO - Received callback for node 68d3f9eecd36afa834e14f77 INFO: 172.20.0.1:43538 - "POST /node/68d3f9eecd36afa834e14f77 HTTP/1.0" 202 Accepted 2025-09-26 13:34:36,774 - lava_callback - INFO - Starting async job submit for node 68d3f9eecd36afa834e14f77 2025-09-26 13:34:36,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:34:36,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f9eecd36afa834e14f77 HTTP/1.1" 200 None 2025-09-26 13:34:36,822 - lava_callback - DEBUG - Processing node 68d3f9eecd36afa834e14f77: baseline-arm64 2025-09-26 13:34:37,248 - lava_callback - ERROR - Error processing callback for node 68d3f9eecd36afa834e14f77: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:34:38,143 - lava_callback - INFO - Received callback for node 68d3f9efcd36afa834e14f7a INFO: 172.20.0.1:43554 - "POST /node/68d3f9efcd36afa834e14f7a HTTP/1.0" 202 Accepted 2025-09-26 13:34:38,149 - lava_callback - INFO - Starting async job submit for node 68d3f9efcd36afa834e14f7a 2025-09-26 13:34:38,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:34:38,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f9efcd36afa834e14f7a HTTP/1.1" 200 None 2025-09-26 13:34:38,183 - lava_callback - DEBUG - Processing node 68d3f9efcd36afa834e14f7a: baseline-arm64 2025-09-26 13:34:38,472 - lava_callback - ERROR - Error processing callback for node 68d3f9efcd36afa834e14f7a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:34:39,743 - lava_callback - INFO - Received callback for node 68d6955c2f83206171a9204a INFO: 172.20.0.1:55684 - "POST /node/68d6955c2f83206171a9204a HTTP/1.0" 202 Accepted 2025-09-26 13:34:39,749 - lava_callback - INFO - Starting async job submit for node 68d6955c2f83206171a9204a 2025-09-26 13:34:39,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:34:39,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6955c2f83206171a9204a HTTP/1.1" 200 None 2025-09-26 13:34:39,787 - lava_callback - DEBUG - Processing node 68d6955c2f83206171a9204a: baseline-arm-clabbe 2025-09-26 13:34:39,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:34:40,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:34:40,108 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d6955c2f83206171a9204a/log.txt.gz 2025-09-26 13:34:40,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:34:40,245 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:34:40,245 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-68d6955c2f83206171a9204a/lava_callback.json.gz 2025-09-26 13:34:40,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:34:40,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6955c2f83206171a9204a HTTP/1.1" 200 None 2025-09-26 13:34:40,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:34:40,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 13:34:40,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:34:40,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6955c2f83206171a9204a HTTP/1.1" 200 None 2025-09-26 13:34:40,346 - lava_callback - INFO - Completed processing callback for node 68d6955c2f83206171a9204a INFO: 172.20.0.1:55696 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:34:49,262 - lava_callback - INFO - Received callback for node 68d46d2fa5c2c05277bcc31c INFO: 172.20.0.1:55712 - "POST /node/68d46d2fa5c2c05277bcc31c HTTP/1.0" 202 Accepted 2025-09-26 13:34:49,268 - lava_callback - INFO - Starting async job submit for node 68d46d2fa5c2c05277bcc31c 2025-09-26 13:34:49,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:34:49,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d46d2fa5c2c05277bcc31c HTTP/1.1" 200 None 2025-09-26 13:34:49,308 - lava_callback - DEBUG - Processing node 68d46d2fa5c2c05277bcc31c: baseline-arm64-broonie 2025-09-26 13:34:49,602 - lava_callback - ERROR - Error processing callback for node 68d46d2fa5c2c05277bcc31c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:44728 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:34:57,068 - lava_callback - INFO - Received callback for node 68d3f9f7cd36afa834e14f80 INFO: 172.20.0.1:44730 - "POST /node/68d3f9f7cd36afa834e14f80 HTTP/1.0" 202 Accepted 2025-09-26 13:34:57,074 - lava_callback - INFO - Starting async job submit for node 68d3f9f7cd36afa834e14f80 2025-09-26 13:34:57,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:34:57,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f9f7cd36afa834e14f80 HTTP/1.1" 200 None 2025-09-26 13:34:57,106 - lava_callback - DEBUG - Processing node 68d3f9f7cd36afa834e14f80: baseline-arm64 2025-09-26 13:34:57,397 - lava_callback - ERROR - Error processing callback for node 68d3f9f7cd36afa834e14f80: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:43464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46478 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:35:20,448 - lava_callback - INFO - Received callback for node 68d3f9f9cd36afa834e14f83 INFO: 172.20.0.1:35174 - "POST /node/68d3f9f9cd36afa834e14f83 HTTP/1.0" 202 Accepted 2025-09-26 13:35:20,454 - lava_callback - INFO - Starting async job submit for node 68d3f9f9cd36afa834e14f83 2025-09-26 13:35:20,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:35:20,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f9f9cd36afa834e14f83 HTTP/1.1" 200 None 2025-09-26 13:35:20,509 - lava_callback - DEBUG - Processing node 68d3f9f9cd36afa834e14f83: baseline-arm64 2025-09-26 13:35:20,820 - lava_callback - ERROR - Error processing callback for node 68d3f9f9cd36afa834e14f83: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:35176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35190 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:35:29,774 - lava_callback - INFO - Received callback for node 68d694ec2f83206171a91f75 INFO: 172.20.0.1:46156 - "POST /node/68d694ec2f83206171a91f75 HTTP/1.0" 202 Accepted 2025-09-26 13:35:29,780 - lava_callback - INFO - Starting async job submit for node 68d694ec2f83206171a91f75 2025-09-26 13:35:29,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:35:29,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694ec2f83206171a91f75 HTTP/1.1" 200 None 2025-09-26 13:35:29,833 - lava_callback - DEBUG - Processing node 68d694ec2f83206171a91f75: baseline-arm64-broonie 2025-09-26 13:35:30,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:35:30,644 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:35:30,645 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d694ec2f83206171a91f75/log.txt.gz 2025-09-26 13:35:30,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:35:30,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:35:30,815 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d694ec2f83206171a91f75/lava_callback.json.gz 2025-09-26 13:35:30,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:35:30,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694ec2f83206171a91f75 HTTP/1.1" 200 None 2025-09-26 13:35:30,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:35:30,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:35:30,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:35:30,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694ec2f83206171a91f75 HTTP/1.1" 200 None 2025-09-26 13:35:30,907 - lava_callback - INFO - Completed processing callback for node 68d694ec2f83206171a91f75 INFO: 172.20.0.1:46164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60914 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:35:54,489 - lava_callback - INFO - Received callback for node 68d3fa02cd36afa834e14f8c INFO: 172.20.0.1:47016 - "POST /node/68d3fa02cd36afa834e14f8c HTTP/1.0" 202 Accepted 2025-09-26 13:35:54,494 - lava_callback - INFO - Starting async job submit for node 68d3fa02cd36afa834e14f8c 2025-09-26 13:35:54,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:35:54,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fa02cd36afa834e14f8c HTTP/1.1" 200 None 2025-09-26 13:35:54,527 - lava_callback - DEBUG - Processing node 68d3fa02cd36afa834e14f8c: baseline-arm64 2025-09-26 13:35:54,821 - lava_callback - ERROR - Error processing callback for node 68d3fa02cd36afa834e14f8c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:35:55,814 - lava_callback - INFO - Received callback for node 68d3fa02cd36afa834e14f8f INFO: 172.20.0.1:47030 - "POST /node/68d3fa02cd36afa834e14f8f HTTP/1.0" 202 Accepted 2025-09-26 13:35:55,820 - lava_callback - INFO - Starting async job submit for node 68d3fa02cd36afa834e14f8f 2025-09-26 13:35:55,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:35:55,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fa02cd36afa834e14f8f HTTP/1.1" 200 None 2025-09-26 13:35:55,854 - lava_callback - DEBUG - Processing node 68d3fa02cd36afa834e14f8f: baseline-arm64 2025-09-26 13:35:56,147 - lava_callback - ERROR - Error processing callback for node 68d3fa02cd36afa834e14f8f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:47038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59984 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:36:02,208 - lava_callback - INFO - Received callback for node 68d42816a5c2c05277bc751a INFO: 172.20.0.1:60000 - "POST /node/68d42816a5c2c05277bc751a HTTP/1.0" 202 Accepted 2025-09-26 13:36:02,214 - lava_callback - INFO - Starting async job submit for node 68d42816a5c2c05277bc751a 2025-09-26 13:36:02,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:36:02,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42816a5c2c05277bc751a HTTP/1.1" 200 None 2025-09-26 13:36:02,246 - lava_callback - DEBUG - Processing node 68d42816a5c2c05277bc751a: baseline-arm 2025-09-26 13:36:02,484 - lava_callback - ERROR - Error processing callback for node 68d42816a5c2c05277bc751a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:60016 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:36:13,466 - lava_callback - INFO - Received callback for node 68d3fa07cd36afa834e14f92 INFO: 172.20.0.1:58514 - "POST /node/68d3fa07cd36afa834e14f92 HTTP/1.0" 202 Accepted 2025-09-26 13:36:13,472 - lava_callback - INFO - Starting async job submit for node 68d3fa07cd36afa834e14f92 2025-09-26 13:36:13,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:36:13,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fa07cd36afa834e14f92 HTTP/1.1" 200 None 2025-09-26 13:36:13,525 - lava_callback - DEBUG - Processing node 68d3fa07cd36afa834e14f92: baseline-arm64 2025-09-26 13:36:13,815 - lava_callback - ERROR - Error processing callback for node 68d3fa07cd36afa834e14f92: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:58528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58536 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:36:22,596 - lava_callback - INFO - Received callback for node 68d3fa08cd36afa834e14f95 INFO: 172.20.0.1:38192 - "POST /node/68d3fa08cd36afa834e14f95 HTTP/1.0" 202 Accepted 2025-09-26 13:36:22,603 - lava_callback - INFO - Starting async job submit for node 68d3fa08cd36afa834e14f95 2025-09-26 13:36:22,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:36:22,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fa08cd36afa834e14f95 HTTP/1.1" 200 None 2025-09-26 13:36:22,650 - lava_callback - DEBUG - Processing node 68d3fa08cd36afa834e14f95: baseline-arm64 2025-09-26 13:36:23,541 - lava_callback - ERROR - Error processing callback for node 68d3fa08cd36afa834e14f95: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:38208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43962 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:36:37,648 - lava_callback - INFO - Received callback for node 68d6934d2f83206171a91ca7 INFO: 172.20.0.1:43970 - "POST /node/68d6934d2f83206171a91ca7 HTTP/1.0" 202 Accepted 2025-09-26 13:36:37,654 - lava_callback - INFO - Starting async job submit for node 68d6934d2f83206171a91ca7 2025-09-26 13:36:37,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:36:37,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6934d2f83206171a91ca7 HTTP/1.1" 200 None 2025-09-26 13:36:37,693 - lava_callback - DEBUG - Processing node 68d6934d2f83206171a91ca7: baseline-arm64 2025-09-26 13:36:37,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:36:38,100 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:36:38,100 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6934d2f83206171a91ca7/log.txt.gz 2025-09-26 13:36:38,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:36:38,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:36:38,252 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6934d2f83206171a91ca7/lava_callback.json.gz 2025-09-26 13:36:38,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:36:38,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6934d2f83206171a91ca7 HTTP/1.1" 200 None 2025-09-26 13:36:38,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:36:38,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:36:38,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:36:38,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6934d2f83206171a91ca7 HTTP/1.1" 200 None 2025-09-26 13:36:38,349 - lava_callback - INFO - Completed processing callback for node 68d6934d2f83206171a91ca7 INFO: 172.20.0.1:55704 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:36:48,399 - lava_callback - INFO - Received callback for node 68d6934e2f83206171a91cb2 INFO: 172.20.0.1:55706 - "POST /node/68d6934e2f83206171a91cb2 HTTP/1.0" 202 Accepted 2025-09-26 13:36:48,405 - lava_callback - INFO - Starting async job submit for node 68d6934e2f83206171a91cb2 2025-09-26 13:36:48,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:36:48,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6934e2f83206171a91cb2 HTTP/1.1" 200 None 2025-09-26 13:36:48,461 - lava_callback - DEBUG - Processing node 68d6934e2f83206171a91cb2: baseline-arm64 2025-09-26 13:36:48,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:36:48,790 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:36:48,790 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6934e2f83206171a91cb2/log.txt.gz 2025-09-26 13:36:48,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:36:48,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:36:48,909 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6934e2f83206171a91cb2/lava_callback.json.gz 2025-09-26 13:36:48,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:36:48,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6934e2f83206171a91cb2 HTTP/1.1" 200 None 2025-09-26 13:36:48,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:36:48,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:36:48,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:36:48,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6934e2f83206171a91cb2 HTTP/1.1" 200 None 2025-09-26 13:36:48,986 - lava_callback - INFO - Completed processing callback for node 68d6934e2f83206171a91cb2 2025-09-26 13:36:50,208 - lava_callback - INFO - Received callback for node 68d3f3edcd36afa834e143aa INFO: 172.20.0.1:37354 - "POST /node/68d3f3edcd36afa834e143aa HTTP/1.0" 202 Accepted 2025-09-26 13:36:50,214 - lava_callback - INFO - Starting async job submit for node 68d3f3edcd36afa834e143aa 2025-09-26 13:36:50,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:36:50,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f3edcd36afa834e143aa HTTP/1.1" 200 None 2025-09-26 13:36:50,227 - lava_callback - DEBUG - Processing node 68d3f3edcd36afa834e143aa: baseline-arm64-baylibre 2025-09-26 13:36:50,227 - lava_callback - ERROR - Error processing callback for node 68d3f3edcd36afa834e143aa: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:37368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34610 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:37:09,023 - lava_callback - INFO - Received callback for node 68d46d8ca5c2c05277bcc37e INFO: 172.20.0.1:34626 - "POST /node/68d46d8ca5c2c05277bcc37e HTTP/1.0" 202 Accepted 2025-09-26 13:37:09,029 - lava_callback - INFO - Starting async job submit for node 68d46d8ca5c2c05277bcc37e 2025-09-26 13:37:09,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:37:09,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d46d8ca5c2c05277bcc37e HTTP/1.1" 200 None 2025-09-26 13:37:09,061 - lava_callback - DEBUG - Processing node 68d46d8ca5c2c05277bcc37e: baseline-arm64-broonie 2025-09-26 13:37:09,352 - lava_callback - ERROR - Error processing callback for node 68d46d8ca5c2c05277bcc37e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:37:10,190 - lava_callback - INFO - Received callback for node 68d3f402cd36afa834e143eb INFO: 172.20.0.1:50674 - "POST /node/68d3f402cd36afa834e143eb HTTP/1.0" 202 Accepted 2025-09-26 13:37:10,196 - lava_callback - INFO - Starting async job submit for node 68d3f402cd36afa834e143eb 2025-09-26 13:37:10,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:37:10,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f402cd36afa834e143eb HTTP/1.1" 200 None 2025-09-26 13:37:10,222 - lava_callback - DEBUG - Processing node 68d3f402cd36afa834e143eb: baseline-arm64-baylibre 2025-09-26 13:37:10,222 - lava_callback - ERROR - Error processing callback for node 68d3f402cd36afa834e143eb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:50682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50688 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:37:18,747 - lava_callback - INFO - Received callback for node 68d3fa1fcd36afa834e14fa4 INFO: 172.20.0.1:50704 - "POST /node/68d3fa1fcd36afa834e14fa4 HTTP/1.0" 202 Accepted 2025-09-26 13:37:18,753 - lava_callback - INFO - Starting async job submit for node 68d3fa1fcd36afa834e14fa4 2025-09-26 13:37:18,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:37:18,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fa1fcd36afa834e14fa4 HTTP/1.1" 200 None 2025-09-26 13:37:18,791 - lava_callback - DEBUG - Processing node 68d3fa1fcd36afa834e14fa4: baseline-arm64 2025-09-26 13:37:19,110 - lava_callback - ERROR - Error processing callback for node 68d3fa1fcd36afa834e14fa4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:37:20,090 - lava_callback - INFO - Received callback for node 68d3fa20cd36afa834e14fa7 INFO: 172.20.0.1:55262 - "POST /node/68d3fa20cd36afa834e14fa7 HTTP/1.0" 202 Accepted 2025-09-26 13:37:20,096 - lava_callback - INFO - Starting async job submit for node 68d3fa20cd36afa834e14fa7 2025-09-26 13:37:20,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:37:20,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fa20cd36afa834e14fa7 HTTP/1.1" 200 None 2025-09-26 13:37:20,129 - lava_callback - DEBUG - Processing node 68d3fa20cd36afa834e14fa7: baseline-arm64 2025-09-26 13:37:20,415 - lava_callback - ERROR - Error processing callback for node 68d3fa20cd36afa834e14fa7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:55272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55286 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:37:30,201 - lava_callback - INFO - Received callback for node 68d3f40ccd36afa834e143f1 INFO: 172.20.0.1:45126 - "POST /node/68d3f40ccd36afa834e143f1 HTTP/1.0" 202 Accepted 2025-09-26 13:37:30,206 - lava_callback - INFO - Starting async job submit for node 68d3f40ccd36afa834e143f1 2025-09-26 13:37:30,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:37:30,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f40ccd36afa834e143f1 HTTP/1.1" 200 None 2025-09-26 13:37:30,219 - lava_callback - DEBUG - Processing node 68d3f40ccd36afa834e143f1: baseline-arm64-baylibre 2025-09-26 13:37:30,219 - lava_callback - ERROR - Error processing callback for node 68d3f40ccd36afa834e143f1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 13:37:34,116 - lava_callback - INFO - Received callback for node 68d3fa2ccd36afa834e14fdf INFO: 172.20.0.1:45128 - "POST /node/68d3fa2ccd36afa834e14fdf HTTP/1.0" 202 Accepted 2025-09-26 13:37:34,122 - lava_callback - INFO - Starting async job submit for node 68d3fa2ccd36afa834e14fdf 2025-09-26 13:37:34,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:37:34,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fa2ccd36afa834e14fdf HTTP/1.1" 200 None 2025-09-26 13:37:34,157 - lava_callback - DEBUG - Processing node 68d3fa2ccd36afa834e14fdf: baseline-arm64 2025-09-26 13:37:34,445 - lava_callback - ERROR - Error processing callback for node 68d3fa2ccd36afa834e14fdf: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:45140 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:37:46,122 - lava_callback - INFO - Received callback for node 68d3fa2ccd36afa834e14fe2 INFO: 172.20.0.1:51592 - "POST /node/68d3fa2ccd36afa834e14fe2 HTTP/1.0" 202 Accepted 2025-09-26 13:37:46,128 - lava_callback - INFO - Starting async job submit for node 68d3fa2ccd36afa834e14fe2 2025-09-26 13:37:46,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:37:46,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fa2ccd36afa834e14fe2 HTTP/1.1" 200 None 2025-09-26 13:37:46,182 - lava_callback - DEBUG - Processing node 68d3fa2ccd36afa834e14fe2: baseline-arm64 2025-09-26 13:37:46,493 - lava_callback - ERROR - Error processing callback for node 68d3fa2ccd36afa834e14fe2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:51596 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:37:49,611 - lava_callback - INFO - Received callback for node 68d690572f83206171a91b54 INFO: 172.20.0.1:44356 - "POST /node/68d690572f83206171a91b54 HTTP/1.0" 202 Accepted 2025-09-26 13:37:49,617 - lava_callback - INFO - Starting async job submit for node 68d690572f83206171a91b54 2025-09-26 13:37:49,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:37:49,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690572f83206171a91b54 HTTP/1.1" 200 None 2025-09-26 13:37:49,672 - lava_callback - DEBUG - Processing node 68d690572f83206171a91b54: baseline-arm64-broonie 2025-09-26 13:37:49,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:37:50,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:37:50,161 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d690572f83206171a91b54/log.txt.gz 2025-09-26 13:37:50,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:37:50,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:37:50,339 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d690572f83206171a91b54/lava_callback.json.gz 2025-09-26 13:37:50,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:37:50,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690572f83206171a91b54 HTTP/1.1" 200 None 2025-09-26 13:37:50,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:37:50,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:37:50,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:37:50,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690572f83206171a91b54 HTTP/1.1" 200 None 2025-09-26 13:37:50,413 - lava_callback - INFO - Completed processing callback for node 68d690572f83206171a91b54 2025-09-26 13:37:52,960 - lava_callback - INFO - Received callback for node 68d695862f83206171a920c7 INFO: 172.20.0.1:44360 - "POST /node/68d695862f83206171a920c7 HTTP/1.0" 202 Accepted 2025-09-26 13:37:52,965 - lava_callback - INFO - Starting async job submit for node 68d695862f83206171a920c7 2025-09-26 13:37:52,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:37:53,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695862f83206171a920c7 HTTP/1.1" 200 None 2025-09-26 13:37:53,013 - lava_callback - DEBUG - Processing node 68d695862f83206171a920c7: baseline-arm64-broonie 2025-09-26 13:37:53,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:37:53,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:37:53,340 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d695862f83206171a920c7/log.txt.gz 2025-09-26 13:37:53,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:37:53,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:37:53,461 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d695862f83206171a920c7/lava_callback.json.gz 2025-09-26 13:37:53,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:37:53,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695862f83206171a920c7 HTTP/1.1" 200 None 2025-09-26 13:37:53,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:37:53,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:37:53,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:37:53,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695862f83206171a920c7 HTTP/1.1" 200 None 2025-09-26 13:37:53,546 - lava_callback - INFO - Completed processing callback for node 68d695862f83206171a920c7 INFO: 172.20.0.1:44376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50762 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:38:11,970 - lava_callback - INFO - Received callback for node 68d693512f83206171a91cb5 INFO: 172.20.0.1:33590 - "POST /node/68d693512f83206171a91cb5 HTTP/1.0" 202 Accepted 2025-09-26 13:38:11,976 - lava_callback - INFO - Starting async job submit for node 68d693512f83206171a91cb5 2025-09-26 13:38:11,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:38:12,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693512f83206171a91cb5 HTTP/1.1" 200 None 2025-09-26 13:38:12,019 - lava_callback - DEBUG - Processing node 68d693512f83206171a91cb5: baseline-arm64 2025-09-26 13:38:12,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:38:12,454 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:38:12,455 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693512f83206171a91cb5/log.txt.gz 2025-09-26 13:38:12,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:38:12,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:38:12,601 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693512f83206171a91cb5/lava_callback.json.gz 2025-09-26 13:38:12,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:38:12,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693512f83206171a91cb5 HTTP/1.1" 200 None 2025-09-26 13:38:12,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:38:12,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:38:12,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:38:12,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693512f83206171a91cb5 HTTP/1.1" 200 None 2025-09-26 13:38:12,683 - lava_callback - INFO - Completed processing callback for node 68d693512f83206171a91cb5 INFO: 172.20.0.1:33604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33620 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:38:21,396 - lava_callback - INFO - Received callback for node 68d686982f83206171a91356 INFO: 172.20.0.1:49176 - "POST /node/68d686982f83206171a91356 HTTP/1.0" 202 Accepted 2025-09-26 13:38:21,401 - lava_callback - INFO - Starting async job submit for node 68d686982f83206171a91356 2025-09-26 13:38:21,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:38:21,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d686982f83206171a91356 HTTP/1.1" 200 None 2025-09-26 13:38:21,430 - lava_callback - DEBUG - Processing node 68d686982f83206171a91356: baseline-x86 2025-09-26 13:38:21,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:38:21,794 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:38:21,794 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d686982f83206171a91356/log.txt.gz 2025-09-26 13:38:21,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:38:21,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:38:21,913 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d686982f83206171a91356/lava_callback.json.gz 2025-09-26 13:38:21,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:38:21,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d686982f83206171a91356 HTTP/1.1" 200 None 2025-09-26 13:38:21,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:38:21,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c53c1bc82a30b37a925 HTTP/1.1" 200 None 2025-09-26 13:38:21,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:38:21,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d686982f83206171a91356 HTTP/1.1" 200 None 2025-09-26 13:38:21,991 - lava_callback - INFO - Completed processing callback for node 68d686982f83206171a91356 2025-09-26 13:38:23,238 - lava_callback - INFO - Received callback for node 68d42818a5c2c05277bc751d INFO: 172.20.0.1:49190 - "POST /node/68d42818a5c2c05277bc751d HTTP/1.0" 202 Accepted 2025-09-26 13:38:23,244 - lava_callback - INFO - Starting async job submit for node 68d42818a5c2c05277bc751d 2025-09-26 13:38:23,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:38:23,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42818a5c2c05277bc751d HTTP/1.1" 200 None 2025-09-26 13:38:23,275 - lava_callback - DEBUG - Processing node 68d42818a5c2c05277bc751d: baseline-arm 2025-09-26 13:38:23,497 - lava_callback - ERROR - Error processing callback for node 68d42818a5c2c05277bc751d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:49192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49206 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:38:28,330 - lava_callback - INFO - Received callback for node 68d693512f83206171a91cb8 INFO: 172.20.0.1:49210 - "POST /node/68d693512f83206171a91cb8 HTTP/1.0" 202 Accepted 2025-09-26 13:38:28,336 - lava_callback - INFO - Starting async job submit for node 68d693512f83206171a91cb8 2025-09-26 13:38:28,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:38:28,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693512f83206171a91cb8 HTTP/1.1" 200 None 2025-09-26 13:38:28,391 - lava_callback - DEBUG - Processing node 68d693512f83206171a91cb8: baseline-arm64 2025-09-26 13:38:28,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:38:28,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:38:28,777 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693512f83206171a91cb8/log.txt.gz 2025-09-26 13:38:28,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:38:28,885 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:38:28,886 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693512f83206171a91cb8/lava_callback.json.gz 2025-09-26 13:38:28,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:38:28,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693512f83206171a91cb8 HTTP/1.1" 200 None 2025-09-26 13:38:28,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:38:28,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:38:28,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:38:29,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693512f83206171a91cb8 HTTP/1.1" 200 None 2025-09-26 13:38:29,000 - lava_callback - INFO - Completed processing callback for node 68d693512f83206171a91cb8 2025-09-26 13:38:30,289 - lava_callback - INFO - Received callback for node 68d3f44dcd36afa834e14504 INFO: 172.20.0.1:32856 - "POST /node/68d3f44dcd36afa834e14504 HTTP/1.0" 202 Accepted 2025-09-26 13:38:30,295 - lava_callback - INFO - Starting async job submit for node 68d3f44dcd36afa834e14504 2025-09-26 13:38:30,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:38:30,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f44dcd36afa834e14504 HTTP/1.1" 200 None 2025-09-26 13:38:30,308 - lava_callback - DEBUG - Processing node 68d3f44dcd36afa834e14504: baseline-arm64-baylibre 2025-09-26 13:38:30,308 - lava_callback - ERROR - Error processing callback for node 68d3f44dcd36afa834e14504: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 13:38:35,772 - lava_callback - INFO - Received callback for node 68d3fa36cd36afa834e14feb INFO: 172.20.0.1:32868 - "POST /node/68d3fa36cd36afa834e14feb HTTP/1.0" 202 Accepted 2025-09-26 13:38:35,778 - lava_callback - INFO - Starting async job submit for node 68d3fa36cd36afa834e14feb 2025-09-26 13:38:35,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:38:35,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fa36cd36afa834e14feb HTTP/1.1" 200 None 2025-09-26 13:38:35,821 - lava_callback - DEBUG - Processing node 68d3fa36cd36afa834e14feb: baseline-arm64 2025-09-26 13:38:36,119 - lava_callback - ERROR - Error processing callback for node 68d3fa36cd36afa834e14feb: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:32878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36864 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:38:53,118 - lava_callback - INFO - Received callback for node 68d6939e2f83206171a91d47 INFO: 172.20.0.1:60902 - "POST /node/68d6939e2f83206171a91d47 HTTP/1.0" 202 Accepted 2025-09-26 13:38:53,124 - lava_callback - INFO - Starting async job submit for node 68d6939e2f83206171a91d47 2025-09-26 13:38:53,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:38:53,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6939e2f83206171a91d47 HTTP/1.1" 200 None 2025-09-26 13:38:53,156 - lava_callback - DEBUG - Processing node 68d6939e2f83206171a91d47: baseline-arm64 2025-09-26 13:38:53,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:38:53,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:38:53,513 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6939e2f83206171a91d47/log.txt.gz 2025-09-26 13:38:53,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:38:53,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:38:53,650 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6939e2f83206171a91d47/lava_callback.json.gz 2025-09-26 13:38:53,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:38:53,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6939e2f83206171a91d47 HTTP/1.1" 200 None 2025-09-26 13:38:53,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:38:53,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:38:53,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:38:53,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6939e2f83206171a91d47 HTTP/1.1" 200 None 2025-09-26 13:38:53,759 - lava_callback - INFO - Completed processing callback for node 68d6939e2f83206171a91d47 INFO: 172.20.0.1:60914 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:38:59,552 - lava_callback - INFO - Received callback for node 68d3fa47cd36afa834e14ffd INFO: 172.20.0.1:56872 - "POST /node/68d3fa47cd36afa834e14ffd HTTP/1.0" 202 Accepted 2025-09-26 13:38:59,558 - lava_callback - INFO - Starting async job submit for node 68d3fa47cd36afa834e14ffd 2025-09-26 13:38:59,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:38:59,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fa47cd36afa834e14ffd HTTP/1.1" 200 None 2025-09-26 13:38:59,600 - lava_callback - DEBUG - Processing node 68d3fa47cd36afa834e14ffd: baseline-arm64 2025-09-26 13:38:59,906 - lava_callback - ERROR - Error processing callback for node 68d3fa47cd36afa834e14ffd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:39:01,145 - lava_callback - INFO - Received callback for node 68d3fa49cd36afa834e15000 INFO: 172.20.0.1:56884 - "POST /node/68d3fa49cd36afa834e15000 HTTP/1.0" 202 Accepted 2025-09-26 13:39:01,150 - lava_callback - INFO - Starting async job submit for node 68d3fa49cd36afa834e15000 2025-09-26 13:39:01,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:39:01,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fa49cd36afa834e15000 HTTP/1.1" 200 None 2025-09-26 13:39:01,184 - lava_callback - DEBUG - Processing node 68d3fa49cd36afa834e15000: baseline-arm64 2025-09-26 13:39:01,478 - lava_callback - ERROR - Error processing callback for node 68d3fa49cd36afa834e15000: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:56898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56906 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:39:10,031 - lava_callback - INFO - Received callback for node 68d3fa36cd36afa834e14fee INFO: 172.20.0.1:54818 - "POST /node/68d3fa36cd36afa834e14fee HTTP/1.0" 202 Accepted 2025-09-26 13:39:10,037 - lava_callback - INFO - Starting async job submit for node 68d3fa36cd36afa834e14fee 2025-09-26 13:39:10,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:39:10,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fa36cd36afa834e14fee HTTP/1.1" 200 None 2025-09-26 13:39:10,093 - lava_callback - DEBUG - Processing node 68d3fa36cd36afa834e14fee: baseline-arm64 2025-09-26 13:39:10,337 - lava_callback - INFO - Received callback for node 68d3f46ecd36afa834e1453c INFO: 172.20.0.1:54832 - "POST /node/68d3f46ecd36afa834e1453c HTTP/1.0" 202 Accepted 2025-09-26 13:39:10,353 - lava_callback - INFO - Starting async job submit for node 68d3f46ecd36afa834e1453c 2025-09-26 13:39:10,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:39:10,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f46ecd36afa834e1453c HTTP/1.1" 200 None 2025-09-26 13:39:10,434 - lava_callback - DEBUG - Processing node 68d3f46ecd36afa834e1453c: baseline-arm64-baylibre 2025-09-26 13:39:10,439 - lava_callback - ERROR - Error processing callback for node 68d3f46ecd36afa834e1453c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 13:39:10,529 - lava_callback - ERROR - Error processing callback for node 68d3fa36cd36afa834e14fee: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:54840 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 13:39:15,997 - lava_callback - INFO - Received callback for node 68d6939f2f83206171a91d4a INFO: 172.20.0.1:54852 - "POST /node/68d6939f2f83206171a91d4a HTTP/1.0" 202 Accepted 2025-09-26 13:39:16,003 - lava_callback - INFO - Starting async job submit for node 68d6939f2f83206171a91d4a 2025-09-26 13:39:16,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:39:16,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6939f2f83206171a91d4a HTTP/1.1" 200 None 2025-09-26 13:39:16,036 - lava_callback - DEBUG - Processing node 68d6939f2f83206171a91d4a: baseline-arm64 2025-09-26 13:39:16,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:39:16,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:39:16,406 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6939f2f83206171a91d4a/log.txt.gz 2025-09-26 13:39:16,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:54858 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:39:16,520 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:39:16,521 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6939f2f83206171a91d4a/lava_callback.json.gz 2025-09-26 13:39:16,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:39:16,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6939f2f83206171a91d4a HTTP/1.1" 200 None 2025-09-26 13:39:16,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:39:16,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:39:16,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:39:16,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6939f2f83206171a91d4a HTTP/1.1" 200 None 2025-09-26 13:39:16,636 - lava_callback - INFO - Completed processing callback for node 68d6939f2f83206171a91d4a INFO: 172.20.0.1:46638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48502 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:39:53,040 - lava_callback - INFO - Received callback for node 68d4736ca5c2c05277bcc85b INFO: 172.20.0.1:56172 - "POST /node/68d4736ca5c2c05277bcc85b HTTP/1.0" 202 Accepted 2025-09-26 13:39:53,046 - lava_callback - INFO - Starting async job submit for node 68d4736ca5c2c05277bcc85b 2025-09-26 13:39:53,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:39:53,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4736ca5c2c05277bcc85b HTTP/1.1" 200 None 2025-09-26 13:39:53,076 - lava_callback - DEBUG - Processing node 68d4736ca5c2c05277bcc85b: baseline-arm64-broonie 2025-09-26 13:39:53,366 - lava_callback - ERROR - Error processing callback for node 68d4736ca5c2c05277bcc85b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:39:55,295 - lava_callback - INFO - Received callback for node 68d686d02f83206171a9135f INFO: 172.20.0.1:56188 - "POST /node/68d686d02f83206171a9135f HTTP/1.0" 202 Accepted 2025-09-26 13:39:55,301 - lava_callback - INFO - Starting async job submit for node 68d686d02f83206171a9135f 2025-09-26 13:39:55,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:39:55,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d686d02f83206171a9135f HTTP/1.1" 200 None 2025-09-26 13:39:55,329 - lava_callback - DEBUG - Processing node 68d686d02f83206171a9135f: baseline-x86 2025-09-26 13:39:55,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:39:55,879 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:39:55,880 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d686d02f83206171a9135f/log.txt.gz 2025-09-26 13:39:55,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:39:56,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:39:56,018 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d686d02f83206171a9135f/lava_callback.json.gz 2025-09-26 13:39:56,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:39:56,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d686d02f83206171a9135f HTTP/1.1" 200 None 2025-09-26 13:39:56,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:39:56,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8d52be2da466069ac18 HTTP/1.1" 200 None 2025-09-26 13:39:56,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:39:56,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d686d02f83206171a9135f HTTP/1.1" 200 None 2025-09-26 13:39:56,112 - lava_callback - INFO - Completed processing callback for node 68d686d02f83206171a9135f INFO: 172.20.0.1:56192 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:39:57,167 - lava_callback - INFO - Received callback for node 68d693a12f83206171a91d4d INFO: 172.20.0.1:56204 - "POST /node/68d693a12f83206171a91d4d HTTP/1.0" 202 Accepted 2025-09-26 13:39:57,172 - lava_callback - INFO - Starting async job submit for node 68d693a12f83206171a91d4d 2025-09-26 13:39:57,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:39:57,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693a12f83206171a91d4d HTTP/1.1" 200 None 2025-09-26 13:39:57,211 - lava_callback - DEBUG - Processing node 68d693a12f83206171a91d4d: baseline-arm64 2025-09-26 13:39:57,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:39:57,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:39:57,551 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693a12f83206171a91d4d/log.txt.gz 2025-09-26 13:39:57,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:39:57,684 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:39:57,685 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693a12f83206171a91d4d/lava_callback.json.gz 2025-09-26 13:39:57,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:39:57,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693a12f83206171a91d4d HTTP/1.1" 200 None 2025-09-26 13:39:57,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:39:57,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:39:57,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:39:57,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693a12f83206171a91d4d HTTP/1.1" 200 None 2025-09-26 13:39:57,764 - lava_callback - INFO - Completed processing callback for node 68d693a12f83206171a91d4d 2025-09-26 13:40:00,889 - lava_callback - INFO - Received callback for node 68d693ea2f83206171a91de2 INFO: 172.20.0.1:47918 - "POST /node/68d693ea2f83206171a91de2 HTTP/1.0" 202 Accepted 2025-09-26 13:40:00,895 - lava_callback - INFO - Starting async job submit for node 68d693ea2f83206171a91de2 2025-09-26 13:40:00,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:40:00,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693ea2f83206171a91de2 HTTP/1.1" 200 None 2025-09-26 13:40:00,928 - lava_callback - DEBUG - Processing node 68d693ea2f83206171a91de2: baseline-arm64-broonie 2025-09-26 13:40:01,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:40:01,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:40:01,285 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d693ea2f83206171a91de2/log.txt.gz 2025-09-26 13:40:01,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:40:01,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:40:01,400 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d693ea2f83206171a91de2/lava_callback.json.gz 2025-09-26 13:40:01,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:40:01,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693ea2f83206171a91de2 HTTP/1.1" 200 None 2025-09-26 13:40:01,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:40:01,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:40:01,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:40:01,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693ea2f83206171a91de2 HTTP/1.1" 200 None 2025-09-26 13:40:01,478 - lava_callback - INFO - Completed processing callback for node 68d693ea2f83206171a91de2 INFO: 172.20.0.1:47924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47928 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:40:11,764 - lava_callback - INFO - Received callback for node 68d693a22f83206171a91d50 INFO: 172.20.0.1:57150 - "POST /node/68d693a22f83206171a91d50 HTTP/1.0" 202 Accepted 2025-09-26 13:40:11,770 - lava_callback - INFO - Starting async job submit for node 68d693a22f83206171a91d50 2025-09-26 13:40:11,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:40:11,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693a22f83206171a91d50 HTTP/1.1" 200 None 2025-09-26 13:40:11,802 - lava_callback - DEBUG - Processing node 68d693a22f83206171a91d50: baseline-arm64 2025-09-26 13:40:12,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:40:12,167 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:40:12,168 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693a22f83206171a91d50/log.txt.gz 2025-09-26 13:40:12,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:40:12,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:40:12,282 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693a22f83206171a91d50/lava_callback.json.gz 2025-09-26 13:40:12,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:40:12,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693a22f83206171a91d50 HTTP/1.1" 200 None 2025-09-26 13:40:12,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:40:12,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:40:12,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:40:12,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693a22f83206171a91d50 HTTP/1.1" 200 None 2025-09-26 13:40:12,360 - lava_callback - INFO - Completed processing callback for node 68d693a22f83206171a91d50 INFO: 172.20.0.1:57158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57174 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:40:20,857 - lava_callback - INFO - Received callback for node 68d3fcfacd36afa834e1567c INFO: 172.20.0.1:33282 - "POST /node/68d3fcfacd36afa834e1567c HTTP/1.0" 202 Accepted 2025-09-26 13:40:20,863 - lava_callback - INFO - Starting async job submit for node 68d3fcfacd36afa834e1567c 2025-09-26 13:40:20,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:40:20,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fcfacd36afa834e1567c HTTP/1.1" 200 None 2025-09-26 13:40:20,896 - lava_callback - DEBUG - Processing node 68d3fcfacd36afa834e1567c: baseline-arm64 2025-09-26 13:40:21,199 - lava_callback - ERROR - Error processing callback for node 68d3fcfacd36afa834e1567c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:40:23,688 - lava_callback - INFO - Received callback for node 68d3fabacd36afa834e150bd INFO: 172.20.0.1:33286 - "POST /node/68d3fabacd36afa834e150bd HTTP/1.0" 202 Accepted 2025-09-26 13:40:23,694 - lava_callback - INFO - Starting async job submit for node 68d3fabacd36afa834e150bd 2025-09-26 13:40:23,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:40:23,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fabacd36afa834e150bd HTTP/1.1" 200 None 2025-09-26 13:40:23,746 - lava_callback - DEBUG - Processing node 68d3fabacd36afa834e150bd: baseline-arm64 2025-09-26 13:40:24,076 - lava_callback - ERROR - Error processing callback for node 68d3fabacd36afa834e150bd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:33298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33314 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:40:30,403 - lava_callback - INFO - Received callback for node 68d3f4bdcd36afa834e145c2 INFO: 172.20.0.1:48018 - "POST /node/68d3f4bdcd36afa834e145c2 HTTP/1.0" 202 Accepted 2025-09-26 13:40:30,408 - lava_callback - INFO - Starting async job submit for node 68d3f4bdcd36afa834e145c2 2025-09-26 13:40:30,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:40:30,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f4bdcd36afa834e145c2 HTTP/1.1" 200 None 2025-09-26 13:40:30,421 - lava_callback - DEBUG - Processing node 68d3f4bdcd36afa834e145c2: baseline-arm64-baylibre 2025-09-26 13:40:30,421 - lava_callback - ERROR - Error processing callback for node 68d3f4bdcd36afa834e145c2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:48024 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:40:40,853 - lava_callback - INFO - Received callback for node 68d42819a5c2c05277bc7520 INFO: 172.20.0.1:39218 - "POST /node/68d42819a5c2c05277bc7520 HTTP/1.0" 202 Accepted 2025-09-26 13:40:40,859 - lava_callback - INFO - Starting async job submit for node 68d42819a5c2c05277bc7520 2025-09-26 13:40:40,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:40:40,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42819a5c2c05277bc7520 HTTP/1.1" 200 None 2025-09-26 13:40:40,893 - lava_callback - DEBUG - Processing node 68d42819a5c2c05277bc7520: baseline-arm 2025-09-26 13:40:41,137 - lava_callback - ERROR - Error processing callback for node 68d42819a5c2c05277bc7520: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:39228 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:40:56,064 - lava_callback - INFO - Received callback for node 68d6947d2f83206171a91e72 INFO: 172.20.0.1:56954 - "POST /node/68d6947d2f83206171a91e72 HTTP/1.0" 202 Accepted 2025-09-26 13:40:56,070 - lava_callback - INFO - Starting async job submit for node 68d6947d2f83206171a91e72 2025-09-26 13:40:56,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:40:56,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6947d2f83206171a91e72 HTTP/1.1" 200 None 2025-09-26 13:40:56,105 - lava_callback - DEBUG - Processing node 68d6947d2f83206171a91e72: baseline-arm64 2025-09-26 13:40:56,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:40:56,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:40:56,444 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6947d2f83206171a91e72/log.txt.gz 2025-09-26 13:40:56,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:56964 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:40:56,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:40:56,583 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6947d2f83206171a91e72/lava_callback.json.gz 2025-09-26 13:40:56,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:40:56,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6947d2f83206171a91e72 HTTP/1.1" 200 None 2025-09-26 13:40:56,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:40:56,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:40:56,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:40:56,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6947d2f83206171a91e72 HTTP/1.1" 200 None 2025-09-26 13:40:56,699 - lava_callback - INFO - Completed processing callback for node 68d6947d2f83206171a91e72 INFO: 172.20.0.1:54238 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:41:06,006 - lava_callback - INFO - Received callback for node 68d3fcf9cd36afa834e15679 INFO: 172.20.0.1:54248 - "POST /node/68d3fcf9cd36afa834e15679 HTTP/1.0" 202 Accepted 2025-09-26 13:41:06,012 - lava_callback - INFO - Starting async job submit for node 68d3fcf9cd36afa834e15679 2025-09-26 13:41:06,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:41:06,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fcf9cd36afa834e15679 HTTP/1.1" 200 None 2025-09-26 13:41:06,066 - lava_callback - DEBUG - Processing node 68d3fcf9cd36afa834e15679: baseline-arm64 2025-09-26 13:41:06,458 - lava_callback - ERROR - Error processing callback for node 68d3fcf9cd36afa834e15679: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:54250 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:41:13,769 - lava_callback - INFO - Received callback for node 68d3fabacd36afa834e150c0 INFO: 172.20.0.1:37478 - "POST /node/68d3fabacd36afa834e150c0 HTTP/1.0" 202 Accepted 2025-09-26 13:41:13,776 - lava_callback - INFO - Starting async job submit for node 68d3fabacd36afa834e150c0 2025-09-26 13:41:13,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:41:13,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fabacd36afa834e150c0 HTTP/1.1" 200 None 2025-09-26 13:41:13,827 - lava_callback - DEBUG - Processing node 68d3fabacd36afa834e150c0: baseline-arm64 2025-09-26 13:41:14,134 - lava_callback - ERROR - Error processing callback for node 68d3fabacd36afa834e150c0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:37482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40700 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:41:25,631 - lava_callback - INFO - Received callback for node 68d6947c2f83206171a91e5f INFO: 172.20.0.1:40704 - "POST /node/68d6947c2f83206171a91e5f HTTP/1.0" 202 Accepted 2025-09-26 13:41:25,637 - lava_callback - INFO - Starting async job submit for node 68d6947c2f83206171a91e5f 2025-09-26 13:41:25,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:41:25,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6947c2f83206171a91e5f HTTP/1.1" 200 None 2025-09-26 13:41:25,677 - lava_callback - DEBUG - Processing node 68d6947c2f83206171a91e5f: baseline-arm64 2025-09-26 13:41:25,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:41:26,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:41:26,035 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6947c2f83206171a91e5f/log.txt.gz 2025-09-26 13:41:26,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:41:26,175 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:41:26,176 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6947c2f83206171a91e5f/lava_callback.json.gz 2025-09-26 13:41:26,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:41:26,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6947c2f83206171a91e5f HTTP/1.1" 200 None 2025-09-26 13:41:26,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:41:26,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:41:26,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:41:26,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6947c2f83206171a91e5f HTTP/1.1" 200 None 2025-09-26 13:41:26,253 - lava_callback - INFO - Completed processing callback for node 68d6947c2f83206171a91e5f INFO: 172.20.0.1:40710 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:41:34,148 - lava_callback - INFO - Received callback for node 68d6949d2f83206171a91ece INFO: 172.20.0.1:37876 - "POST /node/68d6949d2f83206171a91ece HTTP/1.0" 202 Accepted 2025-09-26 13:41:34,153 - lava_callback - INFO - Starting async job submit for node 68d6949d2f83206171a91ece 2025-09-26 13:41:34,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:41:34,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6949d2f83206171a91ece HTTP/1.1" 200 None 2025-09-26 13:41:34,186 - lava_callback - DEBUG - Processing node 68d6949d2f83206171a91ece: baseline-arm64 2025-09-26 13:41:34,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:41:34,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:41:34,560 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6949d2f83206171a91ece/log.txt.gz 2025-09-26 13:41:34,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:41:34,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:41:34,692 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6949d2f83206171a91ece/lava_callback.json.gz 2025-09-26 13:41:34,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:41:34,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6949d2f83206171a91ece HTTP/1.1" 200 None 2025-09-26 13:41:34,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:41:34,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:41:34,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:41:34,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6949d2f83206171a91ece HTTP/1.1" 200 None 2025-09-26 13:41:34,767 - lava_callback - INFO - Completed processing callback for node 68d6949d2f83206171a91ece INFO: 172.20.0.1:37890 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:41:44,913 - lava_callback - INFO - Received callback for node 68d3fcfdcd36afa834e1567f INFO: 172.20.0.1:58230 - "POST /node/68d3fcfdcd36afa834e1567f HTTP/1.0" 202 Accepted 2025-09-26 13:41:44,921 - lava_callback - INFO - Starting async job submit for node 68d3fcfdcd36afa834e1567f 2025-09-26 13:41:44,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:41:44,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fcfdcd36afa834e1567f HTTP/1.1" 200 None 2025-09-26 13:41:44,955 - lava_callback - DEBUG - Processing node 68d3fcfdcd36afa834e1567f: baseline-arm64 2025-09-26 13:41:46,231 - lava_callback - ERROR - Error processing callback for node 68d3fcfdcd36afa834e1567f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:58238 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:41:48,863 - lava_callback - INFO - Received callback for node 68d6949d2f83206171a91ed1 INFO: 172.20.0.1:58244 - "POST /node/68d6949d2f83206171a91ed1 HTTP/1.0" 202 Accepted 2025-09-26 13:41:48,869 - lava_callback - INFO - Starting async job submit for node 68d6949d2f83206171a91ed1 2025-09-26 13:41:48,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:41:48,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6949d2f83206171a91ed1 HTTP/1.1" 200 None 2025-09-26 13:41:48,902 - lava_callback - DEBUG - Processing node 68d6949d2f83206171a91ed1: baseline-arm64 2025-09-26 13:41:49,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:41:49,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:41:49,280 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6949d2f83206171a91ed1/log.txt.gz 2025-09-26 13:41:49,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:41:49,423 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:41:49,424 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6949d2f83206171a91ed1/lava_callback.json.gz 2025-09-26 13:41:49,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:41:49,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6949d2f83206171a91ed1 HTTP/1.1" 200 None 2025-09-26 13:41:49,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:41:49,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:41:49,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:41:49,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6949d2f83206171a91ed1 HTTP/1.1" 200 None 2025-09-26 13:41:49,521 - lava_callback - INFO - Completed processing callback for node 68d6949d2f83206171a91ed1 2025-09-26 13:41:53,811 - lava_callback - INFO - Received callback for node 68d694e92f83206171a91f72 INFO: 172.20.0.1:34816 - "POST /node/68d694e92f83206171a91f72 HTTP/1.0" 202 Accepted 2025-09-26 13:41:53,818 - lava_callback - INFO - Starting async job submit for node 68d694e92f83206171a91f72 2025-09-26 13:41:53,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:41:53,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694e92f83206171a91f72 HTTP/1.1" 200 None 2025-09-26 13:41:53,854 - lava_callback - DEBUG - Processing node 68d694e92f83206171a91f72: baseline-arm64-broonie 2025-09-26 13:41:54,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:41:54,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:41:54,224 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d694e92f83206171a91f72/log.txt.gz 2025-09-26 13:41:54,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:41:54,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:41:54,339 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d694e92f83206171a91f72/lava_callback.json.gz 2025-09-26 13:41:54,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:41:54,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694e92f83206171a91f72 HTTP/1.1" 200 None 2025-09-26 13:41:54,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:41:54,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:41:54,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:41:54,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694e92f83206171a91f72 HTTP/1.1" 200 None 2025-09-26 13:41:54,421 - lava_callback - INFO - Completed processing callback for node 68d694e92f83206171a91f72 INFO: 172.20.0.1:34822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41732 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:42:14,714 - lava_callback - INFO - Received callback for node 68d3ff80cd36afa834e15978 INFO: 172.20.0.1:42270 - "POST /node/68d3ff80cd36afa834e15978 HTTP/1.0" 202 Accepted 2025-09-26 13:42:14,720 - lava_callback - INFO - Starting async job submit for node 68d3ff80cd36afa834e15978 2025-09-26 13:42:14,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:42:14,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ff80cd36afa834e15978 HTTP/1.1" 200 None 2025-09-26 13:42:14,761 - lava_callback - DEBUG - Processing node 68d3ff80cd36afa834e15978: ltp-sched 2025-09-26 13:42:15,092 - lava_callback - ERROR - Error processing callback for node 68d3ff80cd36afa834e15978: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:42286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42296 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:42:24,134 - lava_callback - INFO - Received callback for node 68d3fcffcd36afa834e15682 INFO: 172.20.0.1:60508 - "POST /node/68d3fcffcd36afa834e15682 HTTP/1.0" 202 Accepted 2025-09-26 13:42:24,140 - lava_callback - INFO - Starting async job submit for node 68d3fcffcd36afa834e15682 INFO: 172.20.0.1:60520 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:42:24,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:42:24,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fcffcd36afa834e15682 HTTP/1.1" 200 None 2025-09-26 13:42:24,195 - lava_callback - DEBUG - Processing node 68d3fcffcd36afa834e15682: baseline-arm64 2025-09-26 13:42:24,636 - lava_callback - ERROR - Error processing callback for node 68d3fcffcd36afa834e15682: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:60522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33480 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:42:41,789 - lava_callback - INFO - Received callback for node 68d3fd0ecd36afa834e15692 INFO: 172.20.0.1:45960 - "POST /node/68d3fd0ecd36afa834e15692 HTTP/1.0" 202 Accepted 2025-09-26 13:42:41,795 - lava_callback - INFO - Starting async job submit for node 68d3fd0ecd36afa834e15692 2025-09-26 13:42:41,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:42:41,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fd0ecd36afa834e15692 HTTP/1.1" 200 None 2025-09-26 13:42:41,827 - lava_callback - DEBUG - Processing node 68d3fd0ecd36afa834e15692: baseline-arm64 2025-09-26 13:42:42,116 - lava_callback - ERROR - Error processing callback for node 68d3fd0ecd36afa834e15692: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:42:43,148 - lava_callback - INFO - Received callback for node 68d3fd0dcd36afa834e1568f INFO: 172.20.0.1:45972 - "POST /node/68d3fd0dcd36afa834e1568f HTTP/1.0" 202 Accepted 2025-09-26 13:42:43,154 - lava_callback - INFO - Starting async job submit for node 68d3fd0dcd36afa834e1568f 2025-09-26 13:42:43,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:42:43,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fd0dcd36afa834e1568f HTTP/1.1" 200 None 2025-09-26 13:42:43,186 - lava_callback - DEBUG - Processing node 68d3fd0dcd36afa834e1568f: baseline-arm64 2025-09-26 13:42:43,506 - lava_callback - ERROR - Error processing callback for node 68d3fd0dcd36afa834e1568f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:45980 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:42:48,966 - lava_callback - INFO - Received callback for node 68d47416a5c2c05277bcc8fe INFO: 172.20.0.1:45982 - "POST /node/68d47416a5c2c05277bcc8fe HTTP/1.0" 202 Accepted 2025-09-26 13:42:48,972 - lava_callback - INFO - Starting async job submit for node 68d47416a5c2c05277bcc8fe 2025-09-26 13:42:48,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:42:49,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d47416a5c2c05277bcc8fe HTTP/1.1" 200 None 2025-09-26 13:42:49,002 - lava_callback - DEBUG - Processing node 68d47416a5c2c05277bcc8fe: baseline-arm64-broonie 2025-09-26 13:42:49,297 - lava_callback - ERROR - Error processing callback for node 68d47416a5c2c05277bcc8fe: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:42:52,886 - lava_callback - INFO - Received callback for node 68d696a32f83206171a9217d INFO: 172.20.0.1:47534 - "POST /node/68d696a32f83206171a9217d HTTP/1.0" 202 Accepted 2025-09-26 13:42:52,892 - lava_callback - INFO - Starting async job submit for node 68d696a32f83206171a9217d 2025-09-26 13:42:52,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:42:52,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d696a32f83206171a9217d HTTP/1.1" 200 None 2025-09-26 13:42:52,964 - lava_callback - DEBUG - Processing node 68d696a32f83206171a9217d: baseline-arm64-broonie 2025-09-26 13:42:53,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:42:53,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:42:53,759 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d696a32f83206171a9217d/log.txt.gz 2025-09-26 13:42:53,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:42:53,925 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:42:53,926 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d696a32f83206171a9217d/lava_callback.json.gz 2025-09-26 13:42:53,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:42:53,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d696a32f83206171a9217d HTTP/1.1" 200 None 2025-09-26 13:42:53,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:42:53,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:42:53,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:42:54,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d696a32f83206171a9217d HTTP/1.1" 200 None 2025-09-26 13:42:54,011 - lava_callback - INFO - Completed processing callback for node 68d696a32f83206171a9217d INFO: 172.20.0.1:47550 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:43:00,979 - lava_callback - INFO - Received callback for node 68d3fd11cd36afa834e15695 INFO: 172.20.0.1:45934 - "POST /node/68d3fd11cd36afa834e15695 HTTP/1.0" 202 Accepted 2025-09-26 13:43:00,985 - lava_callback - INFO - Starting async job submit for node 68d3fd11cd36afa834e15695 2025-09-26 13:43:01,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:43:01,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fd11cd36afa834e15695 HTTP/1.1" 200 None 2025-09-26 13:43:01,040 - lava_callback - DEBUG - Processing node 68d3fd11cd36afa834e15695: baseline-arm64 2025-09-26 13:43:01,209 - lava_callback - INFO - Received callback for node 68d4281ba5c2c05277bc7523 INFO: 172.20.0.1:45938 - "POST /node/68d4281ba5c2c05277bc7523 HTTP/1.0" 202 Accepted 2025-09-26 13:43:01,235 - lava_callback - INFO - Starting async job submit for node 68d4281ba5c2c05277bc7523 2025-09-26 13:43:01,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:43:01,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4281ba5c2c05277bc7523 HTTP/1.1" 200 None 2025-09-26 13:43:01,352 - lava_callback - DEBUG - Processing node 68d4281ba5c2c05277bc7523: baseline-arm 2025-09-26 13:43:01,389 - lava_callback - ERROR - Error processing callback for node 68d3fd11cd36afa834e15695: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:43:01,619 - lava_callback - ERROR - Error processing callback for node 68d4281ba5c2c05277bc7523: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:45950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39368 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:43:53,670 - lava_callback - INFO - Received callback for node 68d3fd13cd36afa834e15698 INFO: 172.20.0.1:33722 - "POST /node/68d3fd13cd36afa834e15698 HTTP/1.0" 202 Accepted 2025-09-26 13:43:53,676 - lava_callback - INFO - Starting async job submit for node 68d3fd13cd36afa834e15698 2025-09-26 13:43:53,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:43:53,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fd13cd36afa834e15698 HTTP/1.1" 200 None 2025-09-26 13:43:53,843 - lava_callback - DEBUG - Processing node 68d3fd13cd36afa834e15698: baseline-arm64 2025-09-26 13:43:54,134 - lava_callback - ERROR - Error processing callback for node 68d3fd13cd36afa834e15698: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:33726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43052 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:44:03,926 - lava_callback - INFO - Received callback for node 68d3ff79cd36afa834e15972 INFO: 172.20.0.1:43054 - "POST /node/68d3ff79cd36afa834e15972 HTTP/1.0" 202 Accepted 2025-09-26 13:44:03,932 - lava_callback - INFO - Starting async job submit for node 68d3ff79cd36afa834e15972 2025-09-26 13:44:03,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:44:03,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3ff79cd36afa834e15972 HTTP/1.1" 200 None 2025-09-26 13:44:03,980 - lava_callback - DEBUG - Processing node 68d3ff79cd36afa834e15972: baseline-arm 2025-09-26 13:44:04,237 - lava_callback - ERROR - Error processing callback for node 68d3ff79cd36afa834e15972: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:43056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37654 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:44:20,467 - lava_callback - INFO - Received callback for node 68d3fd96cd36afa834e15738 INFO: 172.20.0.1:57856 - "POST /node/68d3fd96cd36afa834e15738 HTTP/1.0" 202 Accepted 2025-09-26 13:44:20,473 - lava_callback - INFO - Starting async job submit for node 68d3fd96cd36afa834e15738 2025-09-26 13:44:20,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:44:20,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fd96cd36afa834e15738 HTTP/1.1" 200 None 2025-09-26 13:44:20,506 - lava_callback - DEBUG - Processing node 68d3fd96cd36afa834e15738: baseline-arm64 2025-09-26 13:44:20,821 - lava_callback - ERROR - Error processing callback for node 68d3fd96cd36afa834e15738: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:44:20,972 - lava_callback - INFO - Received callback for node 68d3fda5cd36afa834e1574f INFO: 172.20.0.1:57870 - "POST /node/68d3fda5cd36afa834e1574f HTTP/1.0" 202 Accepted 2025-09-26 13:44:20,978 - lava_callback - INFO - Starting async job submit for node 68d3fda5cd36afa834e1574f 2025-09-26 13:44:20,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:44:21,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fda5cd36afa834e1574f HTTP/1.1" 200 None 2025-09-26 13:44:21,012 - lava_callback - DEBUG - Processing node 68d3fda5cd36afa834e1574f: baseline-arm64 2025-09-26 13:44:21,300 - lava_callback - ERROR - Error processing callback for node 68d3fda5cd36afa834e1574f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:57878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57894 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:44:28,272 - lava_callback - INFO - Received callback for node 68d68e9a2f83206171a9198f INFO: 172.20.0.1:57904 - "POST /node/68d68e9a2f83206171a9198f HTTP/1.0" 202 Accepted 2025-09-26 13:44:28,279 - lava_callback - INFO - Starting async job submit for node 68d68e9a2f83206171a9198f 2025-09-26 13:44:28,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:44:28,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68e9a2f83206171a9198f HTTP/1.1" 200 None 2025-09-26 13:44:28,334 - lava_callback - DEBUG - Processing node 68d68e9a2f83206171a9198f: baseline-arm64 2025-09-26 13:44:29,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:44:29,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:44:29,489 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68e9a2f83206171a9198f/log.txt.gz 2025-09-26 13:44:29,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:44:29,701 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:44:29,701 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68e9a2f83206171a9198f/lava_callback.json.gz DEBUG: Setup failed for 68d68e9a2f83206171a9198f. Transitting job node result: incomplete -> fail 2025-09-26 13:44:29,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:44:29,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68e9a2f83206171a9198f HTTP/1.1" 200 None 2025-09-26 13:44:29,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:44:29,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:44:29,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:44:29,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68e9a2f83206171a9198f HTTP/1.1" 200 None 2025-09-26 13:44:29,838 - lava_callback - INFO - Completed processing callback for node 68d68e9a2f83206171a9198f INFO: 172.20.0.1:33302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36998 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:45:14,361 - lava_callback - INFO - Received callback for node 68d6985e2f83206171a921c6 INFO: 172.20.0.1:39860 - "POST /node/68d6985e2f83206171a921c6 HTTP/1.0" 202 Accepted 2025-09-26 13:45:14,368 - lava_callback - INFO - Starting async job submit for node 68d6985e2f83206171a921c6 2025-09-26 13:45:14,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:45:14,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6985e2f83206171a921c6 HTTP/1.1" 200 None 2025-09-26 13:45:14,425 - lava_callback - DEBUG - Processing node 68d6985e2f83206171a921c6: baseline-arm64-broonie 2025-09-26 13:45:14,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:45:14,896 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:45:14,897 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6985e2f83206171a921c6/log.txt.gz 2025-09-26 13:45:14,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:45:15,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:45:15,018 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6985e2f83206171a921c6/lava_callback.json.gz 2025-09-26 13:45:15,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:45:15,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6985e2f83206171a921c6 HTTP/1.1" 200 None 2025-09-26 13:45:15,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:45:15,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:45:15,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:45:15,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6985e2f83206171a921c6 HTTP/1.1" 200 None 2025-09-26 13:45:15,101 - lava_callback - INFO - Completed processing callback for node 68d6985e2f83206171a921c6 INFO: 172.20.0.1:39870 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 13:45:15,774 - lava_callback - INFO - Received callback for node 68d68e9b2f83206171a91992 INFO: 172.20.0.1:39876 - "POST /node/68d68e9b2f83206171a91992 HTTP/1.0" 202 Accepted 2025-09-26 13:45:15,782 - lava_callback - INFO - Starting async job submit for node 68d68e9b2f83206171a91992 2025-09-26 13:45:15,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:45:15,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68e9b2f83206171a91992 HTTP/1.1" 200 None 2025-09-26 13:45:15,834 - lava_callback - DEBUG - Processing node 68d68e9b2f83206171a91992: baseline-arm64 INFO: 172.20.0.1:39884 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:45:16,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:45:16,975 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:45:16,976 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68e9b2f83206171a91992/log.txt.gz 2025-09-26 13:45:16,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:45:17,167 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:45:17,168 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68e9b2f83206171a91992/lava_callback.json.gz DEBUG: Setup failed for 68d68e9b2f83206171a91992. Transitting job node result: incomplete -> fail 2025-09-26 13:45:17,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:45:17,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68e9b2f83206171a91992 HTTP/1.1" 200 None 2025-09-26 13:45:17,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:45:17,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:45:17,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:45:17,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68e9b2f83206171a91992 HTTP/1.1" 200 None 2025-09-26 13:45:17,303 - lava_callback - INFO - Completed processing callback for node 68d68e9b2f83206171a91992 2025-09-26 13:45:20,174 - lava_callback - INFO - Received callback for node 68d3fda6cd36afa834e15752 INFO: 172.20.0.1:56872 - "POST /node/68d3fda6cd36afa834e15752 HTTP/1.0" 202 Accepted 2025-09-26 13:45:20,180 - lava_callback - INFO - Starting async job submit for node 68d3fda6cd36afa834e15752 2025-09-26 13:45:20,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:45:20,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fda6cd36afa834e15752 HTTP/1.1" 200 None 2025-09-26 13:45:20,222 - lava_callback - DEBUG - Processing node 68d3fda6cd36afa834e15752: baseline-arm64 2025-09-26 13:45:20,603 - lava_callback - ERROR - Error processing callback for node 68d3fda6cd36afa834e15752: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:45:21,233 - lava_callback - INFO - Received callback for node 68d4281da5c2c05277bc7526 INFO: 172.20.0.1:56884 - "POST /node/68d4281da5c2c05277bc7526 HTTP/1.0" 202 Accepted 2025-09-26 13:45:21,239 - lava_callback - INFO - Starting async job submit for node 68d4281da5c2c05277bc7526 2025-09-26 13:45:21,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:45:21,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4281da5c2c05277bc7526 HTTP/1.1" 200 None 2025-09-26 13:45:21,287 - lava_callback - DEBUG - Processing node 68d4281da5c2c05277bc7526: baseline-arm 2025-09-26 13:45:21,517 - lava_callback - ERROR - Error processing callback for node 68d4281da5c2c05277bc7526: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:56888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56892 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:45:32,802 - lava_callback - INFO - Received callback for node 68d3fdb1cd36afa834e1575b INFO: 172.20.0.1:36242 - "POST /node/68d3fdb1cd36afa834e1575b HTTP/1.0" 202 Accepted 2025-09-26 13:45:32,808 - lava_callback - INFO - Starting async job submit for node 68d3fdb1cd36afa834e1575b 2025-09-26 13:45:32,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:45:32,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fdb1cd36afa834e1575b HTTP/1.1" 200 None 2025-09-26 13:45:32,851 - lava_callback - DEBUG - Processing node 68d3fdb1cd36afa834e1575b: baseline-arm64 2025-09-26 13:45:33,138 - lava_callback - ERROR - Error processing callback for node 68d3fdb1cd36afa834e1575b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:36254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39700 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:45:49,832 - lava_callback - INFO - Received callback for node 68d3fdb1cd36afa834e1575e INFO: 172.20.0.1:56388 - "POST /node/68d3fdb1cd36afa834e1575e HTTP/1.0" 202 Accepted 2025-09-26 13:45:49,838 - lava_callback - INFO - Starting async job submit for node 68d3fdb1cd36afa834e1575e 2025-09-26 13:45:49,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:45:49,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fdb1cd36afa834e1575e HTTP/1.1" 200 None 2025-09-26 13:45:49,873 - lava_callback - DEBUG - Processing node 68d3fdb1cd36afa834e1575e: baseline-arm64 2025-09-26 13:45:50,188 - lava_callback - ERROR - Error processing callback for node 68d3fdb1cd36afa834e1575e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:45:50,845 - lava_callback - INFO - Received callback for node 68d3fd98cd36afa834e1573b INFO: 172.20.0.1:56390 - "POST /node/68d3fd98cd36afa834e1573b HTTP/1.0" 202 Accepted 2025-09-26 13:45:50,872 - lava_callback - INFO - Starting async job submit for node 68d3fd98cd36afa834e1573b 2025-09-26 13:45:50,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:45:50,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fd98cd36afa834e1573b HTTP/1.1" 200 None 2025-09-26 13:45:50,915 - lava_callback - DEBUG - Processing node 68d3fd98cd36afa834e1573b: baseline-arm64 INFO: 172.20.0.1:56396 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:45:58,041 - lava_callback - ERROR - Error processing callback for node 68d3fd98cd36afa834e1573b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:52302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47984 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:46:28,957 - lava_callback - INFO - Received callback for node 68d474a6a5c2c05277bcc95a INFO: 172.20.0.1:47992 - "POST /node/68d474a6a5c2c05277bcc95a HTTP/1.0" 202 Accepted 2025-09-26 13:46:28,964 - lava_callback - INFO - Starting async job submit for node 68d474a6a5c2c05277bcc95a 2025-09-26 13:46:28,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:46:28,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d474a6a5c2c05277bcc95a HTTP/1.1" 200 None 2025-09-26 13:46:28,998 - lava_callback - DEBUG - Processing node 68d474a6a5c2c05277bcc95a: baseline-arm64-broonie 2025-09-26 13:46:29,296 - lava_callback - ERROR - Error processing callback for node 68d474a6a5c2c05277bcc95a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:33988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54160 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:46:56,891 - lava_callback - INFO - Received callback for node 68d3fdc1cd36afa834e15770 INFO: 172.20.0.1:54170 - "POST /node/68d3fdc1cd36afa834e15770 HTTP/1.0" 202 Accepted 2025-09-26 13:46:56,897 - lava_callback - INFO - Starting async job submit for node 68d3fdc1cd36afa834e15770 2025-09-26 13:46:56,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:46:56,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fdc1cd36afa834e15770 HTTP/1.1" 200 None 2025-09-26 13:46:56,931 - lava_callback - DEBUG - Processing node 68d3fdc1cd36afa834e15770: baseline-arm64 2025-09-26 13:46:57,227 - lava_callback - ERROR - Error processing callback for node 68d3fdc1cd36afa834e15770: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:47:01,178 - lava_callback - INFO - Received callback for node 68d3fdcecd36afa834e15779 INFO: 172.20.0.1:39892 - "POST /node/68d3fdcecd36afa834e15779 HTTP/1.0" 202 Accepted 2025-09-26 13:47:01,184 - lava_callback - INFO - Starting async job submit for node 68d3fdcecd36afa834e15779 2025-09-26 13:47:01,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:47:01,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fdcecd36afa834e15779 HTTP/1.1" 200 None 2025-09-26 13:47:01,226 - lava_callback - DEBUG - Processing node 68d3fdcecd36afa834e15779: baseline-arm64 2025-09-26 13:47:01,541 - lava_callback - ERROR - Error processing callback for node 68d3fdcecd36afa834e15779: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:39906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45766 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:47:19,158 - lava_callback - INFO - Received callback for node 68d3fdcfcd36afa834e1577c INFO: 172.20.0.1:45774 - "POST /node/68d3fdcfcd36afa834e1577c HTTP/1.0" 202 Accepted 2025-09-26 13:47:19,170 - lava_callback - INFO - Starting async job submit for node 68d3fdcfcd36afa834e1577c 2025-09-26 13:47:19,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:47:19,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fdcfcd36afa834e1577c HTTP/1.1" 200 None 2025-09-26 13:47:19,303 - lava_callback - DEBUG - Processing node 68d3fdcfcd36afa834e1577c: baseline-arm64 2025-09-26 13:47:20,052 - lava_callback - ERROR - Error processing callback for node 68d3fdcfcd36afa834e1577c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:53742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36208 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:47:46,422 - lava_callback - INFO - Received callback for node 68d4281fa5c2c05277bc7529 INFO: 172.20.0.1:55406 - "POST /node/68d4281fa5c2c05277bc7529 HTTP/1.0" 202 Accepted 2025-09-26 13:47:46,428 - lava_callback - INFO - Starting async job submit for node 68d4281fa5c2c05277bc7529 2025-09-26 13:47:46,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:47:46,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4281fa5c2c05277bc7529 HTTP/1.1" 200 None 2025-09-26 13:47:46,461 - lava_callback - DEBUG - Processing node 68d4281fa5c2c05277bc7529: baseline-arm INFO: 172.20.0.1:55410 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:47:46,685 - lava_callback - ERROR - Error processing callback for node 68d4281fa5c2c05277bc7529: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:40824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46336 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:48:05,460 - lava_callback - INFO - Received callback for node 68d695322f83206171a91ffa INFO: 172.20.0.1:46350 - "POST /node/68d695322f83206171a91ffa HTTP/1.0" 202 Accepted 2025-09-26 13:48:05,466 - lava_callback - INFO - Starting async job submit for node 68d695322f83206171a91ffa 2025-09-26 13:48:05,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:48:05,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695322f83206171a91ffa HTTP/1.1" 200 None 2025-09-26 13:48:05,510 - lava_callback - DEBUG - Processing node 68d695322f83206171a91ffa: baseline-arm 2025-09-26 13:48:05,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:48:05,971 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:48:05,971 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d695322f83206171a91ffa/log.txt.gz 2025-09-26 13:48:05,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:48:06,114 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:48:06,115 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d695322f83206171a91ffa/lava_callback.json.gz DEBUG: Setup failed for 68d695322f83206171a91ffa. Transitting job node result: incomplete -> fail 2025-09-26 13:48:06,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:48:06,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695322f83206171a91ffa HTTP/1.1" 200 None 2025-09-26 13:48:06,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:48:06,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 13:48:06,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:48:06,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695322f83206171a91ffa HTTP/1.1" 200 None 2025-09-26 13:48:06,228 - lava_callback - INFO - Completed processing callback for node 68d695322f83206171a91ffa INFO: 172.20.0.1:46360 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:48:08,517 - lava_callback - INFO - Received callback for node 68d6938a2f83206171a91d0c INFO: 172.20.0.1:46364 - "POST /node/68d6938a2f83206171a91d0c HTTP/1.0" 202 Accepted 2025-09-26 13:48:08,523 - lava_callback - INFO - Starting async job submit for node 68d6938a2f83206171a91d0c 2025-09-26 13:48:08,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:48:08,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6938a2f83206171a91d0c HTTP/1.1" 200 None 2025-09-26 13:48:08,565 - lava_callback - DEBUG - Processing node 68d6938a2f83206171a91d0c: baseline-arm64 2025-09-26 13:48:08,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:48:08,955 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:48:08,956 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6938a2f83206171a91d0c/log.txt.gz 2025-09-26 13:48:08,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:48:09,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:48:09,108 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6938a2f83206171a91d0c/lava_callback.json.gz 2025-09-26 13:48:09,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:48:09,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6938a2f83206171a91d0c HTTP/1.1" 200 None 2025-09-26 13:48:09,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:48:09,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:48:09,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:48:09,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6938a2f83206171a91d0c HTTP/1.1" 200 None 2025-09-26 13:48:09,186 - lava_callback - INFO - Completed processing callback for node 68d6938a2f83206171a91d0c 2025-09-26 13:48:14,093 - lava_callback - INFO - Received callback for node 68d3fdd4cd36afa834e1577f INFO: 172.20.0.1:50854 - "POST /node/68d3fdd4cd36afa834e1577f HTTP/1.0" 202 Accepted 2025-09-26 13:48:14,099 - lava_callback - INFO - Starting async job submit for node 68d3fdd4cd36afa834e1577f 2025-09-26 13:48:14,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:48:14,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fdd4cd36afa834e1577f HTTP/1.1" 200 None 2025-09-26 13:48:14,133 - lava_callback - DEBUG - Processing node 68d3fdd4cd36afa834e1577f: baseline-arm64 2025-09-26 13:48:14,422 - lava_callback - ERROR - Error processing callback for node 68d3fdd4cd36afa834e1577f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:50858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50860 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:48:20,828 - lava_callback - INFO - Received callback for node 68d6938b2f83206171a91d21 INFO: 172.20.0.1:45046 - "POST /node/68d6938b2f83206171a91d21 HTTP/1.0" 202 Accepted 2025-09-26 13:48:20,835 - lava_callback - INFO - Starting async job submit for node 68d6938b2f83206171a91d21 2025-09-26 13:48:20,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:48:20,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6938b2f83206171a91d21 HTTP/1.1" 200 None 2025-09-26 13:48:20,875 - lava_callback - DEBUG - Processing node 68d6938b2f83206171a91d21: baseline-arm64 2025-09-26 13:48:21,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:48:21,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:48:21,258 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6938b2f83206171a91d21/log.txt.gz 2025-09-26 13:48:21,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:48:21,358 - lava_callback - INFO - Received callback for node 68d3fdd5cd36afa834e15782 INFO: 172.20.0.1:45060 - "POST /node/68d3fdd5cd36afa834e15782 HTTP/1.0" 202 Accepted 2025-09-26 13:48:21,365 - lava_callback - INFO - Starting async job submit for node 68d3fdd5cd36afa834e15782 2025-09-26 13:48:21,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:48:21,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:48:21,412 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6938b2f83206171a91d21/lava_callback.json.gz 2025-09-26 13:48:21,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:48:21,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fdd5cd36afa834e15782 HTTP/1.1" 200 None 2025-09-26 13:48:21,465 - lava_callback - DEBUG - Processing node 68d3fdd5cd36afa834e15782: baseline-arm64 2025-09-26 13:48:21,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6938b2f83206171a91d21 HTTP/1.1" 200 None 2025-09-26 13:48:21,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:48:21,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:48:21,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:48:21,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6938b2f83206171a91d21 HTTP/1.1" 200 None 2025-09-26 13:48:21,676 - lava_callback - INFO - Completed processing callback for node 68d6938b2f83206171a91d21 2025-09-26 13:48:21,925 - lava_callback - ERROR - Error processing callback for node 68d3fdd5cd36afa834e15782: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:45062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45066 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:48:30,763 - lava_callback - INFO - Received callback for node 68d46c00a5c2c05277bcc1d3 INFO: 172.20.0.1:60116 - "POST /node/68d46c00a5c2c05277bcc1d3 HTTP/1.0" 202 Accepted 2025-09-26 13:48:30,770 - lava_callback - INFO - Starting async job submit for node 68d46c00a5c2c05277bcc1d3 2025-09-26 13:48:30,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:48:30,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d46c00a5c2c05277bcc1d3 HTTP/1.1" 200 None 2025-09-26 13:48:30,805 - lava_callback - DEBUG - Processing node 68d46c00a5c2c05277bcc1d3: baseline-arm64-broonie 2025-09-26 13:48:31,208 - lava_callback - ERROR - Error processing callback for node 68d46c00a5c2c05277bcc1d3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:48:34,551 - lava_callback - INFO - Received callback for node 68d68eae2f83206171a919a1 INFO: 172.20.0.1:60122 - "POST /node/68d68eae2f83206171a919a1 HTTP/1.0" 202 Accepted 2025-09-26 13:48:34,557 - lava_callback - INFO - Starting async job submit for node 68d68eae2f83206171a919a1 2025-09-26 13:48:34,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:48:34,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68eae2f83206171a919a1 HTTP/1.1" 200 None 2025-09-26 13:48:34,603 - lava_callback - DEBUG - Processing node 68d68eae2f83206171a919a1: baseline-arm64 2025-09-26 13:48:35,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:48:35,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:48:35,365 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68eae2f83206171a919a1/log.txt.gz 2025-09-26 13:48:35,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:48:35,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:48:35,489 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68eae2f83206171a919a1/lava_callback.json.gz DEBUG: Setup failed for 68d68eae2f83206171a919a1. Transitting job node result: incomplete -> fail 2025-09-26 13:48:35,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:48:35,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68eae2f83206171a919a1 HTTP/1.1" 200 None 2025-09-26 13:48:35,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:48:35,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:48:35,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:48:35,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68eae2f83206171a919a1 HTTP/1.1" 200 None 2025-09-26 13:48:35,635 - lava_callback - INFO - Completed processing callback for node 68d68eae2f83206171a919a1 INFO: 172.20.0.1:60130 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:48:38,507 - lava_callback - INFO - Received callback for node 68d3fddccd36afa834e15788 INFO: 172.20.0.1:60140 - "POST /node/68d3fddccd36afa834e15788 HTTP/1.0" 202 Accepted 2025-09-26 13:48:38,513 - lava_callback - INFO - Starting async job submit for node 68d3fddccd36afa834e15788 2025-09-26 13:48:38,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:48:38,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fddccd36afa834e15788 HTTP/1.1" 200 None 2025-09-26 13:48:38,556 - lava_callback - DEBUG - Processing node 68d3fddccd36afa834e15788: baseline-arm64 2025-09-26 13:48:38,957 - lava_callback - ERROR - Error processing callback for node 68d3fddccd36afa834e15788: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:48:40,674 - lava_callback - INFO - Received callback for node 68d6938e2f83206171a91d29 INFO: 172.20.0.1:60982 - "POST /node/68d6938e2f83206171a91d29 HTTP/1.0" 202 Accepted 2025-09-26 13:48:40,680 - lava_callback - INFO - Starting async job submit for node 68d6938e2f83206171a91d29 2025-09-26 13:48:40,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:48:40,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6938e2f83206171a91d29 HTTP/1.1" 200 None 2025-09-26 13:48:40,714 - lava_callback - DEBUG - Processing node 68d6938e2f83206171a91d29: baseline-arm64 2025-09-26 13:48:40,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:48:41,090 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:48:41,091 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6938e2f83206171a91d29/log.txt.gz 2025-09-26 13:48:41,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:48:41,217 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:48:41,218 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6938e2f83206171a91d29/lava_callback.json.gz 2025-09-26 13:48:41,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:48:41,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6938e2f83206171a91d29 HTTP/1.1" 200 None 2025-09-26 13:48:41,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:48:41,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:48:41,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:48:41,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6938e2f83206171a91d29 HTTP/1.1" 200 None 2025-09-26 13:48:41,297 - lava_callback - INFO - Completed processing callback for node 68d6938e2f83206171a91d29 INFO: 172.20.0.1:60998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39780 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:49:09,710 - lava_callback - INFO - Received callback for node 68d6936e2f83206171a91cef INFO: 172.20.0.1:41974 - "POST /node/68d6936e2f83206171a91cef HTTP/1.0" 202 Accepted 2025-09-26 13:49:09,716 - lava_callback - INFO - Starting async job submit for node 68d6936e2f83206171a91cef 2025-09-26 13:49:09,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:49:09,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6936e2f83206171a91cef HTTP/1.1" 200 None 2025-09-26 13:49:09,747 - lava_callback - DEBUG - Processing node 68d6936e2f83206171a91cef: baseline-arm64 2025-09-26 13:49:10,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:49:10,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:49:10,380 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6936e2f83206171a91cef/log.txt.gz 2025-09-26 13:49:10,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:49:10,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:49:10,525 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6936e2f83206171a91cef/lava_callback.json.gz 2025-09-26 13:49:10,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:49:10,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6936e2f83206171a91cef HTTP/1.1" 200 None 2025-09-26 13:49:10,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:49:10,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:49:10,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:49:10,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6936e2f83206171a91cef HTTP/1.1" 200 None 2025-09-26 13:49:10,611 - lava_callback - INFO - Completed processing callback for node 68d6936e2f83206171a91cef INFO: 172.20.0.1:41990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39302 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:49:33,985 - lava_callback - INFO - Received callback for node 68d3fdddcd36afa834e1578b INFO: 172.20.0.1:54820 - "POST /node/68d3fdddcd36afa834e1578b HTTP/1.0" 202 Accepted 2025-09-26 13:49:33,991 - lava_callback - INFO - Starting async job submit for node 68d3fdddcd36afa834e1578b 2025-09-26 13:49:34,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:49:34,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fdddcd36afa834e1578b HTTP/1.1" 200 None 2025-09-26 13:49:34,024 - lava_callback - DEBUG - Processing node 68d3fdddcd36afa834e1578b: baseline-arm64 2025-09-26 13:49:34,336 - lava_callback - ERROR - Error processing callback for node 68d3fdddcd36afa834e1578b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:49:35,079 - lava_callback - INFO - Received callback for node 68d40090cd36afa834e15ad3 INFO: 172.20.0.1:54834 - "POST /node/68d40090cd36afa834e15ad3 HTTP/1.0" 202 Accepted 2025-09-26 13:49:35,086 - lava_callback - INFO - Starting async job submit for node 68d40090cd36afa834e15ad3 2025-09-26 13:49:35,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:49:35,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40090cd36afa834e15ad3 HTTP/1.1" 200 None 2025-09-26 13:49:35,204 - lava_callback - DEBUG - Processing node 68d40090cd36afa834e15ad3: ltp-fs-bind 2025-09-26 13:49:35,731 - lava_callback - ERROR - Error processing callback for node 68d40090cd36afa834e15ad3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:49:36,191 - lava_callback - INFO - Received callback for node 68d6936e2f83206171a91cf2 INFO: 172.20.0.1:54846 - "POST /node/68d6936e2f83206171a91cf2 HTTP/1.0" 202 Accepted 2025-09-26 13:49:36,197 - lava_callback - INFO - Starting async job submit for node 68d6936e2f83206171a91cf2 2025-09-26 13:49:36,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:49:36,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6936e2f83206171a91cf2 HTTP/1.1" 200 None 2025-09-26 13:49:36,228 - lava_callback - DEBUG - Processing node 68d6936e2f83206171a91cf2: baseline-arm64 INFO: 172.20.0.1:54858 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:49:36,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:49:36,708 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:49:36,708 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6936e2f83206171a91cf2/log.txt.gz 2025-09-26 13:49:36,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:49:36,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:49:36,865 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6936e2f83206171a91cf2/lava_callback.json.gz 2025-09-26 13:49:36,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:49:36,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6936e2f83206171a91cf2 HTTP/1.1" 200 None 2025-09-26 13:49:36,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:49:36,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:49:36,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:49:36,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6936e2f83206171a91cf2 HTTP/1.1" 200 None 2025-09-26 13:49:36,973 - lava_callback - INFO - Completed processing callback for node 68d6936e2f83206171a91cf2 2025-09-26 13:49:40,755 - lava_callback - INFO - Received callback for node 68d6938f2f83206171a91d2c INFO: 172.20.0.1:50904 - "POST /node/68d6938f2f83206171a91d2c HTTP/1.0" 202 Accepted 2025-09-26 13:49:40,761 - lava_callback - INFO - Starting async job submit for node 68d6938f2f83206171a91d2c 2025-09-26 13:49:40,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:49:40,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6938f2f83206171a91d2c HTTP/1.1" 200 None 2025-09-26 13:49:40,796 - lava_callback - DEBUG - Processing node 68d6938f2f83206171a91d2c: baseline-arm64 2025-09-26 13:49:41,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:49:41,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:49:41,170 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6938f2f83206171a91d2c/log.txt.gz 2025-09-26 13:49:41,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:49:41,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:49:41,287 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6938f2f83206171a91d2c/lava_callback.json.gz 2025-09-26 13:49:41,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:49:41,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6938f2f83206171a91d2c HTTP/1.1" 200 None 2025-09-26 13:49:41,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:49:41,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:49:41,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:49:41,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6938f2f83206171a91d2c HTTP/1.1" 200 None 2025-09-26 13:49:41,362 - lava_callback - INFO - Completed processing callback for node 68d6938f2f83206171a91d2c 2025-09-26 13:49:43,808 - lava_callback - INFO - Received callback for node 68d3fde5cd36afa834e15795 INFO: 172.20.0.1:50910 - "POST /node/68d3fde5cd36afa834e15795 HTTP/1.0" 202 Accepted 2025-09-26 13:49:43,814 - lava_callback - INFO - Starting async job submit for node 68d3fde5cd36afa834e15795 2025-09-26 13:49:43,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:49:43,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fde5cd36afa834e15795 HTTP/1.1" 200 None 2025-09-26 13:49:43,866 - lava_callback - DEBUG - Processing node 68d3fde5cd36afa834e15795: baseline-arm64 2025-09-26 13:49:44,182 - lava_callback - ERROR - Error processing callback for node 68d3fde5cd36afa834e15795: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:50916 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:49:48,768 - lava_callback - INFO - Received callback for node 68d693c42f83206171a91d93 INFO: 172.20.0.1:50924 - "POST /node/68d693c42f83206171a91d93 HTTP/1.0" 202 Accepted 2025-09-26 13:49:48,774 - lava_callback - INFO - Starting async job submit for node 68d693c42f83206171a91d93 2025-09-26 13:49:48,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:49:48,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693c42f83206171a91d93 HTTP/1.1" 200 None 2025-09-26 13:49:48,807 - lava_callback - DEBUG - Processing node 68d693c42f83206171a91d93: baseline-arm64 2025-09-26 13:49:49,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:49:49,191 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:49:49,192 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693c42f83206171a91d93/log.txt.gz 2025-09-26 13:49:49,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:49:49,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:49:49,306 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693c42f83206171a91d93/lava_callback.json.gz 2025-09-26 13:49:49,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:49:49,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693c42f83206171a91d93 HTTP/1.1" 200 None 2025-09-26 13:49:49,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:49:49,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:49:49,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:49:49,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693c42f83206171a91d93 HTTP/1.1" 200 None 2025-09-26 13:49:49,381 - lava_callback - INFO - Completed processing callback for node 68d693c42f83206171a91d93 INFO: 172.20.0.1:57856 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:49:58,218 - lava_callback - INFO - Received callback for node 68d3fde8cd36afa834e15798 INFO: 172.20.0.1:57858 - "POST /node/68d3fde8cd36afa834e15798 HTTP/1.0" 202 Accepted 2025-09-26 13:49:58,224 - lava_callback - INFO - Starting async job submit for node 68d3fde8cd36afa834e15798 2025-09-26 13:49:58,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:49:58,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fde8cd36afa834e15798 HTTP/1.1" 200 None 2025-09-26 13:49:58,258 - lava_callback - DEBUG - Processing node 68d3fde8cd36afa834e15798: baseline-arm64 2025-09-26 13:49:58,573 - lava_callback - ERROR - Error processing callback for node 68d3fde8cd36afa834e15798: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:50:01,108 - lava_callback - INFO - Received callback for node 68d693c52f83206171a91d96 INFO: 172.20.0.1:59218 - "POST /node/68d693c52f83206171a91d96 HTTP/1.0" 202 Accepted 2025-09-26 13:50:01,114 - lava_callback - INFO - Starting async job submit for node 68d693c52f83206171a91d96 2025-09-26 13:50:01,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:50:01,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693c52f83206171a91d96 HTTP/1.1" 200 None 2025-09-26 13:50:01,150 - lava_callback - DEBUG - Processing node 68d693c52f83206171a91d96: baseline-arm64 2025-09-26 13:50:01,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:50:01,547 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:50:01,547 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693c52f83206171a91d96/log.txt.gz 2025-09-26 13:50:01,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:50:01,662 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:50:01,663 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693c52f83206171a91d96/lava_callback.json.gz 2025-09-26 13:50:01,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:50:01,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693c52f83206171a91d96 HTTP/1.1" 200 None 2025-09-26 13:50:01,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:50:01,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:50:01,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:50:01,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693c52f83206171a91d96 HTTP/1.1" 200 None 2025-09-26 13:50:01,742 - lava_callback - INFO - Completed processing callback for node 68d693c52f83206171a91d96 2025-09-26 13:50:02,438 - lava_callback - INFO - Received callback for node 68d42820a5c2c05277bc752c INFO: 172.20.0.1:59232 - "POST /node/68d42820a5c2c05277bc752c HTTP/1.0" 202 Accepted 2025-09-26 13:50:02,443 - lava_callback - INFO - Starting async job submit for node 68d42820a5c2c05277bc752c 2025-09-26 13:50:02,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:50:02,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42820a5c2c05277bc752c HTTP/1.1" 200 None 2025-09-26 13:50:02,476 - lava_callback - DEBUG - Processing node 68d42820a5c2c05277bc752c: baseline-arm 2025-09-26 13:50:02,702 - lava_callback - ERROR - Error processing callback for node 68d42820a5c2c05277bc752c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:59236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59238 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:50:09,703 - lava_callback - INFO - Received callback for node 68d690802f83206171a91b96 INFO: 172.20.0.1:35938 - "POST /node/68d690802f83206171a91b96 HTTP/1.0" 202 Accepted 2025-09-26 13:50:09,709 - lava_callback - INFO - Starting async job submit for node 68d690802f83206171a91b96 2025-09-26 13:50:09,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:50:09,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690802f83206171a91b96 HTTP/1.1" 200 None 2025-09-26 13:50:09,745 - lava_callback - DEBUG - Processing node 68d690802f83206171a91b96: baseline-arm 2025-09-26 13:50:09,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:50:10,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:50:10,029 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d690802f83206171a91b96/log.txt.gz 2025-09-26 13:50:10,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:50:10,147 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:50:10,148 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d690802f83206171a91b96/lava_callback.json.gz 2025-09-26 13:50:10,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:50:10,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690802f83206171a91b96 HTTP/1.1" 200 None 2025-09-26 13:50:10,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:50:10,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6373d5d233c363a761c18 HTTP/1.1" 200 None 2025-09-26 13:50:10,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:50:10,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690802f83206171a91b96 HTTP/1.1" 200 None 2025-09-26 13:50:10,249 - lava_callback - INFO - Completed processing callback for node 68d690802f83206171a91b96 INFO: 172.20.0.1:35952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45210 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:50:51,222 - lava_callback - INFO - Received callback for node 68d4008ccd36afa834e15ac7 INFO: 172.20.0.1:43194 - "POST /node/68d4008ccd36afa834e15ac7 HTTP/1.0" 202 Accepted 2025-09-26 13:50:51,233 - lava_callback - INFO - Starting async job submit for node 68d4008ccd36afa834e15ac7 2025-09-26 13:50:51,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:50:51,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4008ccd36afa834e15ac7 HTTP/1.1" 200 None 2025-09-26 13:50:51,442 - lava_callback - DEBUG - Processing node 68d4008ccd36afa834e15ac7: ltp-controllers 2025-09-26 13:50:52,569 - lava_callback - INFO - Received callback for node 68d693712f83206171a91cf5 INFO: 172.20.0.1:43202 - "POST /node/68d693712f83206171a91cf5 HTTP/1.0" 202 Accepted 2025-09-26 13:50:52,601 - lava_callback - INFO - Starting async job submit for node 68d693712f83206171a91cf5 2025-09-26 13:50:52,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:50:52,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693712f83206171a91cf5 HTTP/1.1" 200 None 2025-09-26 13:50:52,724 - lava_callback - DEBUG - Processing node 68d693712f83206171a91cf5: baseline-arm64 2025-09-26 13:50:53,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:50:53,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:50:53,830 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693712f83206171a91cf5/log.txt.gz 2025-09-26 13:50:53,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:50:54,072 - lava_callback - ERROR - Error processing callback for node 68d4008ccd36afa834e15ac7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:50:54,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:50:54,113 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693712f83206171a91cf5/lava_callback.json.gz 2025-09-26 13:50:54,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:50:54,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693712f83206171a91cf5 HTTP/1.1" 200 None 2025-09-26 13:50:54,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:50:54,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:50:54,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:50:54,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693712f83206171a91cf5 HTTP/1.1" 200 None 2025-09-26 13:50:54,208 - lava_callback - INFO - Completed processing callback for node 68d693712f83206171a91cf5 INFO: 172.20.0.1:43212 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:51:04,214 - lava_callback - INFO - Received callback for node 68d693c72f83206171a91d99 INFO: 172.20.0.1:55522 - "POST /node/68d693c72f83206171a91d99 HTTP/1.0" 202 Accepted 2025-09-26 13:51:04,220 - lava_callback - INFO - Starting async job submit for node 68d693c72f83206171a91d99 2025-09-26 13:51:04,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:04,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693c72f83206171a91d99 HTTP/1.1" 200 None 2025-09-26 13:51:04,253 - lava_callback - DEBUG - Processing node 68d693c72f83206171a91d99: baseline-arm64 2025-09-26 13:51:04,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:51:04,665 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:51:04,665 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693c72f83206171a91d99/log.txt.gz 2025-09-26 13:51:04,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:51:04,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:51:04,778 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693c72f83206171a91d99/lava_callback.json.gz 2025-09-26 13:51:04,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:04,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693c72f83206171a91d99 HTTP/1.1" 200 None 2025-09-26 13:51:04,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:04,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:51:04,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:04,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693c72f83206171a91d99 HTTP/1.1" 200 None 2025-09-26 13:51:04,878 - lava_callback - INFO - Completed processing callback for node 68d693c72f83206171a91d99 INFO: 172.20.0.1:55534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55538 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:51:08,497 - lava_callback - INFO - Received callback for node 68d693722f83206171a91cf8 INFO: 172.20.0.1:55546 - "POST /node/68d693722f83206171a91cf8 HTTP/1.0" 202 Accepted 2025-09-26 13:51:08,503 - lava_callback - INFO - Starting async job submit for node 68d693722f83206171a91cf8 2025-09-26 13:51:08,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:08,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693722f83206171a91cf8 HTTP/1.1" 200 None 2025-09-26 13:51:08,534 - lava_callback - DEBUG - Processing node 68d693722f83206171a91cf8: baseline-arm64 2025-09-26 13:51:08,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:51:08,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:51:09,000 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693722f83206171a91cf8/log.txt.gz 2025-09-26 13:51:09,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:51:09,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:51:09,139 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693722f83206171a91cf8/lava_callback.json.gz 2025-09-26 13:51:09,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:09,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693722f83206171a91cf8 HTTP/1.1" 200 None 2025-09-26 13:51:09,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:09,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:51:09,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:09,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693722f83206171a91cf8 HTTP/1.1" 200 None 2025-09-26 13:51:09,213 - lava_callback - INFO - Completed processing callback for node 68d693722f83206171a91cf8 INFO: 172.20.0.1:43920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48310 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:51:26,363 - lava_callback - INFO - Received callback for node 68d694932f83206171a91ebc INFO: 172.20.0.1:48316 - "POST /node/68d694932f83206171a91ebc HTTP/1.0" 202 Accepted 2025-09-26 13:51:26,369 - lava_callback - INFO - Starting async job submit for node 68d694932f83206171a91ebc 2025-09-26 13:51:26,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:26,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694932f83206171a91ebc HTTP/1.1" 200 None 2025-09-26 13:51:26,402 - lava_callback - DEBUG - Processing node 68d694932f83206171a91ebc: baseline-arm64 INFO: 172.20.0.1:48328 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:51:26,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:51:26,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:51:26,785 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694932f83206171a91ebc/log.txt.gz 2025-09-26 13:51:26,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:51:26,896 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:51:26,897 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694932f83206171a91ebc/lava_callback.json.gz 2025-09-26 13:51:26,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:26,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694932f83206171a91ebc HTTP/1.1" 200 None 2025-09-26 13:51:26,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:26,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:51:26,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:26,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694932f83206171a91ebc HTTP/1.1" 200 None 2025-09-26 13:51:26,982 - lava_callback - INFO - Completed processing callback for node 68d694932f83206171a91ebc 2025-09-26 13:51:28,456 - lava_callback - INFO - Received callback for node 68d693c82f83206171a91da6 INFO: 172.20.0.1:48334 - "POST /node/68d693c82f83206171a91da6 HTTP/1.0" 202 Accepted 2025-09-26 13:51:28,461 - lava_callback - INFO - Starting async job submit for node 68d693c82f83206171a91da6 2025-09-26 13:51:28,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:28,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693c82f83206171a91da6 HTTP/1.1" 200 None 2025-09-26 13:51:28,494 - lava_callback - DEBUG - Processing node 68d693c82f83206171a91da6: baseline-arm64 2025-09-26 13:51:28,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:51:28,871 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:51:28,872 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693c82f83206171a91da6/log.txt.gz 2025-09-26 13:51:28,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:51:28,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:51:28,987 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693c82f83206171a91da6/lava_callback.json.gz 2025-09-26 13:51:29,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:29,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693c82f83206171a91da6 HTTP/1.1" 200 None 2025-09-26 13:51:29,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:29,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:51:29,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:29,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693c82f83206171a91da6 HTTP/1.1" 200 None 2025-09-26 13:51:29,092 - lava_callback - INFO - Completed processing callback for node 68d693c82f83206171a91da6 2025-09-26 13:51:30,686 - lava_callback - INFO - Received callback for node 68d479b4a5c2c05277bccf4b INFO: 172.20.0.1:42690 - "POST /node/68d479b4a5c2c05277bccf4b HTTP/1.0" 202 Accepted 2025-09-26 13:51:30,691 - lava_callback - INFO - Starting async job submit for node 68d479b4a5c2c05277bccf4b 2025-09-26 13:51:30,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:30,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d479b4a5c2c05277bccf4b HTTP/1.1" 200 None 2025-09-26 13:51:30,721 - lava_callback - DEBUG - Processing node 68d479b4a5c2c05277bccf4b: baseline-arm64-broonie 2025-09-26 13:51:31,020 - lava_callback - ERROR - Error processing callback for node 68d479b4a5c2c05277bccf4b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:51:31,118 - lava_callback - INFO - Received callback for node 68d68eae2f83206171a919a4 INFO: 172.20.0.1:42704 - "POST /node/68d68eae2f83206171a919a4 HTTP/1.0" 202 Accepted 2025-09-26 13:51:31,125 - lava_callback - INFO - Starting async job submit for node 68d68eae2f83206171a919a4 2025-09-26 13:51:31,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:31,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68eae2f83206171a919a4 HTTP/1.1" 200 None 2025-09-26 13:51:31,180 - lava_callback - DEBUG - Processing node 68d68eae2f83206171a919a4: baseline-arm64 2025-09-26 13:51:32,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:51:32,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:51:32,316 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68eae2f83206171a919a4/log.txt.gz 2025-09-26 13:51:32,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:51:32,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:51:32,492 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68eae2f83206171a919a4/lava_callback.json.gz DEBUG: Setup failed for 68d68eae2f83206171a919a4. Transitting job node result: incomplete -> fail 2025-09-26 13:51:32,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:32,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68eae2f83206171a919a4 HTTP/1.1" 200 None 2025-09-26 13:51:32,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:32,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 13:51:32,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:32,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68eae2f83206171a919a4 HTTP/1.1" 200 None 2025-09-26 13:51:32,811 - lava_callback - INFO - Completed processing callback for node 68d68eae2f83206171a919a4 INFO: 172.20.0.1:42708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36178 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:51:50,866 - lava_callback - INFO - Received callback for node 68d3f763cd36afa834e14ab1 INFO: 172.20.0.1:53296 - "POST /node/68d3f763cd36afa834e14ab1 HTTP/1.0" 202 Accepted 2025-09-26 13:51:50,872 - lava_callback - INFO - Starting async job submit for node 68d3f763cd36afa834e14ab1 2025-09-26 13:51:50,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:50,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f763cd36afa834e14ab1 HTTP/1.1" 200 None 2025-09-26 13:51:50,887 - lava_callback - DEBUG - Processing node 68d3f763cd36afa834e14ab1: baseline-arm64-baylibre 2025-09-26 13:51:50,887 - lava_callback - ERROR - Error processing callback for node 68d3f763cd36afa834e14ab1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:53312 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:51:56,743 - lava_callback - INFO - Received callback for node 68d685282f83206171a91339 INFO: 172.20.0.1:53314 - "POST /node/68d685282f83206171a91339 HTTP/1.0" 202 Accepted 2025-09-26 13:51:56,749 - lava_callback - INFO - Starting async job submit for node 68d685282f83206171a91339 2025-09-26 13:51:56,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:56,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d685282f83206171a91339 HTTP/1.1" 200 None 2025-09-26 13:51:56,791 - lava_callback - DEBUG - Processing node 68d685282f83206171a91339: baseline-x86-kcidebug-intel 2025-09-26 13:51:57,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:51:57,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:51:57,182 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d685282f83206171a91339/log.txt.gz 2025-09-26 13:51:57,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:51:57,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:51:57,306 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d685282f83206171a91339/lava_callback.json.gz DEBUG: Setup failed for 68d685282f83206171a91339. Transitting job node result: incomplete -> fail 2025-09-26 13:51:57,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:57,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d685282f83206171a91339 HTTP/1.1" 200 None 2025-09-26 13:51:57,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:57,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8d92be2da466069ac1b HTTP/1.1" 200 None 2025-09-26 13:51:57,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:51:57,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d685282f83206171a91339 HTTP/1.1" 200 None 2025-09-26 13:51:57,423 - lava_callback - INFO - Completed processing callback for node 68d685282f83206171a91339 INFO: 172.20.0.1:53794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51934 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:52:21,269 - lava_callback - INFO - Received callback for node 68d693bf2f83206171a91d8a INFO: 172.20.0.1:45356 - "POST /node/68d693bf2f83206171a91d8a HTTP/1.0" 202 Accepted 2025-09-26 13:52:21,275 - lava_callback - INFO - Starting async job submit for node 68d693bf2f83206171a91d8a 2025-09-26 13:52:21,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:52:21,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693bf2f83206171a91d8a HTTP/1.1" 200 None 2025-09-26 13:52:21,306 - lava_callback - DEBUG - Processing node 68d693bf2f83206171a91d8a: baseline-arm64 2025-09-26 13:52:21,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:52:21,766 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:52:21,767 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693bf2f83206171a91d8a/log.txt.gz 2025-09-26 13:52:21,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:52:21,924 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:52:21,925 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693bf2f83206171a91d8a/lava_callback.json.gz 2025-09-26 13:52:21,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:52:21,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693bf2f83206171a91d8a HTTP/1.1" 200 None 2025-09-26 13:52:21,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:52:21,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:52:21,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:52:22,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693bf2f83206171a91d8a HTTP/1.1" 200 None 2025-09-26 13:52:22,006 - lava_callback - INFO - Completed processing callback for node 68d693bf2f83206171a91d8a 2025-09-26 13:52:23,698 - lava_callback - INFO - Received callback for node 68d4293ca5c2c05277bc76f9 INFO: 172.20.0.1:45364 - "POST /node/68d4293ca5c2c05277bc76f9 HTTP/1.0" 202 Accepted 2025-09-26 13:52:23,704 - lava_callback - INFO - Starting async job submit for node 68d4293ca5c2c05277bc76f9 2025-09-26 13:52:23,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:52:23,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4293ca5c2c05277bc76f9 HTTP/1.1" 200 None 2025-09-26 13:52:23,738 - lava_callback - DEBUG - Processing node 68d4293ca5c2c05277bc76f9: baseline-arm 2025-09-26 13:52:23,959 - lava_callback - ERROR - Error processing callback for node 68d4293ca5c2c05277bc76f9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:45372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45374 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:52:30,443 - lava_callback - INFO - Received callback for node 68d693be2f83206171a91d87 INFO: 172.20.0.1:44906 - "POST /node/68d693be2f83206171a91d87 HTTP/1.0" 202 Accepted 2025-09-26 13:52:30,449 - lava_callback - INFO - Starting async job submit for node 68d693be2f83206171a91d87 2025-09-26 13:52:30,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:52:30,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693be2f83206171a91d87 HTTP/1.1" 200 None 2025-09-26 13:52:30,490 - lava_callback - DEBUG - Processing node 68d693be2f83206171a91d87: baseline-arm64 2025-09-26 13:52:30,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:52:30,861 - lava_callback - INFO - Received callback for node 68d3f799cd36afa834e14b21 INFO: 172.20.0.1:44920 - "POST /node/68d3f799cd36afa834e14b21 HTTP/1.0" 202 Accepted 2025-09-26 13:52:30,866 - lava_callback - INFO - Starting async job submit for node 68d3f799cd36afa834e14b21 2025-09-26 13:52:30,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:52:30,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f799cd36afa834e14b21 HTTP/1.1" 200 None 2025-09-26 13:52:30,880 - lava_callback - DEBUG - Processing node 68d3f799cd36afa834e14b21: baseline-arm64-baylibre 2025-09-26 13:52:30,880 - lava_callback - ERROR - Error processing callback for node 68d3f799cd36afa834e14b21: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 13:52:31,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:52:31,082 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693be2f83206171a91d87/log.txt.gz 2025-09-26 13:52:31,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:52:31,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:52:31,209 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693be2f83206171a91d87/lava_callback.json.gz 2025-09-26 13:52:31,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:52:31,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693be2f83206171a91d87 HTTP/1.1" 200 None 2025-09-26 13:52:31,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:52:31,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:52:31,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:52:31,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693be2f83206171a91d87 HTTP/1.1" 200 None 2025-09-26 13:52:31,283 - lava_callback - INFO - Completed processing callback for node 68d693be2f83206171a91d87 INFO: 172.20.0.1:44922 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:52:44,111 - lava_callback - INFO - Received callback for node 68d68fcc2f83206171a91a0c INFO: 172.20.0.1:33458 - "POST /node/68d68fcc2f83206171a91a0c HTTP/1.0" 202 Accepted 2025-09-26 13:52:44,118 - lava_callback - INFO - Starting async job submit for node 68d68fcc2f83206171a91a0c 2025-09-26 13:52:44,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:52:44,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fcc2f83206171a91a0c HTTP/1.1" 200 None 2025-09-26 13:52:44,160 - lava_callback - DEBUG - Processing node 68d68fcc2f83206171a91a0c: baseline-arm64 2025-09-26 13:52:44,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:52:44,924 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:52:44,925 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fcc2f83206171a91a0c/log.txt.gz 2025-09-26 13:52:44,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:52:45,078 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:52:45,078 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fcc2f83206171a91a0c/lava_callback.json.gz DEBUG: 68d68fcc2f83206171a91a0c Transitting job node result: pass -> incomplete 2025-09-26 13:52:45,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:52:45,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fcc2f83206171a91a0c HTTP/1.1" 200 None 2025-09-26 13:52:45,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:52:45,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:52:45,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:52:45,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68fcc2f83206171a91a0c HTTP/1.1" 200 None 2025-09-26 13:52:45,177 - lava_callback - INFO - Completed processing callback for node 68d68fcc2f83206171a91a0c INFO: 172.20.0.1:33462 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:52:47,532 - lava_callback - INFO - Received callback for node 68d694942f83206171a91ebf INFO: 172.20.0.1:33476 - "POST /node/68d694942f83206171a91ebf HTTP/1.0" 202 Accepted 2025-09-26 13:52:47,538 - lava_callback - INFO - Starting async job submit for node 68d694942f83206171a91ebf 2025-09-26 13:52:47,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:52:47,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694942f83206171a91ebf HTTP/1.1" 200 None 2025-09-26 13:52:47,576 - lava_callback - DEBUG - Processing node 68d694942f83206171a91ebf: baseline-arm64 2025-09-26 13:52:47,701 - lava_callback - INFO - Received callback for node 68d693c12f83206171a91d8d INFO: 172.20.0.1:33484 - "POST /node/68d693c12f83206171a91d8d HTTP/1.0" 202 Accepted 2025-09-26 13:52:47,724 - lava_callback - INFO - Starting async job submit for node 68d693c12f83206171a91d8d 2025-09-26 13:52:47,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:52:47,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693c12f83206171a91d8d HTTP/1.1" 200 None 2025-09-26 13:52:47,868 - lava_callback - DEBUG - Processing node 68d693c12f83206171a91d8d: baseline-arm64 2025-09-26 13:52:48,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:52:48,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:52:48,379 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694942f83206171a91ebf/log.txt.gz 2025-09-26 13:52:48,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:52:48,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:52:48,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:52:48,580 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693c12f83206171a91d8d/log.txt.gz 2025-09-26 13:52:48,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:52:48,632 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:52:48,633 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694942f83206171a91ebf/lava_callback.json.gz 2025-09-26 13:52:48,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:52:48,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694942f83206171a91ebf HTTP/1.1" 200 None 2025-09-26 13:52:48,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:52:48,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:52:48,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:52:48,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694942f83206171a91ebf HTTP/1.1" 200 None 2025-09-26 13:52:48,712 - lava_callback - INFO - Completed processing callback for node 68d694942f83206171a91ebf 2025-09-26 13:52:48,747 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:52:48,748 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693c12f83206171a91d8d/lava_callback.json.gz 2025-09-26 13:52:48,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:52:48,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693c12f83206171a91d8d HTTP/1.1" 200 None 2025-09-26 13:52:48,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:52:48,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:52:48,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:52:48,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693c12f83206171a91d8d HTTP/1.1" 200 None 2025-09-26 13:52:48,850 - lava_callback - INFO - Completed processing callback for node 68d693c12f83206171a91d8d INFO: 172.20.0.1:47462 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:53:01,099 - lava_callback - INFO - Received callback for node 68d694b02f83206171a91ef9 INFO: 172.20.0.1:37010 - "POST /node/68d694b02f83206171a91ef9 HTTP/1.0" 202 Accepted 2025-09-26 13:53:01,105 - lava_callback - INFO - Starting async job submit for node 68d694b02f83206171a91ef9 2025-09-26 13:53:01,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:53:01,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694b02f83206171a91ef9 HTTP/1.1" 200 None 2025-09-26 13:53:01,162 - lava_callback - DEBUG - Processing node 68d694b02f83206171a91ef9: baseline-arm64 2025-09-26 13:53:01,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:53:01,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:53:01,580 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694b02f83206171a91ef9/log.txt.gz 2025-09-26 13:53:01,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:53:01,707 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:53:01,708 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694b02f83206171a91ef9/lava_callback.json.gz 2025-09-26 13:53:01,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:53:01,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694b02f83206171a91ef9 HTTP/1.1" 200 None 2025-09-26 13:53:01,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:53:01,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:53:01,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:53:01,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694b02f83206171a91ef9 HTTP/1.1" 200 None 2025-09-26 13:53:01,784 - lava_callback - INFO - Completed processing callback for node 68d694b02f83206171a91ef9 2025-09-26 13:53:02,080 - lava_callback - INFO - Received callback for node 68d68fcf2f83206171a91a12 INFO: 172.20.0.1:37014 - "POST /node/68d68fcf2f83206171a91a12 HTTP/1.0" 202 Accepted 2025-09-26 13:53:02,087 - lava_callback - INFO - Starting async job submit for node 68d68fcf2f83206171a91a12 2025-09-26 13:53:02,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:53:02,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fcf2f83206171a91a12 HTTP/1.1" 200 None 2025-09-26 13:53:02,120 - lava_callback - DEBUG - Processing node 68d68fcf2f83206171a91a12: baseline-arm64 2025-09-26 13:53:02,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:53:02,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:53:02,597 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fcf2f83206171a91a12/log.txt.gz 2025-09-26 13:53:02,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:53:02,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:53:02,717 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fcf2f83206171a91a12/lava_callback.json.gz 2025-09-26 13:53:02,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:53:02,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fcf2f83206171a91a12 HTTP/1.1" 200 None 2025-09-26 13:53:02,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:53:02,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:53:02,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:53:02,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68fcf2f83206171a91a12 HTTP/1.1" 200 None 2025-09-26 13:53:02,797 - lava_callback - INFO - Completed processing callback for node 68d68fcf2f83206171a91a12 INFO: 172.20.0.1:37016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37026 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:53:08,416 - lava_callback - INFO - Received callback for node 68d694b02f83206171a91ef6 INFO: 172.20.0.1:37030 - "POST /node/68d694b02f83206171a91ef6 HTTP/1.0" 202 Accepted 2025-09-26 13:53:08,422 - lava_callback - INFO - Starting async job submit for node 68d694b02f83206171a91ef6 2025-09-26 13:53:08,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:53:08,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694b02f83206171a91ef6 HTTP/1.1" 200 None 2025-09-26 13:53:08,455 - lava_callback - DEBUG - Processing node 68d694b02f83206171a91ef6: baseline-arm64 2025-09-26 13:53:08,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:53:08,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:53:08,852 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694b02f83206171a91ef6/log.txt.gz 2025-09-26 13:53:08,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:53:08,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:53:08,969 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694b02f83206171a91ef6/lava_callback.json.gz 2025-09-26 13:53:08,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:53:09,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694b02f83206171a91ef6 HTTP/1.1" 200 None 2025-09-26 13:53:09,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:53:09,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:53:09,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:53:09,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694b02f83206171a91ef6 HTTP/1.1" 200 None 2025-09-26 13:53:09,053 - lava_callback - INFO - Completed processing callback for node 68d694b02f83206171a91ef6 2025-09-26 13:53:09,863 - lava_callback - INFO - Received callback for node 68d68fd02f83206171a91a15 INFO: 172.20.0.1:39214 - "POST /node/68d68fd02f83206171a91a15 HTTP/1.0" 202 Accepted 2025-09-26 13:53:09,870 - lava_callback - INFO - Starting async job submit for node 68d68fd02f83206171a91a15 2025-09-26 13:53:09,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:53:09,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fd02f83206171a91a15 HTTP/1.1" 200 None 2025-09-26 13:53:09,903 - lava_callback - DEBUG - Processing node 68d68fd02f83206171a91a15: baseline-arm64 2025-09-26 13:53:10,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:53:10,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:53:10,353 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fd02f83206171a91a15/log.txt.gz 2025-09-26 13:53:10,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:53:10,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:53:10,483 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fd02f83206171a91a15/lava_callback.json.gz 2025-09-26 13:53:10,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:53:10,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fd02f83206171a91a15 HTTP/1.1" 200 None 2025-09-26 13:53:10,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:53:10,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:53:10,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:53:10,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68fd02f83206171a91a15 HTTP/1.1" 200 None 2025-09-26 13:53:10,557 - lava_callback - INFO - Completed processing callback for node 68d68fd02f83206171a91a15 2025-09-26 13:53:12,104 - lava_callback - INFO - Received callback for node 68d68fcd2f83206171a91a0f INFO: 172.20.0.1:39218 - "POST /node/68d68fcd2f83206171a91a0f HTTP/1.0" 202 Accepted 2025-09-26 13:53:12,110 - lava_callback - INFO - Starting async job submit for node 68d68fcd2f83206171a91a0f 2025-09-26 13:53:12,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:53:12,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fcd2f83206171a91a0f HTTP/1.1" 200 None 2025-09-26 13:53:12,151 - lava_callback - DEBUG - Processing node 68d68fcd2f83206171a91a0f: baseline-arm64 2025-09-26 13:53:12,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:53:13,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:53:13,087 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fcd2f83206171a91a0f/log.txt.gz 2025-09-26 13:53:13,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:53:13,210 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:53:13,210 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d68fcd2f83206171a91a0f/lava_callback.json.gz DEBUG: 68d68fcd2f83206171a91a0f Transitting job node result: pass -> incomplete 2025-09-26 13:53:13,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:53:13,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68fcd2f83206171a91a0f HTTP/1.1" 200 None 2025-09-26 13:53:13,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:53:13,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:53:13,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:53:13,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68fcd2f83206171a91a0f HTTP/1.1" 200 None 2025-09-26 13:53:13,304 - lava_callback - INFO - Completed processing callback for node 68d68fcd2f83206171a91a0f 2025-09-26 13:53:14,872 - lava_callback - INFO - Received callback for node 68d3fdc1cd36afa834e1576d INFO: 172.20.0.1:39228 - "POST /node/68d3fdc1cd36afa834e1576d HTTP/1.0" 202 Accepted 2025-09-26 13:53:14,882 - lava_callback - INFO - Starting async job submit for node 68d3fdc1cd36afa834e1576d 2025-09-26 13:53:14,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:53:14,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fdc1cd36afa834e1576d HTTP/1.1" 200 None 2025-09-26 13:53:14,933 - lava_callback - DEBUG - Processing node 68d3fdc1cd36afa834e1576d: baseline-arm64 INFO: 172.20.0.1:39236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39244 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:53:17,400 - lava_callback - ERROR - Error processing callback for node 68d3fdc1cd36afa834e1576d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:47116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47122 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:53:30,915 - lava_callback - INFO - Received callback for node 68d3f7d5cd36afa834e14b8d INFO: 172.20.0.1:44154 - "POST /node/68d3f7d5cd36afa834e14b8d HTTP/1.0" 202 Accepted 2025-09-26 13:53:30,920 - lava_callback - INFO - Starting async job submit for node 68d3f7d5cd36afa834e14b8d 2025-09-26 13:53:30,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:53:30,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3f7d5cd36afa834e14b8d HTTP/1.1" 200 None 2025-09-26 13:53:30,934 - lava_callback - DEBUG - Processing node 68d3f7d5cd36afa834e14b8d: baseline-arm64-baylibre 2025-09-26 13:53:30,934 - lava_callback - ERROR - Error processing callback for node 68d3f7d5cd36afa834e14b8d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:44168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54572 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:54:00,639 - lava_callback - INFO - Received callback for node 68d693c22f83206171a91d90 INFO: 172.20.0.1:58516 - "POST /node/68d693c22f83206171a91d90 HTTP/1.0" 202 Accepted 2025-09-26 13:54:00,645 - lava_callback - INFO - Starting async job submit for node 68d693c22f83206171a91d90 2025-09-26 13:54:00,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:00,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693c22f83206171a91d90 HTTP/1.1" 200 None 2025-09-26 13:54:00,677 - lava_callback - DEBUG - Processing node 68d693c22f83206171a91d90: baseline-arm64 2025-09-26 13:54:01,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:54:01,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:54:01,181 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693c22f83206171a91d90/log.txt.gz 2025-09-26 13:54:01,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:54:01,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:54:01,340 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693c22f83206171a91d90/lava_callback.json.gz 2025-09-26 13:54:01,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:01,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693c22f83206171a91d90 HTTP/1.1" 200 None 2025-09-26 13:54:01,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:01,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 13:54:01,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:01,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693c22f83206171a91d90 HTTP/1.1" 200 None 2025-09-26 13:54:01,441 - lava_callback - INFO - Completed processing callback for node 68d693c22f83206171a91d90 INFO: 172.20.0.1:58524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58532 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:54:06,913 - lava_callback - INFO - Received callback for node 68d694902f83206171a91eb6 INFO: 172.20.0.1:58546 - "POST /node/68d694902f83206171a91eb6 HTTP/1.0" 202 Accepted 2025-09-26 13:54:06,919 - lava_callback - INFO - Starting async job submit for node 68d694902f83206171a91eb6 2025-09-26 13:54:06,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:06,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694902f83206171a91eb6 HTTP/1.1" 200 None 2025-09-26 13:54:06,951 - lava_callback - DEBUG - Processing node 68d694902f83206171a91eb6: baseline-arm64 2025-09-26 13:54:07,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:54:07,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:54:07,447 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694902f83206171a91eb6/log.txt.gz 2025-09-26 13:54:07,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:54:07,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:54:07,584 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694902f83206171a91eb6/lava_callback.json.gz 2025-09-26 13:54:07,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:07,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694902f83206171a91eb6 HTTP/1.1" 200 None 2025-09-26 13:54:07,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:07,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:54:07,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:07,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694902f83206171a91eb6 HTTP/1.1" 200 None 2025-09-26 13:54:07,661 - lava_callback - INFO - Completed processing callback for node 68d694902f83206171a91eb6 2025-09-26 13:54:11,618 - lava_callback - INFO - Received callback for node 68d47ae4a5c2c05277bcd199 INFO: 172.20.0.1:37094 - "POST /node/68d47ae4a5c2c05277bcd199 HTTP/1.0" 202 Accepted 2025-09-26 13:54:11,623 - lava_callback - INFO - Starting async job submit for node 68d47ae4a5c2c05277bcd199 2025-09-26 13:54:11,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:11,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d47ae4a5c2c05277bcd199 HTTP/1.1" 200 None 2025-09-26 13:54:11,652 - lava_callback - DEBUG - Processing node 68d47ae4a5c2c05277bcd199: baseline-arm64-broonie 2025-09-26 13:54:11,947 - lava_callback - ERROR - Error processing callback for node 68d47ae4a5c2c05277bcd199: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:37096 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 13:54:15,374 - lava_callback - INFO - Received callback for node 68d4008ccd36afa834e15aca INFO: 172.20.0.1:37108 - "POST /node/68d4008ccd36afa834e15aca HTTP/1.0" 202 Accepted 2025-09-26 13:54:15,381 - lava_callback - INFO - Starting async job submit for node 68d4008ccd36afa834e15aca 2025-09-26 13:54:15,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:15,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4008ccd36afa834e15aca HTTP/1.1" 200 None 2025-09-26 13:54:15,499 - lava_callback - DEBUG - Processing node 68d4008ccd36afa834e15aca: ltp-cve 2025-09-26 13:54:16,228 - lava_callback - ERROR - Error processing callback for node 68d4008ccd36afa834e15aca: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:37112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42310 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:54:30,586 - lava_callback - INFO - Received callback for node 68d6900b2f83206171a91ab2 INFO: 172.20.0.1:50588 - "POST /node/68d6900b2f83206171a91ab2 HTTP/1.0" 202 Accepted 2025-09-26 13:54:30,593 - lava_callback - INFO - Starting async job submit for node 68d6900b2f83206171a91ab2 2025-09-26 13:54:30,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:30,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6900b2f83206171a91ab2 HTTP/1.1" 200 None 2025-09-26 13:54:30,656 - lava_callback - DEBUG - Processing node 68d6900b2f83206171a91ab2: baseline-arm64 2025-09-26 13:54:31,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:54:31,357 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:54:31,358 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6900b2f83206171a91ab2/log.txt.gz 2025-09-26 13:54:31,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:54:31,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:54:31,488 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6900b2f83206171a91ab2/lava_callback.json.gz 2025-09-26 13:54:31,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:31,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6900b2f83206171a91ab2 HTTP/1.1" 200 None 2025-09-26 13:54:31,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:31,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:54:31,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:31,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6900b2f83206171a91ab2 HTTP/1.1" 200 None 2025-09-26 13:54:31,591 - lava_callback - INFO - Completed processing callback for node 68d6900b2f83206171a91ab2 2025-09-26 13:54:31,969 - lava_callback - INFO - Received callback for node 68d690082f83206171a91aaf INFO: 172.20.0.1:50590 - "POST /node/68d690082f83206171a91aaf HTTP/1.0" 202 Accepted 2025-09-26 13:54:31,976 - lava_callback - INFO - Starting async job submit for node 68d690082f83206171a91aaf 2025-09-26 13:54:31,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:32,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690082f83206171a91aaf HTTP/1.1" 200 None 2025-09-26 13:54:32,010 - lava_callback - DEBUG - Processing node 68d690082f83206171a91aaf: baseline-arm64 2025-09-26 13:54:32,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:54:32,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:54:32,500 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690082f83206171a91aaf/log.txt.gz 2025-09-26 13:54:32,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:54:32,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:54:32,615 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690082f83206171a91aaf/lava_callback.json.gz 2025-09-26 13:54:32,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:32,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690082f83206171a91aaf HTTP/1.1" 200 None 2025-09-26 13:54:32,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:32,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:54:32,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:32,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690082f83206171a91aaf HTTP/1.1" 200 None 2025-09-26 13:54:32,694 - lava_callback - INFO - Completed processing callback for node 68d690082f83206171a91aaf 2025-09-26 13:54:35,749 - lava_callback - INFO - Received callback for node 68d694912f83206171a91eb9 INFO: 172.20.0.1:50592 - "POST /node/68d694912f83206171a91eb9 HTTP/1.0" 202 Accepted 2025-09-26 13:54:35,755 - lava_callback - INFO - Starting async job submit for node 68d694912f83206171a91eb9 2025-09-26 13:54:35,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:35,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694912f83206171a91eb9 HTTP/1.1" 200 None 2025-09-26 13:54:35,789 - lava_callback - DEBUG - Processing node 68d694912f83206171a91eb9: baseline-arm64 2025-09-26 13:54:36,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:54:36,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:54:36,268 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694912f83206171a91eb9/log.txt.gz 2025-09-26 13:54:36,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:54:36,382 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:54:36,383 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694912f83206171a91eb9/lava_callback.json.gz 2025-09-26 13:54:36,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:36,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694912f83206171a91eb9 HTTP/1.1" 200 None 2025-09-26 13:54:36,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:36,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:54:36,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:36,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694912f83206171a91eb9 HTTP/1.1" 200 None 2025-09-26 13:54:36,464 - lava_callback - INFO - Completed processing callback for node 68d694912f83206171a91eb9 INFO: 172.20.0.1:50600 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:54:37,901 - lava_callback - INFO - Received callback for node 68d4293da5c2c05277bc76fc INFO: 172.20.0.1:50604 - "POST /node/68d4293da5c2c05277bc76fc HTTP/1.0" 202 Accepted 2025-09-26 13:54:37,907 - lava_callback - INFO - Starting async job submit for node 68d4293da5c2c05277bc76fc 2025-09-26 13:54:37,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:37,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4293da5c2c05277bc76fc HTTP/1.1" 200 None 2025-09-26 13:54:37,941 - lava_callback - DEBUG - Processing node 68d4293da5c2c05277bc76fc: baseline-arm 2025-09-26 13:54:38,165 - lava_callback - ERROR - Error processing callback for node 68d4293da5c2c05277bc76fc: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 13:54:44,538 - lava_callback - INFO - Received callback for node 68d6900b2f83206171a91ab5 INFO: 172.20.0.1:35794 - "POST /node/68d6900b2f83206171a91ab5 HTTP/1.0" 202 Accepted 2025-09-26 13:54:44,544 - lava_callback - INFO - Starting async job submit for node 68d6900b2f83206171a91ab5 2025-09-26 13:54:44,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:44,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6900b2f83206171a91ab5 HTTP/1.1" 200 None 2025-09-26 13:54:44,579 - lava_callback - DEBUG - Processing node 68d6900b2f83206171a91ab5: baseline-arm64 2025-09-26 13:54:44,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:54:45,033 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:54:45,034 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6900b2f83206171a91ab5/log.txt.gz 2025-09-26 13:54:45,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:54:45,163 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:54:45,164 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6900b2f83206171a91ab5/lava_callback.json.gz 2025-09-26 13:54:45,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:45,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6900b2f83206171a91ab5 HTTP/1.1" 200 None 2025-09-26 13:54:45,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:45,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 13:54:45,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:54:45,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6900b2f83206171a91ab5 HTTP/1.1" 200 None 2025-09-26 13:54:45,245 - lava_callback - INFO - Completed processing callback for node 68d6900b2f83206171a91ab5 INFO: 172.20.0.1:35806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48058 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:55:05,903 - lava_callback - INFO - Received callback for node 68d68b512f83206171a91925 INFO: 172.20.0.1:53654 - "POST /node/68d68b512f83206171a91925 HTTP/1.0" 202 Accepted 2025-09-26 13:55:05,909 - lava_callback - INFO - Starting async job submit for node 68d68b512f83206171a91925 2025-09-26 13:55:05,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:55:05,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68b512f83206171a91925 HTTP/1.1" 200 None 2025-09-26 13:55:05,940 - lava_callback - DEBUG - Processing node 68d68b512f83206171a91925: baseline-x86 2025-09-26 13:55:06,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:55:06,364 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:55:06,365 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d68b512f83206171a91925/log.txt.gz 2025-09-26 13:55:06,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:55:06,501 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:55:06,501 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d68b512f83206171a91925/lava_callback.json.gz 2025-09-26 13:55:06,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:53668 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:55:06,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d68b512f83206171a91925 HTTP/1.1" 200 None 2025-09-26 13:55:06,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:55:06,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc9630c58dac7d9410db HTTP/1.1" 200 None 2025-09-26 13:55:06,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:55:06,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d68b512f83206171a91925 HTTP/1.1" 200 None 2025-09-26 13:55:06,614 - lava_callback - INFO - Completed processing callback for node 68d68b512f83206171a91925 INFO: 172.20.0.1:53678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33306 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:55:50,942 - lava_callback - INFO - Received callback for node 68d694ad2f83206171a91ef3 INFO: 172.20.0.1:37684 - "POST /node/68d694ad2f83206171a91ef3 HTTP/1.0" 202 Accepted 2025-09-26 13:55:50,948 - lava_callback - INFO - Starting async job submit for node 68d694ad2f83206171a91ef3 2025-09-26 13:55:50,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:55:50,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694ad2f83206171a91ef3 HTTP/1.1" 200 None 2025-09-26 13:55:50,979 - lava_callback - DEBUG - Processing node 68d694ad2f83206171a91ef3: baseline-arm64 2025-09-26 13:55:51,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:55:51,470 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:55:51,471 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694ad2f83206171a91ef3/log.txt.gz 2025-09-26 13:55:51,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:55:51,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:55:51,594 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694ad2f83206171a91ef3/lava_callback.json.gz 2025-09-26 13:55:51,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:55:51,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694ad2f83206171a91ef3 HTTP/1.1" 200 None 2025-09-26 13:55:51,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:55:51,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:55:51,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:55:51,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694ad2f83206171a91ef3 HTTP/1.1" 200 None 2025-09-26 13:55:51,668 - lava_callback - INFO - Completed processing callback for node 68d694ad2f83206171a91ef3 2025-09-26 13:55:52,917 - lava_callback - INFO - Received callback for node 68d694ad2f83206171a91ef0 INFO: 172.20.0.1:37690 - "POST /node/68d694ad2f83206171a91ef0 HTTP/1.0" 202 Accepted 2025-09-26 13:55:52,923 - lava_callback - INFO - Starting async job submit for node 68d694ad2f83206171a91ef0 2025-09-26 13:55:52,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:55:52,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694ad2f83206171a91ef0 HTTP/1.1" 200 None 2025-09-26 13:55:52,955 - lava_callback - DEBUG - Processing node 68d694ad2f83206171a91ef0: baseline-arm64 2025-09-26 13:55:53,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:55:53,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:55:53,441 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694ad2f83206171a91ef0/log.txt.gz 2025-09-26 13:55:53,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:55:53,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:55:53,580 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694ad2f83206171a91ef0/lava_callback.json.gz 2025-09-26 13:55:53,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:55:53,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694ad2f83206171a91ef0 HTTP/1.1" 200 None 2025-09-26 13:55:53,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:55:53,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 13:55:53,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:55:53,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694ad2f83206171a91ef0 HTTP/1.1" 200 None 2025-09-26 13:55:53,660 - lava_callback - INFO - Completed processing callback for node 68d694ad2f83206171a91ef0 INFO: 172.20.0.1:37700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40682 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:56:22,977 - lava_callback - INFO - Received callback for node 68d692292f83206171a91c6d INFO: 172.20.0.1:55034 - "POST /node/68d692292f83206171a91c6d HTTP/1.0" 202 Accepted 2025-09-26 13:56:22,983 - lava_callback - INFO - Starting async job submit for node 68d692292f83206171a91c6d 2025-09-26 13:56:22,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:56:23,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d692292f83206171a91c6d HTTP/1.1" 200 None 2025-09-26 13:56:23,012 - lava_callback - DEBUG - Processing node 68d692292f83206171a91c6d: baseline-x86 2025-09-26 13:56:23,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:56:23,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:56:23,416 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d692292f83206171a91c6d/log.txt.gz 2025-09-26 13:56:23,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 13:56:23,551 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 13:56:23,552 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d692292f83206171a91c6d/lava_callback.json.gz 2025-09-26 13:56:23,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:56:23,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d692292f83206171a91c6d HTTP/1.1" 200 None 2025-09-26 13:56:23,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:56:23,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637585d233c363a761c30 HTTP/1.1" 200 None 2025-09-26 13:56:23,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:56:23,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d692292f83206171a91c6d HTTP/1.1" 200 None 2025-09-26 13:56:23,622 - lava_callback - INFO - Completed processing callback for node 68d692292f83206171a91c6d INFO: 172.20.0.1:55040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46610 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:56:41,036 - lava_callback - INFO - Received callback for node 68d4293ea5c2c05277bc76ff INFO: 172.20.0.1:45492 - "POST /node/68d4293ea5c2c05277bc76ff HTTP/1.0" 202 Accepted 2025-09-26 13:56:41,042 - lava_callback - INFO - Starting async job submit for node 68d4293ea5c2c05277bc76ff 2025-09-26 13:56:41,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:56:41,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4293ea5c2c05277bc76ff HTTP/1.1" 200 None 2025-09-26 13:56:41,085 - lava_callback - DEBUG - Processing node 68d4293ea5c2c05277bc76ff: baseline-arm 2025-09-26 13:56:41,304 - lava_callback - ERROR - Error processing callback for node 68d4293ea5c2c05277bc76ff: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:45496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54800 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:58:20,483 - lava_callback - INFO - Received callback for node 68d40091cd36afa834e15ad6 INFO: 172.20.0.1:35890 - "POST /node/68d40091cd36afa834e15ad6 HTTP/1.0" 202 Accepted 2025-09-26 13:58:20,490 - lava_callback - INFO - Starting async job submit for node 68d40091cd36afa834e15ad6 2025-09-26 13:58:20,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:58:20,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40091cd36afa834e15ad6 HTTP/1.1" 200 None 2025-09-26 13:58:20,539 - lava_callback - DEBUG - Processing node 68d40091cd36afa834e15ad6: ltp-fsx 2025-09-26 13:58:20,874 - lava_callback - ERROR - Error processing callback for node 68d40091cd36afa834e15ad6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:35896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38596 - "GET / HTTP/1.0" 200 OK 2025-09-26 13:59:00,216 - lava_callback - INFO - Received callback for node 68d4293fa5c2c05277bc7702 INFO: 172.20.0.1:52928 - "POST /node/68d4293fa5c2c05277bc7702 HTTP/1.0" 202 Accepted 2025-09-26 13:59:00,222 - lava_callback - INFO - Starting async job submit for node 68d4293fa5c2c05277bc7702 2025-09-26 13:59:00,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 13:59:00,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4293fa5c2c05277bc7702 HTTP/1.1" 200 None 2025-09-26 13:59:00,266 - lava_callback - DEBUG - Processing node 68d4293fa5c2c05277bc7702: baseline-arm 2025-09-26 13:59:00,484 - lava_callback - ERROR - Error processing callback for node 68d4293fa5c2c05277bc7702: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:52940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55734 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:00:36,249 - lava_callback - INFO - Received callback for node 68d40092cd36afa834e15adc INFO: 172.20.0.1:58266 - "POST /node/68d40092cd36afa834e15adc HTTP/1.0" 202 Accepted 2025-09-26 14:00:36,256 - lava_callback - INFO - Starting async job submit for node 68d40092cd36afa834e15adc 2025-09-26 14:00:36,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:00:36,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40092cd36afa834e15adc HTTP/1.1" 200 None 2025-09-26 14:00:36,294 - lava_callback - DEBUG - Processing node 68d40092cd36afa834e15adc: ltp-ipc INFO: 172.20.0.1:58274 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:00:36,645 - lava_callback - ERROR - Error processing callback for node 68d40092cd36afa834e15adc: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:34382 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:00:55,846 - lava_callback - INFO - Received callback for node 68d42941a5c2c05277bc7705 INFO: 172.20.0.1:58644 - "POST /node/68d42941a5c2c05277bc7705 HTTP/1.0" 202 Accepted 2025-09-26 14:00:55,852 - lava_callback - INFO - Starting async job submit for node 68d42941a5c2c05277bc7705 2025-09-26 14:00:55,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:00:55,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42941a5c2c05277bc7705 HTTP/1.1" 200 None 2025-09-26 14:00:55,904 - lava_callback - DEBUG - Processing node 68d42941a5c2c05277bc7705: baseline-arm 2025-09-26 14:00:56,128 - lava_callback - ERROR - Error processing callback for node 68d42941a5c2c05277bc7705: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:58650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45788 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:01:08,800 - lava_callback - INFO - Received callback for node 68d690082f83206171a91aac INFO: 172.20.0.1:45804 - "POST /node/68d690082f83206171a91aac HTTP/1.0" 202 Accepted 2025-09-26 14:01:08,807 - lava_callback - INFO - Starting async job submit for node 68d690082f83206171a91aac 2025-09-26 14:01:08,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:01:08,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690082f83206171a91aac HTTP/1.1" 200 None 2025-09-26 14:01:08,848 - lava_callback - DEBUG - Processing node 68d690082f83206171a91aac: baseline-arm64 2025-09-26 14:01:09,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:01:09,685 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:01:09,686 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690082f83206171a91aac/log.txt.gz 2025-09-26 14:01:09,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:01:09,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:01:09,832 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690082f83206171a91aac/lava_callback.json.gz DEBUG: 68d690082f83206171a91aac Transitting job node result: pass -> incomplete 2025-09-26 14:01:09,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:01:09,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690082f83206171a91aac HTTP/1.1" 200 None 2025-09-26 14:01:09,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:01:09,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 14:01:09,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:01:09,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690082f83206171a91aac HTTP/1.1" 200 None 2025-09-26 14:01:09,940 - lava_callback - INFO - Completed processing callback for node 68d690082f83206171a91aac 2025-09-26 14:01:11,030 - lava_callback - INFO - Received callback for node 68d690902f83206171a91bbe INFO: 172.20.0.1:53014 - "POST /node/68d690902f83206171a91bbe HTTP/1.0" 202 Accepted 2025-09-26 14:01:11,043 - lava_callback - INFO - Starting async job submit for node 68d690902f83206171a91bbe 2025-09-26 14:01:11,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:01:11,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690902f83206171a91bbe HTTP/1.1" 200 None 2025-09-26 14:01:11,117 - lava_callback - DEBUG - Processing node 68d690902f83206171a91bbe: baseline-arm64 2025-09-26 14:01:12,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:01:12,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:01:12,681 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690902f83206171a91bbe/log.txt.gz 2025-09-26 14:01:12,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:01:12,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:01:12,908 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690902f83206171a91bbe/lava_callback.json.gz DEBUG: Setup failed for 68d690902f83206171a91bbe. Transitting job node result: incomplete -> fail 2025-09-26 14:01:12,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:01:13,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690902f83206171a91bbe HTTP/1.1" 200 None 2025-09-26 14:01:13,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:01:13,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 14:01:13,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:01:13,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690902f83206171a91bbe HTTP/1.1" 200 None 2025-09-26 14:01:13,079 - lava_callback - INFO - Completed processing callback for node 68d690902f83206171a91bbe INFO: 172.20.0.1:53016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53832 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:01:51,150 - lava_callback - INFO - Received callback for node 68d47ec9a5c2c05277bcd44e INFO: 172.20.0.1:48658 - "POST /node/68d47ec9a5c2c05277bcd44e HTTP/1.0" 202 Accepted 2025-09-26 14:01:51,156 - lava_callback - INFO - Starting async job submit for node 68d47ec9a5c2c05277bcd44e 2025-09-26 14:01:51,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:01:51,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d47ec9a5c2c05277bcd44e HTTP/1.1" 200 None 2025-09-26 14:01:51,187 - lava_callback - DEBUG - Processing node 68d47ec9a5c2c05277bcd44e: baseline-arm64-broonie 2025-09-26 14:01:51,501 - lava_callback - ERROR - Error processing callback for node 68d47ec9a5c2c05277bcd44e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:48666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51876 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:03:02,396 - lava_callback - INFO - Received callback for node 68d42942a5c2c05277bc7708 INFO: 172.20.0.1:58668 - "POST /node/68d42942a5c2c05277bc7708 HTTP/1.0" 202 Accepted 2025-09-26 14:03:02,401 - lava_callback - INFO - Starting async job submit for node 68d42942a5c2c05277bc7708 2025-09-26 14:03:02,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:03:02,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42942a5c2c05277bc7708 HTTP/1.1" 200 None 2025-09-26 14:03:02,434 - lava_callback - DEBUG - Processing node 68d42942a5c2c05277bc7708: baseline-arm 2025-09-26 14:03:02,651 - lava_callback - ERROR - Error processing callback for node 68d42942a5c2c05277bc7708: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:58674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49036 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:04:35,645 - lava_callback - INFO - Received callback for node 68d40091cd36afa834e15ad9 INFO: 172.20.0.1:47370 - "POST /node/68d40091cd36afa834e15ad9 HTTP/1.0" 202 Accepted 2025-09-26 14:04:35,652 - lava_callback - INFO - Starting async job submit for node 68d40091cd36afa834e15ad9 2025-09-26 14:04:35,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:04:35,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40091cd36afa834e15ad9 HTTP/1.1" 200 None 2025-09-26 14:04:35,711 - lava_callback - DEBUG - Processing node 68d40091cd36afa834e15ad9: ltp-input 2025-09-26 14:04:36,376 - lava_callback - ERROR - Error processing callback for node 68d40091cd36afa834e15ad9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56904 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:05:14,554 - lava_callback - INFO - Received callback for node 68d42944a5c2c05277bc770b INFO: 172.20.0.1:56908 - "POST /node/68d42944a5c2c05277bc770b HTTP/1.0" 202 Accepted 2025-09-26 14:05:14,560 - lava_callback - INFO - Starting async job submit for node 68d42944a5c2c05277bc770b 2025-09-26 14:05:14,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:05:14,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42944a5c2c05277bc770b HTTP/1.1" 200 None 2025-09-26 14:05:14,598 - lava_callback - DEBUG - Processing node 68d42944a5c2c05277bc770b: baseline-arm 2025-09-26 14:05:14,830 - lava_callback - ERROR - Error processing callback for node 68d42944a5c2c05277bc770b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:56922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35512 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:05:54,116 - lava_callback - INFO - Received callback for node 68d47f7ca5c2c05277bcd4be INFO: 172.20.0.1:39268 - "POST /node/68d47f7ca5c2c05277bcd4be HTTP/1.0" 202 Accepted 2025-09-26 14:05:54,122 - lava_callback - INFO - Starting async job submit for node 68d47f7ca5c2c05277bcd4be 2025-09-26 14:05:54,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:05:54,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d47f7ca5c2c05277bcd4be HTTP/1.1" 200 None 2025-09-26 14:05:54,152 - lava_callback - DEBUG - Processing node 68d47f7ca5c2c05277bcd4be: baseline-arm64-broonie 2025-09-26 14:05:54,445 - lava_callback - ERROR - Error processing callback for node 68d47f7ca5c2c05277bcd4be: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:39280 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:06:05,318 - lava_callback - INFO - Received callback for node 68d40071cd36afa834e15a7d INFO: 172.20.0.1:34456 - "POST /node/68d40071cd36afa834e15a7d HTTP/1.0" 202 Accepted 2025-09-26 14:06:05,324 - lava_callback - INFO - Starting async job submit for node 68d40071cd36afa834e15a7d 2025-09-26 14:06:05,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:06:05,365 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40071cd36afa834e15a7d HTTP/1.1" 200 None 2025-09-26 14:06:05,365 - lava_callback - DEBUG - Processing node 68d40071cd36afa834e15a7d: baseline-arm 2025-09-26 14:06:05,641 - lava_callback - ERROR - Error processing callback for node 68d40071cd36afa834e15a7d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:34470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47930 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:06:49,798 - lava_callback - INFO - Received callback for node 68d699962f83206171a921e2 INFO: 172.20.0.1:50426 - "POST /node/68d699962f83206171a921e2 HTTP/1.0" 202 Accepted 2025-09-26 14:06:49,804 - lava_callback - INFO - Starting async job submit for node 68d699962f83206171a921e2 2025-09-26 14:06:49,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:06:49,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d699962f83206171a921e2 HTTP/1.1" 200 None 2025-09-26 14:06:49,847 - lava_callback - DEBUG - Processing node 68d699962f83206171a921e2: baseline-arm 2025-09-26 14:06:50,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:06:50,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:06:50,302 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d699962f83206171a921e2/log.txt.gz 2025-09-26 14:06:50,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:06:50,446 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:06:50,447 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d699962f83206171a921e2/lava_callback.json.gz DEBUG: Setup failed for 68d699962f83206171a921e2. Transitting job node result: incomplete -> fail 2025-09-26 14:06:50,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:06:50,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d699962f83206171a921e2 HTTP/1.1" 200 None 2025-09-26 14:06:50,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:06:50,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 14:06:50,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:06:50,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d699962f83206171a921e2 HTTP/1.1" 200 None 2025-09-26 14:06:50,565 - lava_callback - INFO - Completed processing callback for node 68d699962f83206171a921e2 INFO: 172.20.0.1:50434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50364 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:07:22,097 - lava_callback - INFO - Received callback for node 68d42947a5c2c05277bc770e INFO: 172.20.0.1:37708 - "POST /node/68d42947a5c2c05277bc770e HTTP/1.0" 202 Accepted 2025-09-26 14:07:22,102 - lava_callback - INFO - Starting async job submit for node 68d42947a5c2c05277bc770e 2025-09-26 14:07:22,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:07:22,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42947a5c2c05277bc770e HTTP/1.1" 200 None 2025-09-26 14:07:22,136 - lava_callback - DEBUG - Processing node 68d42947a5c2c05277bc770e: baseline-arm 2025-09-26 14:07:22,380 - lava_callback - ERROR - Error processing callback for node 68d42947a5c2c05277bc770e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:37722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51496 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:08:27,919 - lava_callback - INFO - Received callback for node 68d690842f83206171a91ba0 INFO: 172.20.0.1:51502 - "POST /node/68d690842f83206171a91ba0 HTTP/1.0" 202 Accepted 2025-09-26 14:08:27,926 - lava_callback - INFO - Starting async job submit for node 68d690842f83206171a91ba0 2025-09-26 14:08:27,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:08:27,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690842f83206171a91ba0 HTTP/1.1" 200 None 2025-09-26 14:08:27,997 - lava_callback - DEBUG - Processing node 68d690842f83206171a91ba0: ltp-smoketest 2025-09-26 14:08:28,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:08:28,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:08:28,597 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d690842f83206171a91ba0/log.txt.gz 2025-09-26 14:08:28,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:08:28,764 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:08:28,765 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d690842f83206171a91ba0/lava_callback.json.gz 2025-09-26 14:08:28,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:08:28,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690842f83206171a91ba0 HTTP/1.1" 200 None 2025-09-26 14:08:28,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:08:28,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6373d5d233c363a761c18 HTTP/1.1" 200 None 2025-09-26 14:08:28,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:08:28,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690842f83206171a91ba0 HTTP/1.1" 200 None 2025-09-26 14:08:28,950 - lava_callback - INFO - Completed processing callback for node 68d690842f83206171a91ba0 INFO: 172.20.0.1:45398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43806 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:08:53,186 - lava_callback - INFO - Received callback for node 68d40093cd36afa834e15ae1 INFO: 172.20.0.1:45134 - "POST /node/68d40093cd36afa834e15ae1 HTTP/1.0" 202 Accepted 2025-09-26 14:08:53,192 - lava_callback - INFO - Starting async job submit for node 68d40093cd36afa834e15ae1 2025-09-26 14:08:53,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:08:53,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40093cd36afa834e15ae1 HTTP/1.1" 200 None 2025-09-26 14:08:53,244 - lava_callback - DEBUG - Processing node 68d40093cd36afa834e15ae1: ltp-pty 2025-09-26 14:08:53,640 - lava_callback - ERROR - Error processing callback for node 68d40093cd36afa834e15ae1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:45138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42110 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:09:42,141 - lava_callback - INFO - Received callback for node 68d4294ba5c2c05277bc7714 INFO: 172.20.0.1:55338 - "POST /node/68d4294ba5c2c05277bc7714 HTTP/1.0" 202 Accepted 2025-09-26 14:09:42,147 - lava_callback - INFO - Starting async job submit for node 68d4294ba5c2c05277bc7714 2025-09-26 14:09:42,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:09:42,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4294ba5c2c05277bc7714 HTTP/1.1" 200 None 2025-09-26 14:09:42,180 - lava_callback - DEBUG - Processing node 68d4294ba5c2c05277bc7714: baseline-arm 2025-09-26 14:09:42,398 - lava_callback - ERROR - Error processing callback for node 68d4294ba5c2c05277bc7714: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:55354 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:09:54,661 - lava_callback - INFO - Received callback for node 68d4763da5c2c05277bccafe INFO: 172.20.0.1:58096 - "POST /node/68d4763da5c2c05277bccafe HTTP/1.0" 202 Accepted 2025-09-26 14:09:54,666 - lava_callback - INFO - Starting async job submit for node 68d4763da5c2c05277bccafe 2025-09-26 14:09:54,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:09:54,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4763da5c2c05277bccafe HTTP/1.1" 200 None 2025-09-26 14:09:54,700 - lava_callback - DEBUG - Processing node 68d4763da5c2c05277bccafe: baseline-arm64-broonie 2025-09-26 14:09:55,035 - lava_callback - ERROR - Error processing callback for node 68d4763da5c2c05277bccafe: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:58108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53536 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:10:08,802 - lava_callback - INFO - Received callback for node 68d690912f83206171a91bc1 INFO: 172.20.0.1:53540 - "POST /node/68d690912f83206171a91bc1 HTTP/1.0" 202 Accepted 2025-09-26 14:10:08,810 - lava_callback - INFO - Starting async job submit for node 68d690912f83206171a91bc1 2025-09-26 14:10:08,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:10:08,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690912f83206171a91bc1 HTTP/1.1" 200 None 2025-09-26 14:10:08,868 - lava_callback - DEBUG - Processing node 68d690912f83206171a91bc1: baseline-arm64 2025-09-26 14:10:09,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:10:10,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:10:10,112 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690912f83206171a91bc1/log.txt.gz 2025-09-26 14:10:10,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:10:10,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:10:10,342 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690912f83206171a91bc1/lava_callback.json.gz DEBUG: Setup failed for 68d690912f83206171a91bc1. Transitting job node result: incomplete -> fail 2025-09-26 14:10:10,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:10:10,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690912f83206171a91bc1 HTTP/1.1" 200 None 2025-09-26 14:10:10,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:10:10,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 14:10:10,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:10:10,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690912f83206171a91bc1 HTTP/1.1" 200 None 2025-09-26 14:10:10,483 - lava_callback - INFO - Completed processing callback for node 68d690912f83206171a91bc1 INFO: 172.20.0.1:42272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42288 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 14:10:15,383 - lava_callback - INFO - Received callback for node 68d4038dcd36afa834e16311 INFO: 172.20.0.1:42300 - "POST /node/68d4038dcd36afa834e16311 HTTP/1.0" 202 Accepted 2025-09-26 14:10:15,390 - lava_callback - INFO - Starting async job submit for node 68d4038dcd36afa834e16311 2025-09-26 14:10:15,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:10:15,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4038dcd36afa834e16311 HTTP/1.1" 200 None 2025-09-26 14:10:15,443 - lava_callback - DEBUG - Processing node 68d4038dcd36afa834e16311: baseline-arm64 2025-09-26 14:10:16,294 - lava_callback - ERROR - Error processing callback for node 68d4038dcd36afa834e16311: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:42302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43030 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:10:27,932 - lava_callback - INFO - Received callback for node 68d4038ecd36afa834e16314 INFO: 172.20.0.1:43038 - "POST /node/68d4038ecd36afa834e16314 HTTP/1.0" 202 Accepted 2025-09-26 14:10:27,940 - lava_callback - INFO - Starting async job submit for node 68d4038ecd36afa834e16314 2025-09-26 14:10:27,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:10:27,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4038ecd36afa834e16314 HTTP/1.1" 200 None 2025-09-26 14:10:27,992 - lava_callback - DEBUG - Processing node 68d4038ecd36afa834e16314: baseline-arm64 2025-09-26 14:10:28,867 - lava_callback - ERROR - Error processing callback for node 68d4038ecd36afa834e16314: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:33266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59766 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:11:28,397 - lava_callback - INFO - Received callback for node 68d4039acd36afa834e16323 INFO: 172.20.0.1:59772 - "POST /node/68d4039acd36afa834e16323 HTTP/1.0" 202 Accepted 2025-09-26 14:11:28,404 - lava_callback - INFO - Starting async job submit for node 68d4039acd36afa834e16323 2025-09-26 14:11:28,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:11:28,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4039acd36afa834e16323 HTTP/1.1" 200 None 2025-09-26 14:11:28,461 - lava_callback - DEBUG - Processing node 68d4039acd36afa834e16323: baseline-arm64 2025-09-26 14:11:29,292 - lava_callback - ERROR - Error processing callback for node 68d4039acd36afa834e16323: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:52094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55852 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:11:56,782 - lava_callback - INFO - Received callback for node 68d4294ea5c2c05277bc7717 INFO: 172.20.0.1:55864 - "POST /node/68d4294ea5c2c05277bc7717 HTTP/1.0" 202 Accepted 2025-09-26 14:11:56,788 - lava_callback - INFO - Starting async job submit for node 68d4294ea5c2c05277bc7717 2025-09-26 14:11:56,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:11:56,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4294ea5c2c05277bc7717 HTTP/1.1" 200 None 2025-09-26 14:11:56,841 - lava_callback - DEBUG - Processing node 68d4294ea5c2c05277bc7717: baseline-arm 2025-09-26 14:11:57,080 - lava_callback - ERROR - Error processing callback for node 68d4294ea5c2c05277bc7717: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:40970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56226 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:13:50,771 - lava_callback - INFO - Received callback for node 68d4039ccd36afa834e16326 INFO: 172.20.0.1:38542 - "POST /node/68d4039ccd36afa834e16326 HTTP/1.0" 202 Accepted 2025-09-26 14:13:50,779 - lava_callback - INFO - Starting async job submit for node 68d4039ccd36afa834e16326 2025-09-26 14:13:50,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:13:50,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4039ccd36afa834e16326 HTTP/1.1" 200 None 2025-09-26 14:13:50,849 - lava_callback - DEBUG - Processing node 68d4039ccd36afa834e16326: baseline-arm64 2025-09-26 14:13:51,717 - lava_callback - ERROR - Error processing callback for node 68d4039ccd36afa834e16326: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:38556 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:14:04,731 - lava_callback - INFO - Received callback for node 68d42950a5c2c05277bc771a INFO: 172.20.0.1:48330 - "POST /node/68d42950a5c2c05277bc771a HTTP/1.0" 202 Accepted 2025-09-26 14:14:04,737 - lava_callback - INFO - Starting async job submit for node 68d42950a5c2c05277bc771a 2025-09-26 14:14:04,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:14:04,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42950a5c2c05277bc771a HTTP/1.1" 200 None 2025-09-26 14:14:04,770 - lava_callback - DEBUG - Processing node 68d42950a5c2c05277bc771a: baseline-arm 2025-09-26 14:14:04,989 - lava_callback - ERROR - Error processing callback for node 68d42950a5c2c05277bc771a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:48342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53830 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:16:23,048 - lava_callback - INFO - Received callback for node 68d42950a5c2c05277bc771d INFO: 172.20.0.1:52278 - "POST /node/68d42950a5c2c05277bc771d HTTP/1.0" 202 Accepted 2025-09-26 14:16:23,054 - lava_callback - INFO - Starting async job submit for node 68d42950a5c2c05277bc771d 2025-09-26 14:16:23,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:16:23,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42950a5c2c05277bc771d HTTP/1.1" 200 None 2025-09-26 14:16:23,108 - lava_callback - DEBUG - Processing node 68d42950a5c2c05277bc771d: baseline-arm 2025-09-26 14:16:23,323 - lava_callback - ERROR - Error processing callback for node 68d42950a5c2c05277bc771d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:52292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42536 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:16:52,137 - lava_callback - INFO - Received callback for node 68d690b02f83206171a91bcf INFO: 172.20.0.1:55406 - "POST /node/68d690b02f83206171a91bcf HTTP/1.0" 202 Accepted 2025-09-26 14:16:52,144 - lava_callback - INFO - Starting async job submit for node 68d690b02f83206171a91bcf 2025-09-26 14:16:52,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:16:52,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690b02f83206171a91bcf HTTP/1.1" 200 None 2025-09-26 14:16:52,236 - lava_callback - DEBUG - Processing node 68d690b02f83206171a91bcf: baseline-arm64 2025-09-26 14:16:53,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:16:53,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:16:53,484 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690b02f83206171a91bcf/log.txt.gz 2025-09-26 14:16:53,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:16:53,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:16:53,689 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690b02f83206171a91bcf/lava_callback.json.gz DEBUG: Setup failed for 68d690b02f83206171a91bcf. Transitting job node result: incomplete -> fail 2025-09-26 14:16:53,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:16:53,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690b02f83206171a91bcf HTTP/1.1" 200 None 2025-09-26 14:16:53,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:16:53,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 14:16:53,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:16:53,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690b02f83206171a91bcf HTTP/1.1" 200 None 2025-09-26 14:16:53,854 - lava_callback - INFO - Completed processing callback for node 68d690b02f83206171a91bcf INFO: 172.20.0.1:55408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42966 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:18:36,479 - lava_callback - INFO - Received callback for node 68d42952a5c2c05277bc7720 INFO: 172.20.0.1:55910 - "POST /node/68d42952a5c2c05277bc7720 HTTP/1.0" 202 Accepted 2025-09-26 14:18:36,485 - lava_callback - INFO - Starting async job submit for node 68d42952a5c2c05277bc7720 2025-09-26 14:18:36,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:55922 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:18:36,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42952a5c2c05277bc7720 HTTP/1.1" 200 None 2025-09-26 14:18:36,519 - lava_callback - DEBUG - Processing node 68d42952a5c2c05277bc7720: baseline-arm 2025-09-26 14:18:36,746 - lava_callback - ERROR - Error processing callback for node 68d42952a5c2c05277bc7720: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:35696 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:18:52,479 - lava_callback - INFO - Received callback for node 68d3fdc4cd36afa834e15773 INFO: 172.20.0.1:47566 - "POST /node/68d3fdc4cd36afa834e15773 HTTP/1.0" 202 Accepted 2025-09-26 14:18:52,484 - lava_callback - INFO - Starting async job submit for node 68d3fdc4cd36afa834e15773 2025-09-26 14:18:52,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:18:52,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fdc4cd36afa834e15773 HTTP/1.1" 200 None 2025-09-26 14:18:52,511 - lava_callback - DEBUG - Processing node 68d3fdc4cd36afa834e15773: baseline-arm64-baylibre 2025-09-26 14:18:52,511 - lava_callback - ERROR - Error processing callback for node 68d3fdc4cd36afa834e15773: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:47574 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:19:01,294 - lava_callback - INFO - Received callback for node 68d69a7d2f83206171a92232 INFO: 172.20.0.1:59674 - "POST /node/68d69a7d2f83206171a92232 HTTP/1.0" 202 Accepted 2025-09-26 14:19:01,299 - lava_callback - INFO - Starting async job submit for node 68d69a7d2f83206171a92232 2025-09-26 14:19:01,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:19:01,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d69a7d2f83206171a92232 HTTP/1.1" 200 None 2025-09-26 14:19:01,341 - lava_callback - DEBUG - Processing node 68d69a7d2f83206171a92232: baseline-x86-kcidebug-intel 2025-09-26 14:19:01,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:19:01,735 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:19:01,735 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d69a7d2f83206171a92232/log.txt.gz 2025-09-26 14:19:01,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:19:01,881 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:19:01,882 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d69a7d2f83206171a92232/lava_callback.json.gz DEBUG: Setup failed for 68d69a7d2f83206171a92232. Transitting job node result: incomplete -> fail 2025-09-26 14:19:01,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:19:01,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d69a7d2f83206171a92232 HTTP/1.1" 200 None 2025-09-26 14:19:01,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:19:01,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d8d92be2da466069ac1b HTTP/1.1" 200 None 2025-09-26 14:19:01,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:19:02,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d69a7d2f83206171a92232 HTTP/1.1" 200 None 2025-09-26 14:19:02,012 - lava_callback - INFO - Completed processing callback for node 68d69a7d2f83206171a92232 2025-09-26 14:19:06,421 - lava_callback - INFO - Received callback for node 68d6a07b2f83206171a922bc INFO: 172.20.0.1:59682 - "POST /node/68d6a07b2f83206171a922bc HTTP/1.0" 202 Accepted 2025-09-26 14:19:06,427 - lava_callback - INFO - Starting async job submit for node 68d6a07b2f83206171a922bc 2025-09-26 14:19:06,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:19:06,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a07b2f83206171a922bc HTTP/1.1" 200 None 2025-09-26 14:19:06,460 - lava_callback - DEBUG - Processing node 68d6a07b2f83206171a922bc: baseline-riscv-collabora INFO: 172.20.0.1:59698 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:19:06,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:19:06,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:19:06,766 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-riscv-collabora-68d6a07b2f83206171a922bc/log.txt.gz 2025-09-26 14:19:06,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:19:06,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:19:06,874 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-riscv-collabora-68d6a07b2f83206171a922bc/lava_callback.json.gz 2025-09-26 14:19:06,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:19:06,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a07b2f83206171a922bc HTTP/1.1" 200 None 2025-09-26 14:19:06,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:19:06,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d649025d233c363a762363 HTTP/1.1" 200 None 2025-09-26 14:19:06,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:19:06,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a07b2f83206171a922bc HTTP/1.1" 200 None 2025-09-26 14:19:06,948 - lava_callback - INFO - Completed processing callback for node 68d6a07b2f83206171a922bc INFO: 172.20.0.1:51834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36066 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:19:36,485 - lava_callback - INFO - Received callback for node 68d40094cd36afa834e15ae4 INFO: 172.20.0.1:56784 - "POST /node/68d40094cd36afa834e15ae4 HTTP/1.0" 202 Accepted 2025-09-26 14:19:36,491 - lava_callback - INFO - Starting async job submit for node 68d40094cd36afa834e15ae4 2025-09-26 14:19:36,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:56796 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:19:36,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40094cd36afa834e15ae4 HTTP/1.1" 200 None 2025-09-26 14:19:36,657 - lava_callback - DEBUG - Processing node 68d40094cd36afa834e15ae4: ltp-sched 2025-09-26 14:19:36,974 - lava_callback - ERROR - Error processing callback for node 68d40094cd36afa834e15ae4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:58046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51124 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:20:04,565 - lava_callback - INFO - Received callback for node 68d40097cd36afa834e15aea INFO: 172.20.0.1:36522 - "POST /node/68d40097cd36afa834e15aea HTTP/1.0" 202 Accepted 2025-09-26 14:20:04,572 - lava_callback - INFO - Starting async job submit for node 68d40097cd36afa834e15aea 2025-09-26 14:20:04,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:20:04,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40097cd36afa834e15aea HTTP/1.1" 200 None 2025-09-26 14:20:04,629 - lava_callback - DEBUG - Processing node 68d40097cd36afa834e15aea: ltp-smoketest 2025-09-26 14:20:05,070 - lava_callback - ERROR - Error processing callback for node 68d40097cd36afa834e15aea: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 14:20:06,474 - lava_callback - INFO - Received callback for node 68d6a07a2f83206171a922b9 INFO: 172.20.0.1:36538 - "POST /node/68d6a07a2f83206171a922b9 HTTP/1.0" 202 Accepted 2025-09-26 14:20:06,480 - lava_callback - INFO - Starting async job submit for node 68d6a07a2f83206171a922b9 2025-09-26 14:20:06,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:20:06,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a07a2f83206171a922b9 HTTP/1.1" 200 None 2025-09-26 14:20:06,531 - lava_callback - DEBUG - Processing node 68d6a07a2f83206171a922b9: baseline-riscv-broonie INFO: 172.20.0.1:36544 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:20:06,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:20:06,905 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:20:06,905 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-riscv-broonie-68d6a07a2f83206171a922b9/log.txt.gz 2025-09-26 14:20:06,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:20:07,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:20:07,050 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-riscv-broonie-68d6a07a2f83206171a922b9/lava_callback.json.gz 2025-09-26 14:20:07,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:20:07,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a07a2f83206171a922b9 HTTP/1.1" 200 None 2025-09-26 14:20:07,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:20:07,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d649025d233c363a762363 HTTP/1.1" 200 None 2025-09-26 14:20:07,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:20:07,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a07a2f83206171a922b9 HTTP/1.1" 200 None 2025-09-26 14:20:07,126 - lava_callback - INFO - Completed processing callback for node 68d6a07a2f83206171a922b9 2025-09-26 14:20:12,486 - lava_callback - INFO - Received callback for node 68d3fe08cd36afa834e157b0 INFO: 172.20.0.1:50460 - "POST /node/68d3fe08cd36afa834e157b0 HTTP/1.0" 202 Accepted 2025-09-26 14:20:12,492 - lava_callback - INFO - Starting async job submit for node 68d3fe08cd36afa834e157b0 2025-09-26 14:20:12,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:20:12,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fe08cd36afa834e157b0 HTTP/1.1" 200 None 2025-09-26 14:20:12,505 - lava_callback - DEBUG - Processing node 68d3fe08cd36afa834e157b0: baseline-arm64-baylibre 2025-09-26 14:20:12,505 - lava_callback - ERROR - Error processing callback for node 68d3fe08cd36afa834e157b0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43668 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:20:32,534 - lava_callback - INFO - Received callback for node 68d3fe23cd36afa834e157c5 INFO: 172.20.0.1:46384 - "POST /node/68d3fe23cd36afa834e157c5 HTTP/1.0" 202 Accepted 2025-09-26 14:20:32,541 - lava_callback - INFO - Starting async job submit for node 68d3fe23cd36afa834e157c5 2025-09-26 14:20:32,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:20:32,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3fe23cd36afa834e157c5 HTTP/1.1" 200 None 2025-09-26 14:20:32,587 - lava_callback - DEBUG - Processing node 68d3fe23cd36afa834e157c5: baseline-arm64-baylibre 2025-09-26 14:20:32,587 - lava_callback - ERROR - Error processing callback for node 68d3fe23cd36afa834e157c5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:46394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59228 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:20:48,690 - lava_callback - INFO - Received callback for node 68d42955a5c2c05277bc7723 INFO: 172.20.0.1:59234 - "POST /node/68d42955a5c2c05277bc7723 HTTP/1.0" 202 Accepted 2025-09-26 14:20:48,696 - lava_callback - INFO - Starting async job submit for node 68d42955a5c2c05277bc7723 2025-09-26 14:20:48,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:20:48,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42955a5c2c05277bc7723 HTTP/1.1" 200 None 2025-09-26 14:20:48,729 - lava_callback - DEBUG - Processing node 68d42955a5c2c05277bc7723: baseline-arm 2025-09-26 14:20:48,993 - lava_callback - ERROR - Error processing callback for node 68d42955a5c2c05277bc7723: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:38096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40466 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:21:28,390 - lava_callback - INFO - Received callback for node 68d6a1372f83206171a922fe INFO: 172.20.0.1:40468 - "POST /node/68d6a1372f83206171a922fe HTTP/1.0" 202 Accepted 2025-09-26 14:21:28,396 - lava_callback - INFO - Starting async job submit for node 68d6a1372f83206171a922fe 2025-09-26 14:21:28,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:21:28,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a1372f83206171a922fe HTTP/1.1" 200 None 2025-09-26 14:21:28,440 - lava_callback - DEBUG - Processing node 68d6a1372f83206171a922fe: baseline-arm 2025-09-26 14:21:28,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:21:28,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:21:28,916 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d6a1372f83206171a922fe/log.txt.gz 2025-09-26 14:21:28,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:21:29,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:21:29,074 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d6a1372f83206171a922fe/lava_callback.json.gz 2025-09-26 14:21:29,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:21:29,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a1372f83206171a922fe HTTP/1.1" 200 None 2025-09-26 14:21:29,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:21:29,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648e95d233c363a76234e HTTP/1.1" 200 None 2025-09-26 14:21:29,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:21:29,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a1372f83206171a922fe HTTP/1.1" 200 None 2025-09-26 14:21:29,157 - lava_callback - INFO - Completed processing callback for node 68d6a1372f83206171a922fe INFO: 172.20.0.1:47548 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:21:40,301 - lava_callback - INFO - Received callback for node 68d6a1372f83206171a92301 INFO: 172.20.0.1:48852 - "POST /node/68d6a1372f83206171a92301 HTTP/1.0" 202 Accepted 2025-09-26 14:21:40,307 - lava_callback - INFO - Starting async job submit for node 68d6a1372f83206171a92301 2025-09-26 14:21:40,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:21:40,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a1372f83206171a92301 HTTP/1.1" 200 None 2025-09-26 14:21:40,338 - lava_callback - DEBUG - Processing node 68d6a1372f83206171a92301: baseline-arm 2025-09-26 14:21:40,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:21:40,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:21:40,784 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d6a1372f83206171a92301/log.txt.gz 2025-09-26 14:21:40,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:21:41,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:21:41,051 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d6a1372f83206171a92301/lava_callback.json.gz 2025-09-26 14:21:41,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:21:41,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a1372f83206171a92301 HTTP/1.1" 200 None 2025-09-26 14:21:41,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:21:41,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648e95d233c363a76234e HTTP/1.1" 200 None 2025-09-26 14:21:41,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:21:41,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a1372f83206171a92301 HTTP/1.1" 200 None 2025-09-26 14:21:41,145 - lava_callback - INFO - Completed processing callback for node 68d6a1372f83206171a92301 INFO: 172.20.0.1:48866 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:21:54,239 - lava_callback - INFO - Received callback for node 68d6a1522f83206171a92337 INFO: 172.20.0.1:33150 - "POST /node/68d6a1522f83206171a92337 HTTP/1.0" 202 Accepted 2025-09-26 14:21:54,287 - lava_callback - INFO - Starting async job submit for node 68d6a1522f83206171a92337 2025-09-26 14:21:54,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:21:54,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a1522f83206171a92337 HTTP/1.1" 200 None 2025-09-26 14:21:54,319 - lava_callback - DEBUG - Processing node 68d6a1522f83206171a92337: baseline-arm-pengutronix 2025-09-26 14:21:54,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:21:54,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:21:54,604 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d6a1522f83206171a92337/log.txt.gz 2025-09-26 14:21:54,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:21:54,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:21:54,743 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d6a1522f83206171a92337/lava_callback.json.gz 2025-09-26 14:21:54,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:21:54,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a1522f83206171a92337 HTTP/1.1" 200 None 2025-09-26 14:21:54,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:21:54,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648e95d233c363a76234e HTTP/1.1" 200 None 2025-09-26 14:21:54,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:21:54,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a1522f83206171a92337 HTTP/1.1" 200 None 2025-09-26 14:21:54,840 - lava_callback - INFO - Completed processing callback for node 68d6a1522f83206171a92337 INFO: 172.20.0.1:33162 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:22:00,057 - lava_callback - INFO - Received callback for node 68d6a14e2f83206171a92331 INFO: 172.20.0.1:49262 - "POST /node/68d6a14e2f83206171a92331 HTTP/1.0" 202 Accepted 2025-09-26 14:22:00,062 - lava_callback - INFO - Starting async job submit for node 68d6a14e2f83206171a92331 2025-09-26 14:22:00,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:00,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a14e2f83206171a92331 HTTP/1.1" 200 None 2025-09-26 14:22:00,091 - lava_callback - DEBUG - Processing node 68d6a14e2f83206171a92331: baseline-arm-pengutronix 2025-09-26 14:22:00,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:22:00,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:22:00,329 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d6a14e2f83206171a92331/log.txt.gz 2025-09-26 14:22:00,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:22:00,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:22:00,451 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d6a14e2f83206171a92331/lava_callback.json.gz 2025-09-26 14:22:00,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:00,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a14e2f83206171a92331 HTTP/1.1" 200 None 2025-09-26 14:22:00,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:00,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648e95d233c363a76234e HTTP/1.1" 200 None 2025-09-26 14:22:00,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:00,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a14e2f83206171a92331 HTTP/1.1" 200 None 2025-09-26 14:22:00,526 - lava_callback - INFO - Completed processing callback for node 68d6a14e2f83206171a92331 2025-09-26 14:22:01,601 - lava_callback - INFO - Received callback for node 68d6a1392f83206171a92304 INFO: 172.20.0.1:49264 - "POST /node/68d6a1392f83206171a92304 HTTP/1.0" 202 Accepted 2025-09-26 14:22:01,607 - lava_callback - INFO - Starting async job submit for node 68d6a1392f83206171a92304 2025-09-26 14:22:01,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:01,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a1392f83206171a92304 HTTP/1.1" 200 None 2025-09-26 14:22:01,640 - lava_callback - DEBUG - Processing node 68d6a1392f83206171a92304: baseline-arm 2025-09-26 14:22:01,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:22:01,955 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:22:01,956 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d6a1392f83206171a92304/log.txt.gz 2025-09-26 14:22:01,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:22:02,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:22:02,085 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d6a1392f83206171a92304/lava_callback.json.gz 2025-09-26 14:22:02,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:02,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a1392f83206171a92304 HTTP/1.1" 200 None 2025-09-26 14:22:02,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:02,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648e95d233c363a76234e HTTP/1.1" 200 None 2025-09-26 14:22:02,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:02,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a1392f83206171a92304 HTTP/1.1" 200 None 2025-09-26 14:22:02,165 - lava_callback - INFO - Completed processing callback for node 68d6a1392f83206171a92304 2025-09-26 14:22:03,624 - lava_callback - INFO - Received callback for node 68d6a12f2f83206171a922e1 INFO: 172.20.0.1:49272 - "POST /node/68d6a12f2f83206171a922e1 HTTP/1.0" 202 Accepted 2025-09-26 14:22:03,630 - lava_callback - INFO - Starting async job submit for node 68d6a12f2f83206171a922e1 2025-09-26 14:22:03,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:03,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a12f2f83206171a922e1 HTTP/1.1" 200 None 2025-09-26 14:22:03,668 - lava_callback - DEBUG - Processing node 68d6a12f2f83206171a922e1: baseline-arm 2025-09-26 14:22:03,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:22:03,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:22:03,986 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d6a12f2f83206171a922e1/log.txt.gz 2025-09-26 14:22:03,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:22:04,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:22:04,108 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d6a12f2f83206171a922e1/lava_callback.json.gz 2025-09-26 14:22:04,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:04,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a12f2f83206171a922e1 HTTP/1.1" 200 None 2025-09-26 14:22:04,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:04,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648e95d233c363a76234e HTTP/1.1" 200 None 2025-09-26 14:22:04,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:04,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a12f2f83206171a922e1 HTTP/1.1" 200 None 2025-09-26 14:22:04,185 - lava_callback - INFO - Completed processing callback for node 68d6a12f2f83206171a922e1 INFO: 172.20.0.1:49278 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:22:07,814 - lava_callback - INFO - Received callback for node 68d6a1392f83206171a92307 INFO: 172.20.0.1:49288 - "POST /node/68d6a1392f83206171a92307 HTTP/1.0" 202 Accepted 2025-09-26 14:22:07,820 - lava_callback - INFO - Starting async job submit for node 68d6a1392f83206171a92307 2025-09-26 14:22:07,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:07,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a1392f83206171a92307 HTTP/1.1" 200 None 2025-09-26 14:22:07,852 - lava_callback - DEBUG - Processing node 68d6a1392f83206171a92307: baseline-arm 2025-09-26 14:22:08,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:22:08,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:22:08,194 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d6a1392f83206171a92307/log.txt.gz 2025-09-26 14:22:08,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:22:08,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:22:08,309 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d6a1392f83206171a92307/lava_callback.json.gz 2025-09-26 14:22:08,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:08,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a1392f83206171a92307 HTTP/1.1" 200 None 2025-09-26 14:22:08,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:08,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648e95d233c363a76234e HTTP/1.1" 200 None 2025-09-26 14:22:08,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:08,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a1392f83206171a92307 HTTP/1.1" 200 None 2025-09-26 14:22:08,389 - lava_callback - INFO - Completed processing callback for node 68d6a1392f83206171a92307 2025-09-26 14:22:09,010 - lava_callback - INFO - Received callback for node 68d6a12f2f83206171a922ce INFO: 172.20.0.1:49298 - "POST /node/68d6a12f2f83206171a922ce HTTP/1.0" 202 Accepted 2025-09-26 14:22:09,016 - lava_callback - INFO - Starting async job submit for node 68d6a12f2f83206171a922ce 2025-09-26 14:22:09,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:09,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a12f2f83206171a922ce HTTP/1.1" 200 None 2025-09-26 14:22:09,048 - lava_callback - DEBUG - Processing node 68d6a12f2f83206171a922ce: baseline-arm 2025-09-26 14:22:09,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:22:09,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:22:09,388 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d6a12f2f83206171a922ce/log.txt.gz 2025-09-26 14:22:09,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:22:09,531 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:22:09,532 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d6a12f2f83206171a922ce/lava_callback.json.gz 2025-09-26 14:22:09,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:09,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a12f2f83206171a922ce HTTP/1.1" 200 None 2025-09-26 14:22:09,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:09,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648e95d233c363a76234e HTTP/1.1" 200 None 2025-09-26 14:22:09,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:09,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a12f2f83206171a922ce HTTP/1.1" 200 None 2025-09-26 14:22:09,615 - lava_callback - INFO - Completed processing callback for node 68d6a12f2f83206171a922ce INFO: 172.20.0.1:33188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33210 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:22:24,318 - lava_callback - INFO - Received callback for node 68d6a1452f83206171a92322 INFO: 172.20.0.1:56112 - "POST /node/68d6a1452f83206171a92322 HTTP/1.0" 202 Accepted 2025-09-26 14:22:24,324 - lava_callback - INFO - Starting async job submit for node 68d6a1452f83206171a92322 2025-09-26 14:22:24,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:24,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a1452f83206171a92322 HTTP/1.1" 200 None 2025-09-26 14:22:24,357 - lava_callback - DEBUG - Processing node 68d6a1452f83206171a92322: baseline-arm-broonie 2025-09-26 14:22:24,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:22:24,815 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:22:24,815 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d6a1452f83206171a92322/log.txt.gz 2025-09-26 14:22:24,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:56116 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:22:24,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:22:24,969 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d6a1452f83206171a92322/lava_callback.json.gz 2025-09-26 14:22:24,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:25,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a1452f83206171a92322 HTTP/1.1" 200 None 2025-09-26 14:22:25,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:25,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648e95d233c363a76234e HTTP/1.1" 200 None 2025-09-26 14:22:25,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:25,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a1452f83206171a92322 HTTP/1.1" 200 None 2025-09-26 14:22:25,049 - lava_callback - INFO - Completed processing callback for node 68d6a1452f83206171a92322 INFO: 172.20.0.1:56128 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:22:27,181 - lava_callback - INFO - Received callback for node 68d6a13f2f83206171a92316 INFO: 172.20.0.1:56132 - "POST /node/68d6a13f2f83206171a92316 HTTP/1.0" 202 Accepted 2025-09-26 14:22:27,187 - lava_callback - INFO - Starting async job submit for node 68d6a13f2f83206171a92316 2025-09-26 14:22:27,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:27,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a13f2f83206171a92316 HTTP/1.1" 200 None 2025-09-26 14:22:27,217 - lava_callback - DEBUG - Processing node 68d6a13f2f83206171a92316: baseline-arm 2025-09-26 14:22:27,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:22:27,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:22:27,653 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d6a13f2f83206171a92316/log.txt.gz 2025-09-26 14:22:27,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:22:27,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:22:27,774 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d6a13f2f83206171a92316/lava_callback.json.gz 2025-09-26 14:22:27,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:27,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a13f2f83206171a92316 HTTP/1.1" 200 None 2025-09-26 14:22:27,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:27,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648e95d233c363a76234e HTTP/1.1" 200 None 2025-09-26 14:22:27,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:27,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a13f2f83206171a92316 HTTP/1.1" 200 None 2025-09-26 14:22:27,851 - lava_callback - INFO - Completed processing callback for node 68d6a13f2f83206171a92316 2025-09-26 14:22:27,890 - lava_callback - INFO - Received callback for node 68d6a1472f83206171a92325 INFO: 172.20.0.1:56146 - "POST /node/68d6a1472f83206171a92325 HTTP/1.0" 202 Accepted 2025-09-26 14:22:27,898 - lava_callback - INFO - Starting async job submit for node 68d6a1472f83206171a92325 2025-09-26 14:22:27,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:27,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a1472f83206171a92325 HTTP/1.1" 200 None 2025-09-26 14:22:27,940 - lava_callback - DEBUG - Processing node 68d6a1472f83206171a92325: baseline-arm-broonie 2025-09-26 14:22:28,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:22:28,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:22:28,327 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d6a1472f83206171a92325/log.txt.gz 2025-09-26 14:22:28,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:22:28,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:22:28,470 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-68d6a1472f83206171a92325/lava_callback.json.gz 2025-09-26 14:22:28,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:28,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a1472f83206171a92325 HTTP/1.1" 200 None 2025-09-26 14:22:28,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:28,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648e95d233c363a76234e HTTP/1.1" 200 None 2025-09-26 14:22:28,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:28,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a1472f83206171a92325 HTTP/1.1" 200 None 2025-09-26 14:22:28,547 - lava_callback - INFO - Completed processing callback for node 68d6a1472f83206171a92325 2025-09-26 14:22:33,648 - lava_callback - INFO - Received callback for node 68d6a13f2f83206171a92319 INFO: 172.20.0.1:57738 - "POST /node/68d6a13f2f83206171a92319 HTTP/1.0" 202 Accepted 2025-09-26 14:22:33,654 - lava_callback - INFO - Starting async job submit for node 68d6a13f2f83206171a92319 2025-09-26 14:22:33,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:33,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a13f2f83206171a92319 HTTP/1.1" 200 None 2025-09-26 14:22:33,686 - lava_callback - DEBUG - Processing node 68d6a13f2f83206171a92319: baseline-arm 2025-09-26 14:22:33,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:22:34,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:22:34,130 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d6a13f2f83206171a92319/log.txt.gz 2025-09-26 14:22:34,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:22:34,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:22:34,252 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d6a13f2f83206171a92319/lava_callback.json.gz 2025-09-26 14:22:34,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:34,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a13f2f83206171a92319 HTTP/1.1" 200 None 2025-09-26 14:22:34,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:34,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648e95d233c363a76234e HTTP/1.1" 200 None 2025-09-26 14:22:34,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:34,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a13f2f83206171a92319 HTTP/1.1" 200 None 2025-09-26 14:22:34,352 - lava_callback - INFO - Completed processing callback for node 68d6a13f2f83206171a92319 INFO: 172.20.0.1:57746 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:22:41,048 - lava_callback - INFO - Received callback for node 68d6a1502f83206171a92334 INFO: 172.20.0.1:43842 - "POST /node/68d6a1502f83206171a92334 HTTP/1.0" 202 Accepted 2025-09-26 14:22:41,054 - lava_callback - INFO - Starting async job submit for node 68d6a1502f83206171a92334 2025-09-26 14:22:41,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:41,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a1502f83206171a92334 HTTP/1.1" 200 None 2025-09-26 14:22:41,085 - lava_callback - DEBUG - Processing node 68d6a1502f83206171a92334: baseline-arm-pengutronix 2025-09-26 14:22:41,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:22:41,344 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:22:41,345 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d6a1502f83206171a92334/log.txt.gz 2025-09-26 14:22:41,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:22:41,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:22:41,500 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-68d6a1502f83206171a92334/lava_callback.json.gz 2025-09-26 14:22:41,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:41,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a1502f83206171a92334 HTTP/1.1" 200 None 2025-09-26 14:22:41,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:41,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648e95d233c363a76234e HTTP/1.1" 200 None 2025-09-26 14:22:41,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:22:41,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a1502f83206171a92334 HTTP/1.1" 200 None 2025-09-26 14:22:41,593 - lava_callback - INFO - Completed processing callback for node 68d6a1502f83206171a92334 INFO: 172.20.0.1:43852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52594 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:23:09,967 - lava_callback - INFO - Received callback for node 68d42957a5c2c05277bc7726 INFO: 172.20.0.1:48810 - "POST /node/68d42957a5c2c05277bc7726 HTTP/1.0" 202 Accepted 2025-09-26 14:23:09,973 - lava_callback - INFO - Starting async job submit for node 68d42957a5c2c05277bc7726 2025-09-26 14:23:10,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:23:10,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42957a5c2c05277bc7726 HTTP/1.1" 200 None 2025-09-26 14:23:10,073 - lava_callback - DEBUG - Processing node 68d42957a5c2c05277bc7726: baseline-arm 2025-09-26 14:23:10,295 - lava_callback - ERROR - Error processing callback for node 68d42957a5c2c05277bc7726: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:48820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40940 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:23:49,048 - lava_callback - INFO - Received callback for node 68d6a15a2f83206171a92346 INFO: 172.20.0.1:40948 - "POST /node/68d6a15a2f83206171a92346 HTTP/1.0" 202 Accepted 2025-09-26 14:23:49,054 - lava_callback - INFO - Starting async job submit for node 68d6a15a2f83206171a92346 2025-09-26 14:23:49,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:23:49,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a15a2f83206171a92346 HTTP/1.1" 200 None 2025-09-26 14:23:49,101 - lava_callback - DEBUG - Processing node 68d6a15a2f83206171a92346: ltp-dio 2025-09-26 14:23:49,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:23:49,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:23:49,646 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-68d6a15a2f83206171a92346/log.txt.gz 2025-09-26 14:23:49,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:23:49,801 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:23:49,802 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-68d6a15a2f83206171a92346/lava_callback.json.gz 2025-09-26 14:23:49,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:23:49,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a15a2f83206171a92346 HTTP/1.1" 200 None 2025-09-26 14:23:49,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:23:49,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648e95d233c363a76234e HTTP/1.1" 200 None 2025-09-26 14:23:49,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:23:49,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a15a2f83206171a92346 HTTP/1.1" 200 None 2025-09-26 14:23:49,921 - lava_callback - INFO - Completed processing callback for node 68d6a15a2f83206171a92346 INFO: 172.20.0.1:46588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37914 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:24:46,105 - lava_callback - INFO - Received callback for node 68d690b02f83206171a91bd2 INFO: 172.20.0.1:45238 - "POST /node/68d690b02f83206171a91bd2 HTTP/1.0" 202 Accepted 2025-09-26 14:24:46,113 - lava_callback - INFO - Starting async job submit for node 68d690b02f83206171a91bd2 2025-09-26 14:24:46,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:24:46,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690b02f83206171a91bd2 HTTP/1.1" 200 None 2025-09-26 14:24:46,178 - lava_callback - DEBUG - Processing node 68d690b02f83206171a91bd2: baseline-arm64 INFO: 172.20.0.1:45254 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:24:47,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:24:47,303 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:24:47,304 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690b02f83206171a91bd2/log.txt.gz 2025-09-26 14:24:47,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:24:47,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:24:47,478 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d690b02f83206171a91bd2/lava_callback.json.gz DEBUG: Setup failed for 68d690b02f83206171a91bd2. Transitting job node result: incomplete -> fail 2025-09-26 14:24:47,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:24:47,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690b02f83206171a91bd2 HTTP/1.1" 200 None 2025-09-26 14:24:47,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:24:47,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 14:24:47,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:24:47,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690b02f83206171a91bd2 HTTP/1.1" 200 None 2025-09-26 14:24:47,600 - lava_callback - INFO - Completed processing callback for node 68d690b02f83206171a91bd2 INFO: 172.20.0.1:33814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48496 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:25:23,729 - lava_callback - INFO - Received callback for node 68d42958a5c2c05277bc7729 INFO: 172.20.0.1:50854 - "POST /node/68d42958a5c2c05277bc7729 HTTP/1.0" 202 Accepted 2025-09-26 14:25:23,735 - lava_callback - INFO - Starting async job submit for node 68d42958a5c2c05277bc7729 2025-09-26 14:25:23,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:25:23,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42958a5c2c05277bc7729 HTTP/1.1" 200 None 2025-09-26 14:25:23,768 - lava_callback - DEBUG - Processing node 68d42958a5c2c05277bc7729: baseline-arm 2025-09-26 14:25:23,988 - lava_callback - ERROR - Error processing callback for node 68d42958a5c2c05277bc7729: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:50864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50868 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:25:30,550 - lava_callback - INFO - Received callback for node 68d69dfa2f83206171a922a6 INFO: 172.20.0.1:48358 - "POST /node/68d69dfa2f83206171a922a6 HTTP/1.0" 202 Accepted 2025-09-26 14:25:30,557 - lava_callback - INFO - Starting async job submit for node 68d69dfa2f83206171a922a6 2025-09-26 14:25:30,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:25:30,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d69dfa2f83206171a922a6 HTTP/1.1" 200 None 2025-09-26 14:25:30,600 - lava_callback - DEBUG - Processing node 68d69dfa2f83206171a922a6: baseline-arm 2025-09-26 14:25:30,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:25:31,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:25:31,030 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d69dfa2f83206171a922a6/log.txt.gz 2025-09-26 14:25:31,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:25:31,188 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:25:31,189 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d69dfa2f83206171a922a6/lava_callback.json.gz DEBUG: Setup failed for 68d69dfa2f83206171a922a6. Transitting job node result: incomplete -> fail 2025-09-26 14:25:31,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:25:31,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d69dfa2f83206171a922a6 HTTP/1.1" 200 None 2025-09-26 14:25:31,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:25:31,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637365d233c363a761c12 HTTP/1.1" 200 None 2025-09-26 14:25:31,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:25:31,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d69dfa2f83206171a922a6 HTTP/1.1" 200 None 2025-09-26 14:25:31,332 - lava_callback - INFO - Completed processing callback for node 68d69dfa2f83206171a922a6 INFO: 172.20.0.1:48372 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:25:45,566 - lava_callback - INFO - Received callback for node 68d40076cd36afa834e15a8c INFO: 172.20.0.1:48650 - "POST /node/68d40076cd36afa834e15a8c HTTP/1.0" 202 Accepted 2025-09-26 14:25:45,572 - lava_callback - INFO - Starting async job submit for node 68d40076cd36afa834e15a8c 2025-09-26 14:25:45,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:25:45,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40076cd36afa834e15a8c HTTP/1.1" 200 None 2025-09-26 14:25:45,637 - lava_callback - DEBUG - Processing node 68d40076cd36afa834e15a8c: baseline-arm 2025-09-26 14:25:45,895 - lava_callback - ERROR - Error processing callback for node 68d40076cd36afa834e15a8c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:48666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50738 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:26:16,443 - lava_callback - INFO - Received callback for node 68d4009acd36afa834e15af7 INFO: 172.20.0.1:50748 - "POST /node/68d4009acd36afa834e15af7 HTTP/1.0" 202 Accepted 2025-09-26 14:26:16,450 - lava_callback - INFO - Starting async job submit for node 68d4009acd36afa834e15af7 2025-09-26 14:26:16,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:50750 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:26:16,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4009acd36afa834e15af7 HTTP/1.1" 200 None 2025-09-26 14:26:16,520 - lava_callback - DEBUG - Processing node 68d4009acd36afa834e15af7: ltp-watchqueue 2025-09-26 14:26:16,892 - lava_callback - ERROR - Error processing callback for node 68d4009acd36afa834e15af7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 14:26:22,781 - lava_callback - INFO - Received callback for node 68d6935a2f83206171a91ccb INFO: 172.20.0.1:48718 - "POST /node/68d6935a2f83206171a91ccb HTTP/1.0" 202 Accepted 2025-09-26 14:26:22,787 - lava_callback - INFO - Starting async job submit for node 68d6935a2f83206171a91ccb 2025-09-26 14:26:22,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:26:22,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6935a2f83206171a91ccb HTTP/1.1" 200 None 2025-09-26 14:26:22,823 - lava_callback - DEBUG - Processing node 68d6935a2f83206171a91ccb: baseline-arm64 2025-09-26 14:26:23,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:26:23,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:26:23,336 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6935a2f83206171a91ccb/log.txt.gz 2025-09-26 14:26:23,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:26:23,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:26:23,495 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6935a2f83206171a91ccb/lava_callback.json.gz 2025-09-26 14:26:23,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:26:23,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6935a2f83206171a91ccb HTTP/1.1" 200 None 2025-09-26 14:26:23,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:26:23,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 14:26:23,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:26:23,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6935a2f83206171a91ccb HTTP/1.1" 200 None 2025-09-26 14:26:23,571 - lava_callback - INFO - Completed processing callback for node 68d6935a2f83206171a91ccb INFO: 172.20.0.1:48732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52104 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:26:44,483 - lava_callback - INFO - Received callback for node 68d690c22f83206171a91be5 INFO: 172.20.0.1:38636 - "POST /node/68d690c22f83206171a91be5 HTTP/1.0" 202 Accepted 2025-09-26 14:26:44,490 - lava_callback - INFO - Starting async job submit for node 68d690c22f83206171a91be5 2025-09-26 14:26:44,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:26:44,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690c22f83206171a91be5 HTTP/1.1" 200 None 2025-09-26 14:26:44,560 - lava_callback - DEBUG - Processing node 68d690c22f83206171a91be5: ltp-smoketest 2025-09-26 14:26:45,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:26:45,190 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:26:45,191 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d690c22f83206171a91be5/log.txt.gz 2025-09-26 14:26:45,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:26:45,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:26:45,342 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d690c22f83206171a91be5/lava_callback.json.gz 2025-09-26 14:26:45,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:26:45,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690c22f83206171a91be5 HTTP/1.1" 200 None 2025-09-26 14:26:45,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:26:45,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc7b30c58dac7d9410c2 HTTP/1.1" 200 None 2025-09-26 14:26:45,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:26:45,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690c22f83206171a91be5 HTTP/1.1" 200 None 2025-09-26 14:26:45,527 - lava_callback - INFO - Completed processing callback for node 68d690c22f83206171a91be5 INFO: 172.20.0.1:38650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37966 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:27:44,122 - lava_callback - INFO - Received callback for node 68d40099cd36afa834e15af4 INFO: 172.20.0.1:51842 - "POST /node/68d40099cd36afa834e15af4 HTTP/1.0" 202 Accepted 2025-09-26 14:27:44,129 - lava_callback - INFO - Starting async job submit for node 68d40099cd36afa834e15af4 2025-09-26 14:27:44,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:27:44,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40099cd36afa834e15af4 HTTP/1.1" 200 None 2025-09-26 14:27:44,177 - lava_callback - DEBUG - Processing node 68d40099cd36afa834e15af4: ltp-timers 2025-09-26 14:27:44,546 - lava_callback - ERROR - Error processing callback for node 68d40099cd36afa834e15af4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:51844 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:27:54,732 - lava_callback - INFO - Received callback for node 68d4295ea5c2c05277bc772f INFO: 172.20.0.1:50230 - "POST /node/68d4295ea5c2c05277bc772f HTTP/1.0" 202 Accepted 2025-09-26 14:27:54,738 - lava_callback - INFO - Starting async job submit for node 68d4295ea5c2c05277bc772f 2025-09-26 14:27:54,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:27:54,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4295ea5c2c05277bc772f HTTP/1.1" 200 None 2025-09-26 14:27:54,796 - lava_callback - DEBUG - Processing node 68d4295ea5c2c05277bc772f: baseline-arm 2025-09-26 14:27:55,013 - lava_callback - ERROR - Error processing callback for node 68d4295ea5c2c05277bc772f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:50232 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:28:01,868 - lava_callback - INFO - Received callback for node 68d6935b2f83206171a91cce INFO: 172.20.0.1:55438 - "POST /node/68d6935b2f83206171a91cce HTTP/1.0" 202 Accepted 2025-09-26 14:28:01,874 - lava_callback - INFO - Starting async job submit for node 68d6935b2f83206171a91cce 2025-09-26 14:28:01,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:28:01,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6935b2f83206171a91cce HTTP/1.1" 200 None 2025-09-26 14:28:01,925 - lava_callback - DEBUG - Processing node 68d6935b2f83206171a91cce: baseline-arm64 2025-09-26 14:28:02,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:28:02,425 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:28:02,426 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6935b2f83206171a91cce/log.txt.gz 2025-09-26 14:28:02,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:28:02,575 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:28:02,576 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6935b2f83206171a91cce/lava_callback.json.gz 2025-09-26 14:28:02,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:28:02,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6935b2f83206171a91cce HTTP/1.1" 200 None 2025-09-26 14:28:02,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:28:02,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 14:28:02,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:28:02,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6935b2f83206171a91cce HTTP/1.1" 200 None 2025-09-26 14:28:02,649 - lava_callback - INFO - Completed processing callback for node 68d6935b2f83206171a91cce INFO: 172.20.0.1:55448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56986 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:29:12,876 - lava_callback - INFO - Received callback for node 68d40028cd36afa834e15a35 INFO: 172.20.0.1:56280 - "POST /node/68d40028cd36afa834e15a35 HTTP/1.0" 202 Accepted 2025-09-26 14:29:12,881 - lava_callback - INFO - Starting async job submit for node 68d40028cd36afa834e15a35 2025-09-26 14:29:12,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:29:12,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40028cd36afa834e15a35 HTTP/1.1" 200 None 2025-09-26 14:29:12,925 - lava_callback - DEBUG - Processing node 68d40028cd36afa834e15a35: baseline-arm64-baylibre 2025-09-26 14:29:12,925 - lava_callback - ERROR - Error processing callback for node 68d40028cd36afa834e15a35: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:56288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56302 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:29:23,002 - lava_callback - INFO - Received callback for node 68d6935e2f83206171a91cd1 INFO: 172.20.0.1:37620 - "POST /node/68d6935e2f83206171a91cd1 HTTP/1.0" 202 Accepted 2025-09-26 14:29:23,009 - lava_callback - INFO - Starting async job submit for node 68d6935e2f83206171a91cd1 2025-09-26 14:29:23,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:29:23,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6935e2f83206171a91cd1 HTTP/1.1" 200 None 2025-09-26 14:29:23,045 - lava_callback - DEBUG - Processing node 68d6935e2f83206171a91cd1: baseline-arm64 2025-09-26 14:29:23,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:29:23,544 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:29:23,544 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6935e2f83206171a91cd1/log.txt.gz 2025-09-26 14:29:23,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:29:23,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:29:23,689 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6935e2f83206171a91cd1/lava_callback.json.gz 2025-09-26 14:29:23,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:29:23,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6935e2f83206171a91cd1 HTTP/1.1" 200 None 2025-09-26 14:29:23,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:29:23,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 14:29:23,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:29:23,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6935e2f83206171a91cd1 HTTP/1.1" 200 None 2025-09-26 14:29:23,764 - lava_callback - INFO - Completed processing callback for node 68d6935e2f83206171a91cd1 INFO: 172.20.0.1:37624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37632 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:29:32,891 - lava_callback - INFO - Received callback for node 68d40039cd36afa834e15a42 INFO: 172.20.0.1:56004 - "POST /node/68d40039cd36afa834e15a42 HTTP/1.0" 202 Accepted 2025-09-26 14:29:32,896 - lava_callback - INFO - Starting async job submit for node 68d40039cd36afa834e15a42 2025-09-26 14:29:32,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:29:32,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40039cd36afa834e15a42 HTTP/1.1" 200 None 2025-09-26 14:29:32,909 - lava_callback - DEBUG - Processing node 68d40039cd36afa834e15a42: baseline-arm64-baylibre 2025-09-26 14:29:32,909 - lava_callback - ERROR - Error processing callback for node 68d40039cd36afa834e15a42: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:29:33,558 - lava_callback - INFO - Received callback for node 68d40043cd36afa834e15a48 INFO: 172.20.0.1:56016 - "POST /node/68d40043cd36afa834e15a48 HTTP/1.0" 202 Accepted 2025-09-26 14:29:33,565 - lava_callback - INFO - Starting async job submit for node 68d40043cd36afa834e15a48 2025-09-26 14:29:33,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:29:33,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40043cd36afa834e15a48 HTTP/1.1" 200 None 2025-09-26 14:29:33,578 - lava_callback - DEBUG - Processing node 68d40043cd36afa834e15a48: baseline-arm64-baylibre 2025-09-26 14:29:33,578 - lava_callback - ERROR - Error processing callback for node 68d40043cd36afa834e15a48: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:56032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55702 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:29:52,911 - lava_callback - INFO - Received callback for node 68d4004ecd36afa834e15a4e INFO: 172.20.0.1:57174 - "POST /node/68d4004ecd36afa834e15a4e HTTP/1.0" 202 Accepted 2025-09-26 14:29:52,916 - lava_callback - INFO - Starting async job submit for node 68d4004ecd36afa834e15a4e 2025-09-26 14:29:52,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:29:52,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4004ecd36afa834e15a4e HTTP/1.1" 200 None 2025-09-26 14:29:52,929 - lava_callback - DEBUG - Processing node 68d4004ecd36afa834e15a4e: baseline-arm64-baylibre 2025-09-26 14:29:52,929 - lava_callback - ERROR - Error processing callback for node 68d4004ecd36afa834e15a4e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:29:53,580 - lava_callback - INFO - Received callback for node 68d4005dcd36afa834e15a69 INFO: 172.20.0.1:57176 - "POST /node/68d4005dcd36afa834e15a69 HTTP/1.0" 202 Accepted 2025-09-26 14:29:53,586 - lava_callback - INFO - Starting async job submit for node 68d4005dcd36afa834e15a69 2025-09-26 14:29:53,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:29:53,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4005dcd36afa834e15a69 HTTP/1.1" 200 None 2025-09-26 14:29:53,599 - lava_callback - DEBUG - Processing node 68d4005dcd36afa834e15a69: baseline-arm64-baylibre 2025-09-26 14:29:53,599 - lava_callback - ERROR - Error processing callback for node 68d4005dcd36afa834e15a69: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:57188 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:29:57,449 - lava_callback - INFO - Received callback for node 68d42962a5c2c05277bc7732 INFO: 172.20.0.1:57192 - "POST /node/68d42962a5c2c05277bc7732 HTTP/1.0" 202 Accepted 2025-09-26 14:29:57,455 - lava_callback - INFO - Starting async job submit for node 68d42962a5c2c05277bc7732 2025-09-26 14:29:57,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:29:57,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42962a5c2c05277bc7732 HTTP/1.1" 200 None 2025-09-26 14:29:57,489 - lava_callback - DEBUG - Processing node 68d42962a5c2c05277bc7732: baseline-arm 2025-09-26 14:29:57,722 - lava_callback - ERROR - Error processing callback for node 68d42962a5c2c05277bc7732: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:54234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50266 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:30:32,968 - lava_callback - INFO - Received callback for node 68d40078cd36afa834e15a94 INFO: 172.20.0.1:46722 - "POST /node/68d40078cd36afa834e15a94 HTTP/1.0" 202 Accepted 2025-09-26 14:30:32,974 - lava_callback - INFO - Starting async job submit for node 68d40078cd36afa834e15a94 2025-09-26 14:30:32,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:30:33,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40078cd36afa834e15a94 HTTP/1.1" 200 None 2025-09-26 14:30:33,011 - lava_callback - DEBUG - Processing node 68d40078cd36afa834e15a94: baseline-arm64-baylibre 2025-09-26 14:30:33,011 - lava_callback - ERROR - Error processing callback for node 68d40078cd36afa834e15a94: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:30:35,904 - lava_callback - INFO - Received callback for node 68d4040ecd36afa834e163e2 INFO: 172.20.0.1:46732 - "POST /node/68d4040ecd36afa834e163e2 HTTP/1.0" 202 Accepted 2025-09-26 14:30:35,911 - lava_callback - INFO - Starting async job submit for node 68d4040ecd36afa834e163e2 2025-09-26 14:30:35,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:30:35,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4040ecd36afa834e163e2 HTTP/1.1" 200 None 2025-09-26 14:30:35,964 - lava_callback - DEBUG - Processing node 68d4040ecd36afa834e163e2: baseline-arm64 INFO: 172.20.0.1:46738 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:30:36,841 - lava_callback - ERROR - Error processing callback for node 68d4040ecd36afa834e163e2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 14:30:40,157 - lava_callback - INFO - Received callback for node 68d4007ccd36afa834e15a9e INFO: 172.20.0.1:58334 - "POST /node/68d4007ccd36afa834e15a9e HTTP/1.0" 202 Accepted 2025-09-26 14:30:40,163 - lava_callback - INFO - Starting async job submit for node 68d4007ccd36afa834e15a9e 2025-09-26 14:30:40,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:30:40,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4007ccd36afa834e15a9e HTTP/1.1" 200 None 2025-09-26 14:30:40,182 - lava_callback - DEBUG - Processing node 68d4007ccd36afa834e15a9e: baseline-arm-broonie 2025-09-26 14:30:40,183 - lava_callback - ERROR - Error processing callback for node 68d4007ccd36afa834e15a9e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:58350 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:30:50,800 - lava_callback - INFO - Received callback for node 68d693672f83206171a91ce3 INFO: 172.20.0.1:53922 - "POST /node/68d693672f83206171a91ce3 HTTP/1.0" 202 Accepted 2025-09-26 14:30:50,806 - lava_callback - INFO - Starting async job submit for node 68d693672f83206171a91ce3 2025-09-26 14:30:50,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:30:50,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693672f83206171a91ce3 HTTP/1.1" 200 None 2025-09-26 14:30:50,839 - lava_callback - DEBUG - Processing node 68d693672f83206171a91ce3: baseline-arm64 2025-09-26 14:30:51,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:30:51,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:30:51,379 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693672f83206171a91ce3/log.txt.gz 2025-09-26 14:30:51,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:30:51,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:30:51,525 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693672f83206171a91ce3/lava_callback.json.gz 2025-09-26 14:30:51,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:30:51,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693672f83206171a91ce3 HTTP/1.1" 200 None 2025-09-26 14:30:51,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:30:51,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 14:30:51,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:30:51,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693672f83206171a91ce3 HTTP/1.1" 200 None 2025-09-26 14:30:51,621 - lava_callback - INFO - Completed processing callback for node 68d693672f83206171a91ce3 INFO: 172.20.0.1:53924 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:31:00,273 - lava_callback - INFO - Received callback for node 68d40098cd36afa834e15aee INFO: 172.20.0.1:33308 - "POST /node/68d40098cd36afa834e15aee HTTP/1.0" 202 Accepted 2025-09-26 14:31:00,278 - lava_callback - INFO - Starting async job submit for node 68d40098cd36afa834e15aee 2025-09-26 14:31:00,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:31:00,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40098cd36afa834e15aee HTTP/1.1" 200 None 2025-09-26 14:31:00,293 - lava_callback - DEBUG - Processing node 68d40098cd36afa834e15aee: ltp-syscalls 2025-09-26 14:31:00,293 - lava_callback - ERROR - Error processing callback for node 68d40098cd36afa834e15aee: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:31:03,900 - lava_callback - INFO - Received callback for node 68d6935e2f83206171a91cd4 INFO: 172.20.0.1:33320 - "POST /node/68d6935e2f83206171a91cd4 HTTP/1.0" 202 Accepted 2025-09-26 14:31:03,906 - lava_callback - INFO - Starting async job submit for node 68d6935e2f83206171a91cd4 2025-09-26 14:31:03,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:31:03,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6935e2f83206171a91cd4 HTTP/1.1" 200 None 2025-09-26 14:31:03,942 - lava_callback - DEBUG - Processing node 68d6935e2f83206171a91cd4: baseline-arm64 2025-09-26 14:31:04,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:31:04,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:31:04,579 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6935e2f83206171a91cd4/log.txt.gz 2025-09-26 14:31:04,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:31:04,740 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:31:04,740 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6935e2f83206171a91cd4/lava_callback.json.gz 2025-09-26 14:31:04,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:31:04,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6935e2f83206171a91cd4 HTTP/1.1" 200 None 2025-09-26 14:31:04,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:31:04,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 14:31:04,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:31:04,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6935e2f83206171a91cd4 HTTP/1.1" 200 None 2025-09-26 14:31:04,819 - lava_callback - INFO - Completed processing callback for node 68d6935e2f83206171a91cd4 INFO: 172.20.0.1:33336 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:31:10,460 - lava_callback - INFO - Received callback for node 68d4040fcd36afa834e163e5 INFO: 172.20.0.1:40312 - "POST /node/68d4040fcd36afa834e163e5 HTTP/1.0" 202 Accepted 2025-09-26 14:31:10,467 - lava_callback - INFO - Starting async job submit for node 68d4040fcd36afa834e163e5 2025-09-26 14:31:10,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:31:10,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4040fcd36afa834e163e5 HTTP/1.1" 200 None 2025-09-26 14:31:10,520 - lava_callback - DEBUG - Processing node 68d4040fcd36afa834e163e5: baseline-arm64 2025-09-26 14:31:11,362 - lava_callback - ERROR - Error processing callback for node 68d4040fcd36afa834e163e5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 14:31:12,409 - lava_callback - INFO - Received callback for node 68d691cf2f83206171a91c57 INFO: 172.20.0.1:40316 - "POST /node/68d691cf2f83206171a91c57 HTTP/1.0" 202 Accepted 2025-09-26 14:31:12,416 - lava_callback - INFO - Starting async job submit for node 68d691cf2f83206171a91c57 2025-09-26 14:31:12,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:31:12,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d691cf2f83206171a91c57 HTTP/1.1" 200 None 2025-09-26 14:31:12,495 - lava_callback - DEBUG - Processing node 68d691cf2f83206171a91c57: baseline-arm64 2025-09-26 14:31:13,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:31:13,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:31:13,592 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d691cf2f83206171a91c57/log.txt.gz 2025-09-26 14:31:13,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:31:13,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:31:13,786 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d691cf2f83206171a91c57/lava_callback.json.gz DEBUG: Setup failed for 68d691cf2f83206171a91c57. Transitting job node result: incomplete -> fail 2025-09-26 14:31:13,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:31:13,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d691cf2f83206171a91c57 HTTP/1.1" 200 None 2025-09-26 14:31:13,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:31:13,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 14:31:13,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:31:13,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d691cf2f83206171a91c57 HTTP/1.1" 200 None 2025-09-26 14:31:13,912 - lava_callback - INFO - Completed processing callback for node 68d691cf2f83206171a91c57 INFO: 172.20.0.1:40332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54752 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:32:03,030 - lava_callback - INFO - Received callback for node 68d42964a5c2c05277bc7735 INFO: 172.20.0.1:48632 - "POST /node/68d42964a5c2c05277bc7735 HTTP/1.0" 202 Accepted 2025-09-26 14:32:03,035 - lava_callback - INFO - Starting async job submit for node 68d42964a5c2c05277bc7735 2025-09-26 14:32:03,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:32:03,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42964a5c2c05277bc7735 HTTP/1.1" 200 None 2025-09-26 14:32:03,093 - lava_callback - DEBUG - Processing node 68d42964a5c2c05277bc7735: baseline-arm 2025-09-26 14:32:03,348 - lava_callback - ERROR - Error processing callback for node 68d42964a5c2c05277bc7735: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:48646 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:32:09,754 - lava_callback - INFO - Received callback for node 68d40413cd36afa834e163e8 INFO: 172.20.0.1:33184 - "POST /node/68d40413cd36afa834e163e8 HTTP/1.0" 202 Accepted 2025-09-26 14:32:09,762 - lava_callback - INFO - Starting async job submit for node 68d40413cd36afa834e163e8 2025-09-26 14:32:09,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:32:09,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40413cd36afa834e163e8 HTTP/1.1" 200 None 2025-09-26 14:32:09,814 - lava_callback - DEBUG - Processing node 68d40413cd36afa834e163e8: baseline-arm64 2025-09-26 14:32:10,705 - lava_callback - ERROR - Error processing callback for node 68d40413cd36afa834e163e8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 14:32:12,015 - lava_callback - INFO - Received callback for node 68d691d02f83206171a91c5a INFO: 172.20.0.1:33200 - "POST /node/68d691d02f83206171a91c5a HTTP/1.0" 202 Accepted 2025-09-26 14:32:12,023 - lava_callback - INFO - Starting async job submit for node 68d691d02f83206171a91c5a 2025-09-26 14:32:12,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:32:12,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d691d02f83206171a91c5a HTTP/1.1" 200 None 2025-09-26 14:32:12,089 - lava_callback - DEBUG - Processing node 68d691d02f83206171a91c5a: baseline-arm64 2025-09-26 14:32:13,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:32:13,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:32:13,171 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d691d02f83206171a91c5a/log.txt.gz 2025-09-26 14:32:13,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:32:13,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:32:13,329 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d691d02f83206171a91c5a/lava_callback.json.gz DEBUG: Setup failed for 68d691d02f83206171a91c5a. Transitting job node result: incomplete -> fail 2025-09-26 14:32:13,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:32:13,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d691d02f83206171a91c5a HTTP/1.1" 200 None 2025-09-26 14:32:13,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:32:13,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 14:32:13,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:32:13,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d691d02f83206171a91c5a HTTP/1.1" 200 None 2025-09-26 14:32:13,481 - lava_callback - INFO - Completed processing callback for node 68d691d02f83206171a91c5a INFO: 172.20.0.1:33210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33220 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:32:24,054 - lava_callback - INFO - Received callback for node 68d6936a2f83206171a91ce9 INFO: 172.20.0.1:55142 - "POST /node/68d6936a2f83206171a91ce9 HTTP/1.0" 202 Accepted 2025-09-26 14:32:24,060 - lava_callback - INFO - Starting async job submit for node 68d6936a2f83206171a91ce9 2025-09-26 14:32:24,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:32:24,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6936a2f83206171a91ce9 HTTP/1.1" 200 None 2025-09-26 14:32:24,137 - lava_callback - DEBUG - Processing node 68d6936a2f83206171a91ce9: baseline-arm64 2025-09-26 14:32:24,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:32:24,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:32:24,687 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6936a2f83206171a91ce9/log.txt.gz 2025-09-26 14:32:24,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:32:24,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:32:24,819 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6936a2f83206171a91ce9/lava_callback.json.gz 2025-09-26 14:32:24,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:32:24,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6936a2f83206171a91ce9 HTTP/1.1" 200 None 2025-09-26 14:32:24,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:32:24,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 14:32:24,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:32:24,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6936a2f83206171a91ce9 HTTP/1.1" 200 None 2025-09-26 14:32:24,895 - lava_callback - INFO - Completed processing callback for node 68d6936a2f83206171a91ce9 INFO: 172.20.0.1:55152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59464 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:33:50,716 - lava_callback - INFO - Received callback for node 68d693ab2f83206171a91d63 INFO: 172.20.0.1:44984 - "POST /node/68d693ab2f83206171a91d63 HTTP/1.0" 202 Accepted 2025-09-26 14:33:50,721 - lava_callback - INFO - Starting async job submit for node 68d693ab2f83206171a91d63 2025-09-26 14:33:50,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:33:50,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693ab2f83206171a91d63 HTTP/1.1" 200 None 2025-09-26 14:33:50,768 - lava_callback - DEBUG - Processing node 68d693ab2f83206171a91d63: baseline-arm64 2025-09-26 14:33:51,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:33:51,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:33:51,283 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693ab2f83206171a91d63/log.txt.gz 2025-09-26 14:33:51,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:33:51,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:33:51,420 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693ab2f83206171a91d63/lava_callback.json.gz 2025-09-26 14:33:51,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:33:51,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693ab2f83206171a91d63 HTTP/1.1" 200 None 2025-09-26 14:33:51,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:33:51,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 14:33:51,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:33:51,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693ab2f83206171a91d63 HTTP/1.1" 200 None 2025-09-26 14:33:51,500 - lava_callback - INFO - Completed processing callback for node 68d693ab2f83206171a91d63 INFO: 172.20.0.1:44986 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:34:03,458 - lava_callback - INFO - Received callback for node 68d6936b2f83206171a91cec INFO: 172.20.0.1:35984 - "POST /node/68d6936b2f83206171a91cec HTTP/1.0" 202 Accepted 2025-09-26 14:34:03,468 - lava_callback - INFO - Starting async job submit for node 68d6936b2f83206171a91cec 2025-09-26 14:34:03,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:34:03,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6936b2f83206171a91cec HTTP/1.1" 200 None 2025-09-26 14:34:03,506 - lava_callback - DEBUG - Processing node 68d6936b2f83206171a91cec: baseline-arm64 2025-09-26 14:34:03,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:34:04,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:34:04,077 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6936b2f83206171a91cec/log.txt.gz 2025-09-26 14:34:04,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:34:04,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:34:04,204 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6936b2f83206171a91cec/lava_callback.json.gz 2025-09-26 14:34:04,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:34:04,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6936b2f83206171a91cec HTTP/1.1" 200 None 2025-09-26 14:34:04,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:34:04,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 14:34:04,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:34:04,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6936b2f83206171a91cec HTTP/1.1" 200 None 2025-09-26 14:34:04,308 - lava_callback - INFO - Completed processing callback for node 68d6936b2f83206171a91cec INFO: 172.20.0.1:35986 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:34:13,179 - lava_callback - INFO - Received callback for node 68d4015ccd36afa834e15b7e INFO: 172.20.0.1:52784 - "POST /node/68d4015ccd36afa834e15b7e HTTP/1.0" 202 Accepted 2025-09-26 14:34:13,187 - lava_callback - INFO - Starting async job submit for node 68d4015ccd36afa834e15b7e 2025-09-26 14:34:13,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:34:13,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4015ccd36afa834e15b7e HTTP/1.1" 200 None 2025-09-26 14:34:13,202 - lava_callback - DEBUG - Processing node 68d4015ccd36afa834e15b7e: baseline-arm64-baylibre 2025-09-26 14:34:13,202 - lava_callback - ERROR - Error processing callback for node 68d4015ccd36afa834e15b7e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:34:13,853 - lava_callback - INFO - Received callback for node 68d40162cd36afa834e15b81 INFO: 172.20.0.1:52788 - "POST /node/68d40162cd36afa834e15b81 HTTP/1.0" 202 Accepted 2025-09-26 14:34:13,858 - lava_callback - INFO - Starting async job submit for node 68d40162cd36afa834e15b81 2025-09-26 14:34:13,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:34:13,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40162cd36afa834e15b81 HTTP/1.1" 200 None 2025-09-26 14:34:13,871 - lava_callback - DEBUG - Processing node 68d40162cd36afa834e15b81: baseline-arm64-baylibre 2025-09-26 14:34:13,871 - lava_callback - ERROR - Error processing callback for node 68d40162cd36afa834e15b81: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:52802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36682 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:34:29,112 - lava_callback - INFO - Received callback for node 68d40414cd36afa834e163eb INFO: 172.20.0.1:36690 - "POST /node/68d40414cd36afa834e163eb HTTP/1.0" 202 Accepted 2025-09-26 14:34:29,119 - lava_callback - INFO - Starting async job submit for node 68d40414cd36afa834e163eb 2025-09-26 14:34:29,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:34:29,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40414cd36afa834e163eb HTTP/1.1" 200 None 2025-09-26 14:34:29,172 - lava_callback - DEBUG - Processing node 68d40414cd36afa834e163eb: baseline-arm64 2025-09-26 14:34:30,057 - lava_callback - ERROR - Error processing callback for node 68d40414cd36afa834e163eb: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 14:34:33,207 - lava_callback - INFO - Received callback for node 68d40167cd36afa834e15b84 INFO: 172.20.0.1:39546 - "POST /node/68d40167cd36afa834e15b84 HTTP/1.0" 202 Accepted 2025-09-26 14:34:33,212 - lava_callback - INFO - Starting async job submit for node 68d40167cd36afa834e15b84 2025-09-26 14:34:33,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:34:33,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40167cd36afa834e15b84 HTTP/1.1" 200 None 2025-09-26 14:34:33,225 - lava_callback - DEBUG - Processing node 68d40167cd36afa834e15b84: baseline-arm64-baylibre 2025-09-26 14:34:33,225 - lava_callback - ERROR - Error processing callback for node 68d40167cd36afa834e15b84: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:39550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36440 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:35:02,246 - lava_callback - INFO - Received callback for node 68d42964a5c2c05277bc7738 INFO: 172.20.0.1:41650 - "POST /node/68d42964a5c2c05277bc7738 HTTP/1.0" 202 Accepted 2025-09-26 14:35:02,252 - lava_callback - INFO - Starting async job submit for node 68d42964a5c2c05277bc7738 2025-09-26 14:35:02,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:35:02,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42964a5c2c05277bc7738 HTTP/1.1" 200 None 2025-09-26 14:35:02,288 - lava_callback - DEBUG - Processing node 68d42964a5c2c05277bc7738: baseline-arm 2025-09-26 14:35:02,515 - lava_callback - ERROR - Error processing callback for node 68d42964a5c2c05277bc7738: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:41662 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:35:09,672 - lava_callback - INFO - Received callback for node 68d693ac2f83206171a91d66 INFO: 172.20.0.1:46404 - "POST /node/68d693ac2f83206171a91d66 HTTP/1.0" 202 Accepted 2025-09-26 14:35:09,678 - lava_callback - INFO - Starting async job submit for node 68d693ac2f83206171a91d66 2025-09-26 14:35:09,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:35:09,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693ac2f83206171a91d66 HTTP/1.1" 200 None 2025-09-26 14:35:09,735 - lava_callback - DEBUG - Processing node 68d693ac2f83206171a91d66: baseline-arm64 2025-09-26 14:35:10,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:35:10,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:35:10,226 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693ac2f83206171a91d66/log.txt.gz 2025-09-26 14:35:10,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:35:10,419 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:35:10,420 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693ac2f83206171a91d66/lava_callback.json.gz 2025-09-26 14:35:10,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:35:10,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693ac2f83206171a91d66 HTTP/1.1" 200 None 2025-09-26 14:35:10,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:35:10,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 14:35:10,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:35:10,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693ac2f83206171a91d66 HTTP/1.1" 200 None 2025-09-26 14:35:10,495 - lava_callback - INFO - Completed processing callback for node 68d693ac2f83206171a91d66 INFO: 172.20.0.1:46406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46428 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:35:24,214 - lava_callback - INFO - Received callback for node 68d693b82f83206171a91d7b INFO: 172.20.0.1:50878 - "POST /node/68d693b82f83206171a91d7b HTTP/1.0" 202 Accepted 2025-09-26 14:35:24,220 - lava_callback - INFO - Starting async job submit for node 68d693b82f83206171a91d7b 2025-09-26 14:35:24,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:35:24,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693b82f83206171a91d7b HTTP/1.1" 200 None 2025-09-26 14:35:24,253 - lava_callback - DEBUG - Processing node 68d693b82f83206171a91d7b: baseline-arm64 2025-09-26 14:35:24,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:35:24,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:35:24,788 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693b82f83206171a91d7b/log.txt.gz 2025-09-26 14:35:24,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:35:24,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:35:24,934 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693b82f83206171a91d7b/lava_callback.json.gz 2025-09-26 14:35:24,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:35:24,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693b82f83206171a91d7b HTTP/1.1" 200 None 2025-09-26 14:35:24,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:35:24,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 14:35:24,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:35:25,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693b82f83206171a91d7b HTTP/1.1" 200 None 2025-09-26 14:35:25,019 - lava_callback - INFO - Completed processing callback for node 68d693b82f83206171a91d7b INFO: 172.20.0.1:50882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33650 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:35:46,983 - lava_callback - INFO - Received callback for node 68d6922a2f83206171a91c73 INFO: 172.20.0.1:33660 - "POST /node/68d6922a2f83206171a91c73 HTTP/1.0" 202 Accepted 2025-09-26 14:35:46,991 - lava_callback - INFO - Starting async job submit for node 68d6922a2f83206171a91c73 2025-09-26 14:35:47,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:35:47,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6922a2f83206171a91c73 HTTP/1.1" 200 None 2025-09-26 14:35:47,040 - lava_callback - DEBUG - Processing node 68d6922a2f83206171a91c73: baseline-arm64 2025-09-26 14:35:47,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:35:48,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:35:48,114 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6922a2f83206171a91c73/log.txt.gz 2025-09-26 14:35:48,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:35:48,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:35:48,309 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6922a2f83206171a91c73/lava_callback.json.gz DEBUG: Setup failed for 68d6922a2f83206171a91c73. Transitting job node result: incomplete -> fail 2025-09-26 14:35:48,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:35:48,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6922a2f83206171a91c73 HTTP/1.1" 200 None 2025-09-26 14:35:48,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:35:48,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 14:35:48,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:35:48,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6922a2f83206171a91c73 HTTP/1.1" 200 None 2025-09-26 14:35:48,440 - lava_callback - INFO - Completed processing callback for node 68d6922a2f83206171a91c73 INFO: 172.20.0.1:36582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51164 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:36:29,793 - lava_callback - INFO - Received callback for node 68d693ae2f83206171a91d69 INFO: 172.20.0.1:42782 - "POST /node/68d693ae2f83206171a91d69 HTTP/1.0" 202 Accepted 2025-09-26 14:36:29,799 - lava_callback - INFO - Starting async job submit for node 68d693ae2f83206171a91d69 2025-09-26 14:36:29,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:36:29,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693ae2f83206171a91d69 HTTP/1.1" 200 None 2025-09-26 14:36:29,853 - lava_callback - DEBUG - Processing node 68d693ae2f83206171a91d69: baseline-arm64 2025-09-26 14:36:30,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:36:30,351 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:36:30,352 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693ae2f83206171a91d69/log.txt.gz 2025-09-26 14:36:30,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:36:30,507 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:36:30,508 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693ae2f83206171a91d69/lava_callback.json.gz 2025-09-26 14:36:30,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:36:30,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693ae2f83206171a91d69 HTTP/1.1" 200 None 2025-09-26 14:36:30,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:36:30,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 14:36:30,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:36:30,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693ae2f83206171a91d69 HTTP/1.1" 200 None 2025-09-26 14:36:30,627 - lava_callback - INFO - Completed processing callback for node 68d693ae2f83206171a91d69 INFO: 172.20.0.1:42798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36016 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:37:03,300 - lava_callback - INFO - Received callback for node 68d4296ca5c2c05277bc775c INFO: 172.20.0.1:43972 - "POST /node/68d4296ca5c2c05277bc775c HTTP/1.0" 202 Accepted 2025-09-26 14:37:03,305 - lava_callback - INFO - Starting async job submit for node 68d4296ca5c2c05277bc775c 2025-09-26 14:37:03,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:37:03,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4296ca5c2c05277bc775c HTTP/1.1" 200 None 2025-09-26 14:37:03,341 - lava_callback - DEBUG - Processing node 68d4296ca5c2c05277bc775c: baseline-arm 2025-09-26 14:37:03,560 - lava_callback - ERROR - Error processing callback for node 68d4296ca5c2c05277bc775c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:43974 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:37:07,186 - lava_callback - INFO - Received callback for node 68d693b82f83206171a91d7e INFO: 172.20.0.1:43980 - "POST /node/68d693b82f83206171a91d7e HTTP/1.0" 202 Accepted 2025-09-26 14:37:07,192 - lava_callback - INFO - Starting async job submit for node 68d693b82f83206171a91d7e 2025-09-26 14:37:07,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:37:07,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693b82f83206171a91d7e HTTP/1.1" 200 None 2025-09-26 14:37:07,226 - lava_callback - DEBUG - Processing node 68d693b82f83206171a91d7e: baseline-arm64 2025-09-26 14:37:07,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:37:07,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:37:07,793 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693b82f83206171a91d7e/log.txt.gz 2025-09-26 14:37:07,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:37:07,845 - lava_callback - INFO - Received callback for node 68d6a4f52f83206171a923f7 INFO: 172.20.0.1:43990 - "POST /node/68d6a4f52f83206171a923f7 HTTP/1.0" 202 Accepted 2025-09-26 14:37:07,852 - lava_callback - INFO - Starting async job submit for node 68d6a4f52f83206171a923f7 2025-09-26 14:37:07,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:37:07,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a4f52f83206171a923f7 HTTP/1.1" 200 None 2025-09-26 14:37:07,884 - lava_callback - DEBUG - Processing node 68d6a4f52f83206171a923f7: baseline-x86 2025-09-26 14:37:07,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:37:07,999 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693b82f83206171a91d7e/lava_callback.json.gz 2025-09-26 14:37:08,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:37:08,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:37:08,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693b82f83206171a91d7e HTTP/1.1" 200 None 2025-09-26 14:37:08,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:37:08,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 14:37:08,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:37:08,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693b82f83206171a91d7e HTTP/1.1" 200 None 2025-09-26 14:37:08,149 - lava_callback - INFO - Completed processing callback for node 68d693b82f83206171a91d7e 2025-09-26 14:37:08,238 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:37:08,239 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d6a4f52f83206171a923f7/log.txt.gz 2025-09-26 14:37:08,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:37:08,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:37:08,398 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d6a4f52f83206171a923f7/lava_callback.json.gz 2025-09-26 14:37:08,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:37:08,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a4f52f83206171a923f7 HTTP/1.1" 200 None 2025-09-26 14:37:08,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:37:08,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d649055d233c363a762366 HTTP/1.1" 200 None 2025-09-26 14:37:08,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:37:08,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a4f52f83206171a923f7 HTTP/1.1" 200 None 2025-09-26 14:37:08,484 - lava_callback - INFO - Completed processing callback for node 68d6a4f52f83206171a923f7 INFO: 172.20.0.1:34610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34260 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:37:24,809 - lava_callback - INFO - Received callback for node 68d693682f83206171a91ce6 INFO: 172.20.0.1:34276 - "POST /node/68d693682f83206171a91ce6 HTTP/1.0" 202 Accepted 2025-09-26 14:37:24,818 - lava_callback - INFO - Starting async job submit for node 68d693682f83206171a91ce6 2025-09-26 14:37:24,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:37:24,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693682f83206171a91ce6 HTTP/1.1" 200 None 2025-09-26 14:37:24,871 - lava_callback - DEBUG - Processing node 68d693682f83206171a91ce6: baseline-arm64 INFO: 172.20.0.1:34278 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:37:25,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:37:25,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:37:25,704 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693682f83206171a91ce6/log.txt.gz 2025-09-26 14:37:25,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:37:25,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:37:25,834 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693682f83206171a91ce6/lava_callback.json.gz DEBUG: 68d693682f83206171a91ce6 Transitting job node result: pass -> incomplete 2025-09-26 14:37:25,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:37:25,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693682f83206171a91ce6 HTTP/1.1" 200 None 2025-09-26 14:37:25,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:37:25,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 14:37:25,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:37:25,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693682f83206171a91ce6 HTTP/1.1" 200 None 2025-09-26 14:37:25,935 - lava_callback - INFO - Completed processing callback for node 68d693682f83206171a91ce6 INFO: 172.20.0.1:34288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54832 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:37:49,895 - lava_callback - INFO - Received callback for node 68d693af2f83206171a91d6c INFO: 172.20.0.1:56022 - "POST /node/68d693af2f83206171a91d6c HTTP/1.0" 202 Accepted 2025-09-26 14:37:49,901 - lava_callback - INFO - Starting async job submit for node 68d693af2f83206171a91d6c 2025-09-26 14:37:49,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:37:49,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693af2f83206171a91d6c HTTP/1.1" 200 None 2025-09-26 14:37:49,934 - lava_callback - DEBUG - Processing node 68d693af2f83206171a91d6c: baseline-arm64 2025-09-26 14:37:50,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:37:50,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:37:50,413 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693af2f83206171a91d6c/log.txt.gz 2025-09-26 14:37:50,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:37:50,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:37:50,555 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693af2f83206171a91d6c/lava_callback.json.gz 2025-09-26 14:37:50,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:37:50,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693af2f83206171a91d6c HTTP/1.1" 200 None 2025-09-26 14:37:50,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:37:50,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 14:37:50,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:37:50,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693af2f83206171a91d6c HTTP/1.1" 200 None 2025-09-26 14:37:50,630 - lava_callback - INFO - Completed processing callback for node 68d693af2f83206171a91d6c INFO: 172.20.0.1:56030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50350 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:38:37,121 - lava_callback - INFO - Received callback for node 68d40099cd36afa834e15af1 INFO: 172.20.0.1:50362 - "POST /node/68d40099cd36afa834e15af1 HTTP/1.0" 202 Accepted 2025-09-26 14:38:37,129 - lava_callback - INFO - Starting async job submit for node 68d40099cd36afa834e15af1 2025-09-26 14:38:37,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:38:37,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40099cd36afa834e15af1 HTTP/1.1" 200 None 2025-09-26 14:38:37,188 - lava_callback - DEBUG - Processing node 68d40099cd36afa834e15af1: ltp-syscalls-ipc 2025-09-26 14:38:38,122 - lava_callback - ERROR - Error processing callback for node 68d40099cd36afa834e15af1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:46626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34136 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:38:57,113 - lava_callback - INFO - Received callback for node 68d4296ca5c2c05277bc775f INFO: 172.20.0.1:34148 - "POST /node/68d4296ca5c2c05277bc775f HTTP/1.0" 202 Accepted 2025-09-26 14:38:57,119 - lava_callback - INFO - Starting async job submit for node 68d4296ca5c2c05277bc775f 2025-09-26 14:38:57,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:38:57,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4296ca5c2c05277bc775f HTTP/1.1" 200 None 2025-09-26 14:38:57,160 - lava_callback - DEBUG - Processing node 68d4296ca5c2c05277bc775f: baseline-arm 2025-09-26 14:38:57,382 - lava_callback - ERROR - Error processing callback for node 68d4296ca5c2c05277bc775f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 14:39:03,580 - lava_callback - INFO - Received callback for node 68d694862f83206171a91e9c INFO: 172.20.0.1:51812 - "POST /node/68d694862f83206171a91e9c HTTP/1.0" 202 Accepted 2025-09-26 14:39:03,586 - lava_callback - INFO - Starting async job submit for node 68d694862f83206171a91e9c 2025-09-26 14:39:03,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:39:03,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694862f83206171a91e9c HTTP/1.1" 200 None 2025-09-26 14:39:03,639 - lava_callback - DEBUG - Processing node 68d694862f83206171a91e9c: baseline-arm64 2025-09-26 14:39:03,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:39:04,123 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:39:04,124 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694862f83206171a91e9c/log.txt.gz 2025-09-26 14:39:04,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:39:04,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:39:04,254 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694862f83206171a91e9c/lava_callback.json.gz 2025-09-26 14:39:04,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:39:04,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694862f83206171a91e9c HTTP/1.1" 200 None 2025-09-26 14:39:04,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:39:04,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 14:39:04,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:39:04,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694862f83206171a91e9c HTTP/1.1" 200 None 2025-09-26 14:39:04,329 - lava_callback - INFO - Completed processing callback for node 68d694862f83206171a91e9c 2025-09-26 14:39:05,117 - lava_callback - INFO - Received callback for node 68d693bb2f83206171a91d84 INFO: 172.20.0.1:51828 - "POST /node/68d693bb2f83206171a91d84 HTTP/1.0" 202 Accepted 2025-09-26 14:39:05,123 - lava_callback - INFO - Starting async job submit for node 68d693bb2f83206171a91d84 2025-09-26 14:39:05,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:39:05,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693bb2f83206171a91d84 HTTP/1.1" 200 None 2025-09-26 14:39:05,162 - lava_callback - DEBUG - Processing node 68d693bb2f83206171a91d84: baseline-arm64 2025-09-26 14:39:05,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:39:05,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:39:05,721 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693bb2f83206171a91d84/log.txt.gz 2025-09-26 14:39:05,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:39:05,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:39:05,856 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693bb2f83206171a91d84/lava_callback.json.gz 2025-09-26 14:39:05,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:39:05,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693bb2f83206171a91d84 HTTP/1.1" 200 None 2025-09-26 14:39:05,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:39:05,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 14:39:05,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:39:05,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693bb2f83206171a91d84 HTTP/1.1" 200 None 2025-09-26 14:39:05,929 - lava_callback - INFO - Completed processing callback for node 68d693bb2f83206171a91d84 INFO: 172.20.0.1:51840 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:39:09,759 - lava_callback - INFO - Received callback for node 68d694872f83206171a91ea3 INFO: 172.20.0.1:45360 - "POST /node/68d694872f83206171a91ea3 HTTP/1.0" 202 Accepted 2025-09-26 14:39:09,765 - lava_callback - INFO - Starting async job submit for node 68d694872f83206171a91ea3 2025-09-26 14:39:09,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:39:09,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694872f83206171a91ea3 HTTP/1.1" 200 None 2025-09-26 14:39:09,797 - lava_callback - DEBUG - Processing node 68d694872f83206171a91ea3: baseline-arm64 2025-09-26 14:39:10,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:39:10,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:39:10,249 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694872f83206171a91ea3/log.txt.gz 2025-09-26 14:39:10,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:39:10,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:39:10,369 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694872f83206171a91ea3/lava_callback.json.gz 2025-09-26 14:39:10,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:39:10,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694872f83206171a91ea3 HTTP/1.1" 200 None 2025-09-26 14:39:10,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:39:10,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 14:39:10,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:39:10,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694872f83206171a91ea3 HTTP/1.1" 200 None 2025-09-26 14:39:10,446 - lava_callback - INFO - Completed processing callback for node 68d694872f83206171a91ea3 INFO: 172.20.0.1:45362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47938 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:39:30,837 - lava_callback - INFO - Received callback for node 68d6a1422f83206171a9231c INFO: 172.20.0.1:51230 - "POST /node/68d6a1422f83206171a9231c HTTP/1.0" 202 Accepted 2025-09-26 14:39:30,844 - lava_callback - INFO - Starting async job submit for node 68d6a1422f83206171a9231c 2025-09-26 14:39:30,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:39:30,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a1422f83206171a9231c HTTP/1.1" 200 None 2025-09-26 14:39:30,891 - lava_callback - DEBUG - Processing node 68d6a1422f83206171a9231c: baseline-arm 2025-09-26 14:39:31,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:39:31,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:39:31,422 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d6a1422f83206171a9231c/log.txt.gz 2025-09-26 14:39:31,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:39:31,555 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:39:31,555 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d6a1422f83206171a9231c/lava_callback.json.gz DEBUG: Setup failed for 68d6a1422f83206171a9231c. Transitting job node result: incomplete -> fail 2025-09-26 14:39:31,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:39:31,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a1422f83206171a9231c HTTP/1.1" 200 None 2025-09-26 14:39:31,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:39:31,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648e95d233c363a76234e HTTP/1.1" 200 None 2025-09-26 14:39:31,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:39:31,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a1422f83206171a9231c HTTP/1.1" 200 None 2025-09-26 14:39:31,672 - lava_callback - INFO - Completed processing callback for node 68d6a1422f83206171a9231c INFO: 172.20.0.1:51242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55174 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:40:12,874 - lava_callback - INFO - Received callback for node 68d692292f83206171a91c70 INFO: 172.20.0.1:35652 - "POST /node/68d692292f83206171a91c70 HTTP/1.0" 202 Accepted 2025-09-26 14:40:12,881 - lava_callback - INFO - Starting async job submit for node 68d692292f83206171a91c70 2025-09-26 14:40:12,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:40:12,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d692292f83206171a91c70 HTTP/1.1" 200 None 2025-09-26 14:40:12,947 - lava_callback - DEBUG - Processing node 68d692292f83206171a91c70: baseline-arm64 2025-09-26 14:40:13,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:40:14,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:40:14,240 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d692292f83206171a91c70/log.txt.gz 2025-09-26 14:40:14,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:40:14,558 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:40:14,559 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d692292f83206171a91c70/lava_callback.json.gz DEBUG: Setup failed for 68d692292f83206171a91c70. Transitting job node result: incomplete -> fail 2025-09-26 14:40:14,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:40:14,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d692292f83206171a91c70 HTTP/1.1" 200 None 2025-09-26 14:40:14,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:40:14,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 14:40:14,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:40:14,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d692292f83206171a91c70 HTTP/1.1" 200 None 2025-09-26 14:40:14,714 - lava_callback - INFO - Completed processing callback for node 68d692292f83206171a91c70 INFO: 172.20.0.1:35668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53712 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:40:23,290 - lava_callback - INFO - Received callback for node 68d694a32f83206171a91ede INFO: 172.20.0.1:53728 - "POST /node/68d694a32f83206171a91ede HTTP/1.0" 202 Accepted 2025-09-26 14:40:23,296 - lava_callback - INFO - Starting async job submit for node 68d694a32f83206171a91ede 2025-09-26 14:40:23,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:40:23,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694a32f83206171a91ede HTTP/1.1" 200 None 2025-09-26 14:40:23,329 - lava_callback - DEBUG - Processing node 68d694a32f83206171a91ede: baseline-arm64 2025-09-26 14:40:23,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:40:23,808 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:40:23,809 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694a32f83206171a91ede/log.txt.gz 2025-09-26 14:40:23,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:40:23,935 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:40:23,935 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694a32f83206171a91ede/lava_callback.json.gz 2025-09-26 14:40:23,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:40:23,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694a32f83206171a91ede HTTP/1.1" 200 None 2025-09-26 14:40:23,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:40:23,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 14:40:23,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:40:24,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694a32f83206171a91ede HTTP/1.1" 200 None 2025-09-26 14:40:24,015 - lava_callback - INFO - Completed processing callback for node 68d694a32f83206171a91ede INFO: 172.20.0.1:53736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53742 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:40:30,204 - lava_callback - INFO - Received callback for node 68d694a42f83206171a91ee1 INFO: 172.20.0.1:50540 - "POST /node/68d694a42f83206171a91ee1 HTTP/1.0" 202 Accepted 2025-09-26 14:40:30,210 - lava_callback - INFO - Starting async job submit for node 68d694a42f83206171a91ee1 2025-09-26 14:40:30,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:40:30,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694a42f83206171a91ee1 HTTP/1.1" 200 None 2025-09-26 14:40:30,244 - lava_callback - DEBUG - Processing node 68d694a42f83206171a91ee1: baseline-arm64 2025-09-26 14:40:30,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:40:30,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:40:30,696 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694a42f83206171a91ee1/log.txt.gz 2025-09-26 14:40:30,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:40:30,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:40:30,807 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694a42f83206171a91ee1/lava_callback.json.gz 2025-09-26 14:40:30,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:40:30,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694a42f83206171a91ee1 HTTP/1.1" 200 None 2025-09-26 14:40:30,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:40:30,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 14:40:30,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:40:30,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694a42f83206171a91ee1 HTTP/1.1" 200 None 2025-09-26 14:40:30,895 - lava_callback - INFO - Completed processing callback for node 68d694a42f83206171a91ee1 INFO: 172.20.0.1:50544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57576 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:41:04,672 - lava_callback - INFO - Received callback for node 68d42970a5c2c05277bc7762 INFO: 172.20.0.1:46138 - "POST /node/68d42970a5c2c05277bc7762 HTTP/1.0" 202 Accepted 2025-09-26 14:41:04,678 - lava_callback - INFO - Starting async job submit for node 68d42970a5c2c05277bc7762 2025-09-26 14:41:04,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:41:04,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42970a5c2c05277bc7762 HTTP/1.1" 200 None 2025-09-26 14:41:04,711 - lava_callback - DEBUG - Processing node 68d42970a5c2c05277bc7762: baseline-arm 2025-09-26 14:41:04,934 - lava_callback - ERROR - Error processing callback for node 68d42970a5c2c05277bc7762: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:46154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37072 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:41:24,652 - lava_callback - INFO - Received callback for node 68d40310cd36afa834e1626c INFO: 172.20.0.1:37078 - "POST /node/68d40310cd36afa834e1626c HTTP/1.0" 202 Accepted 2025-09-26 14:41:24,657 - lava_callback - INFO - Starting async job submit for node 68d40310cd36afa834e1626c 2025-09-26 14:41:24,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:41:24,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40310cd36afa834e1626c HTTP/1.1" 200 None 2025-09-26 14:41:24,691 - lava_callback - DEBUG - Processing node 68d40310cd36afa834e1626c: baseline-arm 2025-09-26 14:41:24,691 - lava_callback - ERROR - Error processing callback for node 68d40310cd36afa834e1626c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:37080 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:41:25,366 - lava_callback - INFO - Received callback for node 68d40311cd36afa834e1626f INFO: 172.20.0.1:37082 - "POST /node/68d40311cd36afa834e1626f HTTP/1.0" 202 Accepted 2025-09-26 14:41:25,371 - lava_callback - INFO - Starting async job submit for node 68d40311cd36afa834e1626f 2025-09-26 14:41:25,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:41:25,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40311cd36afa834e1626f HTTP/1.1" 200 None 2025-09-26 14:41:25,395 - lava_callback - DEBUG - Processing node 68d40311cd36afa834e1626f: baseline-arm 2025-09-26 14:41:25,395 - lava_callback - ERROR - Error processing callback for node 68d40311cd36afa834e1626f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:37090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39316 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:41:45,030 - lava_callback - INFO - Received callback for node 68d40315cd36afa834e16273 INFO: 172.20.0.1:34406 - "POST /node/68d40315cd36afa834e16273 HTTP/1.0" 202 Accepted 2025-09-26 14:41:45,036 - lava_callback - INFO - Starting async job submit for node 68d40315cd36afa834e16273 2025-09-26 14:41:45,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:41:45,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40315cd36afa834e16273 HTTP/1.1" 200 None 2025-09-26 14:41:45,051 - lava_callback - DEBUG - Processing node 68d40315cd36afa834e16273: baseline-arm 2025-09-26 14:41:45,051 - lava_callback - ERROR - Error processing callback for node 68d40315cd36afa834e16273: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:41:45,772 - lava_callback - INFO - Received callback for node 68d40316cd36afa834e16276 INFO: 172.20.0.1:34410 - "POST /node/68d40316cd36afa834e16276 HTTP/1.0" 202 Accepted 2025-09-26 14:41:45,777 - lava_callback - INFO - Starting async job submit for node 68d40316cd36afa834e16276 2025-09-26 14:41:45,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:41:45,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40316cd36afa834e16276 HTTP/1.1" 200 None 2025-09-26 14:41:45,791 - lava_callback - DEBUG - Processing node 68d40316cd36afa834e16276: baseline-arm 2025-09-26 14:41:45,791 - lava_callback - ERROR - Error processing callback for node 68d40316cd36afa834e16276: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:41:46,487 - lava_callback - INFO - Received callback for node 68d40317cd36afa834e16279 INFO: 172.20.0.1:34422 - "POST /node/68d40317cd36afa834e16279 HTTP/1.0" 202 Accepted 2025-09-26 14:41:46,493 - lava_callback - INFO - Starting async job submit for node 68d40317cd36afa834e16279 2025-09-26 14:41:46,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:41:46,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40317cd36afa834e16279 HTTP/1.1" 200 None 2025-09-26 14:41:46,512 - lava_callback - DEBUG - Processing node 68d40317cd36afa834e16279: baseline-arm 2025-09-26 14:41:46,512 - lava_callback - ERROR - Error processing callback for node 68d40317cd36afa834e16279: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:34424 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:41:47,227 - lava_callback - INFO - Received callback for node 68d40319cd36afa834e1627c INFO: 172.20.0.1:34430 - "POST /node/68d40319cd36afa834e1627c HTTP/1.0" 202 Accepted 2025-09-26 14:41:47,233 - lava_callback - INFO - Starting async job submit for node 68d40319cd36afa834e1627c 2025-09-26 14:41:47,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:41:47,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40319cd36afa834e1627c HTTP/1.1" 200 None 2025-09-26 14:41:47,246 - lava_callback - DEBUG - Processing node 68d40319cd36afa834e1627c: baseline-arm 2025-09-26 14:41:47,247 - lava_callback - ERROR - Error processing callback for node 68d40319cd36afa834e1627c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:41:47,945 - lava_callback - INFO - Received callback for node 68d4031dcd36afa834e1627f INFO: 172.20.0.1:34434 - "POST /node/68d4031dcd36afa834e1627f HTTP/1.0" 202 Accepted 2025-09-26 14:41:47,951 - lava_callback - INFO - Starting async job submit for node 68d4031dcd36afa834e1627f 2025-09-26 14:41:47,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:41:47,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4031dcd36afa834e1627f HTTP/1.1" 200 None 2025-09-26 14:41:47,968 - lava_callback - DEBUG - Processing node 68d4031dcd36afa834e1627f: baseline-arm 2025-09-26 14:41:47,968 - lava_callback - ERROR - Error processing callback for node 68d4031dcd36afa834e1627f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:41:48,673 - lava_callback - INFO - Received callback for node 68d4031ecd36afa834e16282 INFO: 172.20.0.1:34446 - "POST /node/68d4031ecd36afa834e16282 HTTP/1.0" 202 Accepted 2025-09-26 14:41:48,679 - lava_callback - INFO - Starting async job submit for node 68d4031ecd36afa834e16282 2025-09-26 14:41:48,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:41:48,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4031ecd36afa834e16282 HTTP/1.1" 200 None 2025-09-26 14:41:48,697 - lava_callback - DEBUG - Processing node 68d4031ecd36afa834e16282: baseline-arm 2025-09-26 14:41:48,697 - lava_callback - ERROR - Error processing callback for node 68d4031ecd36afa834e16282: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:41:49,354 - lava_callback - INFO - Received callback for node 68d40320cd36afa834e16285 INFO: 172.20.0.1:34454 - "POST /node/68d40320cd36afa834e16285 HTTP/1.0" 202 Accepted 2025-09-26 14:41:49,359 - lava_callback - INFO - Starting async job submit for node 68d40320cd36afa834e16285 2025-09-26 14:41:49,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:41:49,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40320cd36afa834e16285 HTTP/1.1" 200 None 2025-09-26 14:41:49,389 - lava_callback - DEBUG - Processing node 68d40320cd36afa834e16285: baseline-arm 2025-09-26 14:41:49,390 - lava_callback - ERROR - Error processing callback for node 68d40320cd36afa834e16285: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:41:50,070 - lava_callback - INFO - Received callback for node 68d40321cd36afa834e16288 INFO: 172.20.0.1:34466 - "POST /node/68d40321cd36afa834e16288 HTTP/1.0" 202 Accepted 2025-09-26 14:41:50,076 - lava_callback - INFO - Starting async job submit for node 68d40321cd36afa834e16288 2025-09-26 14:41:50,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:41:50,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40321cd36afa834e16288 HTTP/1.1" 200 None 2025-09-26 14:41:50,090 - lava_callback - DEBUG - Processing node 68d40321cd36afa834e16288: baseline-arm 2025-09-26 14:41:50,090 - lava_callback - ERROR - Error processing callback for node 68d40321cd36afa834e16288: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:41:50,790 - lava_callback - INFO - Received callback for node 68d40325cd36afa834e1628b INFO: 172.20.0.1:34470 - "POST /node/68d40325cd36afa834e1628b HTTP/1.0" 202 Accepted 2025-09-26 14:41:50,795 - lava_callback - INFO - Starting async job submit for node 68d40325cd36afa834e1628b 2025-09-26 14:41:50,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:41:50,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40325cd36afa834e1628b HTTP/1.1" 200 None 2025-09-26 14:41:50,811 - lava_callback - DEBUG - Processing node 68d40325cd36afa834e1628b: baseline-arm 2025-09-26 14:41:50,811 - lava_callback - ERROR - Error processing callback for node 68d40325cd36afa834e1628b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:41:51,528 - lava_callback - INFO - Received callback for node 68d40326cd36afa834e1628e INFO: 172.20.0.1:34482 - "POST /node/68d40326cd36afa834e1628e HTTP/1.0" 202 Accepted 2025-09-26 14:41:51,533 - lava_callback - INFO - Starting async job submit for node 68d40326cd36afa834e1628e 2025-09-26 14:41:51,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:41:51,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40326cd36afa834e1628e HTTP/1.1" 200 None 2025-09-26 14:41:51,557 - lava_callback - DEBUG - Processing node 68d40326cd36afa834e1628e: baseline-arm 2025-09-26 14:41:51,557 - lava_callback - ERROR - Error processing callback for node 68d40326cd36afa834e1628e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:34498 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:42:05,229 - lava_callback - INFO - Received callback for node 68d40328cd36afa834e16291 INFO: 172.20.0.1:33038 - "POST /node/68d40328cd36afa834e16291 HTTP/1.0" 202 Accepted 2025-09-26 14:42:05,234 - lava_callback - INFO - Starting async job submit for node 68d40328cd36afa834e16291 2025-09-26 14:42:05,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:42:05,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40328cd36afa834e16291 HTTP/1.1" 200 None 2025-09-26 14:42:05,253 - lava_callback - DEBUG - Processing node 68d40328cd36afa834e16291: baseline-arm 2025-09-26 14:42:05,253 - lava_callback - ERROR - Error processing callback for node 68d40328cd36afa834e16291: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:42:05,961 - lava_callback - INFO - Received callback for node 68d4032acd36afa834e16294 INFO: 172.20.0.1:33044 - "POST /node/68d4032acd36afa834e16294 HTTP/1.0" 202 Accepted 2025-09-26 14:42:05,967 - lava_callback - INFO - Starting async job submit for node 68d4032acd36afa834e16294 2025-09-26 14:42:05,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:42:05,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4032acd36afa834e16294 HTTP/1.1" 200 None 2025-09-26 14:42:05,981 - lava_callback - DEBUG - Processing node 68d4032acd36afa834e16294: baseline-arm 2025-09-26 14:42:05,981 - lava_callback - ERROR - Error processing callback for node 68d4032acd36afa834e16294: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:33058 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:42:06,688 - lava_callback - INFO - Received callback for node 68d40331cd36afa834e1629a INFO: 172.20.0.1:33072 - "POST /node/68d40331cd36afa834e1629a HTTP/1.0" 202 Accepted 2025-09-26 14:42:06,693 - lava_callback - INFO - Starting async job submit for node 68d40331cd36afa834e1629a 2025-09-26 14:42:06,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:42:06,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40331cd36afa834e1629a HTTP/1.1" 200 None 2025-09-26 14:42:06,708 - lava_callback - DEBUG - Processing node 68d40331cd36afa834e1629a: baseline-arm 2025-09-26 14:42:06,708 - lava_callback - ERROR - Error processing callback for node 68d40331cd36afa834e1629a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:42:07,393 - lava_callback - INFO - Received callback for node 68d40332cd36afa834e1629d INFO: 172.20.0.1:33080 - "POST /node/68d40332cd36afa834e1629d HTTP/1.0" 202 Accepted 2025-09-26 14:42:07,399 - lava_callback - INFO - Starting async job submit for node 68d40332cd36afa834e1629d 2025-09-26 14:42:07,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:42:07,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40332cd36afa834e1629d HTTP/1.1" 200 None 2025-09-26 14:42:07,411 - lava_callback - DEBUG - Processing node 68d40332cd36afa834e1629d: baseline-arm 2025-09-26 14:42:07,412 - lava_callback - ERROR - Error processing callback for node 68d40332cd36afa834e1629d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:42:08,101 - lava_callback - INFO - Received callback for node 68d40335cd36afa834e162a0 INFO: 172.20.0.1:33096 - "POST /node/68d40335cd36afa834e162a0 HTTP/1.0" 202 Accepted 2025-09-26 14:42:08,107 - lava_callback - INFO - Starting async job submit for node 68d40335cd36afa834e162a0 2025-09-26 14:42:08,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:42:08,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40335cd36afa834e162a0 HTTP/1.1" 200 None 2025-09-26 14:42:08,120 - lava_callback - DEBUG - Processing node 68d40335cd36afa834e162a0: baseline-arm 2025-09-26 14:42:08,120 - lava_callback - ERROR - Error processing callback for node 68d40335cd36afa834e162a0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:42:08,820 - lava_callback - INFO - Received callback for node 68d40337cd36afa834e162a3 INFO: 172.20.0.1:33106 - "POST /node/68d40337cd36afa834e162a3 HTTP/1.0" 202 Accepted 2025-09-26 14:42:08,825 - lava_callback - INFO - Starting async job submit for node 68d40337cd36afa834e162a3 2025-09-26 14:42:08,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:42:08,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40337cd36afa834e162a3 HTTP/1.1" 200 None 2025-09-26 14:42:08,838 - lava_callback - DEBUG - Processing node 68d40337cd36afa834e162a3: baseline-arm 2025-09-26 14:42:08,838 - lava_callback - ERROR - Error processing callback for node 68d40337cd36afa834e162a3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:42:09,463 - lava_callback - INFO - Received callback for node 68d6a6222f83206171a9243d INFO: 172.20.0.1:45472 - "POST /node/68d6a6222f83206171a9243d HTTP/1.0" 202 Accepted 2025-09-26 14:42:09,469 - lava_callback - INFO - Starting async job submit for node 68d6a6222f83206171a9243d 2025-09-26 14:42:09,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:42:09,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a6222f83206171a9243d HTTP/1.1" 200 None 2025-09-26 14:42:09,499 - lava_callback - DEBUG - Processing node 68d6a6222f83206171a9243d: baseline-x86 2025-09-26 14:42:09,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:42:09,828 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:42:09,828 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d6a6222f83206171a9243d/log.txt.gz 2025-09-26 14:42:09,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:42:09,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:42:09,977 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d6a6222f83206171a9243d/lava_callback.json.gz 2025-09-26 14:42:09,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:42:10,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a6222f83206171a9243d HTTP/1.1" 200 None 2025-09-26 14:42:10,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:42:10,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d24a5c3ab168ecc7a4d HTTP/1.1" 200 None 2025-09-26 14:42:10,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:42:10,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a6222f83206171a9243d HTTP/1.1" 200 None 2025-09-26 14:42:10,053 - lava_callback - INFO - Completed processing callback for node 68d6a6222f83206171a9243d INFO: 172.20.0.1:45486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60762 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:42:24,287 - lava_callback - INFO - Received callback for node 68d4033ecd36afa834e162a9 INFO: 172.20.0.1:60764 - "POST /node/68d4033ecd36afa834e162a9 HTTP/1.0" 202 Accepted 2025-09-26 14:42:24,292 - lava_callback - INFO - Starting async job submit for node 68d4033ecd36afa834e162a9 2025-09-26 14:42:24,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:42:24,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4033ecd36afa834e162a9 HTTP/1.1" 200 None 2025-09-26 14:42:24,312 - lava_callback - DEBUG - Processing node 68d4033ecd36afa834e162a9: baseline-arm 2025-09-26 14:42:24,312 - lava_callback - ERROR - Error processing callback for node 68d4033ecd36afa834e162a9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:42:25,006 - lava_callback - INFO - Received callback for node 68d4033fcd36afa834e162ac INFO: 172.20.0.1:60778 - "POST /node/68d4033fcd36afa834e162ac HTTP/1.0" 202 Accepted 2025-09-26 14:42:25,011 - lava_callback - INFO - Starting async job submit for node 68d4033fcd36afa834e162ac 2025-09-26 14:42:25,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:42:25,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4033fcd36afa834e162ac HTTP/1.1" 200 None 2025-09-26 14:42:25,027 - lava_callback - DEBUG - Processing node 68d4033fcd36afa834e162ac: baseline-arm 2025-09-26 14:42:25,028 - lava_callback - ERROR - Error processing callback for node 68d4033fcd36afa834e162ac: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60788 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:42:25,690 - lava_callback - INFO - Received callback for node 68d40343cd36afa834e162b2 INFO: 172.20.0.1:60802 - "POST /node/68d40343cd36afa834e162b2 HTTP/1.0" 202 Accepted 2025-09-26 14:42:25,696 - lava_callback - INFO - Starting async job submit for node 68d40343cd36afa834e162b2 2025-09-26 14:42:25,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:42:25,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40343cd36afa834e162b2 HTTP/1.1" 200 None 2025-09-26 14:42:25,731 - lava_callback - DEBUG - Processing node 68d40343cd36afa834e162b2: baseline-arm 2025-09-26 14:42:25,731 - lava_callback - ERROR - Error processing callback for node 68d40343cd36afa834e162b2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:42:26,402 - lava_callback - INFO - Received callback for node 68d40345cd36afa834e162b5 INFO: 172.20.0.1:60812 - "POST /node/68d40345cd36afa834e162b5 HTTP/1.0" 202 Accepted 2025-09-26 14:42:26,407 - lava_callback - INFO - Starting async job submit for node 68d40345cd36afa834e162b5 2025-09-26 14:42:26,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:42:26,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40345cd36afa834e162b5 HTTP/1.1" 200 None 2025-09-26 14:42:26,443 - lava_callback - DEBUG - Processing node 68d40345cd36afa834e162b5: baseline-arm 2025-09-26 14:42:26,443 - lava_callback - ERROR - Error processing callback for node 68d40345cd36afa834e162b5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60828 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:42:27,076 - lava_callback - INFO - Received callback for node 68d40348cd36afa834e162b8 INFO: 172.20.0.1:60840 - "POST /node/68d40348cd36afa834e162b8 HTTP/1.0" 202 Accepted 2025-09-26 14:42:27,081 - lava_callback - INFO - Starting async job submit for node 68d40348cd36afa834e162b8 2025-09-26 14:42:27,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:42:27,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40348cd36afa834e162b8 HTTP/1.1" 200 None 2025-09-26 14:42:27,104 - lava_callback - DEBUG - Processing node 68d40348cd36afa834e162b8: baseline-arm 2025-09-26 14:42:27,104 - lava_callback - ERROR - Error processing callback for node 68d40348cd36afa834e162b8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:42:27,796 - lava_callback - INFO - Received callback for node 68d4034acd36afa834e162bb INFO: 172.20.0.1:60856 - "POST /node/68d4034acd36afa834e162bb HTTP/1.0" 202 Accepted 2025-09-26 14:42:27,802 - lava_callback - INFO - Starting async job submit for node 68d4034acd36afa834e162bb 2025-09-26 14:42:27,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:42:27,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4034acd36afa834e162bb HTTP/1.1" 200 None 2025-09-26 14:42:27,816 - lava_callback - DEBUG - Processing node 68d4034acd36afa834e162bb: baseline-arm 2025-09-26 14:42:27,816 - lava_callback - ERROR - Error processing callback for node 68d4034acd36afa834e162bb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:53942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46376 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:43:25,144 - lava_callback - INFO - Received callback for node 68d42971a5c2c05277bc7765 INFO: 172.20.0.1:46388 - "POST /node/68d42971a5c2c05277bc7765 HTTP/1.0" 202 Accepted 2025-09-26 14:43:25,149 - lava_callback - INFO - Starting async job submit for node 68d42971a5c2c05277bc7765 2025-09-26 14:43:25,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:43:25,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42971a5c2c05277bc7765 HTTP/1.1" 200 None 2025-09-26 14:43:25,208 - lava_callback - DEBUG - Processing node 68d42971a5c2c05277bc7765: baseline-arm INFO: 172.20.0.1:46390 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:43:25,428 - lava_callback - ERROR - Error processing callback for node 68d42971a5c2c05277bc7765: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:46402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36182 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:45:06,435 - lava_callback - INFO - Received callback for node 68d403eccd36afa834e163ad INFO: 172.20.0.1:47910 - "POST /node/68d403eccd36afa834e163ad HTTP/1.0" 202 Accepted 2025-09-26 14:45:06,441 - lava_callback - INFO - Starting async job submit for node 68d403eccd36afa834e163ad 2025-09-26 14:45:06,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:45:06,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d403eccd36afa834e163ad HTTP/1.1" 200 None 2025-09-26 14:45:06,479 - lava_callback - DEBUG - Processing node 68d403eccd36afa834e163ad: baseline-arm 2025-09-26 14:45:06,479 - lava_callback - ERROR - Error processing callback for node 68d403eccd36afa834e163ad: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:47914 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:45:07,168 - lava_callback - INFO - Received callback for node 68d403edcd36afa834e163bb INFO: 172.20.0.1:47928 - "POST /node/68d403edcd36afa834e163bb HTTP/1.0" 202 Accepted 2025-09-26 14:45:07,173 - lava_callback - INFO - Starting async job submit for node 68d403edcd36afa834e163bb 2025-09-26 14:45:07,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:45:07,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d403edcd36afa834e163bb HTTP/1.1" 200 None 2025-09-26 14:45:07,194 - lava_callback - DEBUG - Processing node 68d403edcd36afa834e163bb: baseline-arm 2025-09-26 14:45:07,194 - lava_callback - ERROR - Error processing callback for node 68d403edcd36afa834e163bb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:32998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45602 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:45:23,595 - lava_callback - INFO - Received callback for node 68d693bb2f83206171a91d81 INFO: 172.20.0.1:45604 - "POST /node/68d693bb2f83206171a91d81 HTTP/1.0" 202 Accepted 2025-09-26 14:45:23,602 - lava_callback - INFO - Starting async job submit for node 68d693bb2f83206171a91d81 2025-09-26 14:45:23,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:45:23,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693bb2f83206171a91d81 HTTP/1.1" 200 None 2025-09-26 14:45:23,643 - lava_callback - DEBUG - Processing node 68d693bb2f83206171a91d81: baseline-arm64 2025-09-26 14:45:24,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:45:24,595 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:45:24,596 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693bb2f83206171a91d81/log.txt.gz 2025-09-26 14:45:24,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:45:24,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:45:24,788 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693bb2f83206171a91d81/lava_callback.json.gz DEBUG: 68d693bb2f83206171a91d81 Transitting job node result: pass -> incomplete 2025-09-26 14:45:24,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:45:24,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693bb2f83206171a91d81 HTTP/1.1" 200 None 2025-09-26 14:45:24,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:45:24,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 14:45:24,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:45:24,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693bb2f83206171a91d81 HTTP/1.1" 200 None 2025-09-26 14:45:24,879 - lava_callback - INFO - Completed processing callback for node 68d693bb2f83206171a91d81 INFO: 172.20.0.1:45620 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:45:25,703 - lava_callback - INFO - Received callback for node 68d403f1cd36afa834e163be INFO: 172.20.0.1:45636 - "POST /node/68d403f1cd36afa834e163be HTTP/1.0" 202 Accepted 2025-09-26 14:45:25,710 - lava_callback - INFO - Starting async job submit for node 68d403f1cd36afa834e163be 2025-09-26 14:45:25,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:45:25,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d403f1cd36afa834e163be HTTP/1.1" 200 None 2025-09-26 14:45:25,724 - lava_callback - DEBUG - Processing node 68d403f1cd36afa834e163be: baseline-arm 2025-09-26 14:45:25,724 - lava_callback - ERROR - Error processing callback for node 68d403f1cd36afa834e163be: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:45:26,446 - lava_callback - INFO - Received callback for node 68d403f2cd36afa834e163c1 INFO: 172.20.0.1:45644 - "POST /node/68d403f2cd36afa834e163c1 HTTP/1.0" 202 Accepted 2025-09-26 14:45:26,452 - lava_callback - INFO - Starting async job submit for node 68d403f2cd36afa834e163c1 2025-09-26 14:45:26,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:45:26,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d403f2cd36afa834e163c1 HTTP/1.1" 200 None 2025-09-26 14:45:26,467 - lava_callback - DEBUG - Processing node 68d403f2cd36afa834e163c1: baseline-arm 2025-09-26 14:45:26,467 - lava_callback - ERROR - Error processing callback for node 68d403f2cd36afa834e163c1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:45660 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:45:36,105 - lava_callback - INFO - Received callback for node 68d42a26a5c2c05277bc78b2 INFO: 172.20.0.1:37352 - "POST /node/68d42a26a5c2c05277bc78b2 HTTP/1.0" 202 Accepted 2025-09-26 14:45:36,114 - lava_callback - INFO - Starting async job submit for node 68d42a26a5c2c05277bc78b2 2025-09-26 14:45:36,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:45:36,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42a26a5c2c05277bc78b2 HTTP/1.1" 200 None 2025-09-26 14:45:36,194 - lava_callback - DEBUG - Processing node 68d42a26a5c2c05277bc78b2: baseline-arm INFO: 172.20.0.1:37356 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:45:36,724 - lava_callback - ERROR - Error processing callback for node 68d42a26a5c2c05277bc78b2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 14:45:45,448 - lava_callback - INFO - Received callback for node 68d40406cd36afa834e163d7 INFO: 172.20.0.1:55458 - "POST /node/68d40406cd36afa834e163d7 HTTP/1.0" 202 Accepted 2025-09-26 14:45:45,454 - lava_callback - INFO - Starting async job submit for node 68d40406cd36afa834e163d7 2025-09-26 14:45:45,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:45:45,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40406cd36afa834e163d7 HTTP/1.1" 200 None 2025-09-26 14:45:45,468 - lava_callback - DEBUG - Processing node 68d40406cd36afa834e163d7: baseline-arm 2025-09-26 14:45:45,468 - lava_callback - ERROR - Error processing callback for node 68d40406cd36afa834e163d7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:45:46,188 - lava_callback - INFO - Received callback for node 68d40408cd36afa834e163da INFO: 172.20.0.1:55472 - "POST /node/68d40408cd36afa834e163da HTTP/1.0" 202 Accepted 2025-09-26 14:45:46,195 - lava_callback - INFO - Starting async job submit for node 68d40408cd36afa834e163da 2025-09-26 14:45:46,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:45:46,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40408cd36afa834e163da HTTP/1.1" 200 None 2025-09-26 14:45:46,209 - lava_callback - DEBUG - Processing node 68d40408cd36afa834e163da: baseline-arm 2025-09-26 14:45:46,209 - lava_callback - ERROR - Error processing callback for node 68d40408cd36afa834e163da: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:55476 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:45:46,914 - lava_callback - INFO - Received callback for node 68d4040bcd36afa834e163dd INFO: 172.20.0.1:55490 - "POST /node/68d4040bcd36afa834e163dd HTTP/1.0" 202 Accepted 2025-09-26 14:45:46,921 - lava_callback - INFO - Starting async job submit for node 68d4040bcd36afa834e163dd 2025-09-26 14:45:46,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:45:46,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4040bcd36afa834e163dd HTTP/1.1" 200 None 2025-09-26 14:45:46,937 - lava_callback - DEBUG - Processing node 68d4040bcd36afa834e163dd: baseline-arm 2025-09-26 14:45:46,937 - lava_callback - ERROR - Error processing callback for node 68d4040bcd36afa834e163dd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:45:47,110 - lava_callback - INFO - Received callback for node 68d693812f83206171a91cfe INFO: 172.20.0.1:55494 - "POST /node/68d693812f83206171a91cfe HTTP/1.0" 202 Accepted 2025-09-26 14:45:47,117 - lava_callback - INFO - Starting async job submit for node 68d693812f83206171a91cfe 2025-09-26 14:45:47,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:45:47,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693812f83206171a91cfe HTTP/1.1" 200 None 2025-09-26 14:45:47,210 - lava_callback - DEBUG - Processing node 68d693812f83206171a91cfe: baseline-arm64 2025-09-26 14:45:48,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:45:48,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:45:48,514 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693812f83206171a91cfe/log.txt.gz 2025-09-26 14:45:48,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:45:48,652 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:45:48,653 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693812f83206171a91cfe/lava_callback.json.gz DEBUG: Setup failed for 68d693812f83206171a91cfe. Transitting job node result: incomplete -> fail 2025-09-26 14:45:48,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:45:48,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693812f83206171a91cfe HTTP/1.1" 200 None 2025-09-26 14:45:48,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:45:48,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 14:45:48,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:45:48,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693812f83206171a91cfe HTTP/1.1" 200 None 2025-09-26 14:45:48,809 - lava_callback - INFO - Completed processing callback for node 68d693812f83206171a91cfe 2025-09-26 14:45:53,934 - lava_callback - INFO - Received callback for node 68d695802f83206171a920b2 INFO: 172.20.0.1:56248 - "POST /node/68d695802f83206171a920b2 HTTP/1.0" 202 Accepted 2025-09-26 14:45:53,945 - lava_callback - INFO - Starting async job submit for node 68d695802f83206171a920b2 2025-09-26 14:45:54,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:45:54,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695802f83206171a920b2 HTTP/1.1" 200 None 2025-09-26 14:45:54,039 - lava_callback - DEBUG - Processing node 68d695802f83206171a920b2: ltp-smoketest 2025-09-26 14:45:54,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:45:54,729 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:45:54,730 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d695802f83206171a920b2/log.txt.gz 2025-09-26 14:45:54,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:45:54,866 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:45:54,866 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d695802f83206171a920b2/lava_callback.json.gz 2025-09-26 14:45:55,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:45:55,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695802f83206171a920b2 HTTP/1.1" 200 None 2025-09-26 14:45:55,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:45:55,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c3cc1bc82a30b37a90d HTTP/1.1" 200 None 2025-09-26 14:45:55,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:45:55,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695802f83206171a920b2 HTTP/1.1" 200 None 2025-09-26 14:45:55,076 - lava_callback - INFO - Completed processing callback for node 68d695802f83206171a920b2 INFO: 172.20.0.1:56258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49940 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:46:06,743 - lava_callback - INFO - Received callback for node 68d40418cd36afa834e163ee INFO: 172.20.0.1:49946 - "POST /node/68d40418cd36afa834e163ee HTTP/1.0" 202 Accepted 2025-09-26 14:46:06,750 - lava_callback - INFO - Starting async job submit for node 68d40418cd36afa834e163ee 2025-09-26 14:46:06,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:06,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40418cd36afa834e163ee HTTP/1.1" 200 None 2025-09-26 14:46:06,764 - lava_callback - DEBUG - Processing node 68d40418cd36afa834e163ee: baseline-arm 2025-09-26 14:46:06,764 - lava_callback - ERROR - Error processing callback for node 68d40418cd36afa834e163ee: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:46:08,172 - lava_callback - INFO - Received callback for node 68d40419cd36afa834e163f1 INFO: 172.20.0.1:49950 - "POST /node/68d40419cd36afa834e163f1 HTTP/1.0" 202 Accepted 2025-09-26 14:46:08,180 - lava_callback - INFO - Starting async job submit for node 68d40419cd36afa834e163f1 2025-09-26 14:46:08,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:08,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40419cd36afa834e163f1 HTTP/1.1" 200 None 2025-09-26 14:46:08,193 - lava_callback - DEBUG - Processing node 68d40419cd36afa834e163f1: baseline-arm 2025-09-26 14:46:08,193 - lava_callback - ERROR - Error processing callback for node 68d40419cd36afa834e163f1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:46:08,916 - lava_callback - INFO - Received callback for node 68d4041ccd36afa834e163f4 INFO: 172.20.0.1:49962 - "POST /node/68d4041ccd36afa834e163f4 HTTP/1.0" 202 Accepted 2025-09-26 14:46:08,922 - lava_callback - INFO - Starting async job submit for node 68d4041ccd36afa834e163f4 2025-09-26 14:46:08,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:08,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4041ccd36afa834e163f4 HTTP/1.1" 200 None 2025-09-26 14:46:08,936 - lava_callback - DEBUG - Processing node 68d4041ccd36afa834e163f4: baseline-arm 2025-09-26 14:46:08,936 - lava_callback - ERROR - Error processing callback for node 68d4041ccd36afa834e163f4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:46:09,636 - lava_callback - INFO - Received callback for node 68d4041ccd36afa834e163f7 INFO: 172.20.0.1:45352 - "POST /node/68d4041ccd36afa834e163f7 HTTP/1.0" 202 Accepted 2025-09-26 14:46:09,643 - lava_callback - INFO - Starting async job submit for node 68d4041ccd36afa834e163f7 2025-09-26 14:46:09,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:09,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4041ccd36afa834e163f7 HTTP/1.1" 200 None 2025-09-26 14:46:09,657 - lava_callback - DEBUG - Processing node 68d4041ccd36afa834e163f7: baseline-arm 2025-09-26 14:46:09,657 - lava_callback - ERROR - Error processing callback for node 68d4041ccd36afa834e163f7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:46:10,367 - lava_callback - INFO - Received callback for node 68d4041fcd36afa834e163fa INFO: 172.20.0.1:45354 - "POST /node/68d4041fcd36afa834e163fa HTTP/1.0" 202 Accepted 2025-09-26 14:46:10,376 - lava_callback - INFO - Starting async job submit for node 68d4041fcd36afa834e163fa 2025-09-26 14:46:10,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:10,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4041fcd36afa834e163fa HTTP/1.1" 200 None 2025-09-26 14:46:10,391 - lava_callback - DEBUG - Processing node 68d4041fcd36afa834e163fa: baseline-arm 2025-09-26 14:46:10,391 - lava_callback - ERROR - Error processing callback for node 68d4041fcd36afa834e163fa: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:46:11,100 - lava_callback - INFO - Received callback for node 68d40421cd36afa834e163fd INFO: 172.20.0.1:45366 - "POST /node/68d40421cd36afa834e163fd HTTP/1.0" 202 Accepted 2025-09-26 14:46:11,106 - lava_callback - INFO - Starting async job submit for node 68d40421cd36afa834e163fd 2025-09-26 14:46:11,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:11,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40421cd36afa834e163fd HTTP/1.1" 200 None 2025-09-26 14:46:11,125 - lava_callback - DEBUG - Processing node 68d40421cd36afa834e163fd: baseline-arm 2025-09-26 14:46:11,126 - lava_callback - ERROR - Error processing callback for node 68d40421cd36afa834e163fd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:46:11,853 - lava_callback - INFO - Received callback for node 68d40423cd36afa834e16400 INFO: 172.20.0.1:45368 - "POST /node/68d40423cd36afa834e16400 HTTP/1.0" 202 Accepted 2025-09-26 14:46:11,861 - lava_callback - INFO - Starting async job submit for node 68d40423cd36afa834e16400 2025-09-26 14:46:11,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:11,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40423cd36afa834e16400 HTTP/1.1" 200 None 2025-09-26 14:46:11,874 - lava_callback - DEBUG - Processing node 68d40423cd36afa834e16400: baseline-arm 2025-09-26 14:46:11,874 - lava_callback - ERROR - Error processing callback for node 68d40423cd36afa834e16400: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:46:12,642 - lava_callback - INFO - Received callback for node 68d40424cd36afa834e16403 INFO: 172.20.0.1:45380 - "POST /node/68d40424cd36afa834e16403 HTTP/1.0" 202 Accepted 2025-09-26 14:46:12,649 - lava_callback - INFO - Starting async job submit for node 68d40424cd36afa834e16403 2025-09-26 14:46:12,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:12,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40424cd36afa834e16403 HTTP/1.1" 200 None 2025-09-26 14:46:12,666 - lava_callback - DEBUG - Processing node 68d40424cd36afa834e16403: baseline-arm 2025-09-26 14:46:12,666 - lava_callback - ERROR - Error processing callback for node 68d40424cd36afa834e16403: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:46:13,398 - lava_callback - INFO - Received callback for node 68d40426cd36afa834e16406 INFO: 172.20.0.1:45394 - "POST /node/68d40426cd36afa834e16406 HTTP/1.0" 202 Accepted 2025-09-26 14:46:13,403 - lava_callback - INFO - Starting async job submit for node 68d40426cd36afa834e16406 2025-09-26 14:46:13,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:13,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40426cd36afa834e16406 HTTP/1.1" 200 None 2025-09-26 14:46:13,418 - lava_callback - DEBUG - Processing node 68d40426cd36afa834e16406: baseline-arm 2025-09-26 14:46:13,418 - lava_callback - ERROR - Error processing callback for node 68d40426cd36afa834e16406: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:46:14,114 - lava_callback - INFO - Received callback for node 68d40428cd36afa834e16409 INFO: 172.20.0.1:45402 - "POST /node/68d40428cd36afa834e16409 HTTP/1.0" 202 Accepted 2025-09-26 14:46:14,119 - lava_callback - INFO - Starting async job submit for node 68d40428cd36afa834e16409 2025-09-26 14:46:14,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:14,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40428cd36afa834e16409 HTTP/1.1" 200 None 2025-09-26 14:46:14,133 - lava_callback - DEBUG - Processing node 68d40428cd36afa834e16409: baseline-arm 2025-09-26 14:46:14,134 - lava_callback - ERROR - Error processing callback for node 68d40428cd36afa834e16409: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:45404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33058 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:46:24,994 - lava_callback - INFO - Received callback for node 68d4042dcd36afa834e16421 INFO: 172.20.0.1:33062 - "POST /node/68d4042dcd36afa834e16421 HTTP/1.0" 202 Accepted 2025-09-26 14:46:25,001 - lava_callback - INFO - Starting async job submit for node 68d4042dcd36afa834e16421 2025-09-26 14:46:25,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:25,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4042dcd36afa834e16421 HTTP/1.1" 200 None 2025-09-26 14:46:25,022 - lava_callback - DEBUG - Processing node 68d4042dcd36afa834e16421: baseline-arm 2025-09-26 14:46:25,023 - lava_callback - ERROR - Error processing callback for node 68d4042dcd36afa834e16421: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:33076 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:46:25,735 - lava_callback - INFO - Received callback for node 68d4042ecd36afa834e16424 INFO: 172.20.0.1:33092 - "POST /node/68d4042ecd36afa834e16424 HTTP/1.0" 202 Accepted 2025-09-26 14:46:25,741 - lava_callback - INFO - Starting async job submit for node 68d4042ecd36afa834e16424 2025-09-26 14:46:25,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:25,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4042ecd36afa834e16424 HTTP/1.1" 200 None 2025-09-26 14:46:25,757 - lava_callback - DEBUG - Processing node 68d4042ecd36afa834e16424: baseline-arm 2025-09-26 14:46:25,757 - lava_callback - ERROR - Error processing callback for node 68d4042ecd36afa834e16424: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:46:26,455 - lava_callback - INFO - Received callback for node 68d40431cd36afa834e16427 INFO: 172.20.0.1:33098 - "POST /node/68d40431cd36afa834e16427 HTTP/1.0" 202 Accepted 2025-09-26 14:46:26,461 - lava_callback - INFO - Starting async job submit for node 68d40431cd36afa834e16427 2025-09-26 14:46:26,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:26,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40431cd36afa834e16427 HTTP/1.1" 200 None 2025-09-26 14:46:26,480 - lava_callback - DEBUG - Processing node 68d40431cd36afa834e16427: baseline-arm 2025-09-26 14:46:26,480 - lava_callback - ERROR - Error processing callback for node 68d40431cd36afa834e16427: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:33104 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:46:27,178 - lava_callback - INFO - Received callback for node 68d40432cd36afa834e1642e INFO: 172.20.0.1:33106 - "POST /node/68d40432cd36afa834e1642e HTTP/1.0" 202 Accepted 2025-09-26 14:46:27,185 - lava_callback - INFO - Starting async job submit for node 68d40432cd36afa834e1642e 2025-09-26 14:46:27,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:27,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40432cd36afa834e1642e HTTP/1.1" 200 None 2025-09-26 14:46:27,198 - lava_callback - DEBUG - Processing node 68d40432cd36afa834e1642e: baseline-arm 2025-09-26 14:46:27,198 - lava_callback - ERROR - Error processing callback for node 68d40432cd36afa834e1642e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:46:27,897 - lava_callback - INFO - Received callback for node 68d40439cd36afa834e16434 INFO: 172.20.0.1:33110 - "POST /node/68d40439cd36afa834e16434 HTTP/1.0" 202 Accepted 2025-09-26 14:46:27,904 - lava_callback - INFO - Starting async job submit for node 68d40439cd36afa834e16434 2025-09-26 14:46:27,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:27,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40439cd36afa834e16434 HTTP/1.1" 200 None 2025-09-26 14:46:27,921 - lava_callback - DEBUG - Processing node 68d40439cd36afa834e16434: baseline-arm 2025-09-26 14:46:27,921 - lava_callback - ERROR - Error processing callback for node 68d40439cd36afa834e16434: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:46:28,605 - lava_callback - INFO - Received callback for node 68d4043acd36afa834e16437 INFO: 172.20.0.1:33118 - "POST /node/68d4043acd36afa834e16437 HTTP/1.0" 202 Accepted 2025-09-26 14:46:28,611 - lava_callback - INFO - Starting async job submit for node 68d4043acd36afa834e16437 2025-09-26 14:46:28,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:28,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4043acd36afa834e16437 HTTP/1.1" 200 None 2025-09-26 14:46:28,625 - lava_callback - DEBUG - Processing node 68d4043acd36afa834e16437: baseline-arm 2025-09-26 14:46:28,625 - lava_callback - ERROR - Error processing callback for node 68d4043acd36afa834e16437: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:46:34,386 - lava_callback - INFO - Received callback for node 68d693822f83206171a91d01 INFO: 172.20.0.1:59478 - "POST /node/68d693822f83206171a91d01 HTTP/1.0" 202 Accepted 2025-09-26 14:46:34,393 - lava_callback - INFO - Starting async job submit for node 68d693822f83206171a91d01 2025-09-26 14:46:34,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:34,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693822f83206171a91d01 HTTP/1.1" 200 None 2025-09-26 14:46:34,454 - lava_callback - DEBUG - Processing node 68d693822f83206171a91d01: baseline-arm64 2025-09-26 14:46:35,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:46:35,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:46:35,853 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693822f83206171a91d01/log.txt.gz 2025-09-26 14:46:35,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:46:36,048 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:46:36,048 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693822f83206171a91d01/lava_callback.json.gz DEBUG: Setup failed for 68d693822f83206171a91d01. Transitting job node result: incomplete -> fail 2025-09-26 14:46:36,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:36,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693822f83206171a91d01 HTTP/1.1" 200 None 2025-09-26 14:46:36,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:36,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 14:46:36,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:36,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693822f83206171a91d01 HTTP/1.1" 200 None 2025-09-26 14:46:36,205 - lava_callback - INFO - Completed processing callback for node 68d693822f83206171a91d01 INFO: 172.20.0.1:59480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47296 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:46:53,412 - lava_callback - INFO - Received callback for node 68d6a7142f83206171a9247a INFO: 172.20.0.1:55568 - "POST /node/68d6a7142f83206171a9247a HTTP/1.0" 202 Accepted 2025-09-26 14:46:53,420 - lava_callback - INFO - Starting async job submit for node 68d6a7142f83206171a9247a 2025-09-26 14:46:53,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:53,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7142f83206171a9247a HTTP/1.1" 200 None 2025-09-26 14:46:53,473 - lava_callback - DEBUG - Processing node 68d6a7142f83206171a9247a: baseline-arm64 2025-09-26 14:46:53,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:46:53,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:46:53,908 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7142f83206171a9247a/log.txt.gz 2025-09-26 14:46:53,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:46:54,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:46:54,052 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7142f83206171a9247a/lava_callback.json.gz 2025-09-26 14:46:54,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:54,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7142f83206171a9247a HTTP/1.1" 200 None 2025-09-26 14:46:54,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:54,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 14:46:54,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:54,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7142f83206171a9247a HTTP/1.1" 200 None 2025-09-26 14:46:54,136 - lava_callback - INFO - Completed processing callback for node 68d6a7142f83206171a9247a 2025-09-26 14:46:55,894 - lava_callback - INFO - Received callback for node 68d6a7142f83206171a9247d INFO: 172.20.0.1:55582 - "POST /node/68d6a7142f83206171a9247d HTTP/1.0" 202 Accepted 2025-09-26 14:46:55,902 - lava_callback - INFO - Starting async job submit for node 68d6a7142f83206171a9247d 2025-09-26 14:46:55,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:55,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7142f83206171a9247d HTTP/1.1" 200 None 2025-09-26 14:46:55,943 - lava_callback - DEBUG - Processing node 68d6a7142f83206171a9247d: baseline-arm64 2025-09-26 14:46:56,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:46:56,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:46:56,374 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7142f83206171a9247d/log.txt.gz 2025-09-26 14:46:56,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:55586 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:46:56,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:46:56,516 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7142f83206171a9247d/lava_callback.json.gz 2025-09-26 14:46:56,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:56,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7142f83206171a9247d HTTP/1.1" 200 None 2025-09-26 14:46:56,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:56,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 14:46:56,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:46:56,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7142f83206171a9247d HTTP/1.1" 200 None 2025-09-26 14:46:56,613 - lava_callback - INFO - Completed processing callback for node 68d6a7142f83206171a9247d INFO: 172.20.0.1:60976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43146 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:47:18,744 - lava_callback - INFO - Received callback for node 68d6a7102f83206171a9246c INFO: 172.20.0.1:43156 - "POST /node/68d6a7102f83206171a9246c HTTP/1.0" 202 Accepted 2025-09-26 14:47:18,751 - lava_callback - INFO - Starting async job submit for node 68d6a7102f83206171a9246c 2025-09-26 14:47:18,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:18,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7102f83206171a9246c HTTP/1.1" 200 None 2025-09-26 14:47:18,820 - lava_callback - DEBUG - Processing node 68d6a7102f83206171a9246c: baseline-arm64 2025-09-26 14:47:19,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:47:19,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:47:19,225 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7102f83206171a9246c/log.txt.gz 2025-09-26 14:47:19,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:47:19,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:47:19,366 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7102f83206171a9246c/lava_callback.json.gz 2025-09-26 14:47:19,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:19,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7102f83206171a9246c HTTP/1.1" 200 None 2025-09-26 14:47:19,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:19,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 14:47:19,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:19,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7102f83206171a9246c HTTP/1.1" 200 None 2025-09-26 14:47:19,458 - lava_callback - INFO - Completed processing callback for node 68d6a7102f83206171a9246c INFO: 172.20.0.1:42920 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:47:23,701 - lava_callback - INFO - Received callback for node 68d6a7252f83206171a924a2 INFO: 172.20.0.1:42926 - "POST /node/68d6a7252f83206171a924a2 HTTP/1.0" 202 Accepted 2025-09-26 14:47:23,709 - lava_callback - INFO - Starting async job submit for node 68d6a7252f83206171a924a2 2025-09-26 14:47:23,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:23,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7252f83206171a924a2 HTTP/1.1" 200 None 2025-09-26 14:47:23,749 - lava_callback - DEBUG - Processing node 68d6a7252f83206171a924a2: baseline-arm64 2025-09-26 14:47:24,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:47:24,250 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:47:24,251 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7252f83206171a924a2/log.txt.gz 2025-09-26 14:47:24,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:47:24,380 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:47:24,381 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7252f83206171a924a2/lava_callback.json.gz 2025-09-26 14:47:24,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:24,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7252f83206171a924a2 HTTP/1.1" 200 None 2025-09-26 14:47:24,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:24,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 14:47:24,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:24,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7252f83206171a924a2 HTTP/1.1" 200 None 2025-09-26 14:47:24,476 - lava_callback - INFO - Completed processing callback for node 68d6a7252f83206171a924a2 INFO: 172.20.0.1:42942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42954 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:47:32,335 - lava_callback - INFO - Received callback for node 68d6a7212f83206171a92495 INFO: 172.20.0.1:60948 - "POST /node/68d6a7212f83206171a92495 HTTP/1.0" 202 Accepted 2025-09-26 14:47:32,341 - lava_callback - INFO - Starting async job submit for node 68d6a7212f83206171a92495 2025-09-26 14:47:32,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:32,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7212f83206171a92495 HTTP/1.1" 200 None 2025-09-26 14:47:32,372 - lava_callback - DEBUG - Processing node 68d6a7212f83206171a92495: baseline-arm64 2025-09-26 14:47:32,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:47:32,867 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:47:32,867 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7212f83206171a92495/log.txt.gz 2025-09-26 14:47:32,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:47:32,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:47:32,982 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7212f83206171a92495/lava_callback.json.gz 2025-09-26 14:47:33,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:33,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7212f83206171a92495 HTTP/1.1" 200 None 2025-09-26 14:47:33,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:33,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 14:47:33,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:33,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7212f83206171a92495 HTTP/1.1" 200 None 2025-09-26 14:47:33,069 - lava_callback - INFO - Completed processing callback for node 68d6a7212f83206171a92495 2025-09-26 14:47:34,309 - lava_callback - INFO - Received callback for node 68d6a7322f83206171a924ba INFO: 172.20.0.1:60956 - "POST /node/68d6a7322f83206171a924ba HTTP/1.0" 202 Accepted 2025-09-26 14:47:34,315 - lava_callback - INFO - Starting async job submit for node 68d6a7322f83206171a924ba 2025-09-26 14:47:34,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:34,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7322f83206171a924ba HTTP/1.1" 200 None 2025-09-26 14:47:34,348 - lava_callback - DEBUG - Processing node 68d6a7322f83206171a924ba: baseline-arm64 2025-09-26 14:47:34,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:47:34,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:47:34,719 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7322f83206171a924ba/log.txt.gz 2025-09-26 14:47:34,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:47:34,830 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:47:34,831 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7322f83206171a924ba/lava_callback.json.gz 2025-09-26 14:47:34,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:34,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7322f83206171a924ba HTTP/1.1" 200 None 2025-09-26 14:47:34,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:34,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 14:47:34,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:34,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7322f83206171a924ba HTTP/1.1" 200 None 2025-09-26 14:47:34,917 - lava_callback - INFO - Completed processing callback for node 68d6a7322f83206171a924ba INFO: 172.20.0.1:60964 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:47:38,178 - lava_callback - INFO - Received callback for node 68d6a7242f83206171a9249f INFO: 172.20.0.1:60966 - "POST /node/68d6a7242f83206171a9249f HTTP/1.0" 202 Accepted 2025-09-26 14:47:38,184 - lava_callback - INFO - Starting async job submit for node 68d6a7242f83206171a9249f 2025-09-26 14:47:38,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:38,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7242f83206171a9249f HTTP/1.1" 200 None 2025-09-26 14:47:38,246 - lava_callback - DEBUG - Processing node 68d6a7242f83206171a9249f: baseline-arm64 2025-09-26 14:47:38,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:47:38,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:47:38,655 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7242f83206171a9249f/log.txt.gz 2025-09-26 14:47:38,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:47:38,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:47:38,772 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7242f83206171a9249f/lava_callback.json.gz 2025-09-26 14:47:38,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:38,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7242f83206171a9249f HTTP/1.1" 200 None 2025-09-26 14:47:38,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:38,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 14:47:38,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:38,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7242f83206171a9249f HTTP/1.1" 200 None 2025-09-26 14:47:38,845 - lava_callback - INFO - Completed processing callback for node 68d6a7242f83206171a9249f 2025-09-26 14:47:39,796 - lava_callback - INFO - Received callback for node 68d6a7312f83206171a924b7 INFO: 172.20.0.1:60226 - "POST /node/68d6a7312f83206171a924b7 HTTP/1.0" 202 Accepted 2025-09-26 14:47:39,802 - lava_callback - INFO - Starting async job submit for node 68d6a7312f83206171a924b7 2025-09-26 14:47:39,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:39,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7312f83206171a924b7 HTTP/1.1" 200 None 2025-09-26 14:47:39,835 - lava_callback - DEBUG - Processing node 68d6a7312f83206171a924b7: baseline-arm64 2025-09-26 14:47:40,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:47:40,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:47:40,200 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7312f83206171a924b7/log.txt.gz 2025-09-26 14:47:40,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:47:40,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:47:40,365 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7312f83206171a924b7/lava_callback.json.gz 2025-09-26 14:47:40,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:40,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7312f83206171a924b7 HTTP/1.1" 200 None 2025-09-26 14:47:40,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:40,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 14:47:40,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:40,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7312f83206171a924b7 HTTP/1.1" 200 None 2025-09-26 14:47:40,436 - lava_callback - INFO - Completed processing callback for node 68d6a7312f83206171a924b7 2025-09-26 14:47:42,022 - lava_callback - INFO - Received callback for node 68d42a28a5c2c05277bc78b5 INFO: 172.20.0.1:60240 - "POST /node/68d42a28a5c2c05277bc78b5 HTTP/1.0" 202 Accepted 2025-09-26 14:47:42,028 - lava_callback - INFO - Starting async job submit for node 68d42a28a5c2c05277bc78b5 2025-09-26 14:47:42,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:42,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42a28a5c2c05277bc78b5 HTTP/1.1" 200 None 2025-09-26 14:47:42,061 - lava_callback - DEBUG - Processing node 68d42a28a5c2c05277bc78b5: baseline-arm 2025-09-26 14:47:42,290 - lava_callback - ERROR - Error processing callback for node 68d42a28a5c2c05277bc78b5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 14:47:44,352 - lava_callback - INFO - Received callback for node 68d6a73f2f83206171a924cf INFO: 172.20.0.1:60250 - "POST /node/68d6a73f2f83206171a924cf HTTP/1.0" 202 Accepted 2025-09-26 14:47:44,358 - lava_callback - INFO - Starting async job submit for node 68d6a73f2f83206171a924cf 2025-09-26 14:47:44,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:44,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a73f2f83206171a924cf HTTP/1.1" 200 None 2025-09-26 14:47:44,395 - lava_callback - DEBUG - Processing node 68d6a73f2f83206171a924cf: baseline-arm64 2025-09-26 14:47:44,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:47:44,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:47:44,827 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a73f2f83206171a924cf/log.txt.gz 2025-09-26 14:47:44,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:47:44,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:47:44,941 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a73f2f83206171a924cf/lava_callback.json.gz 2025-09-26 14:47:44,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:44,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a73f2f83206171a924cf HTTP/1.1" 200 None 2025-09-26 14:47:44,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:44,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 14:47:44,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:45,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a73f2f83206171a924cf HTTP/1.1" 200 None 2025-09-26 14:47:45,023 - lava_callback - INFO - Completed processing callback for node 68d6a73f2f83206171a924cf INFO: 172.20.0.1:60256 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:47:55,676 - lava_callback - INFO - Received callback for node 68d6a7722f83206171a9251d INFO: 172.20.0.1:33256 - "POST /node/68d6a7722f83206171a9251d HTTP/1.0" 202 Accepted 2025-09-26 14:47:55,681 - lava_callback - INFO - Starting async job submit for node 68d6a7722f83206171a9251d 2025-09-26 14:47:55,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:55,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7722f83206171a9251d HTTP/1.1" 200 None 2025-09-26 14:47:55,752 - lava_callback - DEBUG - Processing node 68d6a7722f83206171a9251d: baseline-arm64-pengutronix 2025-09-26 14:47:55,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:47:56,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:47:56,036 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d6a7722f83206171a9251d/log.txt.gz 2025-09-26 14:47:56,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:47:56,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:47:56,181 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d6a7722f83206171a9251d/lava_callback.json.gz 2025-09-26 14:47:56,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:56,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7722f83206171a9251d HTTP/1.1" 200 None 2025-09-26 14:47:56,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:56,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 14:47:56,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:56,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7722f83206171a9251d HTTP/1.1" 200 None 2025-09-26 14:47:56,258 - lava_callback - INFO - Completed processing callback for node 68d6a7722f83206171a9251d INFO: 172.20.0.1:33260 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:47:57,923 - lava_callback - INFO - Received callback for node 68d6a7282f83206171a924a8 INFO: 172.20.0.1:33266 - "POST /node/68d6a7282f83206171a924a8 HTTP/1.0" 202 Accepted 2025-09-26 14:47:57,929 - lava_callback - INFO - Starting async job submit for node 68d6a7282f83206171a924a8 2025-09-26 14:47:57,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:57,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7282f83206171a924a8 HTTP/1.1" 200 None 2025-09-26 14:47:57,970 - lava_callback - DEBUG - Processing node 68d6a7282f83206171a924a8: baseline-arm64 2025-09-26 14:47:58,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:47:58,418 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:47:58,418 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7282f83206171a924a8/log.txt.gz 2025-09-26 14:47:58,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:47:58,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:47:58,539 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7282f83206171a924a8/lava_callback.json.gz 2025-09-26 14:47:58,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:58,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7282f83206171a924a8 HTTP/1.1" 200 None 2025-09-26 14:47:58,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:58,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 14:47:58,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:58,595 - lava_callback - INFO - Received callback for node 68d6a7452f83206171a924db INFO: 172.20.0.1:33276 - "POST /node/68d6a7452f83206171a924db HTTP/1.0" 202 Accepted 2025-09-26 14:47:58,601 - lava_callback - INFO - Starting async job submit for node 68d6a7452f83206171a924db 2025-09-26 14:47:58,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7282f83206171a924a8 HTTP/1.1" 200 None 2025-09-26 14:47:58,632 - lava_callback - INFO - Completed processing callback for node 68d6a7282f83206171a924a8 2025-09-26 14:47:58,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:58,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7452f83206171a924db HTTP/1.1" 200 None 2025-09-26 14:47:58,679 - lava_callback - DEBUG - Processing node 68d6a7452f83206171a924db: baseline-arm64 2025-09-26 14:47:59,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:47:59,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:47:59,147 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7452f83206171a924db/log.txt.gz 2025-09-26 14:47:59,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:47:59,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:47:59,257 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7452f83206171a924db/lava_callback.json.gz 2025-09-26 14:47:59,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:59,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7452f83206171a924db HTTP/1.1" 200 None 2025-09-26 14:47:59,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:59,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 14:47:59,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:47:59,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7452f83206171a924db HTTP/1.1" 200 None 2025-09-26 14:47:59,329 - lava_callback - INFO - Completed processing callback for node 68d6a7452f83206171a924db 2025-09-26 14:48:01,322 - lava_callback - INFO - Received callback for node 68d6a7462f83206171a924de INFO: 172.20.0.1:53630 - "POST /node/68d6a7462f83206171a924de HTTP/1.0" 202 Accepted 2025-09-26 14:48:01,328 - lava_callback - INFO - Starting async job submit for node 68d6a7462f83206171a924de 2025-09-26 14:48:01,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:01,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7462f83206171a924de HTTP/1.1" 200 None 2025-09-26 14:48:01,382 - lava_callback - DEBUG - Processing node 68d6a7462f83206171a924de: baseline-arm64 2025-09-26 14:48:01,480 - lava_callback - INFO - Received callback for node 68d6a7282f83206171a924a5 INFO: 172.20.0.1:53646 - "POST /node/68d6a7282f83206171a924a5 HTTP/1.0" 202 Accepted 2025-09-26 14:48:01,501 - lava_callback - INFO - Starting async job submit for node 68d6a7282f83206171a924a5 2025-09-26 14:48:01,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:01,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7282f83206171a924a5 HTTP/1.1" 200 None 2025-09-26 14:48:01,625 - lava_callback - DEBUG - Processing node 68d6a7282f83206171a924a5: baseline-arm64 2025-09-26 14:48:01,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:48:02,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:48:02,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:48:02,128 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7462f83206171a924de/log.txt.gz 2025-09-26 14:48:02,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:48:02,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:48:02,182 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7282f83206171a924a5/log.txt.gz 2025-09-26 14:48:02,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:48:02,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:48:02,275 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7462f83206171a924de/lava_callback.json.gz 2025-09-26 14:48:02,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:02,311 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:48:02,312 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7282f83206171a924a5/lava_callback.json.gz 2025-09-26 14:48:02,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:02,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7462f83206171a924de HTTP/1.1" 200 None 2025-09-26 14:48:02,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:02,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7282f83206171a924a5 HTTP/1.1" 200 None 2025-09-26 14:48:02,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:02,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 14:48:02,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:02,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 14:48:02,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:02,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7282f83206171a924a5 HTTP/1.1" 200 None 2025-09-26 14:48:02,403 - lava_callback - INFO - Completed processing callback for node 68d6a7282f83206171a924a5 2025-09-26 14:48:02,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7462f83206171a924de HTTP/1.1" 200 None 2025-09-26 14:48:02,421 - lava_callback - INFO - Completed processing callback for node 68d6a7462f83206171a924de 2025-09-26 14:48:03,196 - lava_callback - INFO - Received callback for node 68d6a7752f83206171a92520 INFO: 172.20.0.1:53658 - "POST /node/68d6a7752f83206171a92520 HTTP/1.0" 202 Accepted 2025-09-26 14:48:03,202 - lava_callback - INFO - Starting async job submit for node 68d6a7752f83206171a92520 2025-09-26 14:48:03,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:03,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7752f83206171a92520 HTTP/1.1" 200 None 2025-09-26 14:48:03,240 - lava_callback - DEBUG - Processing node 68d6a7752f83206171a92520: baseline-arm64-pengutronix 2025-09-26 14:48:03,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:48:03,555 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:48:03,556 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d6a7752f83206171a92520/log.txt.gz 2025-09-26 14:48:03,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:48:03,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:48:03,683 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d6a7752f83206171a92520/lava_callback.json.gz 2025-09-26 14:48:03,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:03,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7752f83206171a92520 HTTP/1.1" 200 None 2025-09-26 14:48:03,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:03,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 14:48:03,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:03,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7752f83206171a92520 HTTP/1.1" 200 None 2025-09-26 14:48:03,754 - lava_callback - INFO - Completed processing callback for node 68d6a7752f83206171a92520 INFO: 172.20.0.1:53662 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:48:07,472 - lava_callback - INFO - Received callback for node 68d6a70f2f83206171a92459 INFO: 172.20.0.1:53664 - "POST /node/68d6a70f2f83206171a92459 HTTP/1.0" 202 Accepted 2025-09-26 14:48:07,478 - lava_callback - INFO - Starting async job submit for node 68d6a70f2f83206171a92459 2025-09-26 14:48:07,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:07,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a70f2f83206171a92459 HTTP/1.1" 200 None 2025-09-26 14:48:07,510 - lava_callback - DEBUG - Processing node 68d6a70f2f83206171a92459: baseline-arm64 2025-09-26 14:48:07,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:48:07,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:48:07,845 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a70f2f83206171a92459/log.txt.gz 2025-09-26 14:48:07,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:48:07,966 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:48:07,967 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a70f2f83206171a92459/lava_callback.json.gz 2025-09-26 14:48:07,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:08,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a70f2f83206171a92459 HTTP/1.1" 200 None 2025-09-26 14:48:08,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:08,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 14:48:08,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:08,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a70f2f83206171a92459 HTTP/1.1" 200 None 2025-09-26 14:48:08,050 - lava_callback - INFO - Completed processing callback for node 68d6a70f2f83206171a92459 2025-09-26 14:48:10,249 - lava_callback - INFO - Received callback for node 68d6a7422f83206171a924d5 INFO: 172.20.0.1:44264 - "POST /node/68d6a7422f83206171a924d5 HTTP/1.0" 202 Accepted 2025-09-26 14:48:10,254 - lava_callback - INFO - Starting async job submit for node 68d6a7422f83206171a924d5 2025-09-26 14:48:10,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:10,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7422f83206171a924d5 HTTP/1.1" 200 None 2025-09-26 14:48:10,295 - lava_callback - DEBUG - Processing node 68d6a7422f83206171a924d5: baseline-arm64 2025-09-26 14:48:10,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:48:10,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:48:10,673 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7422f83206171a924d5/log.txt.gz 2025-09-26 14:48:10,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:48:10,798 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:48:10,799 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7422f83206171a924d5/lava_callback.json.gz 2025-09-26 14:48:10,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:10,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7422f83206171a924d5 HTTP/1.1" 200 None 2025-09-26 14:48:10,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:10,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 14:48:10,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:10,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7422f83206171a924d5 HTTP/1.1" 200 None 2025-09-26 14:48:10,884 - lava_callback - INFO - Completed processing callback for node 68d6a7422f83206171a924d5 2025-09-26 14:48:11,470 - lava_callback - INFO - Received callback for node 68d6a72e2f83206171a924b1 INFO: 172.20.0.1:44278 - "POST /node/68d6a72e2f83206171a924b1 HTTP/1.0" 202 Accepted 2025-09-26 14:48:11,476 - lava_callback - INFO - Starting async job submit for node 68d6a72e2f83206171a924b1 2025-09-26 14:48:11,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:11,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a72e2f83206171a924b1 HTTP/1.1" 200 None 2025-09-26 14:48:11,509 - lava_callback - DEBUG - Processing node 68d6a72e2f83206171a924b1: baseline-arm64 2025-09-26 14:48:11,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:48:11,868 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:48:11,868 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a72e2f83206171a924b1/log.txt.gz 2025-09-26 14:48:11,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:48:11,987 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:48:11,988 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a72e2f83206171a924b1/lava_callback.json.gz 2025-09-26 14:48:12,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:12,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a72e2f83206171a924b1 HTTP/1.1" 200 None 2025-09-26 14:48:12,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:12,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 14:48:12,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:12,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a72e2f83206171a924b1 HTTP/1.1" 200 None 2025-09-26 14:48:12,079 - lava_callback - INFO - Completed processing callback for node 68d6a72e2f83206171a924b1 INFO: 172.20.0.1:44290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44306 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:48:18,761 - lava_callback - INFO - Received callback for node 68d6a7222f83206171a92498 INFO: 172.20.0.1:44318 - "POST /node/68d6a7222f83206171a92498 HTTP/1.0" 202 Accepted 2025-09-26 14:48:18,767 - lava_callback - INFO - Starting async job submit for node 68d6a7222f83206171a92498 2025-09-26 14:48:18,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:18,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7222f83206171a92498 HTTP/1.1" 200 None 2025-09-26 14:48:18,799 - lava_callback - DEBUG - Processing node 68d6a7222f83206171a92498: baseline-arm64 2025-09-26 14:48:19,075 - lava_callback - INFO - Received callback for node 68d6a77b2f83206171a9252a INFO: 172.20.0.1:44328 - "POST /node/68d6a77b2f83206171a9252a HTTP/1.0" 202 Accepted 2025-09-26 14:48:19,103 - lava_callback - INFO - Starting async job submit for node 68d6a77b2f83206171a9252a 2025-09-26 14:48:19,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:19,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:48:19,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a77b2f83206171a9252a HTTP/1.1" 200 None 2025-09-26 14:48:19,197 - lava_callback - DEBUG - Processing node 68d6a77b2f83206171a9252a: baseline-arm64-foundriesio 2025-09-26 14:48:19,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:48:19,386 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7222f83206171a92498/log.txt.gz 2025-09-26 14:48:19,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:48:19,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:48:19,710 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:48:19,710 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7222f83206171a92498/lava_callback.json.gz 2025-09-26 14:48:19,727 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:48:19,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:19,731 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6a77b2f83206171a9252a/log.txt.gz 2025-09-26 14:48:19,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:48:19,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7222f83206171a92498 HTTP/1.1" 200 None 2025-09-26 14:48:19,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:19,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 14:48:19,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:19,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7222f83206171a92498 HTTP/1.1" 200 None 2025-09-26 14:48:19,789 - lava_callback - INFO - Completed processing callback for node 68d6a7222f83206171a92498 2025-09-26 14:48:19,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:48:19,889 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6a77b2f83206171a9252a/lava_callback.json.gz 2025-09-26 14:48:19,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:19,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a77b2f83206171a9252a HTTP/1.1" 200 None 2025-09-26 14:48:19,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:19,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 14:48:19,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:19,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a77b2f83206171a9252a HTTP/1.1" 200 None 2025-09-26 14:48:19,982 - lava_callback - INFO - Completed processing callback for node 68d6a77b2f83206171a9252a INFO: 172.20.0.1:46430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46432 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:48:25,610 - lava_callback - INFO - Received callback for node 68d6a7782f83206171a92527 INFO: 172.20.0.1:46438 - "POST /node/68d6a7782f83206171a92527 HTTP/1.0" 202 Accepted 2025-09-26 14:48:25,615 - lava_callback - INFO - Starting async job submit for node 68d6a7782f83206171a92527 2025-09-26 14:48:25,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:25,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7782f83206171a92527 HTTP/1.1" 200 None 2025-09-26 14:48:25,648 - lava_callback - DEBUG - Processing node 68d6a7782f83206171a92527: baseline-arm64-foundriesio 2025-09-26 14:48:25,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:48:25,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:48:25,952 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6a7782f83206171a92527/log.txt.gz 2025-09-26 14:48:25,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:48:26,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:48:26,108 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6a7782f83206171a92527/lava_callback.json.gz 2025-09-26 14:48:26,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:26,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7782f83206171a92527 HTTP/1.1" 200 None 2025-09-26 14:48:26,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:26,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 14:48:26,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:26,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7782f83206171a92527 HTTP/1.1" 200 None 2025-09-26 14:48:26,194 - lava_callback - INFO - Completed processing callback for node 68d6a7782f83206171a92527 INFO: 172.20.0.1:46442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35262 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:48:37,479 - lava_callback - INFO - Received callback for node 68d4026dcd36afa834e15c43 INFO: 172.20.0.1:35270 - "POST /node/68d4026dcd36afa834e15c43 HTTP/1.0" 202 Accepted 2025-09-26 14:48:37,486 - lava_callback - INFO - Starting async job submit for node 68d4026dcd36afa834e15c43 2025-09-26 14:48:37,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:37,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4026dcd36afa834e15c43 HTTP/1.1" 200 None 2025-09-26 14:48:37,540 - lava_callback - DEBUG - Processing node 68d4026dcd36afa834e15c43: ltp-syscalls-ipc 2025-09-26 14:48:38,447 - lava_callback - ERROR - Error processing callback for node 68d4026dcd36afa834e15c43: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 14:48:43,386 - lava_callback - INFO - Received callback for node 68d6a73f2f83206171a924d2 INFO: 172.20.0.1:39982 - "POST /node/68d6a73f2f83206171a924d2 HTTP/1.0" 202 Accepted 2025-09-26 14:48:43,392 - lava_callback - INFO - Starting async job submit for node 68d6a73f2f83206171a924d2 2025-09-26 14:48:43,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:43,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a73f2f83206171a924d2 HTTP/1.1" 200 None 2025-09-26 14:48:43,424 - lava_callback - DEBUG - Processing node 68d6a73f2f83206171a924d2: baseline-arm64 2025-09-26 14:48:43,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:48:43,926 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:48:43,927 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a73f2f83206171a924d2/log.txt.gz 2025-09-26 14:48:43,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:48:44,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:48:44,073 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a73f2f83206171a924d2/lava_callback.json.gz 2025-09-26 14:48:44,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:44,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a73f2f83206171a924d2 HTTP/1.1" 200 None 2025-09-26 14:48:44,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:44,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 14:48:44,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:44,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a73f2f83206171a924d2 HTTP/1.1" 200 None 2025-09-26 14:48:44,172 - lava_callback - INFO - Completed processing callback for node 68d6a73f2f83206171a924d2 INFO: 172.20.0.1:39996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40958 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:48:59,771 - lava_callback - INFO - Received callback for node 68d6a72f2f83206171a924b4 INFO: 172.20.0.1:42136 - "POST /node/68d6a72f2f83206171a924b4 HTTP/1.0" 202 Accepted 2025-09-26 14:48:59,777 - lava_callback - INFO - Starting async job submit for node 68d6a72f2f83206171a924b4 2025-09-26 14:48:59,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:48:59,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a72f2f83206171a924b4 HTTP/1.1" 200 None 2025-09-26 14:48:59,810 - lava_callback - DEBUG - Processing node 68d6a72f2f83206171a924b4: baseline-arm64 2025-09-26 14:49:00,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:49:00,177 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:49:00,177 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a72f2f83206171a924b4/log.txt.gz 2025-09-26 14:49:00,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:49:00,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:49:00,298 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a72f2f83206171a924b4/lava_callback.json.gz 2025-09-26 14:49:00,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:00,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a72f2f83206171a924b4 HTTP/1.1" 200 None 2025-09-26 14:49:00,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:00,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 14:49:00,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:00,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a72f2f83206171a924b4 HTTP/1.1" 200 None 2025-09-26 14:49:00,387 - lava_callback - INFO - Completed processing callback for node 68d6a72f2f83206171a924b4 2025-09-26 14:49:05,494 - lava_callback - INFO - Received callback for node 68d404dccd36afa834e16559 INFO: 172.20.0.1:42144 - "POST /node/68d404dccd36afa834e16559 HTTP/1.0" 202 Accepted 2025-09-26 14:49:05,500 - lava_callback - INFO - Starting async job submit for node 68d404dccd36afa834e16559 2025-09-26 14:49:05,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:05,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d404dccd36afa834e16559 HTTP/1.1" 200 None 2025-09-26 14:49:05,513 - lava_callback - DEBUG - Processing node 68d404dccd36afa834e16559: baseline-arm 2025-09-26 14:49:05,513 - lava_callback - ERROR - Error processing callback for node 68d404dccd36afa834e16559: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:49:06,206 - lava_callback - INFO - Received callback for node 68d404ddcd36afa834e16567 INFO: 172.20.0.1:42150 - "POST /node/68d404ddcd36afa834e16567 HTTP/1.0" 202 Accepted 2025-09-26 14:49:06,211 - lava_callback - INFO - Starting async job submit for node 68d404ddcd36afa834e16567 2025-09-26 14:49:06,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:06,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d404ddcd36afa834e16567 HTTP/1.1" 200 None 2025-09-26 14:49:06,225 - lava_callback - DEBUG - Processing node 68d404ddcd36afa834e16567: baseline-arm 2025-09-26 14:49:06,225 - lava_callback - ERROR - Error processing callback for node 68d404ddcd36afa834e16567: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:42160 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:49:13,174 - lava_callback - INFO - Received callback for node 68d6a7422f83206171a924d8 INFO: 172.20.0.1:44720 - "POST /node/68d6a7422f83206171a924d8 HTTP/1.0" 202 Accepted 2025-09-26 14:49:13,180 - lava_callback - INFO - Starting async job submit for node 68d6a7422f83206171a924d8 2025-09-26 14:49:13,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:13,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7422f83206171a924d8 HTTP/1.1" 200 None 2025-09-26 14:49:13,213 - lava_callback - DEBUG - Processing node 68d6a7422f83206171a924d8: baseline-arm64 2025-09-26 14:49:13,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:49:13,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:49:13,610 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7422f83206171a924d8/log.txt.gz 2025-09-26 14:49:13,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:49:13,760 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:49:13,760 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7422f83206171a924d8/lava_callback.json.gz 2025-09-26 14:49:13,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:13,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7422f83206171a924d8 HTTP/1.1" 200 None 2025-09-26 14:49:13,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:13,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 14:49:13,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:13,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7422f83206171a924d8 HTTP/1.1" 200 None 2025-09-26 14:49:13,873 - lava_callback - INFO - Completed processing callback for node 68d6a7422f83206171a924d8 INFO: 172.20.0.1:44734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44744 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:49:17,068 - lava_callback - INFO - Received callback for node 68d40ab9cd36afa834e16fc0 INFO: 172.20.0.1:44756 - "POST /node/68d40ab9cd36afa834e16fc0 HTTP/1.0" 202 Accepted 2025-09-26 14:49:17,073 - lava_callback - INFO - Starting async job submit for node 68d40ab9cd36afa834e16fc0 2025-09-26 14:49:17,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:17,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40ab9cd36afa834e16fc0 HTTP/1.1" 200 None 2025-09-26 14:49:17,107 - lava_callback - DEBUG - Processing node 68d40ab9cd36afa834e16fc0: baseline-arm-broonie 2025-09-26 14:49:17,314 - lava_callback - ERROR - Error processing callback for node 68d40ab9cd36afa834e16fc0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 14:49:17,848 - lava_callback - INFO - Received callback for node 68d3e8c1cd36afa834e131b6 INFO: 172.20.0.1:44766 - "POST /node/68d3e8c1cd36afa834e131b6 HTTP/1.0" 202 Accepted 2025-09-26 14:49:17,858 - lava_callback - INFO - Starting async job submit for node 68d3e8c1cd36afa834e131b6 2025-09-26 14:49:17,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:17,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d3e8c1cd36afa834e131b6 HTTP/1.1" 200 None 2025-09-26 14:49:17,898 - lava_callback - DEBUG - Processing node 68d3e8c1cd36afa834e131b6: ltp-syscalls 2025-09-26 14:49:19,906 - lava_callback - ERROR - Error processing callback for node 68d3e8c1cd36afa834e131b6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:60596 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:49:24,658 - lava_callback - INFO - Received callback for node 68d404e1cd36afa834e16571 INFO: 172.20.0.1:60610 - "POST /node/68d404e1cd36afa834e16571 HTTP/1.0" 202 Accepted 2025-09-26 14:49:24,663 - lava_callback - INFO - Starting async job submit for node 68d404e1cd36afa834e16571 2025-09-26 14:49:24,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:24,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d404e1cd36afa834e16571 HTTP/1.1" 200 None 2025-09-26 14:49:24,676 - lava_callback - DEBUG - Processing node 68d404e1cd36afa834e16571: baseline-arm 2025-09-26 14:49:24,677 - lava_callback - ERROR - Error processing callback for node 68d404e1cd36afa834e16571: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:49:25,396 - lava_callback - INFO - Received callback for node 68d404e1cd36afa834e16574 INFO: 172.20.0.1:60626 - "POST /node/68d404e1cd36afa834e16574 HTTP/1.0" 202 Accepted 2025-09-26 14:49:25,402 - lava_callback - INFO - Starting async job submit for node 68d404e1cd36afa834e16574 2025-09-26 14:49:25,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:25,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d404e1cd36afa834e16574 HTTP/1.1" 200 None 2025-09-26 14:49:25,419 - lava_callback - DEBUG - Processing node 68d404e1cd36afa834e16574: baseline-arm 2025-09-26 14:49:25,419 - lava_callback - ERROR - Error processing callback for node 68d404e1cd36afa834e16574: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60628 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:49:26,095 - lava_callback - INFO - Received callback for node 68d404e3cd36afa834e16577 INFO: 172.20.0.1:60630 - "POST /node/68d404e3cd36afa834e16577 HTTP/1.0" 202 Accepted 2025-09-26 14:49:26,100 - lava_callback - INFO - Starting async job submit for node 68d404e3cd36afa834e16577 2025-09-26 14:49:26,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:26,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d404e3cd36afa834e16577 HTTP/1.1" 200 None 2025-09-26 14:49:26,132 - lava_callback - DEBUG - Processing node 68d404e3cd36afa834e16577: baseline-arm 2025-09-26 14:49:26,132 - lava_callback - ERROR - Error processing callback for node 68d404e3cd36afa834e16577: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60642 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:49:26,809 - lava_callback - INFO - Received callback for node 68d404e5cd36afa834e1657a INFO: 172.20.0.1:60648 - "POST /node/68d404e5cd36afa834e1657a HTTP/1.0" 202 Accepted 2025-09-26 14:49:26,815 - lava_callback - INFO - Starting async job submit for node 68d404e5cd36afa834e1657a 2025-09-26 14:49:26,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:26,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d404e5cd36afa834e1657a HTTP/1.1" 200 None 2025-09-26 14:49:26,830 - lava_callback - DEBUG - Processing node 68d404e5cd36afa834e1657a: baseline-arm 2025-09-26 14:49:26,830 - lava_callback - ERROR - Error processing callback for node 68d404e5cd36afa834e1657a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:49:27,537 - lava_callback - INFO - Received callback for node 68d404e9cd36afa834e16599 INFO: 172.20.0.1:60652 - "POST /node/68d404e9cd36afa834e16599 HTTP/1.0" 202 Accepted 2025-09-26 14:49:27,543 - lava_callback - INFO - Starting async job submit for node 68d404e9cd36afa834e16599 2025-09-26 14:49:27,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:27,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d404e9cd36afa834e16599 HTTP/1.1" 200 None 2025-09-26 14:49:27,564 - lava_callback - DEBUG - Processing node 68d404e9cd36afa834e16599: baseline-arm 2025-09-26 14:49:27,564 - lava_callback - ERROR - Error processing callback for node 68d404e9cd36afa834e16599: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:49:28,289 - lava_callback - INFO - Received callback for node 68d404edcd36afa834e1659c INFO: 172.20.0.1:60658 - "POST /node/68d404edcd36afa834e1659c HTTP/1.0" 202 Accepted 2025-09-26 14:49:28,294 - lava_callback - INFO - Starting async job submit for node 68d404edcd36afa834e1659c 2025-09-26 14:49:28,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:28,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d404edcd36afa834e1659c HTTP/1.1" 200 None 2025-09-26 14:49:28,307 - lava_callback - DEBUG - Processing node 68d404edcd36afa834e1659c: baseline-arm 2025-09-26 14:49:28,307 - lava_callback - ERROR - Error processing callback for node 68d404edcd36afa834e1659c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:49:29,012 - lava_callback - INFO - Received callback for node 68d404efcd36afa834e1659f INFO: 172.20.0.1:60668 - "POST /node/68d404efcd36afa834e1659f HTTP/1.0" 202 Accepted 2025-09-26 14:49:29,017 - lava_callback - INFO - Starting async job submit for node 68d404efcd36afa834e1659f 2025-09-26 14:49:29,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:29,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d404efcd36afa834e1659f HTTP/1.1" 200 None 2025-09-26 14:49:29,031 - lava_callback - DEBUG - Processing node 68d404efcd36afa834e1659f: baseline-arm 2025-09-26 14:49:29,031 - lava_callback - ERROR - Error processing callback for node 68d404efcd36afa834e1659f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:50640 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:49:38,219 - lava_callback - INFO - Received callback for node 68d42a2aa5c2c05277bc78b8 INFO: 172.20.0.1:50642 - "POST /node/68d42a2aa5c2c05277bc78b8 HTTP/1.0" 202 Accepted 2025-09-26 14:49:38,231 - lava_callback - INFO - Starting async job submit for node 68d42a2aa5c2c05277bc78b8 2025-09-26 14:49:38,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:38,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42a2aa5c2c05277bc78b8 HTTP/1.1" 200 None 2025-09-26 14:49:38,321 - lava_callback - DEBUG - Processing node 68d42a2aa5c2c05277bc78b8: baseline-arm 2025-09-26 14:49:38,796 - lava_callback - ERROR - Error processing callback for node 68d42a2aa5c2c05277bc78b8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 14:49:45,270 - lava_callback - INFO - Received callback for node 68d404f2cd36afa834e165a2 INFO: 172.20.0.1:50050 - "POST /node/68d404f2cd36afa834e165a2 HTTP/1.0" 202 Accepted 2025-09-26 14:49:45,278 - lava_callback - INFO - Starting async job submit for node 68d404f2cd36afa834e165a2 2025-09-26 14:49:45,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:45,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d404f2cd36afa834e165a2 HTTP/1.1" 200 None 2025-09-26 14:49:45,305 - lava_callback - DEBUG - Processing node 68d404f2cd36afa834e165a2: baseline-arm 2025-09-26 14:49:45,305 - lava_callback - ERROR - Error processing callback for node 68d404f2cd36afa834e165a2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:49:46,000 - lava_callback - INFO - Received callback for node 68d404f6cd36afa834e165a5 INFO: 172.20.0.1:50058 - "POST /node/68d404f6cd36afa834e165a5 HTTP/1.0" 202 Accepted 2025-09-26 14:49:46,007 - lava_callback - INFO - Starting async job submit for node 68d404f6cd36afa834e165a5 2025-09-26 14:49:46,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:46,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d404f6cd36afa834e165a5 HTTP/1.1" 200 None 2025-09-26 14:49:46,021 - lava_callback - DEBUG - Processing node 68d404f6cd36afa834e165a5: baseline-arm 2025-09-26 14:49:46,021 - lava_callback - ERROR - Error processing callback for node 68d404f6cd36afa834e165a5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:50068 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:49:46,722 - lava_callback - INFO - Received callback for node 68d404f7cd36afa834e165a8 INFO: 172.20.0.1:50080 - "POST /node/68d404f7cd36afa834e165a8 HTTP/1.0" 202 Accepted 2025-09-26 14:49:46,730 - lava_callback - INFO - Starting async job submit for node 68d404f7cd36afa834e165a8 2025-09-26 14:49:46,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:46,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d404f7cd36afa834e165a8 HTTP/1.1" 200 None 2025-09-26 14:49:46,753 - lava_callback - DEBUG - Processing node 68d404f7cd36afa834e165a8: baseline-arm 2025-09-26 14:49:46,753 - lava_callback - ERROR - Error processing callback for node 68d404f7cd36afa834e165a8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:49:47,432 - lava_callback - INFO - Received callback for node 68d404f9cd36afa834e165ab INFO: 172.20.0.1:50082 - "POST /node/68d404f9cd36afa834e165ab HTTP/1.0" 202 Accepted 2025-09-26 14:49:47,441 - lava_callback - INFO - Starting async job submit for node 68d404f9cd36afa834e165ab 2025-09-26 14:49:47,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:47,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d404f9cd36afa834e165ab HTTP/1.1" 200 None 2025-09-26 14:49:47,457 - lava_callback - DEBUG - Processing node 68d404f9cd36afa834e165ab: baseline-arm 2025-09-26 14:49:47,457 - lava_callback - ERROR - Error processing callback for node 68d404f9cd36afa834e165ab: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:49:48,153 - lava_callback - INFO - Received callback for node 68d404fccd36afa834e165ae INFO: 172.20.0.1:50092 - "POST /node/68d404fccd36afa834e165ae HTTP/1.0" 202 Accepted 2025-09-26 14:49:48,158 - lava_callback - INFO - Starting async job submit for node 68d404fccd36afa834e165ae 2025-09-26 14:49:48,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:48,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d404fccd36afa834e165ae HTTP/1.1" 200 None 2025-09-26 14:49:48,172 - lava_callback - DEBUG - Processing node 68d404fccd36afa834e165ae: baseline-arm 2025-09-26 14:49:48,172 - lava_callback - ERROR - Error processing callback for node 68d404fccd36afa834e165ae: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:49:48,868 - lava_callback - INFO - Received callback for node 68d404fecd36afa834e165b1 INFO: 172.20.0.1:50102 - "POST /node/68d404fecd36afa834e165b1 HTTP/1.0" 202 Accepted 2025-09-26 14:49:48,875 - lava_callback - INFO - Starting async job submit for node 68d404fecd36afa834e165b1 2025-09-26 14:49:48,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:48,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d404fecd36afa834e165b1 HTTP/1.1" 200 None 2025-09-26 14:49:48,894 - lava_callback - DEBUG - Processing node 68d404fecd36afa834e165b1: baseline-arm 2025-09-26 14:49:48,894 - lava_callback - ERROR - Error processing callback for node 68d404fecd36afa834e165b1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:49:49,601 - lava_callback - INFO - Received callback for node 68d404fecd36afa834e165b4 INFO: 172.20.0.1:35664 - "POST /node/68d404fecd36afa834e165b4 HTTP/1.0" 202 Accepted 2025-09-26 14:49:49,608 - lava_callback - INFO - Starting async job submit for node 68d404fecd36afa834e165b4 2025-09-26 14:49:49,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:49:49,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d404fecd36afa834e165b4 HTTP/1.1" 200 None 2025-09-26 14:49:49,623 - lava_callback - DEBUG - Processing node 68d404fecd36afa834e165b4: baseline-arm 2025-09-26 14:49:49,623 - lava_callback - ERROR - Error processing callback for node 68d404fecd36afa834e165b4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:35670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44188 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:50:06,889 - lava_callback - INFO - Received callback for node 68d4050acd36afa834e165cb INFO: 172.20.0.1:44198 - "POST /node/68d4050acd36afa834e165cb HTTP/1.0" 202 Accepted 2025-09-26 14:50:06,897 - lava_callback - INFO - Starting async job submit for node 68d4050acd36afa834e165cb 2025-09-26 14:50:06,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:50:06,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4050acd36afa834e165cb HTTP/1.1" 200 None 2025-09-26 14:50:06,910 - lava_callback - DEBUG - Processing node 68d4050acd36afa834e165cb: baseline-arm 2025-09-26 14:50:06,910 - lava_callback - ERROR - Error processing callback for node 68d4050acd36afa834e165cb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:50:07,628 - lava_callback - INFO - Received callback for node 68d4050ccd36afa834e165ce INFO: 172.20.0.1:44202 - "POST /node/68d4050ccd36afa834e165ce HTTP/1.0" 202 Accepted 2025-09-26 14:50:07,635 - lava_callback - INFO - Starting async job submit for node 68d4050ccd36afa834e165ce 2025-09-26 14:50:07,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:50:07,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4050ccd36afa834e165ce HTTP/1.1" 200 None 2025-09-26 14:50:07,663 - lava_callback - DEBUG - Processing node 68d4050ccd36afa834e165ce: baseline-arm 2025-09-26 14:50:07,663 - lava_callback - ERROR - Error processing callback for node 68d4050ccd36afa834e165ce: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:50:08,350 - lava_callback - INFO - Received callback for node 68d4050ecd36afa834e165d1 INFO: 172.20.0.1:44216 - "POST /node/68d4050ecd36afa834e165d1 HTTP/1.0" 202 Accepted 2025-09-26 14:50:08,356 - lava_callback - INFO - Starting async job submit for node 68d4050ecd36afa834e165d1 2025-09-26 14:50:08,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:50:08,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4050ecd36afa834e165d1 HTTP/1.1" 200 None 2025-09-26 14:50:08,369 - lava_callback - DEBUG - Processing node 68d4050ecd36afa834e165d1: baseline-arm 2025-09-26 14:50:08,369 - lava_callback - ERROR - Error processing callback for node 68d4050ecd36afa834e165d1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:50:09,123 - lava_callback - INFO - Received callback for node 68d4050fcd36afa834e165d4 INFO: 172.20.0.1:44224 - "POST /node/68d4050fcd36afa834e165d4 HTTP/1.0" 202 Accepted 2025-09-26 14:50:09,129 - lava_callback - INFO - Starting async job submit for node 68d4050fcd36afa834e165d4 2025-09-26 14:50:09,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:50:09,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4050fcd36afa834e165d4 HTTP/1.1" 200 None 2025-09-26 14:50:09,142 - lava_callback - DEBUG - Processing node 68d4050fcd36afa834e165d4: baseline-arm 2025-09-26 14:50:09,142 - lava_callback - ERROR - Error processing callback for node 68d4050fcd36afa834e165d4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:50:09,851 - lava_callback - INFO - Received callback for node 68d40518cd36afa834e165e6 INFO: 172.20.0.1:51102 - "POST /node/68d40518cd36afa834e165e6 HTTP/1.0" 202 Accepted 2025-09-26 14:50:09,857 - lava_callback - INFO - Starting async job submit for node 68d40518cd36afa834e165e6 2025-09-26 14:50:09,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:50:09,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40518cd36afa834e165e6 HTTP/1.1" 200 None 2025-09-26 14:50:09,871 - lava_callback - DEBUG - Processing node 68d40518cd36afa834e165e6: baseline-arm 2025-09-26 14:50:09,871 - lava_callback - ERROR - Error processing callback for node 68d40518cd36afa834e165e6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:50:10,572 - lava_callback - INFO - Received callback for node 68d4051acd36afa834e165e9 INFO: 172.20.0.1:51114 - "POST /node/68d4051acd36afa834e165e9 HTTP/1.0" 202 Accepted 2025-09-26 14:50:10,580 - lava_callback - INFO - Starting async job submit for node 68d4051acd36afa834e165e9 2025-09-26 14:50:10,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:50:10,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4051acd36afa834e165e9 HTTP/1.1" 200 None 2025-09-26 14:50:10,617 - lava_callback - DEBUG - Processing node 68d4051acd36afa834e165e9: baseline-arm 2025-09-26 14:50:10,617 - lava_callback - ERROR - Error processing callback for node 68d4051acd36afa834e165e9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:50:11,312 - lava_callback - INFO - Received callback for node 68d4051ccd36afa834e165ec INFO: 172.20.0.1:51130 - "POST /node/68d4051ccd36afa834e165ec HTTP/1.0" 202 Accepted 2025-09-26 14:50:11,319 - lava_callback - INFO - Starting async job submit for node 68d4051ccd36afa834e165ec 2025-09-26 14:50:11,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:50:11,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4051ccd36afa834e165ec HTTP/1.1" 200 None 2025-09-26 14:50:11,332 - lava_callback - DEBUG - Processing node 68d4051ccd36afa834e165ec: baseline-arm 2025-09-26 14:50:11,332 - lava_callback - ERROR - Error processing callback for node 68d4051ccd36afa834e165ec: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:50:12,038 - lava_callback - INFO - Received callback for node 68d4051dcd36afa834e165ef INFO: 172.20.0.1:51136 - "POST /node/68d4051dcd36afa834e165ef HTTP/1.0" 202 Accepted 2025-09-26 14:50:12,043 - lava_callback - INFO - Starting async job submit for node 68d4051dcd36afa834e165ef 2025-09-26 14:50:12,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:50:12,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4051dcd36afa834e165ef HTTP/1.1" 200 None 2025-09-26 14:50:12,063 - lava_callback - DEBUG - Processing node 68d4051dcd36afa834e165ef: baseline-arm 2025-09-26 14:50:12,063 - lava_callback - ERROR - Error processing callback for node 68d4051dcd36afa834e165ef: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:51138 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60264 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:50:37,440 - lava_callback - INFO - Received callback for node 68d40ac2cd36afa834e16fc9 INFO: 172.20.0.1:60272 - "POST /node/68d40ac2cd36afa834e16fc9 HTTP/1.0" 202 Accepted 2025-09-26 14:50:37,448 - lava_callback - INFO - Starting async job submit for node 68d40ac2cd36afa834e16fc9 2025-09-26 14:50:37,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:50:37,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40ac2cd36afa834e16fc9 HTTP/1.1" 200 None 2025-09-26 14:50:37,489 - lava_callback - DEBUG - Processing node 68d40ac2cd36afa834e16fc9: baseline-arm-broonie 2025-09-26 14:50:37,712 - lava_callback - ERROR - Error processing callback for node 68d40ac2cd36afa834e16fc9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 14:50:38,891 - lava_callback - INFO - Received callback for node 68d40ae8cd36afa834e16ff3 INFO: 172.20.0.1:60280 - "POST /node/68d40ae8cd36afa834e16ff3 HTTP/1.0" 202 Accepted 2025-09-26 14:50:38,898 - lava_callback - INFO - Starting async job submit for node 68d40ae8cd36afa834e16ff3 2025-09-26 14:50:38,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:50:38,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40ae8cd36afa834e16ff3 HTTP/1.1" 200 None 2025-09-26 14:50:38,939 - lava_callback - DEBUG - Processing node 68d40ae8cd36afa834e16ff3: baseline-arm-broonie 2025-09-26 14:50:39,238 - lava_callback - ERROR - Error processing callback for node 68d40ae8cd36afa834e16ff3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:51008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45822 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:51:11,834 - lava_callback - INFO - Received callback for node 68d6a8012f83206171a92587 INFO: 172.20.0.1:47198 - "POST /node/68d6a8012f83206171a92587 HTTP/1.0" 202 Accepted 2025-09-26 14:51:11,841 - lava_callback - INFO - Starting async job submit for node 68d6a8012f83206171a92587 2025-09-26 14:51:11,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:11,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8012f83206171a92587 HTTP/1.1" 200 None 2025-09-26 14:51:11,880 - lava_callback - DEBUG - Processing node 68d6a8012f83206171a92587: baseline-arm64 2025-09-26 14:51:12,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:51:12,323 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:51:12,324 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8012f83206171a92587/log.txt.gz 2025-09-26 14:51:12,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:51:12,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:51:12,481 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8012f83206171a92587/lava_callback.json.gz 2025-09-26 14:51:12,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:12,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8012f83206171a92587 HTTP/1.1" 200 None 2025-09-26 14:51:12,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:12,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:51:12,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:12,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8012f83206171a92587 HTTP/1.1" 200 None 2025-09-26 14:51:12,567 - lava_callback - INFO - Completed processing callback for node 68d6a8012f83206171a92587 INFO: 172.20.0.1:47200 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 14:51:15,747 - lava_callback - INFO - Received callback for node 68d40ac7cd36afa834e16fcf INFO: 172.20.0.1:47204 - "POST /node/68d40ac7cd36afa834e16fcf HTTP/1.0" 202 Accepted 2025-09-26 14:51:15,753 - lava_callback - INFO - Starting async job submit for node 68d40ac7cd36afa834e16fcf 2025-09-26 14:51:15,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:15,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40ac7cd36afa834e16fcf HTTP/1.1" 200 None 2025-09-26 14:51:15,825 - lava_callback - DEBUG - Processing node 68d40ac7cd36afa834e16fcf: baseline-arm-broonie 2025-09-26 14:51:15,852 - lava_callback - INFO - Received callback for node 68d6a8082f83206171a925be INFO: 172.20.0.1:47212 - "POST /node/68d6a8082f83206171a925be HTTP/1.0" 202 Accepted 2025-09-26 14:51:15,869 - lava_callback - INFO - Starting async job submit for node 68d6a8082f83206171a925be 2025-09-26 14:51:15,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:15,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8082f83206171a925be HTTP/1.1" 200 None 2025-09-26 14:51:16,002 - lava_callback - DEBUG - Processing node 68d6a8082f83206171a925be: baseline-arm64 2025-09-26 14:51:16,216 - lava_callback - ERROR - Error processing callback for node 68d40ac7cd36afa834e16fcf: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 14:51:16,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:47218 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:51:16,568 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:51:16,569 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8082f83206171a925be/log.txt.gz 2025-09-26 14:51:16,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:51:16,702 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:51:16,703 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8082f83206171a925be/lava_callback.json.gz 2025-09-26 14:51:16,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:16,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8082f83206171a925be HTTP/1.1" 200 None 2025-09-26 14:51:16,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:16,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:51:16,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:16,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8082f83206171a925be HTTP/1.1" 200 None 2025-09-26 14:51:16,804 - lava_callback - INFO - Completed processing callback for node 68d6a8082f83206171a925be 2025-09-26 14:51:17,656 - lava_callback - INFO - Received callback for node 68d6a8032f83206171a925a2 INFO: 172.20.0.1:47226 - "POST /node/68d6a8032f83206171a925a2 HTTP/1.0" 202 Accepted 2025-09-26 14:51:17,663 - lava_callback - INFO - Starting async job submit for node 68d6a8032f83206171a925a2 2025-09-26 14:51:17,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:17,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8032f83206171a925a2 HTTP/1.1" 200 None 2025-09-26 14:51:17,704 - lava_callback - DEBUG - Processing node 68d6a8032f83206171a925a2: baseline-arm64 2025-09-26 14:51:18,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:51:18,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:51:18,159 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8032f83206171a925a2/log.txt.gz 2025-09-26 14:51:18,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:51:18,279 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:51:18,280 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8032f83206171a925a2/lava_callback.json.gz 2025-09-26 14:51:18,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:18,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8032f83206171a925a2 HTTP/1.1" 200 None 2025-09-26 14:51:18,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:18,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:51:18,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:18,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8032f83206171a925a2 HTTP/1.1" 200 None 2025-09-26 14:51:18,383 - lava_callback - INFO - Completed processing callback for node 68d6a8032f83206171a925a2 2025-09-26 14:51:20,942 - lava_callback - INFO - Received callback for node 68d6a8152f83206171a925d6 INFO: 172.20.0.1:60476 - "POST /node/68d6a8152f83206171a925d6 HTTP/1.0" 202 Accepted 2025-09-26 14:51:20,954 - lava_callback - INFO - Starting async job submit for node 68d6a8152f83206171a925d6 2025-09-26 14:51:20,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:20,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8152f83206171a925d6 HTTP/1.1" 200 None 2025-09-26 14:51:20,993 - lava_callback - DEBUG - Processing node 68d6a8152f83206171a925d6: baseline-arm64 2025-09-26 14:51:21,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:51:21,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:51:21,584 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8152f83206171a925d6/log.txt.gz 2025-09-26 14:51:21,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:51:21,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:51:21,721 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8152f83206171a925d6/lava_callback.json.gz 2025-09-26 14:51:21,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:21,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8152f83206171a925d6 HTTP/1.1" 200 None 2025-09-26 14:51:21,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:21,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:51:21,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:21,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8152f83206171a925d6 HTTP/1.1" 200 None 2025-09-26 14:51:21,814 - lava_callback - INFO - Completed processing callback for node 68d6a8152f83206171a925d6 INFO: 172.20.0.1:60492 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:51:24,927 - lava_callback - INFO - Received callback for node 68d6a8192f83206171a925dc INFO: 172.20.0.1:60496 - "POST /node/68d6a8192f83206171a925dc HTTP/1.0" 202 Accepted 2025-09-26 14:51:24,935 - lava_callback - INFO - Starting async job submit for node 68d6a8192f83206171a925dc 2025-09-26 14:51:24,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:24,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8192f83206171a925dc HTTP/1.1" 200 None 2025-09-26 14:51:24,987 - lava_callback - DEBUG - Processing node 68d6a8192f83206171a925dc: baseline-arm64 2025-09-26 14:51:25,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:51:25,516 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:51:25,517 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8192f83206171a925dc/log.txt.gz INFO: 172.20.0.1:60504 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:51:25,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:51:25,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:51:25,650 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8192f83206171a925dc/lava_callback.json.gz 2025-09-26 14:51:25,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:25,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8192f83206171a925dc HTTP/1.1" 200 None 2025-09-26 14:51:25,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:25,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:51:25,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:25,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8192f83206171a925dc HTTP/1.1" 200 None 2025-09-26 14:51:25,736 - lava_callback - INFO - Completed processing callback for node 68d6a8192f83206171a925dc INFO: 172.20.0.1:60518 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:51:27,679 - lava_callback - INFO - Received callback for node 68d6a8152f83206171a925d3 INFO: 172.20.0.1:60528 - "POST /node/68d6a8152f83206171a925d3 HTTP/1.0" 202 Accepted 2025-09-26 14:51:27,688 - lava_callback - INFO - Starting async job submit for node 68d6a8152f83206171a925d3 2025-09-26 14:51:27,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:27,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8152f83206171a925d3 HTTP/1.1" 200 None 2025-09-26 14:51:27,728 - lava_callback - DEBUG - Processing node 68d6a8152f83206171a925d3: baseline-arm64 2025-09-26 14:51:28,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:51:28,442 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:51:28,443 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8152f83206171a925d3/log.txt.gz 2025-09-26 14:51:28,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:51:28,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:51:28,629 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8152f83206171a925d3/lava_callback.json.gz 2025-09-26 14:51:28,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:28,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8152f83206171a925d3 HTTP/1.1" 200 None 2025-09-26 14:51:28,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:28,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:51:28,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:28,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8152f83206171a925d3 HTTP/1.1" 200 None 2025-09-26 14:51:28,726 - lava_callback - INFO - Completed processing callback for node 68d6a8152f83206171a925d3 2025-09-26 14:51:29,923 - lava_callback - INFO - Received callback for node 68d6a8182f83206171a925d9 INFO: 172.20.0.1:37268 - "POST /node/68d6a8182f83206171a925d9 HTTP/1.0" 202 Accepted 2025-09-26 14:51:29,930 - lava_callback - INFO - Starting async job submit for node 68d6a8182f83206171a925d9 2025-09-26 14:51:29,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:29,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8182f83206171a925d9 HTTP/1.1" 200 None 2025-09-26 14:51:29,970 - lava_callback - DEBUG - Processing node 68d6a8182f83206171a925d9: baseline-arm64 2025-09-26 14:51:30,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:51:30,466 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:51:30,466 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8182f83206171a925d9/log.txt.gz 2025-09-26 14:51:30,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:51:30,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:51:30,587 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8182f83206171a925d9/lava_callback.json.gz 2025-09-26 14:51:30,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:30,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8182f83206171a925d9 HTTP/1.1" 200 None 2025-09-26 14:51:30,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:30,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:51:30,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:30,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8182f83206171a925d9 HTTP/1.1" 200 None 2025-09-26 14:51:30,663 - lava_callback - INFO - Completed processing callback for node 68d6a8182f83206171a925d9 2025-09-26 14:51:33,780 - lava_callback - INFO - Received callback for node 68d6a8262f83206171a925f4 INFO: 172.20.0.1:37282 - "POST /node/68d6a8262f83206171a925f4 HTTP/1.0" 202 Accepted 2025-09-26 14:51:33,787 - lava_callback - INFO - Starting async job submit for node 68d6a8262f83206171a925f4 2025-09-26 14:51:33,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:33,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8262f83206171a925f4 HTTP/1.1" 200 None 2025-09-26 14:51:33,825 - lava_callback - DEBUG - Processing node 68d6a8262f83206171a925f4: baseline-arm64 2025-09-26 14:51:34,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:51:34,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:51:34,494 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8262f83206171a925f4/log.txt.gz 2025-09-26 14:51:34,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:51:34,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:51:34,646 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8262f83206171a925f4/lava_callback.json.gz 2025-09-26 14:51:34,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:34,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8262f83206171a925f4 HTTP/1.1" 200 None 2025-09-26 14:51:34,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:34,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:51:34,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:34,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8262f83206171a925f4 HTTP/1.1" 200 None 2025-09-26 14:51:34,740 - lava_callback - INFO - Completed processing callback for node 68d6a8262f83206171a925f4 2025-09-26 14:51:35,672 - lava_callback - INFO - Received callback for node 68d6a8072f83206171a925bb INFO: 172.20.0.1:37284 - "POST /node/68d6a8072f83206171a925bb HTTP/1.0" 202 Accepted 2025-09-26 14:51:35,680 - lava_callback - INFO - Starting async job submit for node 68d6a8072f83206171a925bb 2025-09-26 14:51:35,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:35,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8072f83206171a925bb HTTP/1.1" 200 None 2025-09-26 14:51:35,717 - lava_callback - DEBUG - Processing node 68d6a8072f83206171a925bb: baseline-arm64 2025-09-26 14:51:35,827 - lava_callback - INFO - Received callback for node 68d6a81b2f83206171a925df INFO: 172.20.0.1:37292 - "POST /node/68d6a81b2f83206171a925df HTTP/1.0" 202 Accepted 2025-09-26 14:51:35,854 - lava_callback - INFO - Starting async job submit for node 68d6a81b2f83206171a925df 2025-09-26 14:51:35,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:35,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a81b2f83206171a925df HTTP/1.1" 200 None 2025-09-26 14:51:35,970 - lava_callback - DEBUG - Processing node 68d6a81b2f83206171a925df: baseline-arm64 2025-09-26 14:51:36,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:51:36,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:37302 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:51:36,603 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:51:36,604 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a81b2f83206171a925df/log.txt.gz 2025-09-26 14:51:36,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:51:36,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:51:36,746 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8072f83206171a925bb/log.txt.gz 2025-09-26 14:51:36,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:51:36,752 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a81b2f83206171a925df/lava_callback.json.gz 2025-09-26 14:51:36,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:36,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:51:36,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a81b2f83206171a925df HTTP/1.1" 200 None 2025-09-26 14:51:36,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:36,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:51:36,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:36,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a81b2f83206171a925df HTTP/1.1" 200 None 2025-09-26 14:51:36,892 - lava_callback - INFO - Completed processing callback for node 68d6a81b2f83206171a925df 2025-09-26 14:51:36,954 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:51:36,955 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8072f83206171a925bb/lava_callback.json.gz 2025-09-26 14:51:36,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:37,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8072f83206171a925bb HTTP/1.1" 200 None 2025-09-26 14:51:37,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:37,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:51:37,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:37,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8072f83206171a925bb HTTP/1.1" 200 None 2025-09-26 14:51:37,059 - lava_callback - INFO - Completed processing callback for node 68d6a8072f83206171a925bb 2025-09-26 14:51:37,754 - lava_callback - INFO - Received callback for node 68d6a81c2f83206171a925e2 INFO: 172.20.0.1:37318 - "POST /node/68d6a81c2f83206171a925e2 HTTP/1.0" 202 Accepted 2025-09-26 14:51:37,761 - lava_callback - INFO - Starting async job submit for node 68d6a81c2f83206171a925e2 2025-09-26 14:51:37,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:37,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a81c2f83206171a925e2 HTTP/1.1" 200 None 2025-09-26 14:51:37,802 - lava_callback - DEBUG - Processing node 68d6a81c2f83206171a925e2: baseline-arm64 2025-09-26 14:51:38,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:51:38,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:51:38,250 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a81c2f83206171a925e2/log.txt.gz 2025-09-26 14:51:38,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:51:38,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:51:38,489 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a81c2f83206171a925e2/lava_callback.json.gz 2025-09-26 14:51:38,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:38,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a81c2f83206171a925e2 HTTP/1.1" 200 None 2025-09-26 14:51:38,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:38,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:51:38,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:38,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a81c2f83206171a925e2 HTTP/1.1" 200 None 2025-09-26 14:51:38,613 - lava_callback - INFO - Completed processing callback for node 68d6a81c2f83206171a925e2 2025-09-26 14:51:38,947 - lava_callback - INFO - Received callback for node 68d6a8252f83206171a925f1 INFO: 172.20.0.1:37328 - "POST /node/68d6a8252f83206171a925f1 HTTP/1.0" 202 Accepted 2025-09-26 14:51:38,954 - lava_callback - INFO - Starting async job submit for node 68d6a8252f83206171a925f1 2025-09-26 14:51:38,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:38,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8252f83206171a925f1 HTTP/1.1" 200 None 2025-09-26 14:51:38,991 - lava_callback - DEBUG - Processing node 68d6a8252f83206171a925f1: baseline-arm64 2025-09-26 14:51:39,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:51:39,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:51:39,406 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8252f83206171a925f1/log.txt.gz 2025-09-26 14:51:39,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:51:39,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:51:39,539 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8252f83206171a925f1/lava_callback.json.gz 2025-09-26 14:51:39,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:39,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8252f83206171a925f1 HTTP/1.1" 200 None 2025-09-26 14:51:39,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:39,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:51:39,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:39,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8252f83206171a925f1 HTTP/1.1" 200 None 2025-09-26 14:51:39,622 - lava_callback - INFO - Completed processing callback for node 68d6a8252f83206171a925f1 2025-09-26 14:51:42,813 - lava_callback - INFO - Received callback for node 68d42a2ba5c2c05277bc78bb INFO: 172.20.0.1:52118 - "POST /node/68d42a2ba5c2c05277bc78bb HTTP/1.0" 202 Accepted 2025-09-26 14:51:42,820 - lava_callback - INFO - Starting async job submit for node 68d42a2ba5c2c05277bc78bb 2025-09-26 14:51:42,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:51:42,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42a2ba5c2c05277bc78bb HTTP/1.1" 200 None 2025-09-26 14:51:42,856 - lava_callback - DEBUG - Processing node 68d42a2ba5c2c05277bc78bb: baseline-arm 2025-09-26 14:51:43,141 - lava_callback - ERROR - Error processing callback for node 68d42a2ba5c2c05277bc78bb: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:52124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40840 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:52:02,735 - lava_callback - INFO - Received callback for node 68d6a8352f83206171a9260f INFO: 172.20.0.1:60754 - "POST /node/68d6a8352f83206171a9260f HTTP/1.0" 202 Accepted 2025-09-26 14:52:02,746 - lava_callback - INFO - Starting async job submit for node 68d6a8352f83206171a9260f 2025-09-26 14:52:02,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:02,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8352f83206171a9260f HTTP/1.1" 200 None 2025-09-26 14:52:02,794 - lava_callback - DEBUG - Processing node 68d6a8352f83206171a9260f: baseline-arm64 2025-09-26 14:52:03,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:52:03,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:52:03,252 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8352f83206171a9260f/log.txt.gz 2025-09-26 14:52:03,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:52:03,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:52:03,374 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8352f83206171a9260f/lava_callback.json.gz 2025-09-26 14:52:03,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:03,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8352f83206171a9260f HTTP/1.1" 200 None 2025-09-26 14:52:03,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:03,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:52:03,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:03,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8352f83206171a9260f HTTP/1.1" 200 None 2025-09-26 14:52:03,498 - lava_callback - INFO - Completed processing callback for node 68d6a8352f83206171a9260f INFO: 172.20.0.1:60762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54368 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:52:17,652 - lava_callback - INFO - Received callback for node 68d40af0cd36afa834e16ffc INFO: 172.20.0.1:54382 - "POST /node/68d40af0cd36afa834e16ffc HTTP/1.0" 202 Accepted 2025-09-26 14:52:17,658 - lava_callback - INFO - Starting async job submit for node 68d40af0cd36afa834e16ffc 2025-09-26 14:52:17,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:17,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40af0cd36afa834e16ffc HTTP/1.1" 200 None 2025-09-26 14:52:17,728 - lava_callback - DEBUG - Processing node 68d40af0cd36afa834e16ffc: baseline-arm-broonie 2025-09-26 14:52:17,978 - lava_callback - ERROR - Error processing callback for node 68d40af0cd36afa834e16ffc: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 14:52:18,324 - lava_callback - INFO - Received callback for node 68d6a8382f83206171a92615 INFO: 172.20.0.1:54394 - "POST /node/68d6a8382f83206171a92615 HTTP/1.0" 202 Accepted 2025-09-26 14:52:18,333 - lava_callback - INFO - Starting async job submit for node 68d6a8382f83206171a92615 2025-09-26 14:52:18,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:18,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8382f83206171a92615 HTTP/1.1" 200 None 2025-09-26 14:52:18,372 - lava_callback - DEBUG - Processing node 68d6a8382f83206171a92615: baseline-arm64 2025-09-26 14:52:18,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:52:18,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:52:18,843 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8382f83206171a92615/log.txt.gz 2025-09-26 14:52:18,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:52:19,005 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:52:19,006 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8382f83206171a92615/lava_callback.json.gz 2025-09-26 14:52:19,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:19,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8382f83206171a92615 HTTP/1.1" 200 None 2025-09-26 14:52:19,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:19,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:52:19,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:19,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8382f83206171a92615 HTTP/1.1" 200 None 2025-09-26 14:52:19,104 - lava_callback - INFO - Completed processing callback for node 68d6a8382f83206171a92615 2025-09-26 14:52:19,286 - lava_callback - INFO - Received callback for node 68d40b39cd36afa834e17034 INFO: 172.20.0.1:54398 - "POST /node/68d40b39cd36afa834e17034 HTTP/1.0" 202 Accepted 2025-09-26 14:52:19,295 - lava_callback - INFO - Starting async job submit for node 68d40b39cd36afa834e17034 2025-09-26 14:52:19,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:19,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40b39cd36afa834e17034 HTTP/1.1" 200 None 2025-09-26 14:52:19,337 - lava_callback - DEBUG - Processing node 68d40b39cd36afa834e17034: baseline-arm-broonie 2025-09-26 14:52:19,584 - lava_callback - ERROR - Error processing callback for node 68d40b39cd36afa834e17034: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 14:52:20,773 - lava_callback - INFO - Received callback for node 68d40b3dcd36afa834e17037 INFO: 172.20.0.1:34008 - "POST /node/68d40b3dcd36afa834e17037 HTTP/1.0" 202 Accepted 2025-09-26 14:52:20,779 - lava_callback - INFO - Starting async job submit for node 68d40b3dcd36afa834e17037 2025-09-26 14:52:20,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:20,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40b3dcd36afa834e17037 HTTP/1.1" 200 None 2025-09-26 14:52:20,813 - lava_callback - DEBUG - Processing node 68d40b3dcd36afa834e17037: baseline-arm-broonie 2025-09-26 14:52:21,036 - lava_callback - ERROR - Error processing callback for node 68d40b3dcd36afa834e17037: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:34010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34018 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:52:26,819 - lava_callback - INFO - Received callback for node 68d6a8392f83206171a92618 INFO: 172.20.0.1:34032 - "POST /node/68d6a8392f83206171a92618 HTTP/1.0" 202 Accepted 2025-09-26 14:52:26,825 - lava_callback - INFO - Starting async job submit for node 68d6a8392f83206171a92618 2025-09-26 14:52:26,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:26,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8392f83206171a92618 HTTP/1.1" 200 None 2025-09-26 14:52:26,859 - lava_callback - DEBUG - Processing node 68d6a8392f83206171a92618: baseline-arm64 2025-09-26 14:52:27,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:52:27,266 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:52:27,267 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8392f83206171a92618/log.txt.gz 2025-09-26 14:52:27,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:52:27,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:52:27,534 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8392f83206171a92618/lava_callback.json.gz 2025-09-26 14:52:27,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:27,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8392f83206171a92618 HTTP/1.1" 200 None 2025-09-26 14:52:27,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:27,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:52:27,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:27,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8392f83206171a92618 HTTP/1.1" 200 None 2025-09-26 14:52:27,614 - lava_callback - INFO - Completed processing callback for node 68d6a8392f83206171a92618 INFO: 172.20.0.1:59976 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:52:37,917 - lava_callback - INFO - Received callback for node 68d6a8332f83206171a9260c INFO: 172.20.0.1:59980 - "POST /node/68d6a8332f83206171a9260c HTTP/1.0" 202 Accepted 2025-09-26 14:52:37,923 - lava_callback - INFO - Starting async job submit for node 68d6a8332f83206171a9260c 2025-09-26 14:52:37,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:37,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8332f83206171a9260c HTTP/1.1" 200 None 2025-09-26 14:52:37,959 - lava_callback - DEBUG - Processing node 68d6a8332f83206171a9260c: baseline-arm64 2025-09-26 14:52:38,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:52:38,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:52:38,457 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8332f83206171a9260c/log.txt.gz 2025-09-26 14:52:38,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:52:38,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:52:38,578 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8332f83206171a9260c/lava_callback.json.gz 2025-09-26 14:52:38,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:38,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8332f83206171a9260c HTTP/1.1" 200 None 2025-09-26 14:52:38,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:38,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:52:38,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:38,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8332f83206171a9260c HTTP/1.1" 200 None 2025-09-26 14:52:38,661 - lava_callback - INFO - Completed processing callback for node 68d6a8332f83206171a9260c INFO: 172.20.0.1:54178 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:52:53,879 - lava_callback - INFO - Received callback for node 68d6a8222f83206171a925ee INFO: 172.20.0.1:46606 - "POST /node/68d6a8222f83206171a925ee HTTP/1.0" 202 Accepted 2025-09-26 14:52:53,884 - lava_callback - INFO - Starting async job submit for node 68d6a8222f83206171a925ee 2025-09-26 14:52:53,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:53,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8222f83206171a925ee HTTP/1.1" 200 None 2025-09-26 14:52:53,917 - lava_callback - DEBUG - Processing node 68d6a8222f83206171a925ee: baseline-arm64 2025-09-26 14:52:54,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:52:54,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:52:54,273 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8222f83206171a925ee/log.txt.gz 2025-09-26 14:52:54,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:52:54,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:52:54,397 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8222f83206171a925ee/lava_callback.json.gz 2025-09-26 14:52:54,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:54,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8222f83206171a925ee HTTP/1.1" 200 None 2025-09-26 14:52:54,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:54,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:52:54,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:54,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8222f83206171a925ee HTTP/1.1" 200 None 2025-09-26 14:52:54,501 - lava_callback - INFO - Completed processing callback for node 68d6a8222f83206171a925ee 2025-09-26 14:52:55,416 - lava_callback - INFO - Received callback for node 68d6a89d2f83206171a926af INFO: 172.20.0.1:46610 - "POST /node/68d6a89d2f83206171a926af HTTP/1.0" 202 Accepted 2025-09-26 14:52:55,422 - lava_callback - INFO - Starting async job submit for node 68d6a89d2f83206171a926af 2025-09-26 14:52:55,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:55,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a89d2f83206171a926af HTTP/1.1" 200 None 2025-09-26 14:52:55,456 - lava_callback - DEBUG - Processing node 68d6a89d2f83206171a926af: baseline-arm64-pengutronix 2025-09-26 14:52:55,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:52:55,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:52:55,775 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d6a89d2f83206171a926af/log.txt.gz 2025-09-26 14:52:55,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:52:55,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:52:55,909 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d6a89d2f83206171a926af/lava_callback.json.gz 2025-09-26 14:52:55,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:55,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a89d2f83206171a926af HTTP/1.1" 200 None 2025-09-26 14:52:55,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:55,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:52:55,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:56,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a89d2f83206171a926af HTTP/1.1" 200 None 2025-09-26 14:52:56,001 - lava_callback - INFO - Completed processing callback for node 68d6a89d2f83206171a926af INFO: 172.20.0.1:46620 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:52:58,787 - lava_callback - INFO - Received callback for node 68d40564cd36afa834e16672 INFO: 172.20.0.1:46626 - "POST /node/68d40564cd36afa834e16672 HTTP/1.0" 202 Accepted 2025-09-26 14:52:58,794 - lava_callback - INFO - Starting async job submit for node 68d40564cd36afa834e16672 2025-09-26 14:52:58,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:52:58,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40564cd36afa834e16672 HTTP/1.1" 200 None 2025-09-26 14:52:58,847 - lava_callback - DEBUG - Processing node 68d40564cd36afa834e16672: baseline-arm64 2025-09-26 14:52:59,721 - lava_callback - ERROR - Error processing callback for node 68d40564cd36afa834e16672: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 14:53:04,207 - lava_callback - INFO - Received callback for node 68d6a8a12f83206171a926b2 INFO: 172.20.0.1:54452 - "POST /node/68d6a8a12f83206171a926b2 HTTP/1.0" 202 Accepted 2025-09-26 14:53:04,213 - lava_callback - INFO - Starting async job submit for node 68d6a8a12f83206171a926b2 2025-09-26 14:53:04,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:04,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8a12f83206171a926b2 HTTP/1.1" 200 None 2025-09-26 14:53:04,262 - lava_callback - DEBUG - Processing node 68d6a8a12f83206171a926b2: baseline-arm64-pengutronix 2025-09-26 14:53:04,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:53:04,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:53:04,605 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d6a8a12f83206171a926b2/log.txt.gz 2025-09-26 14:53:04,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:53:04,757 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:53:04,758 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d6a8a12f83206171a926b2/lava_callback.json.gz 2025-09-26 14:53:04,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:04,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8a12f83206171a926b2 HTTP/1.1" 200 None 2025-09-26 14:53:04,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:04,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:53:04,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:04,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8a12f83206171a926b2 HTTP/1.1" 200 None 2025-09-26 14:53:04,842 - lava_callback - INFO - Completed processing callback for node 68d6a8a12f83206171a926b2 2025-09-26 14:53:06,341 - lava_callback - INFO - Received callback for node 68d405c7cd36afa834e1673a INFO: 172.20.0.1:54468 - "POST /node/68d405c7cd36afa834e1673a HTTP/1.0" 202 Accepted 2025-09-26 14:53:06,347 - lava_callback - INFO - Starting async job submit for node 68d405c7cd36afa834e1673a 2025-09-26 14:53:06,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:06,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d405c7cd36afa834e1673a HTTP/1.1" 200 None 2025-09-26 14:53:06,364 - lava_callback - DEBUG - Processing node 68d405c7cd36afa834e1673a: baseline-arm64 2025-09-26 14:53:06,365 - lava_callback - ERROR - Error processing callback for node 68d405c7cd36afa834e1673a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:54480 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:53:06,980 - lava_callback - INFO - Received callback for node 68d6a8362f83206171a92612 INFO: 172.20.0.1:54490 - "POST /node/68d6a8362f83206171a92612 HTTP/1.0" 202 Accepted 2025-09-26 14:53:06,986 - lava_callback - INFO - Starting async job submit for node 68d6a8362f83206171a92612 2025-09-26 14:53:07,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:07,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8362f83206171a92612 HTTP/1.1" 200 None 2025-09-26 14:53:07,019 - lava_callback - DEBUG - Processing node 68d6a8362f83206171a92612: baseline-arm64 2025-09-26 14:53:07,129 - lava_callback - INFO - Received callback for node 68d405cccd36afa834e1673d INFO: 172.20.0.1:54502 - "POST /node/68d405cccd36afa834e1673d HTTP/1.0" 202 Accepted 2025-09-26 14:53:07,144 - lava_callback - INFO - Starting async job submit for node 68d405cccd36afa834e1673d 2025-09-26 14:53:07,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:07,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d405cccd36afa834e1673d HTTP/1.1" 200 None 2025-09-26 14:53:07,231 - lava_callback - DEBUG - Processing node 68d405cccd36afa834e1673d: baseline-arm64 2025-09-26 14:53:07,231 - lava_callback - ERROR - Error processing callback for node 68d405cccd36afa834e1673d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:53:07,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:53:07,408 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:53:07,409 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8362f83206171a92612/log.txt.gz 2025-09-26 14:53:07,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:53:07,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:53:07,579 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8362f83206171a92612/lava_callback.json.gz 2025-09-26 14:53:07,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:07,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8362f83206171a92612 HTTP/1.1" 200 None 2025-09-26 14:53:07,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:07,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:53:07,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:07,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8362f83206171a92612 HTTP/1.1" 200 None 2025-09-26 14:53:07,658 - lava_callback - INFO - Completed processing callback for node 68d6a8362f83206171a92612 2025-09-26 14:53:07,933 - lava_callback - INFO - Received callback for node 68d405cdcd36afa834e16740 INFO: 172.20.0.1:54516 - "POST /node/68d405cdcd36afa834e16740 HTTP/1.0" 202 Accepted 2025-09-26 14:53:07,939 - lava_callback - INFO - Starting async job submit for node 68d405cdcd36afa834e16740 2025-09-26 14:53:07,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:07,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d405cdcd36afa834e16740 HTTP/1.1" 200 None 2025-09-26 14:53:07,952 - lava_callback - DEBUG - Processing node 68d405cdcd36afa834e16740: baseline-arm64 2025-09-26 14:53:07,952 - lava_callback - ERROR - Error processing callback for node 68d405cdcd36afa834e16740: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:37862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37876 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:53:17,731 - lava_callback - INFO - Received callback for node 68d6a8a72f83206171a926bc INFO: 172.20.0.1:37880 - "POST /node/68d6a8a72f83206171a926bc HTTP/1.0" 202 Accepted 2025-09-26 14:53:17,738 - lava_callback - INFO - Starting async job submit for node 68d6a8a72f83206171a926bc 2025-09-26 14:53:17,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:17,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8a72f83206171a926bc HTTP/1.1" 200 None 2025-09-26 14:53:17,779 - lava_callback - DEBUG - Processing node 68d6a8a72f83206171a926bc: baseline-arm64-foundriesio 2025-09-26 14:53:18,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:53:18,255 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:53:18,255 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6a8a72f83206171a926bc/log.txt.gz 2025-09-26 14:53:18,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:53:18,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:53:18,369 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6a8a72f83206171a926bc/lava_callback.json.gz 2025-09-26 14:53:18,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:18,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8a72f83206171a926bc HTTP/1.1" 200 None 2025-09-26 14:53:18,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:18,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:53:18,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:18,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8a72f83206171a926bc HTTP/1.1" 200 None 2025-09-26 14:53:18,542 - lava_callback - INFO - Completed processing callback for node 68d6a8a72f83206171a926bc 2025-09-26 14:53:21,681 - lava_callback - INFO - Received callback for node 68d6a8892f83206171a92696 INFO: 172.20.0.1:57066 - "POST /node/68d6a8892f83206171a92696 HTTP/1.0" 202 Accepted 2025-09-26 14:53:21,687 - lava_callback - INFO - Starting async job submit for node 68d6a8892f83206171a92696 2025-09-26 14:53:21,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:21,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8892f83206171a92696 HTTP/1.1" 200 None 2025-09-26 14:53:21,721 - lava_callback - DEBUG - Processing node 68d6a8892f83206171a92696: baseline-arm64-clabbe 2025-09-26 14:53:22,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:53:22,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:53:22,193 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d6a8892f83206171a92696/log.txt.gz 2025-09-26 14:53:22,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:53:22,355 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:53:22,356 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d6a8892f83206171a92696/lava_callback.json.gz 2025-09-26 14:53:22,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:22,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8892f83206171a92696 HTTP/1.1" 200 None 2025-09-26 14:53:22,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:22,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:53:22,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:22,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8892f83206171a92696 HTTP/1.1" 200 None 2025-09-26 14:53:22,430 - lava_callback - INFO - Completed processing callback for node 68d6a8892f83206171a92696 2025-09-26 14:53:23,340 - lava_callback - INFO - Received callback for node 68d6a8a42f83206171a926b9 INFO: 172.20.0.1:57072 - "POST /node/68d6a8a42f83206171a926b9 HTTP/1.0" 202 Accepted 2025-09-26 14:53:23,345 - lava_callback - INFO - Starting async job submit for node 68d6a8a42f83206171a926b9 2025-09-26 14:53:23,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:23,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8a42f83206171a926b9 HTTP/1.1" 200 None 2025-09-26 14:53:23,378 - lava_callback - DEBUG - Processing node 68d6a8a42f83206171a926b9: baseline-arm64-foundriesio 2025-09-26 14:53:23,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:53:23,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:53:23,704 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6a8a42f83206171a926b9/log.txt.gz 2025-09-26 14:53:23,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:53:23,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:53:23,841 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6a8a42f83206171a926b9/lava_callback.json.gz 2025-09-26 14:53:23,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:23,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8a42f83206171a926b9 HTTP/1.1" 200 None 2025-09-26 14:53:23,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:23,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:53:23,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:23,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8a42f83206171a926b9 HTTP/1.1" 200 None 2025-09-26 14:53:23,927 - lava_callback - INFO - Completed processing callback for node 68d6a8a42f83206171a926b9 INFO: 172.20.0.1:57084 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:53:25,346 - lava_callback - INFO - Received callback for node 68d6a8422f83206171a92624 INFO: 172.20.0.1:57098 - "POST /node/68d6a8422f83206171a92624 HTTP/1.0" 202 Accepted 2025-09-26 14:53:25,352 - lava_callback - INFO - Starting async job submit for node 68d6a8422f83206171a92624 2025-09-26 14:53:25,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:25,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8422f83206171a92624 HTTP/1.1" 200 None 2025-09-26 14:53:25,385 - lava_callback - DEBUG - Processing node 68d6a8422f83206171a92624: baseline-arm64-baylibre INFO: 172.20.0.1:57114 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:53:25,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:53:25,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:53:25,804 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6a8422f83206171a92624/log.txt.gz 2025-09-26 14:53:25,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:53:25,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:53:25,963 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6a8422f83206171a92624/lava_callback.json.gz 2025-09-26 14:53:25,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:25,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8422f83206171a92624 HTTP/1.1" 200 None 2025-09-26 14:53:25,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:26,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:53:26,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:26,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8422f83206171a92624 HTTP/1.1" 200 None 2025-09-26 14:53:26,046 - lava_callback - INFO - Completed processing callback for node 68d6a8422f83206171a92624 INFO: 172.20.0.1:57116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44642 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:53:36,939 - lava_callback - INFO - Received callback for node 68d40b3fcd36afa834e1703a INFO: 172.20.0.1:44658 - "POST /node/68d40b3fcd36afa834e1703a HTTP/1.0" 202 Accepted 2025-09-26 14:53:36,945 - lava_callback - INFO - Starting async job submit for node 68d40b3fcd36afa834e1703a 2025-09-26 14:53:36,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:36,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40b3fcd36afa834e1703a HTTP/1.1" 200 None 2025-09-26 14:53:36,996 - lava_callback - DEBUG - Processing node 68d40b3fcd36afa834e1703a: baseline-arm-broonie 2025-09-26 14:53:37,181 - lava_callback - ERROR - Error processing callback for node 68d40b3fcd36afa834e1703a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 14:53:41,876 - lava_callback - INFO - Received callback for node 68d6a89a2f83206171a926ac INFO: 172.20.0.1:56842 - "POST /node/68d6a89a2f83206171a926ac HTTP/1.0" 202 Accepted 2025-09-26 14:53:41,882 - lava_callback - INFO - Starting async job submit for node 68d6a89a2f83206171a926ac 2025-09-26 14:53:41,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:41,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a89a2f83206171a926ac HTTP/1.1" 200 None 2025-09-26 14:53:41,938 - lava_callback - DEBUG - Processing node 68d6a89a2f83206171a926ac: baseline-arm64-clabbe 2025-09-26 14:53:42,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:53:42,320 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:53:42,321 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d6a89a2f83206171a926ac/log.txt.gz 2025-09-26 14:53:42,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:53:42,452 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:53:42,452 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d6a89a2f83206171a926ac/lava_callback.json.gz 2025-09-26 14:53:42,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:42,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a89a2f83206171a926ac HTTP/1.1" 200 None 2025-09-26 14:53:42,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:42,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:53:42,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:42,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a89a2f83206171a926ac HTTP/1.1" 200 None 2025-09-26 14:53:42,529 - lava_callback - INFO - Completed processing callback for node 68d6a89a2f83206171a926ac 2025-09-26 14:53:44,915 - lava_callback - INFO - Received callback for node 68d42a2fa5c2c05277bc78be INFO: 172.20.0.1:56848 - "POST /node/68d42a2fa5c2c05277bc78be HTTP/1.0" 202 Accepted 2025-09-26 14:53:44,921 - lava_callback - INFO - Starting async job submit for node 68d42a2fa5c2c05277bc78be 2025-09-26 14:53:44,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:44,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42a2fa5c2c05277bc78be HTTP/1.1" 200 None 2025-09-26 14:53:44,959 - lava_callback - DEBUG - Processing node 68d42a2fa5c2c05277bc78be: baseline-arm 2025-09-26 14:53:45,184 - lava_callback - ERROR - Error processing callback for node 68d42a2fa5c2c05277bc78be: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:56850 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:53:50,558 - lava_callback - INFO - Received callback for node 68d40566cd36afa834e16686 INFO: 172.20.0.1:52870 - "POST /node/68d40566cd36afa834e16686 HTTP/1.0" 202 Accepted 2025-09-26 14:53:50,565 - lava_callback - INFO - Starting async job submit for node 68d40566cd36afa834e16686 2025-09-26 14:53:50,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:50,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40566cd36afa834e16686 HTTP/1.1" 200 None 2025-09-26 14:53:50,619 - lava_callback - DEBUG - Processing node 68d40566cd36afa834e16686: baseline-arm64 2025-09-26 14:53:51,458 - lava_callback - ERROR - Error processing callback for node 68d40566cd36afa834e16686: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 14:53:52,018 - lava_callback - INFO - Received callback for node 68d6a8482f83206171a9262a INFO: 172.20.0.1:52878 - "POST /node/68d6a8482f83206171a9262a HTTP/1.0" 202 Accepted 2025-09-26 14:53:52,024 - lava_callback - INFO - Starting async job submit for node 68d6a8482f83206171a9262a 2025-09-26 14:53:52,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:52,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8482f83206171a9262a HTTP/1.1" 200 None 2025-09-26 14:53:52,057 - lava_callback - DEBUG - Processing node 68d6a8482f83206171a9262a: baseline-arm64-baylibre 2025-09-26 14:53:52,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:53:52,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:53:52,515 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6a8482f83206171a9262a/log.txt.gz 2025-09-26 14:53:52,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:53:52,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:53:52,634 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6a8482f83206171a9262a/lava_callback.json.gz 2025-09-26 14:53:52,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:52,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8482f83206171a9262a HTTP/1.1" 200 None 2025-09-26 14:53:52,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:52,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:53:52,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:52,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8482f83206171a9262a HTTP/1.1" 200 None 2025-09-26 14:53:52,710 - lava_callback - INFO - Completed processing callback for node 68d6a8482f83206171a9262a 2025-09-26 14:53:54,602 - lava_callback - INFO - Received callback for node 68d6a8322f83206171a92609 INFO: 172.20.0.1:52888 - "POST /node/68d6a8322f83206171a92609 HTTP/1.0" 202 Accepted 2025-09-26 14:53:54,608 - lava_callback - INFO - Starting async job submit for node 68d6a8322f83206171a92609 2025-09-26 14:53:54,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:54,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8322f83206171a92609 HTTP/1.1" 200 None 2025-09-26 14:53:54,639 - lava_callback - DEBUG - Processing node 68d6a8322f83206171a92609: baseline-arm64 2025-09-26 14:53:54,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:53:55,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:53:55,077 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8322f83206171a92609/log.txt.gz 2025-09-26 14:53:55,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:53:55,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:53:55,200 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8322f83206171a92609/lava_callback.json.gz 2025-09-26 14:53:55,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:55,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8322f83206171a92609 HTTP/1.1" 200 None 2025-09-26 14:53:55,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:55,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:53:55,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:55,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8322f83206171a92609 HTTP/1.1" 200 None 2025-09-26 14:53:55,279 - lava_callback - INFO - Completed processing callback for node 68d6a8322f83206171a92609 INFO: 172.20.0.1:52892 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:53:57,343 - lava_callback - INFO - Received callback for node 68d40af6cd36afa834e17002 INFO: 172.20.0.1:52904 - "POST /node/68d40af6cd36afa834e17002 HTTP/1.0" 202 Accepted 2025-09-26 14:53:57,348 - lava_callback - INFO - Starting async job submit for node 68d40af6cd36afa834e17002 2025-09-26 14:53:57,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:53:57,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40af6cd36afa834e17002 HTTP/1.1" 200 None 2025-09-26 14:53:57,382 - lava_callback - DEBUG - Processing node 68d40af6cd36afa834e17002: baseline-arm-broonie 2025-09-26 14:53:57,623 - lava_callback - ERROR - Error processing callback for node 68d40af6cd36afa834e17002: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:58594 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:54:09,358 - lava_callback - INFO - Received callback for node 68d6a8452f83206171a92627 INFO: 172.20.0.1:60982 - "POST /node/68d6a8452f83206171a92627 HTTP/1.0" 202 Accepted 2025-09-26 14:54:09,364 - lava_callback - INFO - Starting async job submit for node 68d6a8452f83206171a92627 2025-09-26 14:54:09,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:54:09,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8452f83206171a92627 HTTP/1.1" 200 None 2025-09-26 14:54:09,397 - lava_callback - DEBUG - Processing node 68d6a8452f83206171a92627: baseline-arm64-baylibre 2025-09-26 14:54:09,474 - lava_callback - INFO - Received callback for node 68d40571cd36afa834e166bc INFO: 172.20.0.1:60992 - "POST /node/68d40571cd36afa834e166bc HTTP/1.0" 202 Accepted 2025-09-26 14:54:09,517 - lava_callback - INFO - Starting async job submit for node 68d40571cd36afa834e166bc 2025-09-26 14:54:09,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:54:09,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40571cd36afa834e166bc HTTP/1.1" 200 None 2025-09-26 14:54:09,692 - lava_callback - DEBUG - Processing node 68d40571cd36afa834e166bc: baseline-arm64 2025-09-26 14:54:09,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:54:10,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:54:10,087 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6a8452f83206171a92627/log.txt.gz 2025-09-26 14:54:10,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:54:10,446 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:54:10,488 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6a8452f83206171a92627/lava_callback.json.gz 2025-09-26 14:54:10,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:54:10,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8452f83206171a92627 HTTP/1.1" 200 None 2025-09-26 14:54:10,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:54:10,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:54:10,715 - lava_callback - ERROR - Error processing callback for node 68d40571cd36afa834e166bc: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 14:54:10,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:54:10,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8452f83206171a92627 HTTP/1.1" 200 None 2025-09-26 14:54:10,748 - lava_callback - INFO - Completed processing callback for node 68d6a8452f83206171a92627 INFO: 172.20.0.1:32774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57630 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:54:40,620 - lava_callback - INFO - Received callback for node 68d6a84b2f83206171a9262d INFO: 172.20.0.1:49582 - "POST /node/68d6a84b2f83206171a9262d HTTP/1.0" 202 Accepted 2025-09-26 14:54:40,626 - lava_callback - INFO - Starting async job submit for node 68d6a84b2f83206171a9262d 2025-09-26 14:54:40,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:54:40,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a84b2f83206171a9262d HTTP/1.1" 200 None 2025-09-26 14:54:40,670 - lava_callback - DEBUG - Processing node 68d6a84b2f83206171a9262d: baseline-arm64-baylibre 2025-09-26 14:54:40,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:54:41,064 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:54:41,065 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6a84b2f83206171a9262d/log.txt.gz 2025-09-26 14:54:41,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:54:41,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:54:41,204 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6a84b2f83206171a9262d/lava_callback.json.gz 2025-09-26 14:54:41,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:54:41,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a84b2f83206171a9262d HTTP/1.1" 200 None 2025-09-26 14:54:41,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:54:41,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:54:41,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:54:41,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a84b2f83206171a9262d HTTP/1.1" 200 None 2025-09-26 14:54:41,298 - lava_callback - INFO - Completed processing callback for node 68d6a84b2f83206171a9262d INFO: 172.20.0.1:49598 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:54:47,477 - lava_callback - INFO - Received callback for node 68d6a84e2f83206171a92630 INFO: 172.20.0.1:49606 - "POST /node/68d6a84e2f83206171a92630 HTTP/1.0" 202 Accepted 2025-09-26 14:54:47,482 - lava_callback - INFO - Starting async job submit for node 68d6a84e2f83206171a92630 2025-09-26 14:54:47,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:54:47,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a84e2f83206171a92630 HTTP/1.1" 200 None 2025-09-26 14:54:47,540 - lava_callback - DEBUG - Processing node 68d6a84e2f83206171a92630: baseline-arm64-baylibre 2025-09-26 14:54:47,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:54:47,875 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:54:47,876 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6a84e2f83206171a92630/log.txt.gz 2025-09-26 14:54:47,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:54:47,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:54:47,993 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6a84e2f83206171a92630/lava_callback.json.gz 2025-09-26 14:54:48,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:54:48,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a84e2f83206171a92630 HTTP/1.1" 200 None 2025-09-26 14:54:48,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:54:48,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:54:48,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:54:48,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a84e2f83206171a92630 HTTP/1.1" 200 None 2025-09-26 14:54:48,071 - lava_callback - INFO - Completed processing callback for node 68d6a84e2f83206171a92630 2025-09-26 14:54:48,846 - lava_callback - INFO - Received callback for node 68d695822f83206171a920bc INFO: 172.20.0.1:49610 - "POST /node/68d695822f83206171a920bc HTTP/1.0" 202 Accepted 2025-09-26 14:54:48,853 - lava_callback - INFO - Starting async job submit for node 68d695822f83206171a920bc 2025-09-26 14:54:48,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:54:48,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695822f83206171a920bc HTTP/1.1" 200 None 2025-09-26 14:54:48,903 - lava_callback - DEBUG - Processing node 68d695822f83206171a920bc: baseline-arm64 2025-09-26 14:54:49,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:54:49,957 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:54:49,957 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d695822f83206171a920bc/log.txt.gz 2025-09-26 14:54:49,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:54:50,142 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:54:50,143 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d695822f83206171a920bc/lava_callback.json.gz DEBUG: Setup failed for 68d695822f83206171a920bc. Transitting job node result: incomplete -> fail 2025-09-26 14:54:50,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:54:50,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695822f83206171a920bc HTTP/1.1" 200 None 2025-09-26 14:54:50,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:54:50,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 14:54:50,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:54:50,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695822f83206171a920bc HTTP/1.1" 200 None 2025-09-26 14:54:50,266 - lava_callback - INFO - Completed processing callback for node 68d695822f83206171a920bc 2025-09-26 14:54:54,138 - lava_callback - INFO - Received callback for node 68d695892f83206171a920cd INFO: 172.20.0.1:48232 - "POST /node/68d695892f83206171a920cd HTTP/1.0" 202 Accepted 2025-09-26 14:54:54,145 - lava_callback - INFO - Starting async job submit for node 68d695892f83206171a920cd 2025-09-26 14:54:54,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:54:54,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695892f83206171a920cd HTTP/1.1" 200 None 2025-09-26 14:54:54,194 - lava_callback - DEBUG - Processing node 68d695892f83206171a920cd: baseline-arm64 2025-09-26 14:54:55,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:54:55,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:54:55,244 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d695892f83206171a920cd/log.txt.gz 2025-09-26 14:54:55,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:54:55,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:54:55,414 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d695892f83206171a920cd/lava_callback.json.gz DEBUG: Setup failed for 68d695892f83206171a920cd. Transitting job node result: incomplete -> fail 2025-09-26 14:54:55,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:54:55,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695892f83206171a920cd HTTP/1.1" 200 None 2025-09-26 14:54:55,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:54:55,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 14:54:55,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:54:55,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695892f83206171a920cd HTTP/1.1" 200 None 2025-09-26 14:54:55,564 - lava_callback - INFO - Completed processing callback for node 68d695892f83206171a920cd INFO: 172.20.0.1:48234 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:55:03,879 - lava_callback - INFO - Received callback for node 68d6a8532f83206171a92636 INFO: 172.20.0.1:45036 - "POST /node/68d6a8532f83206171a92636 HTTP/1.0" 202 Accepted 2025-09-26 14:55:03,885 - lava_callback - INFO - Starting async job submit for node 68d6a8532f83206171a92636 2025-09-26 14:55:03,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:55:03,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8532f83206171a92636 HTTP/1.1" 200 None 2025-09-26 14:55:03,924 - lava_callback - DEBUG - Processing node 68d6a8532f83206171a92636: baseline-arm64-baylibre 2025-09-26 14:55:04,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:55:04,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:55:04,301 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6a8532f83206171a92636/log.txt.gz 2025-09-26 14:55:04,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:55:04,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:55:04,421 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6a8532f83206171a92636/lava_callback.json.gz 2025-09-26 14:55:04,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:55:04,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8532f83206171a92636 HTTP/1.1" 200 None 2025-09-26 14:55:04,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:55:04,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:55:04,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:55:04,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8532f83206171a92636 HTTP/1.1" 200 None 2025-09-26 14:55:04,514 - lava_callback - INFO - Completed processing callback for node 68d6a8532f83206171a92636 INFO: 172.20.0.1:45050 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:55:10,642 - lava_callback - INFO - Received callback for node 68d40573cd36afa834e166bf INFO: 172.20.0.1:56574 - "POST /node/68d40573cd36afa834e166bf HTTP/1.0" 202 Accepted 2025-09-26 14:55:10,649 - lava_callback - INFO - Starting async job submit for node 68d40573cd36afa834e166bf 2025-09-26 14:55:10,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:55:10,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40573cd36afa834e166bf HTTP/1.1" 200 None 2025-09-26 14:55:10,703 - lava_callback - DEBUG - Processing node 68d40573cd36afa834e166bf: baseline-arm64 2025-09-26 14:55:11,541 - lava_callback - ERROR - Error processing callback for node 68d40573cd36afa834e166bf: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:56580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56586 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:55:17,360 - lava_callback - INFO - Received callback for node 68d40b53cd36afa834e1704f INFO: 172.20.0.1:56594 - "POST /node/68d40b53cd36afa834e1704f HTTP/1.0" 202 Accepted 2025-09-26 14:55:17,366 - lava_callback - INFO - Starting async job submit for node 68d40b53cd36afa834e1704f 2025-09-26 14:55:17,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:55:17,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40b53cd36afa834e1704f HTTP/1.1" 200 None 2025-09-26 14:55:17,402 - lava_callback - DEBUG - Processing node 68d40b53cd36afa834e1704f: baseline-arm-broonie 2025-09-26 14:55:17,618 - lava_callback - ERROR - Error processing callback for node 68d40b53cd36afa834e1704f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:52722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59574 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:55:42,839 - lava_callback - INFO - Received callback for node 68d6a8512f83206171a92633 INFO: 172.20.0.1:33968 - "POST /node/68d6a8512f83206171a92633 HTTP/1.0" 202 Accepted 2025-09-26 14:55:42,845 - lava_callback - INFO - Starting async job submit for node 68d6a8512f83206171a92633 2025-09-26 14:55:42,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:55:42,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8512f83206171a92633 HTTP/1.1" 200 None 2025-09-26 14:55:42,903 - lava_callback - DEBUG - Processing node 68d6a8512f83206171a92633: baseline-arm64-baylibre 2025-09-26 14:55:43,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:55:43,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:55:43,300 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6a8512f83206171a92633/log.txt.gz 2025-09-26 14:55:43,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:55:43,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:55:43,439 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6a8512f83206171a92633/lava_callback.json.gz 2025-09-26 14:55:43,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:55:43,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8512f83206171a92633 HTTP/1.1" 200 None 2025-09-26 14:55:43,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:55:43,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:55:43,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:55:43,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8512f83206171a92633 HTTP/1.1" 200 None 2025-09-26 14:55:43,687 - lava_callback - INFO - Completed processing callback for node 68d6a8512f83206171a92633 2025-09-26 14:55:44,526 - lava_callback - INFO - Received callback for node 68d4065dcd36afa834e16836 INFO: 172.20.0.1:33972 - "POST /node/68d4065dcd36afa834e16836 HTTP/1.0" 202 Accepted 2025-09-26 14:55:44,532 - lava_callback - INFO - Starting async job submit for node 68d4065dcd36afa834e16836 2025-09-26 14:55:44,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:55:44,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4065dcd36afa834e16836 HTTP/1.1" 200 None 2025-09-26 14:55:44,548 - lava_callback - DEBUG - Processing node 68d4065dcd36afa834e16836: baseline-arm 2025-09-26 14:55:44,549 - lava_callback - ERROR - Error processing callback for node 68d4065dcd36afa834e16836: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:55:45,207 - lava_callback - INFO - Received callback for node 68d4065dcd36afa834e16839 INFO: 172.20.0.1:33986 - "POST /node/68d4065dcd36afa834e16839 HTTP/1.0" 202 Accepted 2025-09-26 14:55:45,212 - lava_callback - INFO - Starting async job submit for node 68d4065dcd36afa834e16839 2025-09-26 14:55:45,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:55:45,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4065dcd36afa834e16839 HTTP/1.1" 200 None 2025-09-26 14:55:45,226 - lava_callback - DEBUG - Processing node 68d4065dcd36afa834e16839: baseline-arm 2025-09-26 14:55:45,226 - lava_callback - ERROR - Error processing callback for node 68d4065dcd36afa834e16839: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:55:45,922 - lava_callback - INFO - Received callback for node 68d40660cd36afa834e1683c INFO: 172.20.0.1:33996 - "POST /node/68d40660cd36afa834e1683c HTTP/1.0" 202 Accepted 2025-09-26 14:55:45,928 - lava_callback - INFO - Starting async job submit for node 68d40660cd36afa834e1683c 2025-09-26 14:55:45,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:55:45,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40660cd36afa834e1683c HTTP/1.1" 200 None 2025-09-26 14:55:45,966 - lava_callback - DEBUG - Processing node 68d40660cd36afa834e1683c: baseline-arm 2025-09-26 14:55:45,966 - lava_callback - ERROR - Error processing callback for node 68d40660cd36afa834e1683c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:34010 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:55:46,600 - lava_callback - INFO - Received callback for node 68d40661cd36afa834e1683f INFO: 172.20.0.1:34026 - "POST /node/68d40661cd36afa834e1683f HTTP/1.0" 202 Accepted 2025-09-26 14:55:46,605 - lava_callback - INFO - Starting async job submit for node 68d40661cd36afa834e1683f 2025-09-26 14:55:46,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:55:46,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40661cd36afa834e1683f HTTP/1.1" 200 None 2025-09-26 14:55:46,622 - lava_callback - DEBUG - Processing node 68d40661cd36afa834e1683f: baseline-arm 2025-09-26 14:55:46,622 - lava_callback - ERROR - Error processing callback for node 68d40661cd36afa834e1683f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:55:47,299 - lava_callback - INFO - Received callback for node 68d40668cd36afa834e16858 INFO: 172.20.0.1:34032 - "POST /node/68d40668cd36afa834e16858 HTTP/1.0" 202 Accepted 2025-09-26 14:55:47,305 - lava_callback - INFO - Starting async job submit for node 68d40668cd36afa834e16858 2025-09-26 14:55:47,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:55:47,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40668cd36afa834e16858 HTTP/1.1" 200 None 2025-09-26 14:55:47,318 - lava_callback - DEBUG - Processing node 68d40668cd36afa834e16858: baseline-arm 2025-09-26 14:55:47,318 - lava_callback - ERROR - Error processing callback for node 68d40668cd36afa834e16858: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:55:48,015 - lava_callback - INFO - Received callback for node 68d40669cd36afa834e16863 INFO: 172.20.0.1:34034 - "POST /node/68d40669cd36afa834e16863 HTTP/1.0" 202 Accepted 2025-09-26 14:55:48,020 - lava_callback - INFO - Starting async job submit for node 68d40669cd36afa834e16863 2025-09-26 14:55:48,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:55:48,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40669cd36afa834e16863 HTTP/1.1" 200 None 2025-09-26 14:55:48,034 - lava_callback - DEBUG - Processing node 68d40669cd36afa834e16863: baseline-arm 2025-09-26 14:55:48,034 - lava_callback - ERROR - Error processing callback for node 68d40669cd36afa834e16863: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:44602 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:56:04,095 - lava_callback - INFO - Received callback for node 68d42a31a5c2c05277bc78c1 INFO: 172.20.0.1:37168 - "POST /node/68d42a31a5c2c05277bc78c1 HTTP/1.0" 202 Accepted 2025-09-26 14:56:04,101 - lava_callback - INFO - Starting async job submit for node 68d42a31a5c2c05277bc78c1 2025-09-26 14:56:04,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:56:04,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42a31a5c2c05277bc78c1 HTTP/1.1" 200 None 2025-09-26 14:56:04,133 - lava_callback - DEBUG - Processing node 68d42a31a5c2c05277bc78c1: baseline-arm 2025-09-26 14:56:04,353 - lava_callback - ERROR - Error processing callback for node 68d42a31a5c2c05277bc78c1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 14:56:05,558 - lava_callback - INFO - Received callback for node 68d40671cd36afa834e16869 INFO: 172.20.0.1:37176 - "POST /node/68d40671cd36afa834e16869 HTTP/1.0" 202 Accepted 2025-09-26 14:56:05,564 - lava_callback - INFO - Starting async job submit for node 68d40671cd36afa834e16869 2025-09-26 14:56:05,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:56:05,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40671cd36afa834e16869 HTTP/1.1" 200 None 2025-09-26 14:56:05,577 - lava_callback - DEBUG - Processing node 68d40671cd36afa834e16869: baseline-arm 2025-09-26 14:56:05,577 - lava_callback - ERROR - Error processing callback for node 68d40671cd36afa834e16869: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:56:06,261 - lava_callback - INFO - Received callback for node 68d40672cd36afa834e1686c INFO: 172.20.0.1:37180 - "POST /node/68d40672cd36afa834e1686c HTTP/1.0" 202 Accepted 2025-09-26 14:56:06,266 - lava_callback - INFO - Starting async job submit for node 68d40672cd36afa834e1686c 2025-09-26 14:56:06,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:56:06,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40672cd36afa834e1686c HTTP/1.1" 200 None 2025-09-26 14:56:06,281 - lava_callback - DEBUG - Processing node 68d40672cd36afa834e1686c: baseline-arm 2025-09-26 14:56:06,281 - lava_callback - ERROR - Error processing callback for node 68d40672cd36afa834e1686c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:37186 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:56:07,007 - lava_callback - INFO - Received callback for node 68d40678cd36afa834e16876 INFO: 172.20.0.1:37192 - "POST /node/68d40678cd36afa834e16876 HTTP/1.0" 202 Accepted 2025-09-26 14:56:07,013 - lava_callback - INFO - Starting async job submit for node 68d40678cd36afa834e16876 2025-09-26 14:56:07,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:56:07,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40678cd36afa834e16876 HTTP/1.1" 200 None 2025-09-26 14:56:07,026 - lava_callback - DEBUG - Processing node 68d40678cd36afa834e16876: baseline-arm 2025-09-26 14:56:07,026 - lava_callback - ERROR - Error processing callback for node 68d40678cd36afa834e16876: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:56:07,732 - lava_callback - INFO - Received callback for node 68d4067acd36afa834e16879 INFO: 172.20.0.1:37200 - "POST /node/68d4067acd36afa834e16879 HTTP/1.0" 202 Accepted 2025-09-26 14:56:07,737 - lava_callback - INFO - Starting async job submit for node 68d4067acd36afa834e16879 2025-09-26 14:56:07,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:56:07,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4067acd36afa834e16879 HTTP/1.1" 200 None 2025-09-26 14:56:07,750 - lava_callback - DEBUG - Processing node 68d4067acd36afa834e16879: baseline-arm 2025-09-26 14:56:07,750 - lava_callback - ERROR - Error processing callback for node 68d4067acd36afa834e16879: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:56:08,472 - lava_callback - INFO - Received callback for node 68d4067ccd36afa834e1687c INFO: 172.20.0.1:37208 - "POST /node/68d4067ccd36afa834e1687c HTTP/1.0" 202 Accepted 2025-09-26 14:56:08,479 - lava_callback - INFO - Starting async job submit for node 68d4067ccd36afa834e1687c 2025-09-26 14:56:08,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:56:08,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4067ccd36afa834e1687c HTTP/1.1" 200 None 2025-09-26 14:56:08,493 - lava_callback - DEBUG - Processing node 68d4067ccd36afa834e1687c: baseline-arm 2025-09-26 14:56:08,493 - lava_callback - ERROR - Error processing callback for node 68d4067ccd36afa834e1687c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:56:09,173 - lava_callback - INFO - Received callback for node 68d4067dcd36afa834e1687f INFO: 172.20.0.1:37218 - "POST /node/68d4067dcd36afa834e1687f HTTP/1.0" 202 Accepted 2025-09-26 14:56:09,179 - lava_callback - INFO - Starting async job submit for node 68d4067dcd36afa834e1687f 2025-09-26 14:56:09,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:56:09,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4067dcd36afa834e1687f HTTP/1.1" 200 None 2025-09-26 14:56:09,195 - lava_callback - DEBUG - Processing node 68d4067dcd36afa834e1687f: baseline-arm 2025-09-26 14:56:09,195 - lava_callback - ERROR - Error processing callback for node 68d4067dcd36afa834e1687f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:48108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48112 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:56:24,879 - lava_callback - INFO - Received callback for node 68d40683cd36afa834e16889 INFO: 172.20.0.1:51694 - "POST /node/68d40683cd36afa834e16889 HTTP/1.0" 202 Accepted 2025-09-26 14:56:24,887 - lava_callback - INFO - Starting async job submit for node 68d40683cd36afa834e16889 2025-09-26 14:56:24,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:56:24,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40683cd36afa834e16889 HTTP/1.1" 200 None 2025-09-26 14:56:24,929 - lava_callback - DEBUG - Processing node 68d40683cd36afa834e16889: baseline-arm 2025-09-26 14:56:24,929 - lava_callback - ERROR - Error processing callback for node 68d40683cd36afa834e16889: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:51706 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:56:25,589 - lava_callback - INFO - Received callback for node 68d40685cd36afa834e1688c INFO: 172.20.0.1:51722 - "POST /node/68d40685cd36afa834e1688c HTTP/1.0" 202 Accepted 2025-09-26 14:56:25,595 - lava_callback - INFO - Starting async job submit for node 68d40685cd36afa834e1688c 2025-09-26 14:56:25,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:56:25,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40685cd36afa834e1688c HTTP/1.1" 200 None 2025-09-26 14:56:25,608 - lava_callback - DEBUG - Processing node 68d40685cd36afa834e1688c: baseline-arm 2025-09-26 14:56:25,608 - lava_callback - ERROR - Error processing callback for node 68d40685cd36afa834e1688c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:51738 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:56:26,303 - lava_callback - INFO - Received callback for node 68d40689cd36afa834e1688f INFO: 172.20.0.1:51750 - "POST /node/68d40689cd36afa834e1688f HTTP/1.0" 202 Accepted 2025-09-26 14:56:26,309 - lava_callback - INFO - Starting async job submit for node 68d40689cd36afa834e1688f 2025-09-26 14:56:26,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:56:26,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40689cd36afa834e1688f HTTP/1.1" 200 None 2025-09-26 14:56:26,323 - lava_callback - DEBUG - Processing node 68d40689cd36afa834e1688f: baseline-arm 2025-09-26 14:56:26,323 - lava_callback - ERROR - Error processing callback for node 68d40689cd36afa834e1688f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:51758 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:56:27,023 - lava_callback - INFO - Received callback for node 68d4068bcd36afa834e16892 INFO: 172.20.0.1:51770 - "POST /node/68d4068bcd36afa834e16892 HTTP/1.0" 202 Accepted 2025-09-26 14:56:27,028 - lava_callback - INFO - Starting async job submit for node 68d4068bcd36afa834e16892 2025-09-26 14:56:27,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:56:27,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4068bcd36afa834e16892 HTTP/1.1" 200 None 2025-09-26 14:56:27,041 - lava_callback - DEBUG - Processing node 68d4068bcd36afa834e16892: baseline-arm 2025-09-26 14:56:27,041 - lava_callback - ERROR - Error processing callback for node 68d4068bcd36afa834e16892: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:56:27,744 - lava_callback - INFO - Received callback for node 68d4068ccd36afa834e16895 INFO: 172.20.0.1:51774 - "POST /node/68d4068ccd36afa834e16895 HTTP/1.0" 202 Accepted 2025-09-26 14:56:27,750 - lava_callback - INFO - Starting async job submit for node 68d4068ccd36afa834e16895 2025-09-26 14:56:27,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:56:27,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4068ccd36afa834e16895 HTTP/1.1" 200 None 2025-09-26 14:56:27,765 - lava_callback - DEBUG - Processing node 68d4068ccd36afa834e16895: baseline-arm 2025-09-26 14:56:27,765 - lava_callback - ERROR - Error processing callback for node 68d4068ccd36afa834e16895: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:56:28,437 - lava_callback - INFO - Received callback for node 68d4068dcd36afa834e16898 INFO: 172.20.0.1:51782 - "POST /node/68d4068dcd36afa834e16898 HTTP/1.0" 202 Accepted 2025-09-26 14:56:28,443 - lava_callback - INFO - Starting async job submit for node 68d4068dcd36afa834e16898 2025-09-26 14:56:28,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:56:28,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4068dcd36afa834e16898 HTTP/1.1" 200 None 2025-09-26 14:56:28,467 - lava_callback - DEBUG - Processing node 68d4068dcd36afa834e16898: baseline-arm 2025-09-26 14:56:28,467 - lava_callback - ERROR - Error processing callback for node 68d4068dcd36afa834e16898: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:56:29,151 - lava_callback - INFO - Received callback for node 68d40693cd36afa834e1689e INFO: 172.20.0.1:51786 - "POST /node/68d40693cd36afa834e1689e HTTP/1.0" 202 Accepted 2025-09-26 14:56:29,156 - lava_callback - INFO - Starting async job submit for node 68d40693cd36afa834e1689e 2025-09-26 14:56:29,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:56:29,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40693cd36afa834e1689e HTTP/1.1" 200 None 2025-09-26 14:56:29,170 - lava_callback - DEBUG - Processing node 68d40693cd36afa834e1689e: baseline-arm 2025-09-26 14:56:29,171 - lava_callback - ERROR - Error processing callback for node 68d40693cd36afa834e1689e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:32912 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:56:37,861 - lava_callback - INFO - Received callback for node 68d40b54cd36afa834e17052 INFO: 172.20.0.1:32924 - "POST /node/68d40b54cd36afa834e17052 HTTP/1.0" 202 Accepted 2025-09-26 14:56:37,867 - lava_callback - INFO - Starting async job submit for node 68d40b54cd36afa834e17052 2025-09-26 14:56:37,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:56:37,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40b54cd36afa834e17052 HTTP/1.1" 200 None 2025-09-26 14:56:37,901 - lava_callback - DEBUG - Processing node 68d40b54cd36afa834e17052: baseline-arm-broonie 2025-09-26 14:56:38,125 - lava_callback - ERROR - Error processing callback for node 68d40b54cd36afa834e17052: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 14:56:39,418 - lava_callback - INFO - Received callback for node 68d40b89cd36afa834e17082 INFO: 172.20.0.1:38274 - "POST /node/68d40b89cd36afa834e17082 HTTP/1.0" 202 Accepted 2025-09-26 14:56:39,425 - lava_callback - INFO - Starting async job submit for node 68d40b89cd36afa834e17082 2025-09-26 14:56:39,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:56:39,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40b89cd36afa834e17082 HTTP/1.1" 200 None 2025-09-26 14:56:39,463 - lava_callback - DEBUG - Processing node 68d40b89cd36afa834e17082: ltp-cap-bounds 2025-09-26 14:56:39,817 - lava_callback - ERROR - Error processing callback for node 68d40b89cd36afa834e17082: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 14:56:44,992 - lava_callback - INFO - Received callback for node 68d40695cd36afa834e168a1 INFO: 172.20.0.1:38288 - "POST /node/68d40695cd36afa834e168a1 HTTP/1.0" 202 Accepted 2025-09-26 14:56:44,998 - lava_callback - INFO - Starting async job submit for node 68d40695cd36afa834e168a1 2025-09-26 14:56:44,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:56:45,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40695cd36afa834e168a1 HTTP/1.1" 200 None 2025-09-26 14:56:45,026 - lava_callback - DEBUG - Processing node 68d40695cd36afa834e168a1: baseline-arm 2025-09-26 14:56:45,027 - lava_callback - ERROR - Error processing callback for node 68d40695cd36afa834e168a1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:56:45,703 - lava_callback - INFO - Received callback for node 68d40699cd36afa834e168a5 INFO: 172.20.0.1:38302 - "POST /node/68d40699cd36afa834e168a5 HTTP/1.0" 202 Accepted 2025-09-26 14:56:45,709 - lava_callback - INFO - Starting async job submit for node 68d40699cd36afa834e168a5 2025-09-26 14:56:45,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:56:45,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40699cd36afa834e168a5 HTTP/1.1" 200 None 2025-09-26 14:56:45,723 - lava_callback - DEBUG - Processing node 68d40699cd36afa834e168a5: baseline-arm 2025-09-26 14:56:45,723 - lava_callback - ERROR - Error processing callback for node 68d40699cd36afa834e168a5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:56:46,414 - lava_callback - INFO - Received callback for node 68d4069bcd36afa834e168a8 INFO: 172.20.0.1:38306 - "POST /node/68d4069bcd36afa834e168a8 HTTP/1.0" 202 Accepted 2025-09-26 14:56:46,419 - lava_callback - INFO - Starting async job submit for node 68d4069bcd36afa834e168a8 2025-09-26 14:56:46,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:56:46,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4069bcd36afa834e168a8 HTTP/1.1" 200 None 2025-09-26 14:56:46,454 - lava_callback - DEBUG - Processing node 68d4069bcd36afa834e168a8: baseline-arm 2025-09-26 14:56:46,454 - lava_callback - ERROR - Error processing callback for node 68d4069bcd36afa834e168a8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:38308 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:56:47,123 - lava_callback - INFO - Received callback for node 68d4069ecd36afa834e168ab INFO: 172.20.0.1:38310 - "POST /node/68d4069ecd36afa834e168ab HTTP/1.0" 202 Accepted 2025-09-26 14:56:47,128 - lava_callback - INFO - Starting async job submit for node 68d4069ecd36afa834e168ab 2025-09-26 14:56:47,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:56:47,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4069ecd36afa834e168ab HTTP/1.1" 200 None 2025-09-26 14:56:47,162 - lava_callback - DEBUG - Processing node 68d4069ecd36afa834e168ab: baseline-arm 2025-09-26 14:56:47,162 - lava_callback - ERROR - Error processing callback for node 68d4069ecd36afa834e168ab: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 14:56:47,828 - lava_callback - INFO - Received callback for node 68d406a0cd36afa834e168ae INFO: 172.20.0.1:38324 - "POST /node/68d406a0cd36afa834e168ae HTTP/1.0" 202 Accepted 2025-09-26 14:56:47,833 - lava_callback - INFO - Starting async job submit for node 68d406a0cd36afa834e168ae 2025-09-26 14:56:47,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:56:47,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d406a0cd36afa834e168ae HTTP/1.1" 200 None 2025-09-26 14:56:47,847 - lava_callback - DEBUG - Processing node 68d406a0cd36afa834e168ae: baseline-arm 2025-09-26 14:56:47,847 - lava_callback - ERROR - Error processing callback for node 68d406a0cd36afa834e168ae: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:40576 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:56:57,987 - lava_callback - INFO - Received callback for node 68d40b8ecd36afa834e17088 INFO: 172.20.0.1:40588 - "POST /node/68d40b8ecd36afa834e17088 HTTP/1.0" 202 Accepted 2025-09-26 14:56:57,994 - lava_callback - INFO - Starting async job submit for node 68d40b8ecd36afa834e17088 2025-09-26 14:56:58,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:56:58,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40b8ecd36afa834e17088 HTTP/1.1" 200 None 2025-09-26 14:56:58,032 - lava_callback - DEBUG - Processing node 68d40b8ecd36afa834e17088: ltp-cap-bounds 2025-09-26 14:56:58,389 - lava_callback - ERROR - Error processing callback for node 68d40b8ecd36afa834e17088: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:53070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49722 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:58:08,454 - lava_callback - INFO - Received callback for node 68d6a5a42f83206171a92425 INFO: 172.20.0.1:49730 - "POST /node/68d6a5a42f83206171a92425 HTTP/1.0" 202 Accepted 2025-09-26 14:58:08,460 - lava_callback - INFO - Starting async job submit for node 68d6a5a42f83206171a92425 2025-09-26 14:58:08,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:58:08,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a5a42f83206171a92425 HTTP/1.1" 200 None 2025-09-26 14:58:08,503 - lava_callback - DEBUG - Processing node 68d6a5a42f83206171a92425: baseline-arm 2025-09-26 14:58:08,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:58:08,952 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:58:08,953 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d6a5a42f83206171a92425/log.txt.gz 2025-09-26 14:58:08,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:58:09,095 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:58:09,095 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d6a5a42f83206171a92425/lava_callback.json.gz DEBUG: Setup failed for 68d6a5a42f83206171a92425. Transitting job node result: incomplete -> fail 2025-09-26 14:58:09,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:58:09,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a5a42f83206171a92425 HTTP/1.1" 200 None 2025-09-26 14:58:09,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:58:09,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648e95d233c363a76234e HTTP/1.1" 200 None 2025-09-26 14:58:09,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:58:09,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a5a42f83206171a92425 HTTP/1.1" 200 None 2025-09-26 14:58:09,252 - lava_callback - INFO - Completed processing callback for node 68d6a5a42f83206171a92425 INFO: 172.20.0.1:52992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53008 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:58:23,979 - lava_callback - INFO - Received callback for node 68d42a34a5c2c05277bc78c4 INFO: 172.20.0.1:37916 - "POST /node/68d42a34a5c2c05277bc78c4 HTTP/1.0" 202 Accepted 2025-09-26 14:58:23,984 - lava_callback - INFO - Starting async job submit for node 68d42a34a5c2c05277bc78c4 2025-09-26 14:58:24,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:58:24,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42a34a5c2c05277bc78c4 HTTP/1.1" 200 None 2025-09-26 14:58:24,017 - lava_callback - DEBUG - Processing node 68d42a34a5c2c05277bc78c4: baseline-arm 2025-09-26 14:58:24,238 - lava_callback - ERROR - Error processing callback for node 68d42a34a5c2c05277bc78c4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:37918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42750 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:59:27,909 - lava_callback - INFO - Received callback for node 68d6a8222f83206171a925eb INFO: 172.20.0.1:42754 - "POST /node/68d6a8222f83206171a925eb HTTP/1.0" 202 Accepted 2025-09-26 14:59:27,915 - lava_callback - INFO - Starting async job submit for node 68d6a8222f83206171a925eb 2025-09-26 14:59:27,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:59:27,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8222f83206171a925eb HTTP/1.1" 200 None 2025-09-26 14:59:27,952 - lava_callback - DEBUG - Processing node 68d6a8222f83206171a925eb: baseline-arm64 2025-09-26 14:59:28,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:59:28,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:59:28,336 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8222f83206171a925eb/log.txt.gz 2025-09-26 14:59:28,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:59:28,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:59:28,485 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8222f83206171a925eb/lava_callback.json.gz 2025-09-26 14:59:28,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:59:28,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8222f83206171a925eb HTTP/1.1" 200 None 2025-09-26 14:59:28,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:59:28,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 14:59:28,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:59:28,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8222f83206171a925eb HTTP/1.1" 200 None 2025-09-26 14:59:28,580 - lava_callback - INFO - Completed processing callback for node 68d6a8222f83206171a925eb INFO: 172.20.0.1:46756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37932 - "GET / HTTP/1.0" 200 OK 2025-09-26 14:59:51,357 - lava_callback - INFO - Received callback for node 68d694092f83206171a91e0f INFO: 172.20.0.1:48254 - "POST /node/68d694092f83206171a91e0f HTTP/1.0" 202 Accepted 2025-09-26 14:59:51,365 - lava_callback - INFO - Starting async job submit for node 68d694092f83206171a91e0f 2025-09-26 14:59:51,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:59:51,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694092f83206171a91e0f HTTP/1.1" 200 None 2025-09-26 14:59:51,420 - lava_callback - DEBUG - Processing node 68d694092f83206171a91e0f: baseline-arm64 2025-09-26 14:59:52,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:59:52,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:59:52,641 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694092f83206171a91e0f/log.txt.gz 2025-09-26 14:59:52,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:59:52,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:59:52,828 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694092f83206171a91e0f/lava_callback.json.gz DEBUG: Setup failed for 68d694092f83206171a91e0f. Transitting job node result: incomplete -> fail 2025-09-26 14:59:52,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:59:52,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694092f83206171a91e0f HTTP/1.1" 200 None 2025-09-26 14:59:52,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:59:52,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 14:59:52,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:59:52,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694092f83206171a91e0f HTTP/1.1" 200 None 2025-09-26 14:59:52,963 - lava_callback - INFO - Completed processing callback for node 68d694092f83206171a91e0f 2025-09-26 14:59:54,329 - lava_callback - INFO - Received callback for node 68d6a4fe2f83206171a923fd INFO: 172.20.0.1:48260 - "POST /node/68d6a4fe2f83206171a923fd HTTP/1.0" 202 Accepted 2025-09-26 14:59:54,337 - lava_callback - INFO - Starting async job submit for node 68d6a4fe2f83206171a923fd 2025-09-26 14:59:54,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:59:54,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a4fe2f83206171a923fd HTTP/1.1" 200 None 2025-09-26 14:59:54,370 - lava_callback - DEBUG - Processing node 68d6a4fe2f83206171a923fd: blktests-ddp-x86 2025-09-26 14:59:55,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:59:55,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:59:55,319 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/blktests-ddp-x86-68d6a4fe2f83206171a923fd/log.txt.gz 2025-09-26 14:59:55,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 14:59:55,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 14:59:55,518 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/blktests-ddp-x86-68d6a4fe2f83206171a923fd/lava_callback.json.gz 2025-09-26 14:59:55,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:59:55,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a4fe2f83206171a923fd HTTP/1.1" 200 None 2025-09-26 14:59:55,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:59:55,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d649055d233c363a762366 HTTP/1.1" 200 None 2025-09-26 14:59:55,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 14:59:55,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a4fe2f83206171a923fd HTTP/1.1" 200 None 2025-09-26 14:59:55,615 - lava_callback - INFO - Completed processing callback for node 68d6a4fe2f83206171a923fd INFO: 172.20.0.1:48276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42710 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:00:18,359 - lava_callback - INFO - Received callback for node 68d694092f83206171a91e12 INFO: 172.20.0.1:42712 - "POST /node/68d694092f83206171a91e12 HTTP/1.0" 202 Accepted 2025-09-26 15:00:18,367 - lava_callback - INFO - Starting async job submit for node 68d694092f83206171a91e12 2025-09-26 15:00:18,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:00:18,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694092f83206171a91e12 HTTP/1.1" 200 None 2025-09-26 15:00:18,419 - lava_callback - DEBUG - Processing node 68d694092f83206171a91e12: baseline-arm64 2025-09-26 15:00:18,954 - lava_callback - INFO - Received callback for node 68d6a7692f83206171a92514 INFO: 172.20.0.1:42720 - "POST /node/68d6a7692f83206171a92514 HTTP/1.0" 202 Accepted 2025-09-26 15:00:18,976 - lava_callback - INFO - Starting async job submit for node 68d6a7692f83206171a92514 2025-09-26 15:00:19,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:00:19,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7692f83206171a92514 HTTP/1.1" 200 None 2025-09-26 15:00:19,153 - lava_callback - DEBUG - Processing node 68d6a7692f83206171a92514: baseline-arm64-broonie 2025-09-26 15:00:19,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:00:19,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:00:19,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:00:19,836 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694092f83206171a91e12/log.txt.gz 2025-09-26 15:00:19,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:00:19,903 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:00:19,904 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a7692f83206171a92514/log.txt.gz 2025-09-26 15:00:19,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:00:20,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:00:20,020 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694092f83206171a91e12/lava_callback.json.gz 2025-09-26 15:00:20,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 DEBUG: Setup failed for 68d694092f83206171a91e12. Transitting job node result: incomplete -> fail 2025-09-26 15:00:20,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:00:20,104 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a7692f83206171a92514/lava_callback.json.gz 2025-09-26 15:00:20,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:00:20,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694092f83206171a91e12 HTTP/1.1" 200 None 2025-09-26 15:00:20,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:00:20,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7692f83206171a92514 HTTP/1.1" 200 None 2025-09-26 15:00:20,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:00:20,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 15:00:20,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:00:20,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 15:00:20,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:00:20,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694092f83206171a91e12 HTTP/1.1" 200 None 2025-09-26 15:00:20,196 - lava_callback - INFO - Completed processing callback for node 68d694092f83206171a91e12 2025-09-26 15:00:20,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7692f83206171a92514 HTTP/1.1" 200 None 2025-09-26 15:00:20,216 - lava_callback - INFO - Completed processing callback for node 68d6a7692f83206171a92514 INFO: 172.20.0.1:34832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36160 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:00:42,635 - lava_callback - INFO - Received callback for node 68d42a36a5c2c05277bc78c7 INFO: 172.20.0.1:37074 - "POST /node/68d42a36a5c2c05277bc78c7 HTTP/1.0" 202 Accepted 2025-09-26 15:00:42,641 - lava_callback - INFO - Starting async job submit for node 68d42a36a5c2c05277bc78c7 2025-09-26 15:00:42,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:00:42,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42a36a5c2c05277bc78c7 HTTP/1.1" 200 None 2025-09-26 15:00:42,675 - lava_callback - DEBUG - Processing node 68d42a36a5c2c05277bc78c7: baseline-arm 2025-09-26 15:00:42,909 - lava_callback - ERROR - Error processing callback for node 68d42a36a5c2c05277bc78c7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:00:45,521 - lava_callback - INFO - Received callback for node 68d4078ccd36afa834e16a71 INFO: 172.20.0.1:37084 - "POST /node/68d4078ccd36afa834e16a71 HTTP/1.0" 202 Accepted 2025-09-26 15:00:45,527 - lava_callback - INFO - Starting async job submit for node 68d4078ccd36afa834e16a71 2025-09-26 15:00:45,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:00:45,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4078ccd36afa834e16a71 HTTP/1.1" 200 None 2025-09-26 15:00:45,541 - lava_callback - DEBUG - Processing node 68d4078ccd36afa834e16a71: baseline-arm 2025-09-26 15:00:45,542 - lava_callback - ERROR - Error processing callback for node 68d4078ccd36afa834e16a71: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:00:46,243 - lava_callback - INFO - Received callback for node 68d4078ccd36afa834e16a74 INFO: 172.20.0.1:37090 - "POST /node/68d4078ccd36afa834e16a74 HTTP/1.0" 202 Accepted 2025-09-26 15:00:46,248 - lava_callback - INFO - Starting async job submit for node 68d4078ccd36afa834e16a74 2025-09-26 15:00:46,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:00:46,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4078ccd36afa834e16a74 HTTP/1.1" 200 None 2025-09-26 15:00:46,261 - lava_callback - DEBUG - Processing node 68d4078ccd36afa834e16a74: baseline-arm 2025-09-26 15:00:46,261 - lava_callback - ERROR - Error processing callback for node 68d4078ccd36afa834e16a74: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:37096 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:00:46,963 - lava_callback - INFO - Received callback for node 68d40791cd36afa834e16a77 INFO: 172.20.0.1:37110 - "POST /node/68d40791cd36afa834e16a77 HTTP/1.0" 202 Accepted 2025-09-26 15:00:46,969 - lava_callback - INFO - Starting async job submit for node 68d40791cd36afa834e16a77 2025-09-26 15:00:46,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:00:46,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40791cd36afa834e16a77 HTTP/1.1" 200 None 2025-09-26 15:00:46,982 - lava_callback - DEBUG - Processing node 68d40791cd36afa834e16a77: baseline-arm 2025-09-26 15:00:46,982 - lava_callback - ERROR - Error processing callback for node 68d40791cd36afa834e16a77: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:00:47,744 - lava_callback - INFO - Received callback for node 68d40793cd36afa834e16a7a INFO: 172.20.0.1:37124 - "POST /node/68d40793cd36afa834e16a7a HTTP/1.0" 202 Accepted 2025-09-26 15:00:47,750 - lava_callback - INFO - Starting async job submit for node 68d40793cd36afa834e16a7a 2025-09-26 15:00:47,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:00:47,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40793cd36afa834e16a7a HTTP/1.1" 200 None 2025-09-26 15:00:47,763 - lava_callback - DEBUG - Processing node 68d40793cd36afa834e16a7a: baseline-arm 2025-09-26 15:00:47,763 - lava_callback - ERROR - Error processing callback for node 68d40793cd36afa834e16a7a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:00:48,497 - lava_callback - INFO - Received callback for node 68d40796cd36afa834e16a7d INFO: 172.20.0.1:37130 - "POST /node/68d40796cd36afa834e16a7d HTTP/1.0" 202 Accepted 2025-09-26 15:00:48,503 - lava_callback - INFO - Starting async job submit for node 68d40796cd36afa834e16a7d 2025-09-26 15:00:48,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:00:48,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40796cd36afa834e16a7d HTTP/1.1" 200 None 2025-09-26 15:00:48,516 - lava_callback - DEBUG - Processing node 68d40796cd36afa834e16a7d: baseline-arm 2025-09-26 15:00:48,516 - lava_callback - ERROR - Error processing callback for node 68d40796cd36afa834e16a7d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:00:49,258 - lava_callback - INFO - Received callback for node 68d40797cd36afa834e16a80 INFO: 172.20.0.1:37146 - "POST /node/68d40797cd36afa834e16a80 HTTP/1.0" 202 Accepted 2025-09-26 15:00:49,264 - lava_callback - INFO - Starting async job submit for node 68d40797cd36afa834e16a80 2025-09-26 15:00:49,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:00:49,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40797cd36afa834e16a80 HTTP/1.1" 200 None 2025-09-26 15:00:49,276 - lava_callback - DEBUG - Processing node 68d40797cd36afa834e16a80: baseline-arm 2025-09-26 15:00:49,277 - lava_callback - ERROR - Error processing callback for node 68d40797cd36afa834e16a80: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:00:50,001 - lava_callback - INFO - Received callback for node 68d40799cd36afa834e16a83 INFO: 172.20.0.1:44436 - "POST /node/68d40799cd36afa834e16a83 HTTP/1.0" 202 Accepted 2025-09-26 15:00:50,007 - lava_callback - INFO - Starting async job submit for node 68d40799cd36afa834e16a83 2025-09-26 15:00:50,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:00:50,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40799cd36afa834e16a83 HTTP/1.1" 200 None 2025-09-26 15:00:50,020 - lava_callback - DEBUG - Processing node 68d40799cd36afa834e16a83: baseline-arm 2025-09-26 15:00:50,020 - lava_callback - ERROR - Error processing callback for node 68d40799cd36afa834e16a83: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:00:50,771 - lava_callback - INFO - Received callback for node 68d4079acd36afa834e16a86 INFO: 172.20.0.1:44448 - "POST /node/68d4079acd36afa834e16a86 HTTP/1.0" 202 Accepted 2025-09-26 15:00:50,776 - lava_callback - INFO - Starting async job submit for node 68d4079acd36afa834e16a86 2025-09-26 15:00:50,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:00:50,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4079acd36afa834e16a86 HTTP/1.1" 200 None 2025-09-26 15:00:50,791 - lava_callback - DEBUG - Processing node 68d4079acd36afa834e16a86: baseline-arm 2025-09-26 15:00:50,791 - lava_callback - ERROR - Error processing callback for node 68d4079acd36afa834e16a86: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:00:51,508 - lava_callback - INFO - Received callback for node 68d4079ccd36afa834e16a89 INFO: 172.20.0.1:44454 - "POST /node/68d4079ccd36afa834e16a89 HTTP/1.0" 202 Accepted 2025-09-26 15:00:51,514 - lava_callback - INFO - Starting async job submit for node 68d4079ccd36afa834e16a89 2025-09-26 15:00:51,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:00:51,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4079ccd36afa834e16a89 HTTP/1.1" 200 None 2025-09-26 15:00:51,527 - lava_callback - DEBUG - Processing node 68d4079ccd36afa834e16a89: baseline-arm 2025-09-26 15:00:51,527 - lava_callback - ERROR - Error processing callback for node 68d4079ccd36afa834e16a89: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:00:52,122 - lava_callback - INFO - Received callback for node 68d695802f83206171a920b5 INFO: 172.20.0.1:44466 - "POST /node/68d695802f83206171a920b5 HTTP/1.0" 202 Accepted 2025-09-26 15:00:52,130 - lava_callback - INFO - Starting async job submit for node 68d695802f83206171a920b5 2025-09-26 15:00:52,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:00:52,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695802f83206171a920b5 HTTP/1.1" 200 None 2025-09-26 15:00:52,182 - lava_callback - DEBUG - Processing node 68d695802f83206171a920b5: baseline-arm64 2025-09-26 15:00:53,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:00:53,339 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:00:53,340 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d695802f83206171a920b5/log.txt.gz 2025-09-26 15:00:53,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:00:53,543 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:00:53,543 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d695802f83206171a920b5/lava_callback.json.gz DEBUG: Setup failed for 68d695802f83206171a920b5. Transitting job node result: incomplete -> fail 2025-09-26 15:00:53,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:00:53,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695802f83206171a920b5 HTTP/1.1" 200 None 2025-09-26 15:00:53,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:00:53,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 15:00:53,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:00:53,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695802f83206171a920b5 HTTP/1.1" 200 None 2025-09-26 15:00:53,683 - lava_callback - INFO - Completed processing callback for node 68d695802f83206171a920b5 INFO: 172.20.0.1:44470 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:00:56,902 - lava_callback - INFO - Received callback for node 68d40b91cd36afa834e1708b INFO: 172.20.0.1:44476 - "POST /node/68d40b91cd36afa834e1708b HTTP/1.0" 202 Accepted 2025-09-26 15:00:56,910 - lava_callback - INFO - Starting async job submit for node 68d40b91cd36afa834e1708b 2025-09-26 15:00:57,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:00:57,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40b91cd36afa834e1708b HTTP/1.1" 200 None 2025-09-26 15:00:57,023 - lava_callback - DEBUG - Processing node 68d40b91cd36afa834e1708b: ltp-containers 2025-09-26 15:00:57,793 - lava_callback - ERROR - Error processing callback for node 68d40b91cd36afa834e1708b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:00:57,794 - lava_callback - INFO - Received callback for node 68d40b94cd36afa834e1708e INFO: 172.20.0.1:44486 - "POST /node/68d40b94cd36afa834e1708e HTTP/1.0" 202 Accepted 2025-09-26 15:00:57,801 - lava_callback - INFO - Starting async job submit for node 68d40b94cd36afa834e1708e 2025-09-26 15:00:57,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:00:57,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40b94cd36afa834e1708e HTTP/1.1" 200 None 2025-09-26 15:00:57,839 - lava_callback - DEBUG - Processing node 68d40b94cd36afa834e1708e: ltp-cap-bounds 2025-09-26 15:00:58,180 - lava_callback - ERROR - Error processing callback for node 68d40b94cd36afa834e1708e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:01:05,996 - lava_callback - INFO - Received callback for node 68d4079dcd36afa834e16a8c INFO: 172.20.0.1:57124 - "POST /node/68d4079dcd36afa834e16a8c HTTP/1.0" 202 Accepted 2025-09-26 15:01:06,001 - lava_callback - INFO - Starting async job submit for node 68d4079dcd36afa834e16a8c 2025-09-26 15:01:06,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:01:06,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4079dcd36afa834e16a8c HTTP/1.1" 200 None 2025-09-26 15:01:06,032 - lava_callback - DEBUG - Processing node 68d4079dcd36afa834e16a8c: baseline-arm 2025-09-26 15:01:06,032 - lava_callback - ERROR - Error processing callback for node 68d4079dcd36afa834e16a8c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:57132 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:01:06,727 - lava_callback - INFO - Received callback for node 68d4079ecd36afa834e16a8f INFO: 172.20.0.1:57136 - "POST /node/68d4079ecd36afa834e16a8f HTTP/1.0" 202 Accepted 2025-09-26 15:01:06,733 - lava_callback - INFO - Starting async job submit for node 68d4079ecd36afa834e16a8f 2025-09-26 15:01:06,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:01:06,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4079ecd36afa834e16a8f HTTP/1.1" 200 None 2025-09-26 15:01:06,752 - lava_callback - DEBUG - Processing node 68d4079ecd36afa834e16a8f: baseline-arm 2025-09-26 15:01:06,752 - lava_callback - ERROR - Error processing callback for node 68d4079ecd36afa834e16a8f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:01:07,426 - lava_callback - INFO - Received callback for node 68d407a0cd36afa834e16a92 INFO: 172.20.0.1:57142 - "POST /node/68d407a0cd36afa834e16a92 HTTP/1.0" 202 Accepted 2025-09-26 15:01:07,431 - lava_callback - INFO - Starting async job submit for node 68d407a0cd36afa834e16a92 2025-09-26 15:01:07,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:01:07,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d407a0cd36afa834e16a92 HTTP/1.1" 200 None 2025-09-26 15:01:07,444 - lava_callback - DEBUG - Processing node 68d407a0cd36afa834e16a92: baseline-arm 2025-09-26 15:01:07,444 - lava_callback - ERROR - Error processing callback for node 68d407a0cd36afa834e16a92: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:01:08,133 - lava_callback - INFO - Received callback for node 68d407a5cd36afa834e16aa8 INFO: 172.20.0.1:57146 - "POST /node/68d407a5cd36afa834e16aa8 HTTP/1.0" 202 Accepted 2025-09-26 15:01:08,139 - lava_callback - INFO - Starting async job submit for node 68d407a5cd36afa834e16aa8 2025-09-26 15:01:08,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:01:08,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d407a5cd36afa834e16aa8 HTTP/1.1" 200 None 2025-09-26 15:01:08,151 - lava_callback - DEBUG - Processing node 68d407a5cd36afa834e16aa8: baseline-arm 2025-09-26 15:01:08,152 - lava_callback - ERROR - Error processing callback for node 68d407a5cd36afa834e16aa8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:01:08,860 - lava_callback - INFO - Received callback for node 68d407a6cd36afa834e16aab INFO: 172.20.0.1:57154 - "POST /node/68d407a6cd36afa834e16aab HTTP/1.0" 202 Accepted 2025-09-26 15:01:08,865 - lava_callback - INFO - Starting async job submit for node 68d407a6cd36afa834e16aab 2025-09-26 15:01:08,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:01:08,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d407a6cd36afa834e16aab HTTP/1.1" 200 None 2025-09-26 15:01:08,893 - lava_callback - DEBUG - Processing node 68d407a6cd36afa834e16aab: baseline-arm 2025-09-26 15:01:08,893 - lava_callback - ERROR - Error processing callback for node 68d407a6cd36afa834e16aab: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:01:09,597 - lava_callback - INFO - Received callback for node 68d407a8cd36afa834e16aae INFO: 172.20.0.1:33624 - "POST /node/68d407a8cd36afa834e16aae HTTP/1.0" 202 Accepted 2025-09-26 15:01:09,602 - lava_callback - INFO - Starting async job submit for node 68d407a8cd36afa834e16aae 2025-09-26 15:01:09,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:01:09,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d407a8cd36afa834e16aae HTTP/1.1" 200 None 2025-09-26 15:01:09,616 - lava_callback - DEBUG - Processing node 68d407a8cd36afa834e16aae: baseline-arm 2025-09-26 15:01:09,616 - lava_callback - ERROR - Error processing callback for node 68d407a8cd36afa834e16aae: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:01:10,317 - lava_callback - INFO - Received callback for node 68d407a9cd36afa834e16ab1 INFO: 172.20.0.1:33626 - "POST /node/68d407a9cd36afa834e16ab1 HTTP/1.0" 202 Accepted 2025-09-26 15:01:10,322 - lava_callback - INFO - Starting async job submit for node 68d407a9cd36afa834e16ab1 2025-09-26 15:01:10,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:01:10,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d407a9cd36afa834e16ab1 HTTP/1.1" 200 None 2025-09-26 15:01:10,336 - lava_callback - DEBUG - Processing node 68d407a9cd36afa834e16ab1: baseline-arm 2025-09-26 15:01:10,336 - lava_callback - ERROR - Error processing callback for node 68d407a9cd36afa834e16ab1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:01:11,044 - lava_callback - INFO - Received callback for node 68d407abcd36afa834e16ab4 INFO: 172.20.0.1:33638 - "POST /node/68d407abcd36afa834e16ab4 HTTP/1.0" 202 Accepted 2025-09-26 15:01:11,049 - lava_callback - INFO - Starting async job submit for node 68d407abcd36afa834e16ab4 2025-09-26 15:01:11,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:01:11,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d407abcd36afa834e16ab4 HTTP/1.1" 200 None 2025-09-26 15:01:11,063 - lava_callback - DEBUG - Processing node 68d407abcd36afa834e16ab4: baseline-arm 2025-09-26 15:01:11,063 - lava_callback - ERROR - Error processing callback for node 68d407abcd36afa834e16ab4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:01:11,761 - lava_callback - INFO - Received callback for node 68d407accd36afa834e16ab7 INFO: 172.20.0.1:33642 - "POST /node/68d407accd36afa834e16ab7 HTTP/1.0" 202 Accepted 2025-09-26 15:01:11,766 - lava_callback - INFO - Starting async job submit for node 68d407accd36afa834e16ab7 2025-09-26 15:01:11,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:01:11,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d407accd36afa834e16ab7 HTTP/1.1" 200 None 2025-09-26 15:01:11,780 - lava_callback - DEBUG - Processing node 68d407accd36afa834e16ab7: baseline-arm 2025-09-26 15:01:11,780 - lava_callback - ERROR - Error processing callback for node 68d407accd36afa834e16ab7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:01:12,501 - lava_callback - INFO - Received callback for node 68d407b0cd36afa834e16aba INFO: 172.20.0.1:33658 - "POST /node/68d407b0cd36afa834e16aba HTTP/1.0" 202 Accepted 2025-09-26 15:01:12,507 - lava_callback - INFO - Starting async job submit for node 68d407b0cd36afa834e16aba 2025-09-26 15:01:12,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:01:12,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d407b0cd36afa834e16aba HTTP/1.1" 200 None 2025-09-26 15:01:12,520 - lava_callback - DEBUG - Processing node 68d407b0cd36afa834e16aba: baseline-arm 2025-09-26 15:01:12,520 - lava_callback - ERROR - Error processing callback for node 68d407b0cd36afa834e16aba: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:33672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33678 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:01:18,264 - lava_callback - INFO - Received callback for node 68d40b58cd36afa834e17055 INFO: 172.20.0.1:33682 - "POST /node/68d40b58cd36afa834e17055 HTTP/1.0" 202 Accepted 2025-09-26 15:01:18,270 - lava_callback - INFO - Starting async job submit for node 68d40b58cd36afa834e17055 2025-09-26 15:01:18,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:01:18,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40b58cd36afa834e17055 HTTP/1.1" 200 None 2025-09-26 15:01:18,312 - lava_callback - DEBUG - Processing node 68d40b58cd36afa834e17055: baseline-arm-broonie 2025-09-26 15:01:18,683 - lava_callback - ERROR - Error processing callback for node 68d40b58cd36afa834e17055: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:01:25,347 - lava_callback - INFO - Received callback for node 68d407b1cd36afa834e16abd INFO: 172.20.0.1:41472 - "POST /node/68d407b1cd36afa834e16abd HTTP/1.0" 202 Accepted 2025-09-26 15:01:25,353 - lava_callback - INFO - Starting async job submit for node 68d407b1cd36afa834e16abd 2025-09-26 15:01:25,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:01:25,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d407b1cd36afa834e16abd HTTP/1.1" 200 None 2025-09-26 15:01:25,366 - lava_callback - DEBUG - Processing node 68d407b1cd36afa834e16abd: baseline-arm 2025-09-26 15:01:25,367 - lava_callback - ERROR - Error processing callback for node 68d407b1cd36afa834e16abd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:41476 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:01:26,075 - lava_callback - INFO - Received callback for node 68d407b2cd36afa834e16ac0 INFO: 172.20.0.1:41482 - "POST /node/68d407b2cd36afa834e16ac0 HTTP/1.0" 202 Accepted 2025-09-26 15:01:26,080 - lava_callback - INFO - Starting async job submit for node 68d407b2cd36afa834e16ac0 2025-09-26 15:01:26,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:01:26,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d407b2cd36afa834e16ac0 HTTP/1.1" 200 None 2025-09-26 15:01:26,102 - lava_callback - DEBUG - Processing node 68d407b2cd36afa834e16ac0: baseline-arm 2025-09-26 15:01:26,102 - lava_callback - ERROR - Error processing callback for node 68d407b2cd36afa834e16ac0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:41498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41504 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:01:26,787 - lava_callback - INFO - Received callback for node 68d407b4cd36afa834e16ac3 INFO: 172.20.0.1:41506 - "POST /node/68d407b4cd36afa834e16ac3 HTTP/1.0" 202 Accepted 2025-09-26 15:01:26,792 - lava_callback - INFO - Starting async job submit for node 68d407b4cd36afa834e16ac3 2025-09-26 15:01:26,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:01:26,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d407b4cd36afa834e16ac3 HTTP/1.1" 200 None 2025-09-26 15:01:26,828 - lava_callback - DEBUG - Processing node 68d407b4cd36afa834e16ac3: baseline-arm 2025-09-26 15:01:26,828 - lava_callback - ERROR - Error processing callback for node 68d407b4cd36afa834e16ac3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:01:27,470 - lava_callback - INFO - Received callback for node 68d407b6cd36afa834e16ac6 INFO: 172.20.0.1:41510 - "POST /node/68d407b6cd36afa834e16ac6 HTTP/1.0" 202 Accepted 2025-09-26 15:01:27,476 - lava_callback - INFO - Starting async job submit for node 68d407b6cd36afa834e16ac6 2025-09-26 15:01:27,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:01:27,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d407b6cd36afa834e16ac6 HTTP/1.1" 200 None 2025-09-26 15:01:27,488 - lava_callback - DEBUG - Processing node 68d407b6cd36afa834e16ac6: baseline-arm 2025-09-26 15:01:27,488 - lava_callback - ERROR - Error processing callback for node 68d407b6cd36afa834e16ac6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:01:28,240 - lava_callback - INFO - Received callback for node 68d407b7cd36afa834e16ac9 INFO: 172.20.0.1:41522 - "POST /node/68d407b7cd36afa834e16ac9 HTTP/1.0" 202 Accepted 2025-09-26 15:01:28,254 - lava_callback - INFO - Starting async job submit for node 68d407b7cd36afa834e16ac9 2025-09-26 15:01:28,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:01:28,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d407b7cd36afa834e16ac9 HTTP/1.1" 200 None 2025-09-26 15:01:28,299 - lava_callback - DEBUG - Processing node 68d407b7cd36afa834e16ac9: baseline-arm 2025-09-26 15:01:28,299 - lava_callback - ERROR - Error processing callback for node 68d407b7cd36afa834e16ac9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:59218 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:01:43,188 - lava_callback - INFO - Received callback for node 68d693982f83206171a91d3b INFO: 172.20.0.1:35662 - "POST /node/68d693982f83206171a91d3b HTTP/1.0" 202 Accepted 2025-09-26 15:01:43,194 - lava_callback - INFO - Starting async job submit for node 68d693982f83206171a91d3b 2025-09-26 15:01:43,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:01:43,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693982f83206171a91d3b HTTP/1.1" 200 None 2025-09-26 15:01:43,231 - lava_callback - DEBUG - Processing node 68d693982f83206171a91d3b: baseline-arm64 2025-09-26 15:01:43,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:01:43,642 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:01:43,643 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693982f83206171a91d3b/log.txt.gz 2025-09-26 15:01:43,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:01:43,760 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:01:43,761 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693982f83206171a91d3b/lava_callback.json.gz 2025-09-26 15:01:43,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:01:43,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693982f83206171a91d3b HTTP/1.1" 200 None 2025-09-26 15:01:43,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:01:43,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 15:01:43,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:01:43,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693982f83206171a91d3b HTTP/1.1" 200 None 2025-09-26 15:01:43,842 - lava_callback - INFO - Completed processing callback for node 68d693982f83206171a91d3b INFO: 172.20.0.1:35664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59834 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:02:05,611 - lava_callback - INFO - Received callback for node 68d407e3cd36afa834e16b17 INFO: 172.20.0.1:55154 - "POST /node/68d407e3cd36afa834e16b17 HTTP/1.0" 202 Accepted 2025-09-26 15:02:05,617 - lava_callback - INFO - Starting async job submit for node 68d407e3cd36afa834e16b17 2025-09-26 15:02:05,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:02:05,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d407e3cd36afa834e16b17 HTTP/1.1" 200 None 2025-09-26 15:02:05,656 - lava_callback - DEBUG - Processing node 68d407e3cd36afa834e16b17: baseline-arm64 2025-09-26 15:02:05,656 - lava_callback - ERROR - Error processing callback for node 68d407e3cd36afa834e16b17: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:02:06,364 - lava_callback - INFO - Received callback for node 68d407e6cd36afa834e16b1a INFO: 172.20.0.1:55160 - "POST /node/68d407e6cd36afa834e16b1a HTTP/1.0" 202 Accepted 2025-09-26 15:02:06,369 - lava_callback - INFO - Starting async job submit for node 68d407e6cd36afa834e16b1a 2025-09-26 15:02:06,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:02:06,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d407e6cd36afa834e16b1a HTTP/1.1" 200 None 2025-09-26 15:02:06,382 - lava_callback - DEBUG - Processing node 68d407e6cd36afa834e16b1a: baseline-arm64 2025-09-26 15:02:06,383 - lava_callback - ERROR - Error processing callback for node 68d407e6cd36afa834e16b1a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:55166 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:02:15,088 - lava_callback - INFO - Received callback for node 68d695c52f83206171a92103 INFO: 172.20.0.1:39746 - "POST /node/68d695c52f83206171a92103 HTTP/1.0" 202 Accepted 2025-09-26 15:02:15,095 - lava_callback - INFO - Starting async job submit for node 68d695c52f83206171a92103 2025-09-26 15:02:15,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:02:15,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695c52f83206171a92103 HTTP/1.1" 200 None 2025-09-26 15:02:15,144 - lava_callback - DEBUG - Processing node 68d695c52f83206171a92103: baseline-arm64 INFO: 172.20.0.1:39760 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 15:02:16,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:02:16,217 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:02:16,217 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d695c52f83206171a92103/log.txt.gz 2025-09-26 15:02:16,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:02:16,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:02:16,417 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d695c52f83206171a92103/lava_callback.json.gz DEBUG: Setup failed for 68d695c52f83206171a92103. Transitting job node result: incomplete -> fail 2025-09-26 15:02:16,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:02:16,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695c52f83206171a92103 HTTP/1.1" 200 None 2025-09-26 15:02:16,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:02:16,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 15:02:16,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:39764 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:02:16,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695c52f83206171a92103 HTTP/1.1" 200 None 2025-09-26 15:02:16,555 - lava_callback - INFO - Completed processing callback for node 68d695c52f83206171a92103 INFO: 172.20.0.1:36370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47680 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:02:43,106 - lava_callback - INFO - Received callback for node 68d693992f83206171a91d3e INFO: 172.20.0.1:49978 - "POST /node/68d693992f83206171a91d3e HTTP/1.0" 202 Accepted 2025-09-26 15:02:43,111 - lava_callback - INFO - Starting async job submit for node 68d693992f83206171a91d3e 2025-09-26 15:02:43,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:02:43,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693992f83206171a91d3e HTTP/1.1" 200 None 2025-09-26 15:02:43,145 - lava_callback - DEBUG - Processing node 68d693992f83206171a91d3e: baseline-arm64 2025-09-26 15:02:43,345 - lava_callback - INFO - Received callback for node 68d42a3ba5c2c05277bc78cd INFO: 172.20.0.1:49980 - "POST /node/68d42a3ba5c2c05277bc78cd HTTP/1.0" 202 Accepted 2025-09-26 15:02:43,366 - lava_callback - INFO - Starting async job submit for node 68d42a3ba5c2c05277bc78cd 2025-09-26 15:02:43,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:02:43,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:02:43,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42a3ba5c2c05277bc78cd HTTP/1.1" 200 None 2025-09-26 15:02:43,434 - lava_callback - DEBUG - Processing node 68d42a3ba5c2c05277bc78cd: baseline-arm 2025-09-26 15:02:43,658 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:02:43,723 - lava_callback - ERROR - Error processing callback for node 68d42a3ba5c2c05277bc78cd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:02:43,724 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693992f83206171a91d3e/log.txt.gz 2025-09-26 15:02:43,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:02:43,848 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:02:43,849 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693992f83206171a91d3e/lava_callback.json.gz 2025-09-26 15:02:43,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:02:43,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693992f83206171a91d3e HTTP/1.1" 200 None 2025-09-26 15:02:43,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:02:43,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 15:02:43,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:02:43,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693992f83206171a91d3e HTTP/1.1" 200 None 2025-09-26 15:02:43,933 - lava_callback - INFO - Completed processing callback for node 68d693992f83206171a91d3e INFO: 172.20.0.1:49994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39190 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:02:56,884 - lava_callback - INFO - Received callback for node 68d694282f83206171a91e20 INFO: 172.20.0.1:39204 - "POST /node/68d694282f83206171a91e20 HTTP/1.0" 202 Accepted 2025-09-26 15:02:56,890 - lava_callback - INFO - Starting async job submit for node 68d694282f83206171a91e20 2025-09-26 15:02:56,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:02:56,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694282f83206171a91e20 HTTP/1.1" 200 None 2025-09-26 15:02:56,941 - lava_callback - DEBUG - Processing node 68d694282f83206171a91e20: baseline-arm64 2025-09-26 15:02:57,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:02:57,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:02:57,577 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694282f83206171a91e20/log.txt.gz 2025-09-26 15:02:57,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:02:57,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:02:57,738 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694282f83206171a91e20/lava_callback.json.gz DEBUG: Setup failed for 68d694282f83206171a91e20. Transitting job node result: incomplete -> fail 2025-09-26 15:02:57,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:02:57,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694282f83206171a91e20 HTTP/1.1" 200 None 2025-09-26 15:02:57,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:02:57,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 15:02:57,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:02:57,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694282f83206171a91e20 HTTP/1.1" 200 None 2025-09-26 15:02:57,866 - lava_callback - INFO - Completed processing callback for node 68d694282f83206171a91e20 2025-09-26 15:02:58,082 - lava_callback - INFO - Received callback for node 68d40b95cd36afa834e17091 INFO: 172.20.0.1:39206 - "POST /node/68d40b95cd36afa834e17091 HTTP/1.0" 202 Accepted 2025-09-26 15:02:58,091 - lava_callback - INFO - Starting async job submit for node 68d40b95cd36afa834e17091 2025-09-26 15:02:58,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:02:58,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40b95cd36afa834e17091 HTTP/1.1" 200 None 2025-09-26 15:02:58,226 - lava_callback - DEBUG - Processing node 68d40b95cd36afa834e17091: ltp-containers 2025-09-26 15:02:59,047 - lava_callback - ERROR - Error processing callback for node 68d40b95cd36afa834e17091: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:03:05,918 - lava_callback - INFO - Received callback for node 68d40818cd36afa834e16b68 INFO: 172.20.0.1:33234 - "POST /node/68d40818cd36afa834e16b68 HTTP/1.0" 202 Accepted 2025-09-26 15:03:05,924 - lava_callback - INFO - Starting async job submit for node 68d40818cd36afa834e16b68 2025-09-26 15:03:05,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:03:05,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40818cd36afa834e16b68 HTTP/1.1" 200 None 2025-09-26 15:03:05,937 - lava_callback - DEBUG - Processing node 68d40818cd36afa834e16b68: baseline-arm64 2025-09-26 15:03:05,937 - lava_callback - ERROR - Error processing callback for node 68d40818cd36afa834e16b68: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:33240 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:03:06,643 - lava_callback - INFO - Received callback for node 68d40819cd36afa834e16b6b INFO: 172.20.0.1:33246 - "POST /node/68d40819cd36afa834e16b6b HTTP/1.0" 202 Accepted 2025-09-26 15:03:06,649 - lava_callback - INFO - Starting async job submit for node 68d40819cd36afa834e16b6b 2025-09-26 15:03:06,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:03:06,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40819cd36afa834e16b6b HTTP/1.1" 200 None 2025-09-26 15:03:06,662 - lava_callback - DEBUG - Processing node 68d40819cd36afa834e16b6b: baseline-arm64 2025-09-26 15:03:06,662 - lava_callback - ERROR - Error processing callback for node 68d40819cd36afa834e16b6b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:03:07,366 - lava_callback - INFO - Received callback for node 68d4081dcd36afa834e16b84 INFO: 172.20.0.1:33252 - "POST /node/68d4081dcd36afa834e16b84 HTTP/1.0" 202 Accepted 2025-09-26 15:03:07,371 - lava_callback - INFO - Starting async job submit for node 68d4081dcd36afa834e16b84 2025-09-26 15:03:07,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:03:07,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4081dcd36afa834e16b84 HTTP/1.1" 200 None 2025-09-26 15:03:07,385 - lava_callback - DEBUG - Processing node 68d4081dcd36afa834e16b84: baseline-arm64 2025-09-26 15:03:07,385 - lava_callback - ERROR - Error processing callback for node 68d4081dcd36afa834e16b84: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:03:08,081 - lava_callback - INFO - Received callback for node 68d4081ecd36afa834e16b87 INFO: 172.20.0.1:33254 - "POST /node/68d4081ecd36afa834e16b87 HTTP/1.0" 202 Accepted 2025-09-26 15:03:08,086 - lava_callback - INFO - Starting async job submit for node 68d4081ecd36afa834e16b87 2025-09-26 15:03:08,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:03:08,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4081ecd36afa834e16b87 HTTP/1.1" 200 None 2025-09-26 15:03:08,122 - lava_callback - DEBUG - Processing node 68d4081ecd36afa834e16b87: baseline-arm64 2025-09-26 15:03:08,122 - lava_callback - ERROR - Error processing callback for node 68d4081ecd36afa834e16b87: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:38080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36316 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:03:43,110 - lava_callback - INFO - Received callback for node 68d6939b2f83206171a91d41 INFO: 172.20.0.1:57608 - "POST /node/68d6939b2f83206171a91d41 HTTP/1.0" 202 Accepted 2025-09-26 15:03:43,120 - lava_callback - INFO - Starting async job submit for node 68d6939b2f83206171a91d41 2025-09-26 15:03:43,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:03:43,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6939b2f83206171a91d41 HTTP/1.1" 200 None 2025-09-26 15:03:43,164 - lava_callback - DEBUG - Processing node 68d6939b2f83206171a91d41: baseline-arm64 2025-09-26 15:03:43,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:03:43,682 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:03:43,683 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6939b2f83206171a91d41/log.txt.gz 2025-09-26 15:03:43,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:03:43,830 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:03:43,831 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6939b2f83206171a91d41/lava_callback.json.gz 2025-09-26 15:03:43,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:03:43,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6939b2f83206171a91d41 HTTP/1.1" 200 None 2025-09-26 15:03:43,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:03:43,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 15:03:43,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:03:43,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6939b2f83206171a91d41 HTTP/1.1" 200 None 2025-09-26 15:03:43,928 - lava_callback - INFO - Completed processing callback for node 68d6939b2f83206171a91d41 INFO: 172.20.0.1:57612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45178 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:03:59,220 - lava_callback - INFO - Received callback for node 68d69e5d2f83206171a922ad INFO: 172.20.0.1:45192 - "POST /node/68d69e5d2f83206171a922ad HTTP/1.0" 202 Accepted 2025-09-26 15:03:59,227 - lava_callback - INFO - Starting async job submit for node 68d69e5d2f83206171a922ad 2025-09-26 15:03:59,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:03:59,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d69e5d2f83206171a922ad HTTP/1.1" 200 None 2025-09-26 15:03:59,298 - lava_callback - DEBUG - Processing node 68d69e5d2f83206171a922ad: ltp-smoketest 2025-09-26 15:03:59,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:03:59,906 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:03:59,907 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d69e5d2f83206171a922ad/log.txt.gz 2025-09-26 15:03:59,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:04:00,042 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:04:00,043 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d69e5d2f83206171a922ad/lava_callback.json.gz 2025-09-26 15:04:00,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:04:00,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d69e5d2f83206171a922ad HTTP/1.1" 200 None 2025-09-26 15:04:00,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:04:00,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6373d5d233c363a761c18 HTTP/1.1" 200 None 2025-09-26 15:04:00,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:04:00,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d69e5d2f83206171a922ad HTTP/1.1" 200 None 2025-09-26 15:04:00,234 - lava_callback - INFO - Completed processing callback for node 68d69e5d2f83206171a922ad INFO: 172.20.0.1:56440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48068 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:04:34,307 - lava_callback - INFO - Received callback for node 68d6ab512f83206171a92748 INFO: 172.20.0.1:42464 - "POST /node/68d6ab512f83206171a92748 HTTP/1.0" 202 Accepted 2025-09-26 15:04:34,312 - lava_callback - INFO - Starting async job submit for node 68d6ab512f83206171a92748 2025-09-26 15:04:34,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:04:34,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ab512f83206171a92748 HTTP/1.1" 200 None 2025-09-26 15:04:34,341 - lava_callback - DEBUG - Processing node 68d6ab512f83206171a92748: baseline-x86 2025-09-26 15:04:34,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:04:34,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:04:34,667 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d6ab512f83206171a92748/log.txt.gz 2025-09-26 15:04:34,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:04:34,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:04:34,785 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d6ab512f83206171a92748/lava_callback.json.gz 2025-09-26 15:04:34,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:04:34,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ab512f83206171a92748 HTTP/1.1" 200 None 2025-09-26 15:04:34,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:04:34,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651efcca86fb17472aa39 HTTP/1.1" 200 None 2025-09-26 15:04:34,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:04:34,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ab512f83206171a92748 HTTP/1.1" 200 None 2025-09-26 15:04:34,855 - lava_callback - INFO - Completed processing callback for node 68d6ab512f83206171a92748 INFO: 172.20.0.1:42478 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:04:43,203 - lava_callback - INFO - Received callback for node 68d6939c2f83206171a91d44 INFO: 172.20.0.1:43358 - "POST /node/68d6939c2f83206171a91d44 HTTP/1.0" 202 Accepted 2025-09-26 15:04:43,208 - lava_callback - INFO - Starting async job submit for node 68d6939c2f83206171a91d44 2025-09-26 15:04:43,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:04:43,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6939c2f83206171a91d44 HTTP/1.1" 200 None 2025-09-26 15:04:43,241 - lava_callback - DEBUG - Processing node 68d6939c2f83206171a91d44: baseline-arm64 2025-09-26 15:04:43,396 - lava_callback - INFO - Received callback for node 68d42a3ca5c2c05277bc78d0 INFO: 172.20.0.1:43374 - "POST /node/68d42a3ca5c2c05277bc78d0 HTTP/1.0" 202 Accepted 2025-09-26 15:04:43,428 - lava_callback - INFO - Starting async job submit for node 68d42a3ca5c2c05277bc78d0 2025-09-26 15:04:43,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:04:43,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:04:43,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42a3ca5c2c05277bc78d0 HTTP/1.1" 200 None 2025-09-26 15:04:43,533 - lava_callback - DEBUG - Processing node 68d42a3ca5c2c05277bc78d0: baseline-arm 2025-09-26 15:04:43,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:04:43,789 - lava_callback - ERROR - Error processing callback for node 68d42a3ca5c2c05277bc78d0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:04:43,790 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6939c2f83206171a91d44/log.txt.gz 2025-09-26 15:04:43,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:04:43,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:04:43,964 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6939c2f83206171a91d44/lava_callback.json.gz 2025-09-26 15:04:43,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:04:43,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6939c2f83206171a91d44 HTTP/1.1" 200 None 2025-09-26 15:04:43,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:04:44,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 15:04:44,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:04:44,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6939c2f83206171a91d44 HTTP/1.1" 200 None 2025-09-26 15:04:44,062 - lava_callback - INFO - Completed processing callback for node 68d6939c2f83206171a91d44 2025-09-26 15:04:45,584 - lava_callback - INFO - Received callback for node 68d40889cd36afa834e16c7f INFO: 172.20.0.1:43390 - "POST /node/68d40889cd36afa834e16c7f HTTP/1.0" 202 Accepted 2025-09-26 15:04:45,589 - lava_callback - INFO - Starting async job submit for node 68d40889cd36afa834e16c7f 2025-09-26 15:04:45,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:04:45,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40889cd36afa834e16c7f HTTP/1.1" 200 None 2025-09-26 15:04:45,602 - lava_callback - DEBUG - Processing node 68d40889cd36afa834e16c7f: baseline-arm 2025-09-26 15:04:45,602 - lava_callback - ERROR - Error processing callback for node 68d40889cd36afa834e16c7f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:04:46,260 - lava_callback - INFO - Received callback for node 68d4088ccd36afa834e16c82 INFO: 172.20.0.1:43392 - "POST /node/68d4088ccd36afa834e16c82 HTTP/1.0" 202 Accepted 2025-09-26 15:04:46,266 - lava_callback - INFO - Starting async job submit for node 68d4088ccd36afa834e16c82 2025-09-26 15:04:46,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:04:46,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4088ccd36afa834e16c82 HTTP/1.1" 200 None 2025-09-26 15:04:46,298 - lava_callback - DEBUG - Processing node 68d4088ccd36afa834e16c82: baseline-arm 2025-09-26 15:04:46,298 - lava_callback - ERROR - Error processing callback for node 68d4088ccd36afa834e16c82: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:43408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53398 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:05:06,789 - lava_callback - INFO - Received callback for node 68d40404cd36afa834e163d4 INFO: 172.20.0.1:53408 - "POST /node/68d40404cd36afa834e163d4 HTTP/1.0" 202 Accepted 2025-09-26 15:05:06,795 - lava_callback - INFO - Starting async job submit for node 68d40404cd36afa834e163d4 2025-09-26 15:05:06,824 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:05:06,832 - lava_callback - INFO - Received callback for node 68d4088ecd36afa834e16c85 INFO: 172.20.0.1:53412 - "POST /node/68d4088ecd36afa834e16c85 HTTP/1.0" 202 Accepted 2025-09-26 15:05:06,838 - lava_callback - INFO - Starting async job submit for node 68d4088ecd36afa834e16c85 2025-09-26 15:05:06,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:05:06,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40404cd36afa834e163d4 HTTP/1.1" 200 None 2025-09-26 15:05:06,843 - lava_callback - DEBUG - Processing node 68d40404cd36afa834e163d4: baseline-arm 2025-09-26 15:05:06,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4088ecd36afa834e16c85 HTTP/1.1" 200 None 2025-09-26 15:05:06,910 - lava_callback - DEBUG - Processing node 68d4088ecd36afa834e16c85: baseline-arm 2025-09-26 15:05:06,916 - lava_callback - ERROR - Error processing callback for node 68d4088ecd36afa834e16c85: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:05:07,124 - lava_callback - ERROR - Error processing callback for node 68d40404cd36afa834e163d4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:05:07,567 - lava_callback - INFO - Received callback for node 68d40890cd36afa834e16c88 INFO: 172.20.0.1:53424 - "POST /node/68d40890cd36afa834e16c88 HTTP/1.0" 202 Accepted 2025-09-26 15:05:07,573 - lava_callback - INFO - Starting async job submit for node 68d40890cd36afa834e16c88 2025-09-26 15:05:07,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:05:07,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40890cd36afa834e16c88 HTTP/1.1" 200 None 2025-09-26 15:05:07,603 - lava_callback - DEBUG - Processing node 68d40890cd36afa834e16c88: baseline-arm 2025-09-26 15:05:07,603 - lava_callback - ERROR - Error processing callback for node 68d40890cd36afa834e16c88: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:05:08,313 - lava_callback - INFO - Received callback for node 68d4089bcd36afa834e16cb2 INFO: 172.20.0.1:53438 - "POST /node/68d4089bcd36afa834e16cb2 HTTP/1.0" 202 Accepted 2025-09-26 15:05:08,318 - lava_callback - INFO - Starting async job submit for node 68d4089bcd36afa834e16cb2 2025-09-26 15:05:08,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:05:08,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4089bcd36afa834e16cb2 HTTP/1.1" 200 None 2025-09-26 15:05:08,340 - lava_callback - DEBUG - Processing node 68d4089bcd36afa834e16cb2: baseline-arm 2025-09-26 15:05:08,340 - lava_callback - ERROR - Error processing callback for node 68d4089bcd36afa834e16cb2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:05:09,055 - lava_callback - INFO - Received callback for node 68d4089ccd36afa834e16cb5 INFO: 172.20.0.1:53446 - "POST /node/68d4089ccd36afa834e16cb5 HTTP/1.0" 202 Accepted 2025-09-26 15:05:09,061 - lava_callback - INFO - Starting async job submit for node 68d4089ccd36afa834e16cb5 2025-09-26 15:05:09,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:05:09,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4089ccd36afa834e16cb5 HTTP/1.1" 200 None 2025-09-26 15:05:09,095 - lava_callback - DEBUG - Processing node 68d4089ccd36afa834e16cb5: baseline-arm 2025-09-26 15:05:09,095 - lava_callback - ERROR - Error processing callback for node 68d4089ccd36afa834e16cb5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:59946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59160 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:05:27,061 - lava_callback - INFO - Received callback for node 68d408a2cd36afa834e16cbb INFO: 172.20.0.1:59162 - "POST /node/68d408a2cd36afa834e16cbb HTTP/1.0" 202 Accepted 2025-09-26 15:05:27,067 - lava_callback - INFO - Starting async job submit for node 68d408a2cd36afa834e16cbb 2025-09-26 15:05:27,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:05:27,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408a2cd36afa834e16cbb HTTP/1.1" 200 None 2025-09-26 15:05:27,080 - lava_callback - DEBUG - Processing node 68d408a2cd36afa834e16cbb: baseline-arm 2025-09-26 15:05:27,080 - lava_callback - ERROR - Error processing callback for node 68d408a2cd36afa834e16cbb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:59176 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:05:27,814 - lava_callback - INFO - Received callback for node 68d408a8cd36afa834e16cc4 INFO: 172.20.0.1:59182 - "POST /node/68d408a8cd36afa834e16cc4 HTTP/1.0" 202 Accepted 2025-09-26 15:05:27,819 - lava_callback - INFO - Starting async job submit for node 68d408a8cd36afa834e16cc4 2025-09-26 15:05:27,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:05:27,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408a8cd36afa834e16cc4 HTTP/1.1" 200 None 2025-09-26 15:05:27,834 - lava_callback - DEBUG - Processing node 68d408a8cd36afa834e16cc4: baseline-arm 2025-09-26 15:05:27,834 - lava_callback - ERROR - Error processing callback for node 68d408a8cd36afa834e16cc4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:05:28,578 - lava_callback - INFO - Received callback for node 68d408a9cd36afa834e16cc7 INFO: 172.20.0.1:59186 - "POST /node/68d408a9cd36afa834e16cc7 HTTP/1.0" 202 Accepted 2025-09-26 15:05:28,584 - lava_callback - INFO - Starting async job submit for node 68d408a9cd36afa834e16cc7 2025-09-26 15:05:28,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:05:28,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408a9cd36afa834e16cc7 HTTP/1.1" 200 None 2025-09-26 15:05:28,598 - lava_callback - DEBUG - Processing node 68d408a9cd36afa834e16cc7: baseline-arm 2025-09-26 15:05:28,598 - lava_callback - ERROR - Error processing callback for node 68d408a9cd36afa834e16cc7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:05:29,329 - lava_callback - INFO - Received callback for node 68d408b0cd36afa834e16cd0 INFO: 172.20.0.1:36530 - "POST /node/68d408b0cd36afa834e16cd0 HTTP/1.0" 202 Accepted 2025-09-26 15:05:29,334 - lava_callback - INFO - Starting async job submit for node 68d408b0cd36afa834e16cd0 2025-09-26 15:05:29,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:05:29,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408b0cd36afa834e16cd0 HTTP/1.1" 200 None 2025-09-26 15:05:29,356 - lava_callback - DEBUG - Processing node 68d408b0cd36afa834e16cd0: baseline-arm 2025-09-26 15:05:29,356 - lava_callback - ERROR - Error processing callback for node 68d408b0cd36afa834e16cd0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:36534 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:05:39,583 - lava_callback - INFO - Received callback for node 68d6a8782f83206171a9267a INFO: 172.20.0.1:56196 - "POST /node/68d6a8782f83206171a9267a HTTP/1.0" 202 Accepted 2025-09-26 15:05:39,589 - lava_callback - INFO - Starting async job submit for node 68d6a8782f83206171a9267a 2025-09-26 15:05:39,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:05:39,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8782f83206171a9267a HTTP/1.1" 200 None 2025-09-26 15:05:39,634 - lava_callback - DEBUG - Processing node 68d6a8782f83206171a9267a: baseline-arm64-broonie 2025-09-26 15:05:39,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:05:40,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:05:40,012 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a8782f83206171a9267a/log.txt.gz 2025-09-26 15:05:40,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:05:40,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:05:40,159 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a8782f83206171a9267a/lava_callback.json.gz 2025-09-26 15:05:40,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:05:40,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8782f83206171a9267a HTTP/1.1" 200 None 2025-09-26 15:05:40,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:05:40,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 15:05:40,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:05:40,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8782f83206171a9267a HTTP/1.1" 200 None 2025-09-26 15:05:40,258 - lava_callback - INFO - Completed processing callback for node 68d6a8782f83206171a9267a 2025-09-26 15:05:44,144 - lava_callback - INFO - Received callback for node 68d693d12f83206171a91db5 INFO: 172.20.0.1:56198 - "POST /node/68d693d12f83206171a91db5 HTTP/1.0" 202 Accepted 2025-09-26 15:05:44,150 - lava_callback - INFO - Starting async job submit for node 68d693d12f83206171a91db5 2025-09-26 15:05:44,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:05:44,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693d12f83206171a91db5 HTTP/1.1" 200 None 2025-09-26 15:05:44,184 - lava_callback - DEBUG - Processing node 68d693d12f83206171a91db5: baseline-arm64 2025-09-26 15:05:44,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:05:44,553 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:05:44,554 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693d12f83206171a91db5/log.txt.gz 2025-09-26 15:05:44,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:05:44,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:05:44,670 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693d12f83206171a91db5/lava_callback.json.gz 2025-09-26 15:05:44,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:05:44,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693d12f83206171a91db5 HTTP/1.1" 200 None 2025-09-26 15:05:44,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:05:44,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 15:05:44,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:05:44,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693d12f83206171a91db5 HTTP/1.1" 200 None 2025-09-26 15:05:44,755 - lava_callback - INFO - Completed processing callback for node 68d693d12f83206171a91db5 2025-09-26 15:05:46,374 - lava_callback - INFO - Received callback for node 68d408b2cd36afa834e16cd3 INFO: 172.20.0.1:56206 - "POST /node/68d408b2cd36afa834e16cd3 HTTP/1.0" 202 Accepted 2025-09-26 15:05:46,380 - lava_callback - INFO - Starting async job submit for node 68d408b2cd36afa834e16cd3 2025-09-26 15:05:46,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:05:46,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408b2cd36afa834e16cd3 HTTP/1.1" 200 None 2025-09-26 15:05:46,393 - lava_callback - DEBUG - Processing node 68d408b2cd36afa834e16cd3: baseline-arm 2025-09-26 15:05:46,393 - lava_callback - ERROR - Error processing callback for node 68d408b2cd36afa834e16cd3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:56218 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:05:47,109 - lava_callback - INFO - Received callback for node 68d408bacd36afa834e16cdc INFO: 172.20.0.1:56226 - "POST /node/68d408bacd36afa834e16cdc HTTP/1.0" 202 Accepted 2025-09-26 15:05:47,115 - lava_callback - INFO - Starting async job submit for node 68d408bacd36afa834e16cdc 2025-09-26 15:05:47,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:05:47,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408bacd36afa834e16cdc HTTP/1.1" 200 None 2025-09-26 15:05:47,129 - lava_callback - DEBUG - Processing node 68d408bacd36afa834e16cdc: baseline-arm 2025-09-26 15:05:47,129 - lava_callback - ERROR - Error processing callback for node 68d408bacd36afa834e16cdc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:05:47,824 - lava_callback - INFO - Received callback for node 68d408bccd36afa834e16cdf INFO: 172.20.0.1:56232 - "POST /node/68d408bccd36afa834e16cdf HTTP/1.0" 202 Accepted 2025-09-26 15:05:47,830 - lava_callback - INFO - Starting async job submit for node 68d408bccd36afa834e16cdf 2025-09-26 15:05:47,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:05:47,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408bccd36afa834e16cdf HTTP/1.1" 200 None 2025-09-26 15:05:47,843 - lava_callback - DEBUG - Processing node 68d408bccd36afa834e16cdf: baseline-arm 2025-09-26 15:05:47,843 - lava_callback - ERROR - Error processing callback for node 68d408bccd36afa834e16cdf: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:54952 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:05:57,103 - lava_callback - INFO - Received callback for node 68d6a5e22f83206171a92435 INFO: 172.20.0.1:54954 - "POST /node/68d6a5e22f83206171a92435 HTTP/1.0" 202 Accepted 2025-09-26 15:05:57,109 - lava_callback - INFO - Starting async job submit for node 68d6a5e22f83206171a92435 2025-09-26 15:05:57,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:05:57,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a5e22f83206171a92435 HTTP/1.1" 200 None 2025-09-26 15:05:57,143 - lava_callback - DEBUG - Processing node 68d6a5e22f83206171a92435: baseline-arm 2025-09-26 15:05:57,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:05:57,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:05:57,602 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d6a5e22f83206171a92435/log.txt.gz 2025-09-26 15:05:57,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:05:57,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:05:57,722 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d6a5e22f83206171a92435/lava_callback.json.gz 2025-09-26 15:05:57,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:05:57,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a5e22f83206171a92435 HTTP/1.1" 200 None 2025-09-26 15:05:57,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:05:57,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d07a5c3ab168ecc7a34 HTTP/1.1" 200 None 2025-09-26 15:05:57,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:05:57,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a5e22f83206171a92435 HTTP/1.1" 200 None 2025-09-26 15:05:57,803 - lava_callback - INFO - Completed processing callback for node 68d6a5e22f83206171a92435 INFO: 172.20.0.1:53694 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:06:06,996 - lava_callback - INFO - Received callback for node 68d408cacd36afa834e16cee INFO: 172.20.0.1:53702 - "POST /node/68d408cacd36afa834e16cee HTTP/1.0" 202 Accepted 2025-09-26 15:06:07,002 - lava_callback - INFO - Starting async job submit for node 68d408cacd36afa834e16cee 2025-09-26 15:06:07,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:06:07,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408cacd36afa834e16cee HTTP/1.1" 200 None 2025-09-26 15:06:07,015 - lava_callback - DEBUG - Processing node 68d408cacd36afa834e16cee: baseline-arm 2025-09-26 15:06:07,015 - lava_callback - ERROR - Error processing callback for node 68d408cacd36afa834e16cee: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:06:07,744 - lava_callback - INFO - Received callback for node 68d408cccd36afa834e16cf1 INFO: 172.20.0.1:53712 - "POST /node/68d408cccd36afa834e16cf1 HTTP/1.0" 202 Accepted 2025-09-26 15:06:07,749 - lava_callback - INFO - Starting async job submit for node 68d408cccd36afa834e16cf1 2025-09-26 15:06:07,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:06:07,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408cccd36afa834e16cf1 HTTP/1.1" 200 None 2025-09-26 15:06:07,763 - lava_callback - DEBUG - Processing node 68d408cccd36afa834e16cf1: baseline-arm 2025-09-26 15:06:07,763 - lava_callback - ERROR - Error processing callback for node 68d408cccd36afa834e16cf1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:06:08,557 - lava_callback - INFO - Received callback for node 68d408d3cd36afa834e16cfa INFO: 172.20.0.1:53722 - "POST /node/68d408d3cd36afa834e16cfa HTTP/1.0" 202 Accepted 2025-09-26 15:06:08,562 - lava_callback - INFO - Starting async job submit for node 68d408d3cd36afa834e16cfa 2025-09-26 15:06:08,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:06:08,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408d3cd36afa834e16cfa HTTP/1.1" 200 None 2025-09-26 15:06:08,578 - lava_callback - DEBUG - Processing node 68d408d3cd36afa834e16cfa: baseline-arm 2025-09-26 15:06:08,578 - lava_callback - ERROR - Error processing callback for node 68d408d3cd36afa834e16cfa: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:06:09,278 - lava_callback - INFO - Received callback for node 68d408d4cd36afa834e16cfd INFO: 172.20.0.1:53734 - "POST /node/68d408d4cd36afa834e16cfd HTTP/1.0" 202 Accepted 2025-09-26 15:06:09,284 - lava_callback - INFO - Starting async job submit for node 68d408d4cd36afa834e16cfd 2025-09-26 15:06:09,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:06:09,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408d4cd36afa834e16cfd HTTP/1.1" 200 None 2025-09-26 15:06:09,297 - lava_callback - DEBUG - Processing node 68d408d4cd36afa834e16cfd: baseline-arm 2025-09-26 15:06:09,297 - lava_callback - ERROR - Error processing callback for node 68d408d4cd36afa834e16cfd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:06:09,992 - lava_callback - INFO - Received callback for node 68d408dbcd36afa834e16d15 INFO: 172.20.0.1:60724 - "POST /node/68d408dbcd36afa834e16d15 HTTP/1.0" 202 Accepted 2025-09-26 15:06:09,998 - lava_callback - INFO - Starting async job submit for node 68d408dbcd36afa834e16d15 2025-09-26 15:06:09,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:06:10,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408dbcd36afa834e16d15 HTTP/1.1" 200 None 2025-09-26 15:06:10,037 - lava_callback - DEBUG - Processing node 68d408dbcd36afa834e16d15: baseline-arm 2025-09-26 15:06:10,037 - lava_callback - ERROR - Error processing callback for node 68d408dbcd36afa834e16d15: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:06:10,717 - lava_callback - INFO - Received callback for node 68d408ddcd36afa834e16d18 INFO: 172.20.0.1:60730 - "POST /node/68d408ddcd36afa834e16d18 HTTP/1.0" 202 Accepted 2025-09-26 15:06:10,723 - lava_callback - INFO - Starting async job submit for node 68d408ddcd36afa834e16d18 2025-09-26 15:06:10,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:06:10,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408ddcd36afa834e16d18 HTTP/1.1" 200 None 2025-09-26 15:06:10,736 - lava_callback - DEBUG - Processing node 68d408ddcd36afa834e16d18: baseline-arm 2025-09-26 15:06:10,736 - lava_callback - ERROR - Error processing callback for node 68d408ddcd36afa834e16d18: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:06:11,714 - lava_callback - INFO - Received callback for node 68d694292f83206171a91e23 INFO: 172.20.0.1:60732 - "POST /node/68d694292f83206171a91e23 HTTP/1.0" 202 Accepted 2025-09-26 15:06:11,721 - lava_callback - INFO - Starting async job submit for node 68d694292f83206171a91e23 2025-09-26 15:06:11,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:06:11,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694292f83206171a91e23 HTTP/1.1" 200 None 2025-09-26 15:06:11,793 - lava_callback - DEBUG - Processing node 68d694292f83206171a91e23: baseline-arm64 2025-09-26 15:06:12,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:06:13,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:06:13,001 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694292f83206171a91e23/log.txt.gz 2025-09-26 15:06:13,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:06:13,191 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:06:13,192 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694292f83206171a91e23/lava_callback.json.gz DEBUG: Setup failed for 68d694292f83206171a91e23. Transitting job node result: incomplete -> fail 2025-09-26 15:06:13,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:06:13,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694292f83206171a91e23 HTTP/1.1" 200 None 2025-09-26 15:06:13,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:06:13,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 15:06:13,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:06:13,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694292f83206171a91e23 HTTP/1.1" 200 None 2025-09-26 15:06:13,324 - lava_callback - INFO - Completed processing callback for node 68d694292f83206171a91e23 INFO: 172.20.0.1:60740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49668 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:06:26,267 - lava_callback - INFO - Received callback for node 68d408e4cd36afa834e16d21 INFO: 172.20.0.1:49678 - "POST /node/68d408e4cd36afa834e16d21 HTTP/1.0" 202 Accepted 2025-09-26 15:06:26,273 - lava_callback - INFO - Starting async job submit for node 68d408e4cd36afa834e16d21 2025-09-26 15:06:26,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:06:26,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408e4cd36afa834e16d21 HTTP/1.1" 200 None 2025-09-26 15:06:26,286 - lava_callback - DEBUG - Processing node 68d408e4cd36afa834e16d21: baseline-arm 2025-09-26 15:06:26,286 - lava_callback - ERROR - Error processing callback for node 68d408e4cd36afa834e16d21: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:49684 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:06:27,020 - lava_callback - INFO - Received callback for node 68d408e5cd36afa834e16d24 INFO: 172.20.0.1:49690 - "POST /node/68d408e5cd36afa834e16d24 HTTP/1.0" 202 Accepted 2025-09-26 15:06:27,026 - lava_callback - INFO - Starting async job submit for node 68d408e5cd36afa834e16d24 2025-09-26 15:06:27,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:06:27,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408e5cd36afa834e16d24 HTTP/1.1" 200 None 2025-09-26 15:06:27,039 - lava_callback - DEBUG - Processing node 68d408e5cd36afa834e16d24: baseline-arm 2025-09-26 15:06:27,039 - lava_callback - ERROR - Error processing callback for node 68d408e5cd36afa834e16d24: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:06:27,786 - lava_callback - INFO - Received callback for node 68d408eecd36afa834e16d2d INFO: 172.20.0.1:49692 - "POST /node/68d408eecd36afa834e16d2d HTTP/1.0" 202 Accepted 2025-09-26 15:06:27,791 - lava_callback - INFO - Starting async job submit for node 68d408eecd36afa834e16d2d 2025-09-26 15:06:27,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:06:27,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408eecd36afa834e16d2d HTTP/1.1" 200 None 2025-09-26 15:06:27,807 - lava_callback - DEBUG - Processing node 68d408eecd36afa834e16d2d: baseline-arm 2025-09-26 15:06:27,807 - lava_callback - ERROR - Error processing callback for node 68d408eecd36afa834e16d2d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:49694 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:06:28,537 - lava_callback - INFO - Received callback for node 68d408f0cd36afa834e16d30 INFO: 172.20.0.1:49710 - "POST /node/68d408f0cd36afa834e16d30 HTTP/1.0" 202 Accepted 2025-09-26 15:06:28,542 - lava_callback - INFO - Starting async job submit for node 68d408f0cd36afa834e16d30 2025-09-26 15:06:28,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:06:28,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408f0cd36afa834e16d30 HTTP/1.1" 200 None 2025-09-26 15:06:28,560 - lava_callback - DEBUG - Processing node 68d408f0cd36afa834e16d30: baseline-arm 2025-09-26 15:06:28,560 - lava_callback - ERROR - Error processing callback for node 68d408f0cd36afa834e16d30: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:42324 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:06:43,743 - lava_callback - INFO - Received callback for node 68d693d22f83206171a91db8 INFO: 172.20.0.1:55906 - "POST /node/68d693d22f83206171a91db8 HTTP/1.0" 202 Accepted 2025-09-26 15:06:43,749 - lava_callback - INFO - Starting async job submit for node 68d693d22f83206171a91db8 2025-09-26 15:06:43,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:06:43,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693d22f83206171a91db8 HTTP/1.1" 200 None 2025-09-26 15:06:43,782 - lava_callback - DEBUG - Processing node 68d693d22f83206171a91db8: baseline-arm64 2025-09-26 15:06:44,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:06:44,175 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:06:44,175 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693d22f83206171a91db8/log.txt.gz 2025-09-26 15:06:44,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:06:44,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:06:44,299 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693d22f83206171a91db8/lava_callback.json.gz 2025-09-26 15:06:44,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:06:44,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693d22f83206171a91db8 HTTP/1.1" 200 None 2025-09-26 15:06:44,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:06:44,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 15:06:44,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:06:44,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693d22f83206171a91db8 HTTP/1.1" 200 None 2025-09-26 15:06:44,420 - lava_callback - INFO - Completed processing callback for node 68d693d22f83206171a91db8 2025-09-26 15:06:45,989 - lava_callback - INFO - Received callback for node 68d42a3ea5c2c05277bc78d3 INFO: 172.20.0.1:55908 - "POST /node/68d42a3ea5c2c05277bc78d3 HTTP/1.0" 202 Accepted 2025-09-26 15:06:45,995 - lava_callback - INFO - Starting async job submit for node 68d42a3ea5c2c05277bc78d3 2025-09-26 15:06:46,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:06:46,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42a3ea5c2c05277bc78d3 HTTP/1.1" 200 None 2025-09-26 15:06:46,045 - lava_callback - DEBUG - Processing node 68d42a3ea5c2c05277bc78d3: baseline-arm 2025-09-26 15:06:46,265 - lava_callback - ERROR - Error processing callback for node 68d42a3ea5c2c05277bc78d3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:55910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47954 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:07:17,097 - lava_callback - INFO - Received callback for node 68d40b9bcd36afa834e17097 INFO: 172.20.0.1:47960 - "POST /node/68d40b9bcd36afa834e17097 HTTP/1.0" 202 Accepted 2025-09-26 15:07:17,105 - lava_callback - INFO - Starting async job submit for node 68d40b9bcd36afa834e17097 2025-09-26 15:07:17,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:07:17,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40b9bcd36afa834e17097 HTTP/1.1" 200 None 2025-09-26 15:07:17,217 - lava_callback - DEBUG - Processing node 68d40b9bcd36afa834e17097: ltp-containers 2025-09-26 15:07:18,005 - lava_callback - ERROR - Error processing callback for node 68d40b9bcd36afa834e17097: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:52774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52780 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:07:30,662 - lava_callback - INFO - Received callback for node 68d6948d2f83206171a91eb0 INFO: 172.20.0.1:56614 - "POST /node/68d6948d2f83206171a91eb0 HTTP/1.0" 202 Accepted 2025-09-26 15:07:30,668 - lava_callback - INFO - Starting async job submit for node 68d6948d2f83206171a91eb0 2025-09-26 15:07:30,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:07:30,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6948d2f83206171a91eb0 HTTP/1.1" 200 None 2025-09-26 15:07:30,701 - lava_callback - DEBUG - Processing node 68d6948d2f83206171a91eb0: baseline-arm64 2025-09-26 15:07:31,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:07:31,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:07:31,247 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6948d2f83206171a91eb0/log.txt.gz 2025-09-26 15:07:31,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:07:31,398 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:07:31,399 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6948d2f83206171a91eb0/lava_callback.json.gz 2025-09-26 15:07:31,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:07:31,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6948d2f83206171a91eb0 HTTP/1.1" 200 None 2025-09-26 15:07:31,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:07:31,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 15:07:31,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:07:31,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6948d2f83206171a91eb0 HTTP/1.1" 200 None 2025-09-26 15:07:31,474 - lava_callback - INFO - Completed processing callback for node 68d6948d2f83206171a91eb0 INFO: 172.20.0.1:56624 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:07:37,823 - lava_callback - INFO - Received callback for node 68d6a7642f83206171a9250e INFO: 172.20.0.1:56626 - "POST /node/68d6a7642f83206171a9250e HTTP/1.0" 202 Accepted 2025-09-26 15:07:37,828 - lava_callback - INFO - Starting async job submit for node 68d6a7642f83206171a9250e 2025-09-26 15:07:37,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:07:37,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7642f83206171a9250e HTTP/1.1" 200 None 2025-09-26 15:07:37,884 - lava_callback - DEBUG - Processing node 68d6a7642f83206171a9250e: baseline-arm64-broonie 2025-09-26 15:07:38,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:07:38,283 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:07:38,284 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a7642f83206171a9250e/log.txt.gz 2025-09-26 15:07:38,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:07:38,414 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:07:38,415 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a7642f83206171a9250e/lava_callback.json.gz 2025-09-26 15:07:38,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:07:38,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7642f83206171a9250e HTTP/1.1" 200 None 2025-09-26 15:07:38,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:07:38,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 15:07:38,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:07:38,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7642f83206171a9250e HTTP/1.1" 200 None 2025-09-26 15:07:38,490 - lava_callback - INFO - Completed processing callback for node 68d6a7642f83206171a9250e 2025-09-26 15:07:43,764 - lava_callback - INFO - Received callback for node 68d693d42f83206171a91dbb INFO: 172.20.0.1:44310 - "POST /node/68d693d42f83206171a91dbb HTTP/1.0" 202 Accepted 2025-09-26 15:07:43,770 - lava_callback - INFO - Starting async job submit for node 68d693d42f83206171a91dbb 2025-09-26 15:07:43,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:07:43,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693d42f83206171a91dbb HTTP/1.1" 200 None 2025-09-26 15:07:43,802 - lava_callback - DEBUG - Processing node 68d693d42f83206171a91dbb: baseline-arm64 2025-09-26 15:07:44,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:07:44,175 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:07:44,176 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693d42f83206171a91dbb/log.txt.gz 2025-09-26 15:07:44,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:07:44,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:07:44,311 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693d42f83206171a91dbb/lava_callback.json.gz 2025-09-26 15:07:44,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:07:44,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693d42f83206171a91dbb HTTP/1.1" 200 None 2025-09-26 15:07:44,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:07:44,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 15:07:44,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:07:44,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693d42f83206171a91dbb HTTP/1.1" 200 None 2025-09-26 15:07:44,385 - lava_callback - INFO - Completed processing callback for node 68d693d42f83206171a91dbb 2025-09-26 15:07:46,252 - lava_callback - INFO - Received callback for node 68d4093acd36afa834e16d93 INFO: 172.20.0.1:44320 - "POST /node/68d4093acd36afa834e16d93 HTTP/1.0" 202 Accepted 2025-09-26 15:07:46,257 - lava_callback - INFO - Starting async job submit for node 68d4093acd36afa834e16d93 2025-09-26 15:07:46,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:07:46,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4093acd36afa834e16d93 HTTP/1.1" 200 None 2025-09-26 15:07:46,270 - lava_callback - DEBUG - Processing node 68d4093acd36afa834e16d93: baseline-arm 2025-09-26 15:07:46,270 - lava_callback - ERROR - Error processing callback for node 68d4093acd36afa834e16d93: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:44328 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:07:46,944 - lava_callback - INFO - Received callback for node 68d4093ccd36afa834e16d96 INFO: 172.20.0.1:44332 - "POST /node/68d4093ccd36afa834e16d96 HTTP/1.0" 202 Accepted 2025-09-26 15:07:46,949 - lava_callback - INFO - Starting async job submit for node 68d4093ccd36afa834e16d96 2025-09-26 15:07:46,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:07:46,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4093ccd36afa834e16d96 HTTP/1.1" 200 None 2025-09-26 15:07:46,962 - lava_callback - DEBUG - Processing node 68d4093ccd36afa834e16d96: baseline-arm 2025-09-26 15:07:46,962 - lava_callback - ERROR - Error processing callback for node 68d4093ccd36afa834e16d96: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:07:47,659 - lava_callback - INFO - Received callback for node 68d40940cd36afa834e16d99 INFO: 172.20.0.1:44338 - "POST /node/68d40940cd36afa834e16d99 HTTP/1.0" 202 Accepted 2025-09-26 15:07:47,665 - lava_callback - INFO - Starting async job submit for node 68d40940cd36afa834e16d99 2025-09-26 15:07:47,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:07:47,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40940cd36afa834e16d99 HTTP/1.1" 200 None 2025-09-26 15:07:47,679 - lava_callback - DEBUG - Processing node 68d40940cd36afa834e16d99: baseline-arm 2025-09-26 15:07:47,679 - lava_callback - ERROR - Error processing callback for node 68d40940cd36afa834e16d99: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:07:48,393 - lava_callback - INFO - Received callback for node 68d40940cd36afa834e16d9c INFO: 172.20.0.1:44344 - "POST /node/68d40940cd36afa834e16d9c HTTP/1.0" 202 Accepted 2025-09-26 15:07:48,398 - lava_callback - INFO - Starting async job submit for node 68d40940cd36afa834e16d9c 2025-09-26 15:07:48,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:07:48,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40940cd36afa834e16d9c HTTP/1.1" 200 None 2025-09-26 15:07:48,436 - lava_callback - DEBUG - Processing node 68d40940cd36afa834e16d9c: baseline-arm 2025-09-26 15:07:48,436 - lava_callback - ERROR - Error processing callback for node 68d40940cd36afa834e16d9c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:58102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49852 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:08:06,547 - lava_callback - INFO - Received callback for node 68d40942cd36afa834e16d9f INFO: 172.20.0.1:49868 - "POST /node/68d40942cd36afa834e16d9f HTTP/1.0" 202 Accepted 2025-09-26 15:08:06,553 - lava_callback - INFO - Starting async job submit for node 68d40942cd36afa834e16d9f 2025-09-26 15:08:06,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:06,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40942cd36afa834e16d9f HTTP/1.1" 200 None 2025-09-26 15:08:06,566 - lava_callback - DEBUG - Processing node 68d40942cd36afa834e16d9f: baseline-arm 2025-09-26 15:08:06,566 - lava_callback - ERROR - Error processing callback for node 68d40942cd36afa834e16d9f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:08:07,246 - lava_callback - INFO - Received callback for node 68d40942cd36afa834e16da2 INFO: 172.20.0.1:49882 - "POST /node/68d40942cd36afa834e16da2 HTTP/1.0" 202 Accepted 2025-09-26 15:08:07,251 - lava_callback - INFO - Starting async job submit for node 68d40942cd36afa834e16da2 2025-09-26 15:08:07,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:07,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40942cd36afa834e16da2 HTTP/1.1" 200 None 2025-09-26 15:08:07,288 - lava_callback - DEBUG - Processing node 68d40942cd36afa834e16da2: baseline-arm 2025-09-26 15:08:07,288 - lava_callback - ERROR - Error processing callback for node 68d40942cd36afa834e16da2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:08:07,956 - lava_callback - INFO - Received callback for node 68d40944cd36afa834e16da5 INFO: 172.20.0.1:49890 - "POST /node/68d40944cd36afa834e16da5 HTTP/1.0" 202 Accepted 2025-09-26 15:08:07,962 - lava_callback - INFO - Starting async job submit for node 68d40944cd36afa834e16da5 2025-09-26 15:08:07,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:07,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40944cd36afa834e16da5 HTTP/1.1" 200 None 2025-09-26 15:08:07,975 - lava_callback - DEBUG - Processing node 68d40944cd36afa834e16da5: baseline-arm 2025-09-26 15:08:07,975 - lava_callback - ERROR - Error processing callback for node 68d40944cd36afa834e16da5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:08:08,692 - lava_callback - INFO - Received callback for node 68d40947cd36afa834e16da8 INFO: 172.20.0.1:49892 - "POST /node/68d40947cd36afa834e16da8 HTTP/1.0" 202 Accepted 2025-09-26 15:08:08,697 - lava_callback - INFO - Starting async job submit for node 68d40947cd36afa834e16da8 2025-09-26 15:08:08,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:08,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40947cd36afa834e16da8 HTTP/1.1" 200 None 2025-09-26 15:08:08,710 - lava_callback - DEBUG - Processing node 68d40947cd36afa834e16da8: baseline-arm 2025-09-26 15:08:08,710 - lava_callback - ERROR - Error processing callback for node 68d40947cd36afa834e16da8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:08:09,447 - lava_callback - INFO - Received callback for node 68d4094acd36afa834e16dab INFO: 172.20.0.1:50724 - "POST /node/68d4094acd36afa834e16dab HTTP/1.0" 202 Accepted 2025-09-26 15:08:09,453 - lava_callback - INFO - Starting async job submit for node 68d4094acd36afa834e16dab 2025-09-26 15:08:09,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:09,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4094acd36afa834e16dab HTTP/1.1" 200 None 2025-09-26 15:08:09,477 - lava_callback - DEBUG - Processing node 68d4094acd36afa834e16dab: baseline-arm 2025-09-26 15:08:09,477 - lava_callback - ERROR - Error processing callback for node 68d4094acd36afa834e16dab: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:08:10,148 - lava_callback - INFO - Received callback for node 68d4094bcd36afa834e16dae INFO: 172.20.0.1:50736 - "POST /node/68d4094bcd36afa834e16dae HTTP/1.0" 202 Accepted 2025-09-26 15:08:10,154 - lava_callback - INFO - Starting async job submit for node 68d4094bcd36afa834e16dae 2025-09-26 15:08:10,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:10,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4094bcd36afa834e16dae HTTP/1.1" 200 None 2025-09-26 15:08:10,167 - lava_callback - DEBUG - Processing node 68d4094bcd36afa834e16dae: baseline-arm 2025-09-26 15:08:10,168 - lava_callback - ERROR - Error processing callback for node 68d4094bcd36afa834e16dae: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:08:10,866 - lava_callback - INFO - Received callback for node 68d4094dcd36afa834e16db1 INFO: 172.20.0.1:50742 - "POST /node/68d4094dcd36afa834e16db1 HTTP/1.0" 202 Accepted 2025-09-26 15:08:10,871 - lava_callback - INFO - Starting async job submit for node 68d4094dcd36afa834e16db1 2025-09-26 15:08:10,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:10,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4094dcd36afa834e16db1 HTTP/1.1" 200 None 2025-09-26 15:08:10,885 - lava_callback - DEBUG - Processing node 68d4094dcd36afa834e16db1: baseline-arm 2025-09-26 15:08:10,885 - lava_callback - ERROR - Error processing callback for node 68d4094dcd36afa834e16db1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:08:11,596 - lava_callback - INFO - Received callback for node 68d4094fcd36afa834e16db4 INFO: 172.20.0.1:50756 - "POST /node/68d4094fcd36afa834e16db4 HTTP/1.0" 202 Accepted 2025-09-26 15:08:11,601 - lava_callback - INFO - Starting async job submit for node 68d4094fcd36afa834e16db4 2025-09-26 15:08:11,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:11,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4094fcd36afa834e16db4 HTTP/1.1" 200 None 2025-09-26 15:08:11,615 - lava_callback - DEBUG - Processing node 68d4094fcd36afa834e16db4: baseline-arm 2025-09-26 15:08:11,615 - lava_callback - ERROR - Error processing callback for node 68d4094fcd36afa834e16db4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:08:11,641 - lava_callback - INFO - Received callback for node 68d6958a2f83206171a920d0 INFO: 172.20.0.1:50764 - "POST /node/68d6958a2f83206171a920d0 HTTP/1.0" 202 Accepted 2025-09-26 15:08:11,648 - lava_callback - INFO - Starting async job submit for node 68d6958a2f83206171a920d0 2025-09-26 15:08:11,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:11,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6958a2f83206171a920d0 HTTP/1.1" 200 None 2025-09-26 15:08:11,723 - lava_callback - DEBUG - Processing node 68d6958a2f83206171a920d0: baseline-arm64 2025-09-26 15:08:12,345 - lava_callback - INFO - Received callback for node 68d40953cd36afa834e16db7 INFO: 172.20.0.1:50776 - "POST /node/68d40953cd36afa834e16db7 HTTP/1.0" 202 Accepted 2025-09-26 15:08:12,361 - lava_callback - INFO - Starting async job submit for node 68d40953cd36afa834e16db7 2025-09-26 15:08:12,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:12,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40953cd36afa834e16db7 HTTP/1.1" 200 None 2025-09-26 15:08:12,453 - lava_callback - DEBUG - Processing node 68d40953cd36afa834e16db7: baseline-arm 2025-09-26 15:08:12,453 - lava_callback - ERROR - Error processing callback for node 68d40953cd36afa834e16db7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:08:12,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:08:12,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:08:12,969 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6958a2f83206171a920d0/log.txt.gz 2025-09-26 15:08:12,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:08:13,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:08:13,159 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6958a2f83206171a920d0/lava_callback.json.gz DEBUG: Setup failed for 68d6958a2f83206171a920d0. Transitting job node result: incomplete -> fail 2025-09-26 15:08:13,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:13,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6958a2f83206171a920d0 HTTP/1.1" 200 None 2025-09-26 15:08:13,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:13,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 15:08:13,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:13,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6958a2f83206171a920d0 HTTP/1.1" 200 None 2025-09-26 15:08:13,321 - lava_callback - INFO - Completed processing callback for node 68d6958a2f83206171a920d0 INFO: 172.20.0.1:50780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50782 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:08:19,908 - lava_callback - INFO - Received callback for node 68d6a76f2f83206171a9251a INFO: 172.20.0.1:59424 - "POST /node/68d6a76f2f83206171a9251a HTTP/1.0" 202 Accepted 2025-09-26 15:08:19,914 - lava_callback - INFO - Starting async job submit for node 68d6a76f2f83206171a9251a 2025-09-26 15:08:19,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:19,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a76f2f83206171a9251a HTTP/1.1" 200 None 2025-09-26 15:08:19,958 - lava_callback - DEBUG - Processing node 68d6a76f2f83206171a9251a: baseline-arm64-broonie 2025-09-26 15:08:20,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:08:20,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:08:20,353 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a76f2f83206171a9251a/log.txt.gz 2025-09-26 15:08:20,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:08:20,478 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:08:20,478 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a76f2f83206171a9251a/lava_callback.json.gz 2025-09-26 15:08:20,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:20,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a76f2f83206171a9251a HTTP/1.1" 200 None 2025-09-26 15:08:20,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:20,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 15:08:20,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:20,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a76f2f83206171a9251a HTTP/1.1" 200 None 2025-09-26 15:08:20,562 - lava_callback - INFO - Completed processing callback for node 68d6a76f2f83206171a9251a INFO: 172.20.0.1:59440 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:08:26,256 - lava_callback - INFO - Received callback for node 68d4095ecd36afa834e16dc6 INFO: 172.20.0.1:59450 - "POST /node/68d4095ecd36afa834e16dc6 HTTP/1.0" 202 Accepted 2025-09-26 15:08:26,261 - lava_callback - INFO - Starting async job submit for node 68d4095ecd36afa834e16dc6 2025-09-26 15:08:26,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:26,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4095ecd36afa834e16dc6 HTTP/1.1" 200 None 2025-09-26 15:08:26,274 - lava_callback - DEBUG - Processing node 68d4095ecd36afa834e16dc6: baseline-arm64 2025-09-26 15:08:26,274 - lava_callback - ERROR - Error processing callback for node 68d4095ecd36afa834e16dc6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:59464 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:08:26,950 - lava_callback - INFO - Received callback for node 68d40961cd36afa834e16dc9 INFO: 172.20.0.1:59478 - "POST /node/68d40961cd36afa834e16dc9 HTTP/1.0" 202 Accepted 2025-09-26 15:08:26,955 - lava_callback - INFO - Starting async job submit for node 68d40961cd36afa834e16dc9 2025-09-26 15:08:26,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:26,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40961cd36afa834e16dc9 HTTP/1.1" 200 None 2025-09-26 15:08:26,968 - lava_callback - DEBUG - Processing node 68d40961cd36afa834e16dc9: baseline-arm64 2025-09-26 15:08:26,968 - lava_callback - ERROR - Error processing callback for node 68d40961cd36afa834e16dc9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:08:27,647 - lava_callback - INFO - Received callback for node 68d40962cd36afa834e16dcc INFO: 172.20.0.1:59488 - "POST /node/68d40962cd36afa834e16dcc HTTP/1.0" 202 Accepted 2025-09-26 15:08:27,652 - lava_callback - INFO - Starting async job submit for node 68d40962cd36afa834e16dcc 2025-09-26 15:08:27,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:27,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40962cd36afa834e16dcc HTTP/1.1" 200 None 2025-09-26 15:08:27,675 - lava_callback - DEBUG - Processing node 68d40962cd36afa834e16dcc: baseline-arm64 2025-09-26 15:08:27,675 - lava_callback - ERROR - Error processing callback for node 68d40962cd36afa834e16dcc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:08:28,367 - lava_callback - INFO - Received callback for node 68d40954cd36afa834e16dba INFO: 172.20.0.1:59498 - "POST /node/68d40954cd36afa834e16dba HTTP/1.0" 202 Accepted 2025-09-26 15:08:28,372 - lava_callback - INFO - Starting async job submit for node 68d40954cd36afa834e16dba 2025-09-26 15:08:28,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:28,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40954cd36afa834e16dba HTTP/1.1" 200 None 2025-09-26 15:08:28,389 - lava_callback - DEBUG - Processing node 68d40954cd36afa834e16dba: baseline-arm 2025-09-26 15:08:28,390 - lava_callback - ERROR - Error processing callback for node 68d40954cd36afa834e16dba: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:59514 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:08:29,090 - lava_callback - INFO - Received callback for node 68d40958cd36afa834e16dbd INFO: 172.20.0.1:59518 - "POST /node/68d40958cd36afa834e16dbd HTTP/1.0" 202 Accepted 2025-09-26 15:08:29,095 - lava_callback - INFO - Starting async job submit for node 68d40958cd36afa834e16dbd 2025-09-26 15:08:29,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:29,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40958cd36afa834e16dbd HTTP/1.1" 200 None 2025-09-26 15:08:29,109 - lava_callback - DEBUG - Processing node 68d40958cd36afa834e16dbd: baseline-arm 2025-09-26 15:08:29,109 - lava_callback - ERROR - Error processing callback for node 68d40958cd36afa834e16dbd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:08:29,800 - lava_callback - INFO - Received callback for node 68d40959cd36afa834e16dc0 INFO: 172.20.0.1:57936 - "POST /node/68d40959cd36afa834e16dc0 HTTP/1.0" 202 Accepted 2025-09-26 15:08:29,805 - lava_callback - INFO - Starting async job submit for node 68d40959cd36afa834e16dc0 2025-09-26 15:08:29,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:29,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40959cd36afa834e16dc0 HTTP/1.1" 200 None 2025-09-26 15:08:29,835 - lava_callback - DEBUG - Processing node 68d40959cd36afa834e16dc0: baseline-arm 2025-09-26 15:08:29,835 - lava_callback - ERROR - Error processing callback for node 68d40959cd36afa834e16dc0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:08:31,460 - lava_callback - INFO - Received callback for node 68d6abc42f83206171a9275e INFO: 172.20.0.1:57940 - "POST /node/68d6abc42f83206171a9275e HTTP/1.0" 202 Accepted 2025-09-26 15:08:31,465 - lava_callback - INFO - Starting async job submit for node 68d6abc42f83206171a9275e 2025-09-26 15:08:31,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:31,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6abc42f83206171a9275e HTTP/1.1" 200 None 2025-09-26 15:08:31,501 - lava_callback - DEBUG - Processing node 68d6abc42f83206171a9275e: baseline-arm64-broonie 2025-09-26 15:08:31,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:08:31,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:08:31,908 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6abc42f83206171a9275e/log.txt.gz 2025-09-26 15:08:31,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:08:32,061 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:08:32,061 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6abc42f83206171a9275e/lava_callback.json.gz 2025-09-26 15:08:32,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:32,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6abc42f83206171a9275e HTTP/1.1" 200 None 2025-09-26 15:08:32,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:32,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 15:08:32,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:32,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6abc42f83206171a9275e HTTP/1.1" 200 None 2025-09-26 15:08:32,140 - lava_callback - INFO - Completed processing callback for node 68d6abc42f83206171a9275e INFO: 172.20.0.1:57944 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:08:43,331 - lava_callback - INFO - Received callback for node 68d693d52f83206171a91dbe INFO: 172.20.0.1:38050 - "POST /node/68d693d52f83206171a91dbe HTTP/1.0" 202 Accepted 2025-09-26 15:08:43,337 - lava_callback - INFO - Starting async job submit for node 68d693d52f83206171a91dbe 2025-09-26 15:08:43,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:43,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693d52f83206171a91dbe HTTP/1.1" 200 None 2025-09-26 15:08:43,370 - lava_callback - DEBUG - Processing node 68d693d52f83206171a91dbe: baseline-arm64 2025-09-26 15:08:43,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:08:43,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:08:43,788 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693d52f83206171a91dbe/log.txt.gz 2025-09-26 15:08:43,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:08:43,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:08:43,923 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d693d52f83206171a91dbe/lava_callback.json.gz 2025-09-26 15:08:43,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:43,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693d52f83206171a91dbe HTTP/1.1" 200 None 2025-09-26 15:08:43,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:43,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 15:08:43,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:44,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693d52f83206171a91dbe HTTP/1.1" 200 None 2025-09-26 15:08:44,024 - lava_callback - INFO - Completed processing callback for node 68d693d52f83206171a91dbe 2025-09-26 15:08:44,907 - lava_callback - INFO - Received callback for node 68d6948e2f83206171a91eb3 INFO: 172.20.0.1:38062 - "POST /node/68d6948e2f83206171a91eb3 HTTP/1.0" 202 Accepted 2025-09-26 15:08:44,913 - lava_callback - INFO - Starting async job submit for node 68d6948e2f83206171a91eb3 2025-09-26 15:08:44,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:44,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6948e2f83206171a91eb3 HTTP/1.1" 200 None 2025-09-26 15:08:44,947 - lava_callback - DEBUG - Processing node 68d6948e2f83206171a91eb3: baseline-arm64 2025-09-26 15:08:45,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:08:45,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:08:45,474 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6948e2f83206171a91eb3/log.txt.gz 2025-09-26 15:08:45,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:08:45,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:08:45,606 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6948e2f83206171a91eb3/lava_callback.json.gz 2025-09-26 15:08:45,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:45,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6948e2f83206171a91eb3 HTTP/1.1" 200 None 2025-09-26 15:08:45,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:45,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 15:08:45,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:45,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6948e2f83206171a91eb3 HTTP/1.1" 200 None 2025-09-26 15:08:45,723 - lava_callback - INFO - Completed processing callback for node 68d6948e2f83206171a91eb3 2025-09-26 15:08:46,307 - lava_callback - INFO - Received callback for node 68d40966cd36afa834e16dcf INFO: 172.20.0.1:38070 - "POST /node/68d40966cd36afa834e16dcf HTTP/1.0" 202 Accepted 2025-09-26 15:08:46,313 - lava_callback - INFO - Starting async job submit for node 68d40966cd36afa834e16dcf 2025-09-26 15:08:46,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:46,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40966cd36afa834e16dcf HTTP/1.1" 200 None 2025-09-26 15:08:46,327 - lava_callback - DEBUG - Processing node 68d40966cd36afa834e16dcf: baseline-arm 2025-09-26 15:08:46,327 - lava_callback - ERROR - Error processing callback for node 68d40966cd36afa834e16dcf: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:38076 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:08:47,019 - lava_callback - INFO - Received callback for node 68d40969cd36afa834e16dd3 INFO: 172.20.0.1:38082 - "POST /node/68d40969cd36afa834e16dd3 HTTP/1.0" 202 Accepted 2025-09-26 15:08:47,025 - lava_callback - INFO - Starting async job submit for node 68d40969cd36afa834e16dd3 2025-09-26 15:08:47,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:47,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40969cd36afa834e16dd3 HTTP/1.1" 200 None 2025-09-26 15:08:47,039 - lava_callback - DEBUG - Processing node 68d40969cd36afa834e16dd3: baseline-arm 2025-09-26 15:08:47,039 - lava_callback - ERROR - Error processing callback for node 68d40969cd36afa834e16dd3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:08:47,727 - lava_callback - INFO - Received callback for node 68d4096bcd36afa834e16dd6 INFO: 172.20.0.1:38090 - "POST /node/68d4096bcd36afa834e16dd6 HTTP/1.0" 202 Accepted 2025-09-26 15:08:47,734 - lava_callback - INFO - Starting async job submit for node 68d4096bcd36afa834e16dd6 2025-09-26 15:08:47,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:47,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4096bcd36afa834e16dd6 HTTP/1.1" 200 None 2025-09-26 15:08:47,747 - lava_callback - DEBUG - Processing node 68d4096bcd36afa834e16dd6: baseline-arm 2025-09-26 15:08:47,747 - lava_callback - ERROR - Error processing callback for node 68d4096bcd36afa834e16dd6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:08:48,499 - lava_callback - INFO - Received callback for node 68d4096ccd36afa834e16dd9 INFO: 172.20.0.1:38094 - "POST /node/68d4096ccd36afa834e16dd9 HTTP/1.0" 202 Accepted 2025-09-26 15:08:48,505 - lava_callback - INFO - Starting async job submit for node 68d4096ccd36afa834e16dd9 2025-09-26 15:08:48,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:48,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4096ccd36afa834e16dd9 HTTP/1.1" 200 None 2025-09-26 15:08:48,518 - lava_callback - DEBUG - Processing node 68d4096ccd36afa834e16dd9: baseline-arm 2025-09-26 15:08:48,518 - lava_callback - ERROR - Error processing callback for node 68d4096ccd36afa834e16dd9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:08:49,212 - lava_callback - INFO - Received callback for node 68d4096ecd36afa834e16ddc INFO: 172.20.0.1:38096 - "POST /node/68d4096ecd36afa834e16ddc HTTP/1.0" 202 Accepted 2025-09-26 15:08:49,219 - lava_callback - INFO - Starting async job submit for node 68d4096ecd36afa834e16ddc 2025-09-26 15:08:49,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:49,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4096ecd36afa834e16ddc HTTP/1.1" 200 None 2025-09-26 15:08:49,232 - lava_callback - DEBUG - Processing node 68d4096ecd36afa834e16ddc: baseline-arm 2025-09-26 15:08:49,233 - lava_callback - ERROR - Error processing callback for node 68d4096ecd36afa834e16ddc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:08:49,944 - lava_callback - INFO - Received callback for node 68d4096ecd36afa834e16ddf INFO: 172.20.0.1:38144 - "POST /node/68d4096ecd36afa834e16ddf HTTP/1.0" 202 Accepted 2025-09-26 15:08:49,949 - lava_callback - INFO - Starting async job submit for node 68d4096ecd36afa834e16ddf 2025-09-26 15:08:49,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:49,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4096ecd36afa834e16ddf HTTP/1.1" 200 None 2025-09-26 15:08:49,962 - lava_callback - DEBUG - Processing node 68d4096ecd36afa834e16ddf: baseline-arm 2025-09-26 15:08:49,963 - lava_callback - ERROR - Error processing callback for node 68d4096ecd36afa834e16ddf: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:08:50,697 - lava_callback - INFO - Received callback for node 68d40970cd36afa834e16de2 INFO: 172.20.0.1:38156 - "POST /node/68d40970cd36afa834e16de2 HTTP/1.0" 202 Accepted 2025-09-26 15:08:50,702 - lava_callback - INFO - Starting async job submit for node 68d40970cd36afa834e16de2 2025-09-26 15:08:50,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:50,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40970cd36afa834e16de2 HTTP/1.1" 200 None 2025-09-26 15:08:50,716 - lava_callback - DEBUG - Processing node 68d40970cd36afa834e16de2: baseline-arm 2025-09-26 15:08:50,716 - lava_callback - ERROR - Error processing callback for node 68d40970cd36afa834e16de2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:08:51,437 - lava_callback - INFO - Received callback for node 68d40972cd36afa834e16de5 INFO: 172.20.0.1:38158 - "POST /node/68d40972cd36afa834e16de5 HTTP/1.0" 202 Accepted 2025-09-26 15:08:51,442 - lava_callback - INFO - Starting async job submit for node 68d40972cd36afa834e16de5 2025-09-26 15:08:51,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:51,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40972cd36afa834e16de5 HTTP/1.1" 200 None 2025-09-26 15:08:51,456 - lava_callback - DEBUG - Processing node 68d40972cd36afa834e16de5: baseline-arm 2025-09-26 15:08:51,456 - lava_callback - ERROR - Error processing callback for node 68d40972cd36afa834e16de5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:08:56,478 - lava_callback - INFO - Received callback for node 68d694a92f83206171a91eea INFO: 172.20.0.1:38162 - "POST /node/68d694a92f83206171a91eea HTTP/1.0" 202 Accepted 2025-09-26 15:08:56,483 - lava_callback - INFO - Starting async job submit for node 68d694a92f83206171a91eea 2025-09-26 15:08:56,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:56,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694a92f83206171a91eea HTTP/1.1" 200 None 2025-09-26 15:08:56,519 - lava_callback - DEBUG - Processing node 68d694a92f83206171a91eea: baseline-arm64 INFO: 172.20.0.1:38166 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:08:56,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:08:57,062 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:08:57,063 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694a92f83206171a91eea/log.txt.gz 2025-09-26 15:08:57,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:08:57,186 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:08:57,187 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694a92f83206171a91eea/lava_callback.json.gz 2025-09-26 15:08:57,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:57,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694a92f83206171a91eea HTTP/1.1" 200 None 2025-09-26 15:08:57,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:57,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 15:08:57,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:57,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694a92f83206171a91eea HTTP/1.1" 200 None 2025-09-26 15:08:57,282 - lava_callback - INFO - Completed processing callback for node 68d694a92f83206171a91eea 2025-09-26 15:08:59,453 - lava_callback - INFO - Received callback for node 68d6aa842f83206171a9272e INFO: 172.20.0.1:44734 - "POST /node/68d6aa842f83206171a9272e HTTP/1.0" 202 Accepted 2025-09-26 15:08:59,459 - lava_callback - INFO - Starting async job submit for node 68d6aa842f83206171a9272e 2025-09-26 15:08:59,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:59,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6aa842f83206171a9272e HTTP/1.1" 200 None 2025-09-26 15:08:59,505 - lava_callback - DEBUG - Processing node 68d6aa842f83206171a9272e: baseline-arm64-broonie 2025-09-26 15:08:59,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:08:59,823 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:08:59,824 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6aa842f83206171a9272e/log.txt.gz 2025-09-26 15:08:59,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:08:59,942 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:08:59,943 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6aa842f83206171a9272e/lava_callback.json.gz 2025-09-26 15:08:59,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:08:59,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6aa842f83206171a9272e HTTP/1.1" 200 None 2025-09-26 15:08:59,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:09:00,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 15:09:00,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:09:00,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6aa842f83206171a9272e HTTP/1.1" 200 None 2025-09-26 15:09:00,035 - lava_callback - INFO - Completed processing callback for node 68d6aa842f83206171a9272e 2025-09-26 15:09:04,511 - lava_callback - INFO - Received callback for node 68d42a41a5c2c05277bc78d6 INFO: 172.20.0.1:44748 - "POST /node/68d42a41a5c2c05277bc78d6 HTTP/1.0" 202 Accepted 2025-09-26 15:09:04,517 - lava_callback - INFO - Starting async job submit for node 68d42a41a5c2c05277bc78d6 2025-09-26 15:09:04,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:09:04,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42a41a5c2c05277bc78d6 HTTP/1.1" 200 None 2025-09-26 15:09:04,549 - lava_callback - DEBUG - Processing node 68d42a41a5c2c05277bc78d6: baseline-arm 2025-09-26 15:09:04,769 - lava_callback - ERROR - Error processing callback for node 68d42a41a5c2c05277bc78d6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:44750 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:09:13,769 - lava_callback - INFO - Received callback for node 68d695c52f83206171a92106 INFO: 172.20.0.1:58234 - "POST /node/68d695c52f83206171a92106 HTTP/1.0" 202 Accepted 2025-09-26 15:09:13,776 - lava_callback - INFO - Starting async job submit for node 68d695c52f83206171a92106 2025-09-26 15:09:13,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:09:13,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695c52f83206171a92106 HTTP/1.1" 200 None 2025-09-26 15:09:13,826 - lava_callback - DEBUG - Processing node 68d695c52f83206171a92106: baseline-arm64 2025-09-26 15:09:14,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:09:15,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:09:15,020 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d695c52f83206171a92106/log.txt.gz 2025-09-26 15:09:15,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:58246 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 15:09:15,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:09:15,192 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d695c52f83206171a92106/lava_callback.json.gz DEBUG: Setup failed for 68d695c52f83206171a92106. Transitting job node result: incomplete -> fail 2025-09-26 15:09:15,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:09:15,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d695c52f83206171a92106 HTTP/1.1" 200 None 2025-09-26 15:09:15,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:09:15,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 15:09:15,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:09:15,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d695c52f83206171a92106 HTTP/1.1" 200 None 2025-09-26 15:09:15,321 - lava_callback - INFO - Completed processing callback for node 68d695c52f83206171a92106 INFO: 172.20.0.1:58260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41266 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:09:43,968 - lava_callback - INFO - Received callback for node 68d6949a2f83206171a91ec8 INFO: 172.20.0.1:35486 - "POST /node/68d6949a2f83206171a91ec8 HTTP/1.0" 202 Accepted 2025-09-26 15:09:43,974 - lava_callback - INFO - Starting async job submit for node 68d6949a2f83206171a91ec8 2025-09-26 15:09:43,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:09:44,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6949a2f83206171a91ec8 HTTP/1.1" 200 None 2025-09-26 15:09:44,030 - lava_callback - DEBUG - Processing node 68d6949a2f83206171a91ec8: baseline-arm64 2025-09-26 15:09:44,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:09:44,423 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:09:44,424 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6949a2f83206171a91ec8/log.txt.gz 2025-09-26 15:09:44,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:09:44,557 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:09:44,558 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6949a2f83206171a91ec8/lava_callback.json.gz 2025-09-26 15:09:44,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:09:44,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6949a2f83206171a91ec8 HTTP/1.1" 200 None 2025-09-26 15:09:44,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:09:44,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 15:09:44,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:09:44,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6949a2f83206171a91ec8 HTTP/1.1" 200 None 2025-09-26 15:09:44,645 - lava_callback - INFO - Completed processing callback for node 68d6949a2f83206171a91ec8 INFO: 172.20.0.1:35492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46980 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:10:06,765 - lava_callback - INFO - Received callback for node 68d409c3cd36afa834e16e58 INFO: 172.20.0.1:46984 - "POST /node/68d409c3cd36afa834e16e58 HTTP/1.0" 202 Accepted 2025-09-26 15:10:06,771 - lava_callback - INFO - Starting async job submit for node 68d409c3cd36afa834e16e58 2025-09-26 15:10:06,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:10:06,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d409c3cd36afa834e16e58 HTTP/1.1" 200 None 2025-09-26 15:10:06,820 - lava_callback - DEBUG - Processing node 68d409c3cd36afa834e16e58: baseline-arm64 2025-09-26 15:10:06,820 - lava_callback - ERROR - Error processing callback for node 68d409c3cd36afa834e16e58: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:10:07,529 - lava_callback - INFO - Received callback for node 68d409c4cd36afa834e16e5b INFO: 172.20.0.1:46988 - "POST /node/68d409c4cd36afa834e16e5b HTTP/1.0" 202 Accepted 2025-09-26 15:10:07,535 - lava_callback - INFO - Starting async job submit for node 68d409c4cd36afa834e16e5b 2025-09-26 15:10:07,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:10:07,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d409c4cd36afa834e16e5b HTTP/1.1" 200 None 2025-09-26 15:10:07,548 - lava_callback - DEBUG - Processing node 68d409c4cd36afa834e16e5b: baseline-arm64 2025-09-26 15:10:07,548 - lava_callback - ERROR - Error processing callback for node 68d409c4cd36afa834e16e5b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:10:08,293 - lava_callback - INFO - Received callback for node 68d409c9cd36afa834e16e5e INFO: 172.20.0.1:46996 - "POST /node/68d409c9cd36afa834e16e5e HTTP/1.0" 202 Accepted 2025-09-26 15:10:08,299 - lava_callback - INFO - Starting async job submit for node 68d409c9cd36afa834e16e5e 2025-09-26 15:10:08,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:10:08,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d409c9cd36afa834e16e5e HTTP/1.1" 200 None 2025-09-26 15:10:08,312 - lava_callback - DEBUG - Processing node 68d409c9cd36afa834e16e5e: baseline-arm64 2025-09-26 15:10:08,312 - lava_callback - ERROR - Error processing callback for node 68d409c9cd36afa834e16e5e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:10:09,018 - lava_callback - INFO - Received callback for node 68d409cacd36afa834e16e61 INFO: 172.20.0.1:47002 - "POST /node/68d409cacd36afa834e16e61 HTTP/1.0" 202 Accepted 2025-09-26 15:10:09,024 - lava_callback - INFO - Starting async job submit for node 68d409cacd36afa834e16e61 2025-09-26 15:10:09,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:10:09,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d409cacd36afa834e16e61 HTTP/1.1" 200 None 2025-09-26 15:10:09,044 - lava_callback - DEBUG - Processing node 68d409cacd36afa834e16e61: baseline-arm64 2025-09-26 15:10:09,044 - lava_callback - ERROR - Error processing callback for node 68d409cacd36afa834e16e61: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:10:10,673 - lava_callback - INFO - Received callback for node 68d694aa2f83206171a91eed INFO: 172.20.0.1:39636 - "POST /node/68d694aa2f83206171a91eed HTTP/1.0" 202 Accepted 2025-09-26 15:10:10,679 - lava_callback - INFO - Starting async job submit for node 68d694aa2f83206171a91eed 2025-09-26 15:10:10,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:10:10,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694aa2f83206171a91eed HTTP/1.1" 200 None 2025-09-26 15:10:10,727 - lava_callback - DEBUG - Processing node 68d694aa2f83206171a91eed: baseline-arm64 2025-09-26 15:10:11,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:10:11,314 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:10:11,315 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694aa2f83206171a91eed/log.txt.gz 2025-09-26 15:10:11,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:10:11,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:10:11,460 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694aa2f83206171a91eed/lava_callback.json.gz 2025-09-26 15:10:11,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:10:11,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694aa2f83206171a91eed HTTP/1.1" 200 None 2025-09-26 15:10:11,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:10:11,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 15:10:11,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:10:11,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694aa2f83206171a91eed HTTP/1.1" 200 None 2025-09-26 15:10:11,543 - lava_callback - INFO - Completed processing callback for node 68d694aa2f83206171a91eed INFO: 172.20.0.1:39638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39640 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:10:21,140 - lava_callback - INFO - Received callback for node 68d6a8722f83206171a9266c INFO: 172.20.0.1:50918 - "POST /node/68d6a8722f83206171a9266c HTTP/1.0" 202 Accepted 2025-09-26 15:10:21,146 - lava_callback - INFO - Starting async job submit for node 68d6a8722f83206171a9266c 2025-09-26 15:10:21,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:10:21,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8722f83206171a9266c HTTP/1.1" 200 None 2025-09-26 15:10:21,180 - lava_callback - DEBUG - Processing node 68d6a8722f83206171a9266c: baseline-arm64-broonie 2025-09-26 15:10:21,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:10:21,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:10:21,572 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a8722f83206171a9266c/log.txt.gz 2025-09-26 15:10:21,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:10:21,728 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:10:21,728 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a8722f83206171a9266c/lava_callback.json.gz 2025-09-26 15:10:21,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:10:21,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8722f83206171a9266c HTTP/1.1" 200 None 2025-09-26 15:10:21,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:10:21,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 15:10:21,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:10:21,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8722f83206171a9266c HTTP/1.1" 200 None 2025-09-26 15:10:21,804 - lava_callback - INFO - Completed processing callback for node 68d6a8722f83206171a9266c INFO: 172.20.0.1:50930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51232 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:10:43,392 - lava_callback - INFO - Received callback for node 68d6949a2f83206171a91ecb INFO: 172.20.0.1:39354 - "POST /node/68d6949a2f83206171a91ecb HTTP/1.0" 202 Accepted 2025-09-26 15:10:43,398 - lava_callback - INFO - Starting async job submit for node 68d6949a2f83206171a91ecb 2025-09-26 15:10:43,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:10:43,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6949a2f83206171a91ecb HTTP/1.1" 200 None 2025-09-26 15:10:43,438 - lava_callback - DEBUG - Processing node 68d6949a2f83206171a91ecb: baseline-arm64 2025-09-26 15:10:43,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:10:43,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:10:43,819 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6949a2f83206171a91ecb/log.txt.gz 2025-09-26 15:10:43,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:10:43,926 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:10:43,927 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6949a2f83206171a91ecb/lava_callback.json.gz 2025-09-26 15:10:43,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:10:43,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6949a2f83206171a91ecb HTTP/1.1" 200 None 2025-09-26 15:10:43,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:10:43,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 15:10:43,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:10:44,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6949a2f83206171a91ecb HTTP/1.1" 200 None 2025-09-26 15:10:44,007 - lava_callback - INFO - Completed processing callback for node 68d6949a2f83206171a91ecb INFO: 172.20.0.1:39366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37246 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:11:01,138 - lava_callback - INFO - Received callback for node 68d6a87e2f83206171a92690 INFO: 172.20.0.1:46272 - "POST /node/68d6a87e2f83206171a92690 HTTP/1.0" 202 Accepted 2025-09-26 15:11:01,144 - lava_callback - INFO - Starting async job submit for node 68d6a87e2f83206171a92690 2025-09-26 15:11:01,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:11:01,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a87e2f83206171a92690 HTTP/1.1" 200 None 2025-09-26 15:11:01,183 - lava_callback - DEBUG - Processing node 68d6a87e2f83206171a92690: baseline-arm64-broonie 2025-09-26 15:11:01,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:11:01,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:11:01,541 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a87e2f83206171a92690/log.txt.gz 2025-09-26 15:11:01,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:11:01,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:11:01,662 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a87e2f83206171a92690/lava_callback.json.gz 2025-09-26 15:11:01,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:11:01,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a87e2f83206171a92690 HTTP/1.1" 200 None 2025-09-26 15:11:01,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:11:01,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 15:11:01,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:11:01,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a87e2f83206171a92690 HTTP/1.1" 200 None 2025-09-26 15:11:01,738 - lava_callback - INFO - Completed processing callback for node 68d6a87e2f83206171a92690 2025-09-26 15:11:03,630 - lava_callback - INFO - Received callback for node 68d42a44a5c2c05277bc78d9 INFO: 172.20.0.1:46284 - "POST /node/68d42a44a5c2c05277bc78d9 HTTP/1.0" 202 Accepted 2025-09-26 15:11:03,636 - lava_callback - INFO - Starting async job submit for node 68d42a44a5c2c05277bc78d9 2025-09-26 15:11:03,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:11:03,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42a44a5c2c05277bc78d9 HTTP/1.1" 200 None 2025-09-26 15:11:03,671 - lava_callback - DEBUG - Processing node 68d42a44a5c2c05277bc78d9: baseline-arm 2025-09-26 15:11:03,890 - lava_callback - ERROR - Error processing callback for node 68d42a44a5c2c05277bc78d9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:46300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47426 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:11:18,391 - lava_callback - INFO - Received callback for node 68d6ac8c2f83206171a9279a INFO: 172.20.0.1:47436 - "POST /node/68d6ac8c2f83206171a9279a HTTP/1.0" 202 Accepted 2025-09-26 15:11:18,397 - lava_callback - INFO - Starting async job submit for node 68d6ac8c2f83206171a9279a 2025-09-26 15:11:18,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:11:18,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ac8c2f83206171a9279a HTTP/1.1" 200 None 2025-09-26 15:11:18,441 - lava_callback - DEBUG - Processing node 68d6ac8c2f83206171a9279a: baseline-arm64-broonie 2025-09-26 15:11:18,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:11:18,813 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:11:18,814 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6ac8c2f83206171a9279a/log.txt.gz 2025-09-26 15:11:18,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:11:18,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:11:18,943 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6ac8c2f83206171a9279a/lava_callback.json.gz 2025-09-26 15:11:18,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:11:19,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ac8c2f83206171a9279a HTTP/1.1" 200 None 2025-09-26 15:11:19,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:11:19,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 15:11:19,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:11:19,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ac8c2f83206171a9279a HTTP/1.1" 200 None 2025-09-26 15:11:19,184 - lava_callback - INFO - Completed processing callback for node 68d6ac8c2f83206171a9279a INFO: 172.20.0.1:40894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47762 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:11:40,335 - lava_callback - INFO - Received callback for node 68d689ff2f83206171a9180b INFO: 172.20.0.1:48992 - "POST /node/68d689ff2f83206171a9180b HTTP/1.0" 202 Accepted 2025-09-26 15:11:40,341 - lava_callback - INFO - Starting async job submit for node 68d689ff2f83206171a9180b 2025-09-26 15:11:40,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:11:40,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689ff2f83206171a9180b HTTP/1.1" 200 None 2025-09-26 15:11:40,377 - lava_callback - DEBUG - Processing node 68d689ff2f83206171a9180b: baseline-arm64-broonie 2025-09-26 15:11:40,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:11:40,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:11:40,750 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d689ff2f83206171a9180b/log.txt.gz 2025-09-26 15:11:40,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:11:40,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:11:40,885 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d689ff2f83206171a9180b/lava_callback.json.gz 2025-09-26 15:11:40,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:11:40,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d689ff2f83206171a9180b HTTP/1.1" 200 None 2025-09-26 15:11:40,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:11:40,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 15:11:40,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:11:40,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d689ff2f83206171a9180b HTTP/1.1" 200 None 2025-09-26 15:11:40,974 - lava_callback - INFO - Completed processing callback for node 68d689ff2f83206171a9180b 2025-09-26 15:11:43,994 - lava_callback - INFO - Received callback for node 68d694b62f83206171a91f02 INFO: 172.20.0.1:48994 - "POST /node/68d694b62f83206171a91f02 HTTP/1.0" 202 Accepted 2025-09-26 15:11:44,000 - lava_callback - INFO - Starting async job submit for node 68d694b62f83206171a91f02 2025-09-26 15:11:44,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:11:44,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694b62f83206171a91f02 HTTP/1.1" 200 None 2025-09-26 15:11:44,034 - lava_callback - DEBUG - Processing node 68d694b62f83206171a91f02: baseline-arm64 2025-09-26 15:11:44,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:11:44,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:11:44,396 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694b62f83206171a91f02/log.txt.gz 2025-09-26 15:11:44,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:11:44,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:11:44,553 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694b62f83206171a91f02/lava_callback.json.gz 2025-09-26 15:11:44,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:11:44,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694b62f83206171a91f02 HTTP/1.1" 200 None 2025-09-26 15:11:44,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:11:44,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 15:11:44,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:11:44,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694b62f83206171a91f02 HTTP/1.1" 200 None 2025-09-26 15:11:44,629 - lava_callback - INFO - Completed processing callback for node 68d694b62f83206171a91f02 INFO: 172.20.0.1:49000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45098 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:12:18,006 - lava_callback - INFO - Received callback for node 68d6a76c2f83206171a92517 INFO: 172.20.0.1:45106 - "POST /node/68d6a76c2f83206171a92517 HTTP/1.0" 202 Accepted 2025-09-26 15:12:18,012 - lava_callback - INFO - Starting async job submit for node 68d6a76c2f83206171a92517 2025-09-26 15:12:18,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:18,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a76c2f83206171a92517 HTTP/1.1" 200 None 2025-09-26 15:12:18,049 - lava_callback - DEBUG - Processing node 68d6a76c2f83206171a92517: baseline-arm64-broonie 2025-09-26 15:12:18,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:12:18,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:12:18,418 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a76c2f83206171a92517/log.txt.gz 2025-09-26 15:12:18,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:12:18,555 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:12:18,556 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a76c2f83206171a92517/lava_callback.json.gz 2025-09-26 15:12:18,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:18,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a76c2f83206171a92517 HTTP/1.1" 200 None 2025-09-26 15:12:18,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:18,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 15:12:18,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:18,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a76c2f83206171a92517 HTTP/1.1" 200 None 2025-09-26 15:12:18,744 - lava_callback - INFO - Completed processing callback for node 68d6a76c2f83206171a92517 INFO: 172.20.0.1:42956 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:12:25,939 - lava_callback - INFO - Received callback for node 68d40a47cd36afa834e16f24 INFO: 172.20.0.1:42972 - "POST /node/68d40a47cd36afa834e16f24 HTTP/1.0" 202 Accepted 2025-09-26 15:12:25,944 - lava_callback - INFO - Starting async job submit for node 68d40a47cd36afa834e16f24 2025-09-26 15:12:25,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:25,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a47cd36afa834e16f24 HTTP/1.1" 200 None 2025-09-26 15:12:25,965 - lava_callback - DEBUG - Processing node 68d40a47cd36afa834e16f24: baseline-arm 2025-09-26 15:12:25,965 - lava_callback - ERROR - Error processing callback for node 68d40a47cd36afa834e16f24: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:42984 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:12:26,621 - lava_callback - INFO - Received callback for node 68d40a48cd36afa834e16f27 INFO: 172.20.0.1:43000 - "POST /node/68d40a48cd36afa834e16f27 HTTP/1.0" 202 Accepted 2025-09-26 15:12:26,627 - lava_callback - INFO - Starting async job submit for node 68d40a48cd36afa834e16f27 2025-09-26 15:12:26,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:26,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a48cd36afa834e16f27 HTTP/1.1" 200 None 2025-09-26 15:12:26,648 - lava_callback - DEBUG - Processing node 68d40a48cd36afa834e16f27: baseline-arm 2025-09-26 15:12:26,649 - lava_callback - ERROR - Error processing callback for node 68d40a48cd36afa834e16f27: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:12:27,361 - lava_callback - INFO - Received callback for node 68d40a49cd36afa834e16f2a INFO: 172.20.0.1:43002 - "POST /node/68d40a49cd36afa834e16f2a HTTP/1.0" 202 Accepted 2025-09-26 15:12:27,367 - lava_callback - INFO - Starting async job submit for node 68d40a49cd36afa834e16f2a 2025-09-26 15:12:27,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:27,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a49cd36afa834e16f2a HTTP/1.1" 200 None 2025-09-26 15:12:27,382 - lava_callback - DEBUG - Processing node 68d40a49cd36afa834e16f2a: baseline-arm 2025-09-26 15:12:27,382 - lava_callback - ERROR - Error processing callback for node 68d40a49cd36afa834e16f2a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:12:28,088 - lava_callback - INFO - Received callback for node 68d40a4ccd36afa834e16f2d INFO: 172.20.0.1:43018 - "POST /node/68d40a4ccd36afa834e16f2d HTTP/1.0" 202 Accepted 2025-09-26 15:12:28,093 - lava_callback - INFO - Starting async job submit for node 68d40a4ccd36afa834e16f2d 2025-09-26 15:12:28,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:28,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a4ccd36afa834e16f2d HTTP/1.1" 200 None 2025-09-26 15:12:28,107 - lava_callback - DEBUG - Processing node 68d40a4ccd36afa834e16f2d: baseline-arm 2025-09-26 15:12:28,107 - lava_callback - ERROR - Error processing callback for node 68d40a4ccd36afa834e16f2d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:12:28,786 - lava_callback - INFO - Received callback for node 68d40a4dcd36afa834e16f30 INFO: 172.20.0.1:43030 - "POST /node/68d40a4dcd36afa834e16f30 HTTP/1.0" 202 Accepted 2025-09-26 15:12:28,791 - lava_callback - INFO - Starting async job submit for node 68d40a4dcd36afa834e16f30 2025-09-26 15:12:28,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:28,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a4dcd36afa834e16f30 HTTP/1.1" 200 None 2025-09-26 15:12:28,807 - lava_callback - DEBUG - Processing node 68d40a4dcd36afa834e16f30: baseline-arm 2025-09-26 15:12:28,807 - lava_callback - ERROR - Error processing callback for node 68d40a4dcd36afa834e16f30: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:12:29,494 - lava_callback - INFO - Received callback for node 68d40a4ecd36afa834e16f33 INFO: 172.20.0.1:41652 - "POST /node/68d40a4ecd36afa834e16f33 HTTP/1.0" 202 Accepted 2025-09-26 15:12:29,500 - lava_callback - INFO - Starting async job submit for node 68d40a4ecd36afa834e16f33 2025-09-26 15:12:29,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:29,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a4ecd36afa834e16f33 HTTP/1.1" 200 None 2025-09-26 15:12:29,512 - lava_callback - DEBUG - Processing node 68d40a4ecd36afa834e16f33: baseline-arm 2025-09-26 15:12:29,513 - lava_callback - ERROR - Error processing callback for node 68d40a4ecd36afa834e16f33: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:41664 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:12:30,216 - lava_callback - INFO - Received callback for node 68d40a52cd36afa834e16f36 INFO: 172.20.0.1:41666 - "POST /node/68d40a52cd36afa834e16f36 HTTP/1.0" 202 Accepted 2025-09-26 15:12:30,221 - lava_callback - INFO - Starting async job submit for node 68d40a52cd36afa834e16f36 2025-09-26 15:12:30,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:30,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a52cd36afa834e16f36 HTTP/1.1" 200 None 2025-09-26 15:12:30,242 - lava_callback - DEBUG - Processing node 68d40a52cd36afa834e16f36: baseline-arm 2025-09-26 15:12:30,242 - lava_callback - ERROR - Error processing callback for node 68d40a52cd36afa834e16f36: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:12:30,939 - lava_callback - INFO - Received callback for node 68d40a54cd36afa834e16f39 INFO: 172.20.0.1:41674 - "POST /node/68d40a54cd36afa834e16f39 HTTP/1.0" 202 Accepted 2025-09-26 15:12:30,944 - lava_callback - INFO - Starting async job submit for node 68d40a54cd36afa834e16f39 2025-09-26 15:12:30,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:30,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a54cd36afa834e16f39 HTTP/1.1" 200 None 2025-09-26 15:12:30,957 - lava_callback - DEBUG - Processing node 68d40a54cd36afa834e16f39: baseline-arm 2025-09-26 15:12:30,957 - lava_callback - ERROR - Error processing callback for node 68d40a54cd36afa834e16f39: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:12:31,650 - lava_callback - INFO - Received callback for node 68d40a57cd36afa834e16f3c INFO: 172.20.0.1:41688 - "POST /node/68d40a57cd36afa834e16f3c HTTP/1.0" 202 Accepted 2025-09-26 15:12:31,655 - lava_callback - INFO - Starting async job submit for node 68d40a57cd36afa834e16f3c 2025-09-26 15:12:31,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:31,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a57cd36afa834e16f3c HTTP/1.1" 200 None 2025-09-26 15:12:31,669 - lava_callback - DEBUG - Processing node 68d40a57cd36afa834e16f3c: baseline-arm 2025-09-26 15:12:31,669 - lava_callback - ERROR - Error processing callback for node 68d40a57cd36afa834e16f3c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:41700 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:12:43,354 - lava_callback - INFO - Received callback for node 68d694b72f83206171a91f05 INFO: 172.20.0.1:59892 - "POST /node/68d694b72f83206171a91f05 HTTP/1.0" 202 Accepted 2025-09-26 15:12:43,365 - lava_callback - INFO - Starting async job submit for node 68d694b72f83206171a91f05 2025-09-26 15:12:43,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:43,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694b72f83206171a91f05 HTTP/1.1" 200 None 2025-09-26 15:12:43,408 - lava_callback - DEBUG - Processing node 68d694b72f83206171a91f05: baseline-arm64 2025-09-26 15:12:43,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:12:43,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:12:43,807 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694b72f83206171a91f05/log.txt.gz 2025-09-26 15:12:43,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:12:43,966 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:12:43,967 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d694b72f83206171a91f05/lava_callback.json.gz 2025-09-26 15:12:43,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:44,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694b72f83206171a91f05 HTTP/1.1" 200 None 2025-09-26 15:12:44,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:44,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 15:12:44,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:44,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694b72f83206171a91f05 HTTP/1.1" 200 None 2025-09-26 15:12:44,040 - lava_callback - INFO - Completed processing callback for node 68d694b72f83206171a91f05 2025-09-26 15:12:46,113 - lava_callback - INFO - Received callback for node 68d40a59cd36afa834e16f3f INFO: 172.20.0.1:59898 - "POST /node/68d40a59cd36afa834e16f3f HTTP/1.0" 202 Accepted 2025-09-26 15:12:46,118 - lava_callback - INFO - Starting async job submit for node 68d40a59cd36afa834e16f3f 2025-09-26 15:12:46,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:46,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a59cd36afa834e16f3f HTTP/1.1" 200 None 2025-09-26 15:12:46,132 - lava_callback - DEBUG - Processing node 68d40a59cd36afa834e16f3f: baseline-arm 2025-09-26 15:12:46,132 - lava_callback - ERROR - Error processing callback for node 68d40a59cd36afa834e16f3f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:59904 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:12:46,854 - lava_callback - INFO - Received callback for node 68d40a5bcd36afa834e16f42 INFO: 172.20.0.1:59910 - "POST /node/68d40a5bcd36afa834e16f42 HTTP/1.0" 202 Accepted 2025-09-26 15:12:46,860 - lava_callback - INFO - Starting async job submit for node 68d40a5bcd36afa834e16f42 2025-09-26 15:12:46,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:46,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a5bcd36afa834e16f42 HTTP/1.1" 200 None 2025-09-26 15:12:46,883 - lava_callback - DEBUG - Processing node 68d40a5bcd36afa834e16f42: baseline-arm 2025-09-26 15:12:46,883 - lava_callback - ERROR - Error processing callback for node 68d40a5bcd36afa834e16f42: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:12:47,606 - lava_callback - INFO - Received callback for node 68d40a5bcd36afa834e16f45 INFO: 172.20.0.1:59922 - "POST /node/68d40a5bcd36afa834e16f45 HTTP/1.0" 202 Accepted 2025-09-26 15:12:47,611 - lava_callback - INFO - Starting async job submit for node 68d40a5bcd36afa834e16f45 2025-09-26 15:12:47,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:47,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a5bcd36afa834e16f45 HTTP/1.1" 200 None 2025-09-26 15:12:47,624 - lava_callback - DEBUG - Processing node 68d40a5bcd36afa834e16f45: baseline-arm 2025-09-26 15:12:47,624 - lava_callback - ERROR - Error processing callback for node 68d40a5bcd36afa834e16f45: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:12:48,318 - lava_callback - INFO - Received callback for node 68d40a5dcd36afa834e16f48 INFO: 172.20.0.1:59934 - "POST /node/68d40a5dcd36afa834e16f48 HTTP/1.0" 202 Accepted 2025-09-26 15:12:48,323 - lava_callback - INFO - Starting async job submit for node 68d40a5dcd36afa834e16f48 2025-09-26 15:12:48,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:48,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a5dcd36afa834e16f48 HTTP/1.1" 200 None 2025-09-26 15:12:48,336 - lava_callback - DEBUG - Processing node 68d40a5dcd36afa834e16f48: baseline-arm 2025-09-26 15:12:48,336 - lava_callback - ERROR - Error processing callback for node 68d40a5dcd36afa834e16f48: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:12:49,042 - lava_callback - INFO - Received callback for node 68d40a5fcd36afa834e16f4b INFO: 172.20.0.1:59940 - "POST /node/68d40a5fcd36afa834e16f4b HTTP/1.0" 202 Accepted 2025-09-26 15:12:49,047 - lava_callback - INFO - Starting async job submit for node 68d40a5fcd36afa834e16f4b 2025-09-26 15:12:49,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:49,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a5fcd36afa834e16f4b HTTP/1.1" 200 None 2025-09-26 15:12:49,061 - lava_callback - DEBUG - Processing node 68d40a5fcd36afa834e16f4b: baseline-arm 2025-09-26 15:12:49,061 - lava_callback - ERROR - Error processing callback for node 68d40a5fcd36afa834e16f4b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:12:49,791 - lava_callback - INFO - Received callback for node 68d40a61cd36afa834e16f4e INFO: 172.20.0.1:46234 - "POST /node/68d40a61cd36afa834e16f4e HTTP/1.0" 202 Accepted 2025-09-26 15:12:49,797 - lava_callback - INFO - Starting async job submit for node 68d40a61cd36afa834e16f4e 2025-09-26 15:12:49,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:49,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a61cd36afa834e16f4e HTTP/1.1" 200 None 2025-09-26 15:12:49,812 - lava_callback - DEBUG - Processing node 68d40a61cd36afa834e16f4e: baseline-arm 2025-09-26 15:12:49,812 - lava_callback - ERROR - Error processing callback for node 68d40a61cd36afa834e16f4e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:12:50,510 - lava_callback - INFO - Received callback for node 68d40a61cd36afa834e16f51 INFO: 172.20.0.1:46240 - "POST /node/68d40a61cd36afa834e16f51 HTTP/1.0" 202 Accepted 2025-09-26 15:12:50,517 - lava_callback - INFO - Starting async job submit for node 68d40a61cd36afa834e16f51 2025-09-26 15:12:50,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:50,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a61cd36afa834e16f51 HTTP/1.1" 200 None 2025-09-26 15:12:50,532 - lava_callback - DEBUG - Processing node 68d40a61cd36afa834e16f51: baseline-arm 2025-09-26 15:12:50,533 - lava_callback - ERROR - Error processing callback for node 68d40a61cd36afa834e16f51: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:12:51,226 - lava_callback - INFO - Received callback for node 68d40a66cd36afa834e16f54 INFO: 172.20.0.1:46250 - "POST /node/68d40a66cd36afa834e16f54 HTTP/1.0" 202 Accepted 2025-09-26 15:12:51,232 - lava_callback - INFO - Starting async job submit for node 68d40a66cd36afa834e16f54 2025-09-26 15:12:51,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:51,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a66cd36afa834e16f54 HTTP/1.1" 200 None 2025-09-26 15:12:51,271 - lava_callback - DEBUG - Processing node 68d40a66cd36afa834e16f54: baseline-arm 2025-09-26 15:12:51,271 - lava_callback - ERROR - Error processing callback for node 68d40a66cd36afa834e16f54: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:12:51,949 - lava_callback - INFO - Received callback for node 68d40a66cd36afa834e16f57 INFO: 172.20.0.1:46256 - "POST /node/68d40a66cd36afa834e16f57 HTTP/1.0" 202 Accepted 2025-09-26 15:12:51,954 - lava_callback - INFO - Starting async job submit for node 68d40a66cd36afa834e16f57 2025-09-26 15:12:51,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:51,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a66cd36afa834e16f57 HTTP/1.1" 200 None 2025-09-26 15:12:51,967 - lava_callback - DEBUG - Processing node 68d40a66cd36afa834e16f57: baseline-arm 2025-09-26 15:12:51,967 - lava_callback - ERROR - Error processing callback for node 68d40a66cd36afa834e16f57: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:12:52,681 - lava_callback - INFO - Received callback for node 68d40a68cd36afa834e16f5a INFO: 172.20.0.1:46258 - "POST /node/68d40a68cd36afa834e16f5a HTTP/1.0" 202 Accepted 2025-09-26 15:12:52,687 - lava_callback - INFO - Starting async job submit for node 68d40a68cd36afa834e16f5a 2025-09-26 15:12:52,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:52,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a68cd36afa834e16f5a HTTP/1.1" 200 None 2025-09-26 15:12:52,704 - lava_callback - DEBUG - Processing node 68d40a68cd36afa834e16f5a: baseline-arm 2025-09-26 15:12:52,704 - lava_callback - ERROR - Error processing callback for node 68d40a68cd36afa834e16f5a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:12:53,394 - lava_callback - INFO - Received callback for node 68d40a6acd36afa834e16f5d INFO: 172.20.0.1:46260 - "POST /node/68d40a6acd36afa834e16f5d HTTP/1.0" 202 Accepted 2025-09-26 15:12:53,399 - lava_callback - INFO - Starting async job submit for node 68d40a6acd36afa834e16f5d 2025-09-26 15:12:53,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:12:53,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a6acd36afa834e16f5d HTTP/1.1" 200 None 2025-09-26 15:12:53,413 - lava_callback - DEBUG - Processing node 68d40a6acd36afa834e16f5d: baseline-arm 2025-09-26 15:12:53,413 - lava_callback - ERROR - Error processing callback for node 68d40a6acd36afa834e16f5d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:46276 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:13:05,971 - lava_callback - INFO - Received callback for node 68d40a6ecd36afa834e16f60 INFO: 172.20.0.1:41390 - "POST /node/68d40a6ecd36afa834e16f60 HTTP/1.0" 202 Accepted 2025-09-26 15:13:05,977 - lava_callback - INFO - Starting async job submit for node 68d40a6ecd36afa834e16f60 2025-09-26 15:13:05,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:13:05,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a6ecd36afa834e16f60 HTTP/1.1" 200 None 2025-09-26 15:13:05,990 - lava_callback - DEBUG - Processing node 68d40a6ecd36afa834e16f60: baseline-arm 2025-09-26 15:13:05,990 - lava_callback - ERROR - Error processing callback for node 68d40a6ecd36afa834e16f60: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:41402 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:13:06,672 - lava_callback - INFO - Received callback for node 68d40a6ecd36afa834e16f63 INFO: 172.20.0.1:41408 - "POST /node/68d40a6ecd36afa834e16f63 HTTP/1.0" 202 Accepted 2025-09-26 15:13:06,677 - lava_callback - INFO - Starting async job submit for node 68d40a6ecd36afa834e16f63 2025-09-26 15:13:06,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:13:06,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a6ecd36afa834e16f63 HTTP/1.1" 200 None 2025-09-26 15:13:06,715 - lava_callback - DEBUG - Processing node 68d40a6ecd36afa834e16f63: baseline-arm 2025-09-26 15:13:06,715 - lava_callback - ERROR - Error processing callback for node 68d40a6ecd36afa834e16f63: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:13:07,376 - lava_callback - INFO - Received callback for node 68d40a70cd36afa834e16f66 INFO: 172.20.0.1:41420 - "POST /node/68d40a70cd36afa834e16f66 HTTP/1.0" 202 Accepted 2025-09-26 15:13:07,381 - lava_callback - INFO - Starting async job submit for node 68d40a70cd36afa834e16f66 2025-09-26 15:13:07,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:13:07,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a70cd36afa834e16f66 HTTP/1.1" 200 None 2025-09-26 15:13:07,400 - lava_callback - DEBUG - Processing node 68d40a70cd36afa834e16f66: baseline-arm 2025-09-26 15:13:07,400 - lava_callback - ERROR - Error processing callback for node 68d40a70cd36afa834e16f66: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:13:08,077 - lava_callback - INFO - Received callback for node 68d40a72cd36afa834e16f69 INFO: 172.20.0.1:41428 - "POST /node/68d40a72cd36afa834e16f69 HTTP/1.0" 202 Accepted 2025-09-26 15:13:08,083 - lava_callback - INFO - Starting async job submit for node 68d40a72cd36afa834e16f69 2025-09-26 15:13:08,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:13:08,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40a72cd36afa834e16f69 HTTP/1.1" 200 None 2025-09-26 15:13:08,096 - lava_callback - DEBUG - Processing node 68d40a72cd36afa834e16f69: baseline-arm 2025-09-26 15:13:08,096 - lava_callback - ERROR - Error processing callback for node 68d40a72cd36afa834e16f69: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:56448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56452 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:13:17,119 - lava_callback - INFO - Received callback for node 68d405c5cd36afa834e16737 INFO: 172.20.0.1:56456 - "POST /node/68d405c5cd36afa834e16737 HTTP/1.0" 202 Accepted 2025-09-26 15:13:17,129 - lava_callback - INFO - Starting async job submit for node 68d405c5cd36afa834e16737 2025-09-26 15:13:17,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:13:17,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d405c5cd36afa834e16737 HTTP/1.1" 200 None 2025-09-26 15:13:17,185 - lava_callback - DEBUG - Processing node 68d405c5cd36afa834e16737: baseline-arm64 2025-09-26 15:13:18,045 - lava_callback - ERROR - Error processing callback for node 68d405c5cd36afa834e16737: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:45684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57186 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:14:04,294 - lava_callback - INFO - Received callback for node 68d42a46a5c2c05277bc78dc INFO: 172.20.0.1:34732 - "POST /node/68d42a46a5c2c05277bc78dc HTTP/1.0" 202 Accepted 2025-09-26 15:14:04,300 - lava_callback - INFO - Starting async job submit for node 68d42a46a5c2c05277bc78dc 2025-09-26 15:14:04,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:14:04,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42a46a5c2c05277bc78dc HTTP/1.1" 200 None 2025-09-26 15:14:04,342 - lava_callback - DEBUG - Processing node 68d42a46a5c2c05277bc78dc: baseline-arm 2025-09-26 15:14:04,561 - lava_callback - ERROR - Error processing callback for node 68d42a46a5c2c05277bc78dc: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:34742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50986 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:14:23,756 - lava_callback - INFO - Received callback for node 68d40c0bcd36afa834e17279 INFO: 172.20.0.1:57402 - "POST /node/68d40c0bcd36afa834e17279 HTTP/1.0" 202 Accepted 2025-09-26 15:14:23,762 - lava_callback - INFO - Starting async job submit for node 68d40c0bcd36afa834e17279 2025-09-26 15:14:23,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:14:23,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40c0bcd36afa834e17279 HTTP/1.1" 200 None 2025-09-26 15:14:23,797 - lava_callback - DEBUG - Processing node 68d40c0bcd36afa834e17279: baseline-arm64 2025-09-26 15:14:24,100 - lava_callback - ERROR - Error processing callback for node 68d40c0bcd36afa834e17279: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:57418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58036 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:15:18,700 - lava_callback - INFO - Received callback for node 68d690452f83206171a91b36 INFO: 172.20.0.1:58048 - "POST /node/68d690452f83206171a91b36 HTTP/1.0" 202 Accepted 2025-09-26 15:15:18,710 - lava_callback - INFO - Starting async job submit for node 68d690452f83206171a91b36 2025-09-26 15:15:18,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:15:18,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690452f83206171a91b36 HTTP/1.1" 200 None 2025-09-26 15:15:18,755 - lava_callback - DEBUG - Processing node 68d690452f83206171a91b36: baseline-arm64-broonie 2025-09-26 15:15:18,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:15:19,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:15:19,098 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d690452f83206171a91b36/log.txt.gz 2025-09-26 15:15:19,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:15:19,239 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:15:19,240 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d690452f83206171a91b36/lava_callback.json.gz 2025-09-26 15:15:19,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:15:19,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d690452f83206171a91b36 HTTP/1.1" 200 None 2025-09-26 15:15:19,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:15:19,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5dc8530c58dac7d9410cb HTTP/1.1" 200 None 2025-09-26 15:15:19,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:15:19,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d690452f83206171a91b36 HTTP/1.1" 200 None 2025-09-26 15:15:19,335 - lava_callback - INFO - Completed processing callback for node 68d690452f83206171a91b36 INFO: 172.20.0.1:47814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47816 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:15:28,835 - lava_callback - INFO - Received callback for node 68d40c0ecd36afa834e1727c INFO: 172.20.0.1:47828 - "POST /node/68d40c0ecd36afa834e1727c HTTP/1.0" 202 Accepted 2025-09-26 15:15:28,842 - lava_callback - INFO - Starting async job submit for node 68d40c0ecd36afa834e1727c 2025-09-26 15:15:28,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:15:28,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40c0ecd36afa834e1727c HTTP/1.1" 200 None 2025-09-26 15:15:28,881 - lava_callback - DEBUG - Processing node 68d40c0ecd36afa834e1727c: baseline-arm64 2025-09-26 15:15:29,223 - lava_callback - ERROR - Error processing callback for node 68d40c0ecd36afa834e1727c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34738 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:15:38,981 - lava_callback - INFO - Received callback for node 68d6a87b2f83206171a9268d INFO: 172.20.0.1:34740 - "POST /node/68d6a87b2f83206171a9268d HTTP/1.0" 202 Accepted 2025-09-26 15:15:38,988 - lava_callback - INFO - Starting async job submit for node 68d6a87b2f83206171a9268d 2025-09-26 15:15:39,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:15:39,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a87b2f83206171a9268d HTTP/1.1" 200 None 2025-09-26 15:15:39,028 - lava_callback - DEBUG - Processing node 68d6a87b2f83206171a9268d: baseline-arm64-broonie 2025-09-26 15:15:39,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:15:39,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:15:39,587 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a87b2f83206171a9268d/log.txt.gz 2025-09-26 15:15:39,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:15:39,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:15:39,732 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a87b2f83206171a9268d/lava_callback.json.gz 2025-09-26 15:15:39,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:15:39,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a87b2f83206171a9268d HTTP/1.1" 200 None 2025-09-26 15:15:39,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:15:39,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 15:15:39,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:15:39,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a87b2f83206171a9268d HTTP/1.1" 200 None 2025-09-26 15:15:39,814 - lava_callback - INFO - Completed processing callback for node 68d6a87b2f83206171a9268d INFO: 172.20.0.1:49348 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:15:51,769 - lava_callback - INFO - Received callback for node 68d407ddcd36afa834e16afc INFO: 172.20.0.1:50366 - "POST /node/68d407ddcd36afa834e16afc HTTP/1.0" 202 Accepted 2025-09-26 15:15:51,778 - lava_callback - INFO - Starting async job submit for node 68d407ddcd36afa834e16afc 2025-09-26 15:15:51,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:15:51,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d407ddcd36afa834e16afc HTTP/1.1" 200 None 2025-09-26 15:15:51,849 - lava_callback - DEBUG - Processing node 68d407ddcd36afa834e16afc: baseline-arm64 2025-09-26 15:15:52,941 - lava_callback - ERROR - Error processing callback for node 68d407ddcd36afa834e16afc: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:50382 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:15:58,266 - lava_callback - INFO - Received callback for node 68d6a7582f83206171a924fa INFO: 172.20.0.1:50384 - "POST /node/68d6a7582f83206171a924fa HTTP/1.0" 202 Accepted 2025-09-26 15:15:58,275 - lava_callback - INFO - Starting async job submit for node 68d6a7582f83206171a924fa 2025-09-26 15:15:58,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:15:58,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7582f83206171a924fa HTTP/1.1" 200 None 2025-09-26 15:15:58,326 - lava_callback - DEBUG - Processing node 68d6a7582f83206171a924fa: baseline-arm64-broonie 2025-09-26 15:15:58,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:15:58,782 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:15:58,782 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a7582f83206171a924fa/log.txt.gz 2025-09-26 15:15:58,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:15:58,935 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:15:58,935 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a7582f83206171a924fa/lava_callback.json.gz 2025-09-26 15:15:58,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:15:58,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7582f83206171a924fa HTTP/1.1" 200 None 2025-09-26 15:15:58,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:15:58,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 15:15:58,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:15:59,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7582f83206171a924fa HTTP/1.1" 200 None 2025-09-26 15:15:59,018 - lava_callback - INFO - Completed processing callback for node 68d6a7582f83206171a924fa 2025-09-26 15:16:04,810 - lava_callback - INFO - Received callback for node 68d42a48a5c2c05277bc78df INFO: 172.20.0.1:55706 - "POST /node/68d42a48a5c2c05277bc78df HTTP/1.0" 202 Accepted 2025-09-26 15:16:04,816 - lava_callback - INFO - Starting async job submit for node 68d42a48a5c2c05277bc78df 2025-09-26 15:16:04,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:04,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42a48a5c2c05277bc78df HTTP/1.1" 200 None 2025-09-26 15:16:04,855 - lava_callback - DEBUG - Processing node 68d42a48a5c2c05277bc78df: baseline-arm 2025-09-26 15:16:05,098 - lava_callback - ERROR - Error processing callback for node 68d42a48a5c2c05277bc78df: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:55708 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:16:11,561 - lava_callback - INFO - Received callback for node 68d6ade32f83206171a927e9 INFO: 172.20.0.1:59966 - "POST /node/68d6ade32f83206171a927e9 HTTP/1.0" 202 Accepted 2025-09-26 15:16:11,567 - lava_callback - INFO - Starting async job submit for node 68d6ade32f83206171a927e9 2025-09-26 15:16:11,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:11,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ade32f83206171a927e9 HTTP/1.1" 200 None 2025-09-26 15:16:11,603 - lava_callback - DEBUG - Processing node 68d6ade32f83206171a927e9: baseline-arm64 2025-09-26 15:16:11,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:16:12,105 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:16:12,105 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ade32f83206171a927e9/log.txt.gz 2025-09-26 15:16:12,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:16:12,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:16:12,264 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ade32f83206171a927e9/lava_callback.json.gz 2025-09-26 15:16:12,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:12,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ade32f83206171a927e9 HTTP/1.1" 200 None 2025-09-26 15:16:12,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:12,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:16:12,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:12,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ade32f83206171a927e9 HTTP/1.1" 200 None 2025-09-26 15:16:12,350 - lava_callback - INFO - Completed processing callback for node 68d6ade32f83206171a927e9 2025-09-26 15:16:15,006 - lava_callback - INFO - Received callback for node 68d6ade22f83206171a927cd INFO: 172.20.0.1:59968 - "POST /node/68d6ade22f83206171a927cd HTTP/1.0" 202 Accepted 2025-09-26 15:16:15,013 - lava_callback - INFO - Starting async job submit for node 68d6ade22f83206171a927cd 2025-09-26 15:16:15,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:15,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ade22f83206171a927cd HTTP/1.1" 200 None 2025-09-26 15:16:15,053 - lava_callback - DEBUG - Processing node 68d6ade22f83206171a927cd: baseline-arm64 INFO: 172.20.0.1:59978 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 15:16:15,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:16:15,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:16:15,480 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ade22f83206171a927cd/log.txt.gz 2025-09-26 15:16:15,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:16:15,615 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:16:15,615 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ade22f83206171a927cd/lava_callback.json.gz 2025-09-26 15:16:15,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:15,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ade22f83206171a927cd HTTP/1.1" 200 None 2025-09-26 15:16:15,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:15,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:16:15,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:15,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ade22f83206171a927cd HTTP/1.1" 200 None 2025-09-26 15:16:15,711 - lava_callback - INFO - Completed processing callback for node 68d6ade22f83206171a927cd INFO: 172.20.0.1:59988 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:16:19,359 - lava_callback - INFO - Received callback for node 68d6ade92f83206171a92805 INFO: 172.20.0.1:58302 - "POST /node/68d6ade92f83206171a92805 HTTP/1.0" 202 Accepted 2025-09-26 15:16:19,369 - lava_callback - INFO - Starting async job submit for node 68d6ade92f83206171a92805 2025-09-26 15:16:19,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:19,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ade92f83206171a92805 HTTP/1.1" 200 None 2025-09-26 15:16:19,430 - lava_callback - DEBUG - Processing node 68d6ade92f83206171a92805: baseline-arm64 2025-09-26 15:16:19,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:16:19,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:16:19,963 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ade92f83206171a92805/log.txt.gz 2025-09-26 15:16:19,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:16:20,112 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:16:20,113 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ade92f83206171a92805/lava_callback.json.gz 2025-09-26 15:16:20,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:20,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ade92f83206171a92805 HTTP/1.1" 200 None 2025-09-26 15:16:20,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:20,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:16:20,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:20,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ade92f83206171a92805 HTTP/1.1" 200 None 2025-09-26 15:16:20,250 - lava_callback - INFO - Completed processing callback for node 68d6ade92f83206171a92805 2025-09-26 15:16:20,897 - lava_callback - INFO - Received callback for node 68d6ade82f83206171a92802 INFO: 172.20.0.1:58306 - "POST /node/68d6ade82f83206171a92802 HTTP/1.0" 202 Accepted 2025-09-26 15:16:20,905 - lava_callback - INFO - Starting async job submit for node 68d6ade82f83206171a92802 2025-09-26 15:16:20,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:20,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ade82f83206171a92802 HTTP/1.1" 200 None 2025-09-26 15:16:20,956 - lava_callback - DEBUG - Processing node 68d6ade82f83206171a92802: baseline-arm64 2025-09-26 15:16:21,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:16:21,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:16:21,496 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ade82f83206171a92802/log.txt.gz 2025-09-26 15:16:21,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:16:21,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:16:21,658 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ade82f83206171a92802/lava_callback.json.gz 2025-09-26 15:16:21,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:21,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ade82f83206171a92802 HTTP/1.1" 200 None 2025-09-26 15:16:21,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:21,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:16:21,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:21,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ade82f83206171a92802 HTTP/1.1" 200 None 2025-09-26 15:16:21,790 - lava_callback - INFO - Completed processing callback for node 68d6ade82f83206171a92802 INFO: 172.20.0.1:58308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33624 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:16:31,361 - lava_callback - INFO - Received callback for node 68d6adf52f83206171a9281a INFO: 172.20.0.1:33636 - "POST /node/68d6adf52f83206171a9281a HTTP/1.0" 202 Accepted 2025-09-26 15:16:31,368 - lava_callback - INFO - Starting async job submit for node 68d6adf52f83206171a9281a 2025-09-26 15:16:31,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:31,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6adf52f83206171a9281a HTTP/1.1" 200 None 2025-09-26 15:16:31,403 - lava_callback - DEBUG - Processing node 68d6adf52f83206171a9281a: baseline-arm64 2025-09-26 15:16:31,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:16:31,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:16:31,969 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6adf52f83206171a9281a/log.txt.gz 2025-09-26 15:16:31,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:16:32,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:16:32,109 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6adf52f83206171a9281a/lava_callback.json.gz 2025-09-26 15:16:32,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:32,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6adf52f83206171a9281a HTTP/1.1" 200 None 2025-09-26 15:16:32,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:32,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:16:32,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:32,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6adf52f83206171a9281a HTTP/1.1" 200 None 2025-09-26 15:16:32,202 - lava_callback - INFO - Completed processing callback for node 68d6adf52f83206171a9281a 2025-09-26 15:16:36,521 - lava_callback - INFO - Received callback for node 68d6adfc2f83206171a92826 INFO: 172.20.0.1:33640 - "POST /node/68d6adfc2f83206171a92826 HTTP/1.0" 202 Accepted 2025-09-26 15:16:36,528 - lava_callback - INFO - Starting async job submit for node 68d6adfc2f83206171a92826 INFO: 172.20.0.1:33652 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:16:36,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:36,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6adfc2f83206171a92826 HTTP/1.1" 200 None 2025-09-26 15:16:36,569 - lava_callback - DEBUG - Processing node 68d6adfc2f83206171a92826: baseline-arm64 2025-09-26 15:16:36,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:16:37,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:16:37,117 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6adfc2f83206171a92826/log.txt.gz 2025-09-26 15:16:37,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:16:37,255 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:16:37,256 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6adfc2f83206171a92826/lava_callback.json.gz 2025-09-26 15:16:37,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:37,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6adfc2f83206171a92826 HTTP/1.1" 200 None 2025-09-26 15:16:37,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:37,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:16:37,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:37,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6adfc2f83206171a92826 HTTP/1.1" 200 None 2025-09-26 15:16:37,354 - lava_callback - INFO - Completed processing callback for node 68d6adfc2f83206171a92826 2025-09-26 15:16:42,485 - lava_callback - INFO - Received callback for node 68d6ae062f83206171a9283b INFO: 172.20.0.1:50276 - "POST /node/68d6ae062f83206171a9283b HTTP/1.0" 202 Accepted 2025-09-26 15:16:42,494 - lava_callback - INFO - Starting async job submit for node 68d6ae062f83206171a9283b 2025-09-26 15:16:42,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:42,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae062f83206171a9283b HTTP/1.1" 200 None 2025-09-26 15:16:42,548 - lava_callback - DEBUG - Processing node 68d6ae062f83206171a9283b: baseline-arm64 2025-09-26 15:16:42,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:16:43,033 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:16:43,034 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ae062f83206171a9283b/log.txt.gz 2025-09-26 15:16:43,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:16:43,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:16:43,195 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ae062f83206171a9283b/lava_callback.json.gz 2025-09-26 15:16:43,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:43,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae062f83206171a9283b HTTP/1.1" 200 None 2025-09-26 15:16:43,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:43,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:16:43,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:43,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae062f83206171a9283b HTTP/1.1" 200 None 2025-09-26 15:16:43,300 - lava_callback - INFO - Completed processing callback for node 68d6ae062f83206171a9283b 2025-09-26 15:16:46,113 - lava_callback - INFO - Received callback for node 68d6ae062f83206171a92838 INFO: 172.20.0.1:50292 - "POST /node/68d6ae062f83206171a92838 HTTP/1.0" 202 Accepted 2025-09-26 15:16:46,120 - lava_callback - INFO - Starting async job submit for node 68d6ae062f83206171a92838 2025-09-26 15:16:46,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:46,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae062f83206171a92838 HTTP/1.1" 200 None 2025-09-26 15:16:46,175 - lava_callback - DEBUG - Processing node 68d6ae062f83206171a92838: baseline-arm64 INFO: 172.20.0.1:50300 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:16:46,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:16:46,666 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:16:46,667 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ae062f83206171a92838/log.txt.gz 2025-09-26 15:16:46,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:16:46,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:16:46,851 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ae062f83206171a92838/lava_callback.json.gz 2025-09-26 15:16:46,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:46,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae062f83206171a92838 HTTP/1.1" 200 None 2025-09-26 15:16:46,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:46,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:16:46,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:46,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae062f83206171a92838 HTTP/1.1" 200 None 2025-09-26 15:16:46,949 - lava_callback - INFO - Completed processing callback for node 68d6ae062f83206171a92838 2025-09-26 15:16:48,644 - lava_callback - INFO - Received callback for node 68d40c12cd36afa834e1727f INFO: 172.20.0.1:50316 - "POST /node/68d40c12cd36afa834e1727f HTTP/1.0" 202 Accepted 2025-09-26 15:16:48,656 - lava_callback - INFO - Starting async job submit for node 68d40c12cd36afa834e1727f 2025-09-26 15:16:48,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:48,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40c12cd36afa834e1727f HTTP/1.1" 200 None 2025-09-26 15:16:48,712 - lava_callback - DEBUG - Processing node 68d40c12cd36afa834e1727f: baseline-arm64 2025-09-26 15:16:49,164 - lava_callback - ERROR - Error processing callback for node 68d40c12cd36afa834e1727f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:16:52,111 - lava_callback - INFO - Received callback for node 68d6aa012f83206171a92710 INFO: 172.20.0.1:53304 - "POST /node/68d6aa012f83206171a92710 HTTP/1.0" 202 Accepted 2025-09-26 15:16:52,119 - lava_callback - INFO - Starting async job submit for node 68d6aa012f83206171a92710 2025-09-26 15:16:52,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:52,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6aa012f83206171a92710 HTTP/1.1" 200 None 2025-09-26 15:16:52,163 - lava_callback - DEBUG - Processing node 68d6aa012f83206171a92710: baseline-arm 2025-09-26 15:16:52,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:16:52,781 - lava_callback - INFO - Received callback for node 68d6adf92f83206171a92820 INFO: 172.20.0.1:53318 - "POST /node/68d6adf92f83206171a92820 HTTP/1.0" 202 Accepted 2025-09-26 15:16:52,788 - lava_callback - INFO - Starting async job submit for node 68d6adf92f83206171a92820 2025-09-26 15:16:52,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:52,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:16:52,815 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d6aa012f83206171a92710/log.txt.gz 2025-09-26 15:16:52,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:16:52,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6adf92f83206171a92820 HTTP/1.1" 200 None 2025-09-26 15:16:52,829 - lava_callback - DEBUG - Processing node 68d6adf92f83206171a92820: baseline-arm64 2025-09-26 15:16:53,006 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:16:53,048 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d6aa012f83206171a92710/lava_callback.json.gz DEBUG: Setup failed for 68d6aa012f83206171a92710. Transitting job node result: incomplete -> fail 2025-09-26 15:16:53,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:53,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6aa012f83206171a92710 HTTP/1.1" 200 None 2025-09-26 15:16:53,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:53,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:16:53,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648e95d233c363a76234e HTTP/1.1" 200 None 2025-09-26 15:16:53,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:53,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6aa012f83206171a92710 HTTP/1.1" 200 None 2025-09-26 15:16:53,377 - lava_callback - INFO - Completed processing callback for node 68d6aa012f83206171a92710 2025-09-26 15:16:53,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:16:53,525 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6adf92f83206171a92820/log.txt.gz 2025-09-26 15:16:53,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:16:53,697 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:16:53,697 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6adf92f83206171a92820/lava_callback.json.gz 2025-09-26 15:16:53,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:53,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6adf92f83206171a92820 HTTP/1.1" 200 None 2025-09-26 15:16:53,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:53,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:16:53,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:53,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6adf92f83206171a92820 HTTP/1.1" 200 None 2025-09-26 15:16:53,820 - lava_callback - INFO - Completed processing callback for node 68d6adf92f83206171a92820 INFO: 172.20.0.1:53334 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:16:59,405 - lava_callback - INFO - Received callback for node 68d6ae032f83206171a92835 INFO: 172.20.0.1:40940 - "POST /node/68d6ae032f83206171a92835 HTTP/1.0" 202 Accepted 2025-09-26 15:16:59,411 - lava_callback - INFO - Starting async job submit for node 68d6ae032f83206171a92835 2025-09-26 15:16:59,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:16:59,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae032f83206171a92835 HTTP/1.1" 200 None 2025-09-26 15:16:59,446 - lava_callback - DEBUG - Processing node 68d6ae032f83206171a92835: baseline-arm64 2025-09-26 15:16:59,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:16:59,836 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:16:59,837 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ae032f83206171a92835/log.txt.gz 2025-09-26 15:16:59,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:16:59,994 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:16:59,995 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ae032f83206171a92835/lava_callback.json.gz 2025-09-26 15:17:00,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:00,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae032f83206171a92835 HTTP/1.1" 200 None 2025-09-26 15:17:00,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:00,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:17:00,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:00,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae032f83206171a92835 HTTP/1.1" 200 None 2025-09-26 15:17:00,085 - lava_callback - INFO - Completed processing callback for node 68d6ae032f83206171a92835 2025-09-26 15:17:01,300 - lava_callback - INFO - Received callback for node 68d6a75e2f83206171a92504 INFO: 172.20.0.1:40942 - "POST /node/68d6a75e2f83206171a92504 HTTP/1.0" 202 Accepted 2025-09-26 15:17:01,306 - lava_callback - INFO - Starting async job submit for node 68d6a75e2f83206171a92504 2025-09-26 15:17:01,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:01,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a75e2f83206171a92504 HTTP/1.1" 200 None 2025-09-26 15:17:01,340 - lava_callback - DEBUG - Processing node 68d6a75e2f83206171a92504: baseline-arm64-broonie 2025-09-26 15:17:01,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:17:01,788 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:17:01,788 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a75e2f83206171a92504/log.txt.gz 2025-09-26 15:17:01,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:17:01,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:17:01,916 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a75e2f83206171a92504/lava_callback.json.gz 2025-09-26 15:17:01,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:01,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a75e2f83206171a92504 HTTP/1.1" 200 None 2025-09-26 15:17:01,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:01,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 15:17:01,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:01,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a75e2f83206171a92504 HTTP/1.1" 200 None 2025-09-26 15:17:02,000 - lava_callback - INFO - Completed processing callback for node 68d6a75e2f83206171a92504 INFO: 172.20.0.1:40956 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:17:13,941 - lava_callback - INFO - Received callback for node 68d6ae122f83206171a92854 INFO: 172.20.0.1:50132 - "POST /node/68d6ae122f83206171a92854 HTTP/1.0" 202 Accepted 2025-09-26 15:17:13,948 - lava_callback - INFO - Starting async job submit for node 68d6ae122f83206171a92854 2025-09-26 15:17:13,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:13,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae122f83206171a92854 HTTP/1.1" 200 None 2025-09-26 15:17:13,987 - lava_callback - DEBUG - Processing node 68d6ae122f83206171a92854: baseline-arm64 2025-09-26 15:17:14,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:17:14,581 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:17:14,582 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ae122f83206171a92854/log.txt.gz 2025-09-26 15:17:14,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:17:14,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:17:14,719 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ae122f83206171a92854/lava_callback.json.gz 2025-09-26 15:17:14,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:14,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae122f83206171a92854 HTTP/1.1" 200 None 2025-09-26 15:17:14,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:14,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:17:14,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:14,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae122f83206171a92854 HTTP/1.1" 200 None 2025-09-26 15:17:14,831 - lava_callback - INFO - Completed processing callback for node 68d6ae122f83206171a92854 INFO: 172.20.0.1:50142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50148 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:17:20,513 - lava_callback - INFO - Received callback for node 68d6ae152f83206171a9285a INFO: 172.20.0.1:49106 - "POST /node/68d6ae152f83206171a9285a HTTP/1.0" 202 Accepted 2025-09-26 15:17:20,520 - lava_callback - INFO - Starting async job submit for node 68d6ae152f83206171a9285a 2025-09-26 15:17:20,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:20,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae152f83206171a9285a HTTP/1.1" 200 None 2025-09-26 15:17:20,573 - lava_callback - DEBUG - Processing node 68d6ae152f83206171a9285a: baseline-arm64 2025-09-26 15:17:20,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:17:21,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:17:21,074 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ae152f83206171a9285a/log.txt.gz 2025-09-26 15:17:21,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:17:21,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:17:21,225 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ae152f83206171a9285a/lava_callback.json.gz 2025-09-26 15:17:21,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:21,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae152f83206171a9285a HTTP/1.1" 200 None 2025-09-26 15:17:21,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:21,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:17:21,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:21,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae152f83206171a9285a HTTP/1.1" 200 None 2025-09-26 15:17:21,311 - lava_callback - INFO - Completed processing callback for node 68d6ae152f83206171a9285a 2025-09-26 15:17:21,462 - lava_callback - INFO - Received callback for node 68d693d82f83206171a91dc1 INFO: 172.20.0.1:49120 - "POST /node/68d693d82f83206171a91dc1 HTTP/1.0" 202 Accepted 2025-09-26 15:17:21,472 - lava_callback - INFO - Starting async job submit for node 68d693d82f83206171a91dc1 2025-09-26 15:17:21,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:21,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693d82f83206171a91dc1 HTTP/1.1" 200 None 2025-09-26 15:17:21,519 - lava_callback - DEBUG - Processing node 68d693d82f83206171a91dc1: baseline-arm64-broonie 2025-09-26 15:17:21,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:17:21,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:17:21,922 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d693d82f83206171a91dc1/log.txt.gz 2025-09-26 15:17:21,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:17:22,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:17:22,060 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d693d82f83206171a91dc1/lava_callback.json.gz 2025-09-26 15:17:22,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:22,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d693d82f83206171a91dc1 HTTP/1.1" 200 None 2025-09-26 15:17:22,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:22,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d5d90f2be2da466069ac22 HTTP/1.1" 200 None 2025-09-26 15:17:22,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:22,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d693d82f83206171a91dc1 HTTP/1.1" 200 None 2025-09-26 15:17:22,146 - lava_callback - INFO - Completed processing callback for node 68d693d82f83206171a91dc1 INFO: 172.20.0.1:49122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49168 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:17:31,114 - lava_callback - INFO - Received callback for node 68d6adf62f83206171a9281d INFO: 172.20.0.1:49174 - "POST /node/68d6adf62f83206171a9281d HTTP/1.0" 202 Accepted 2025-09-26 15:17:31,123 - lava_callback - INFO - Starting async job submit for node 68d6adf62f83206171a9281d 2025-09-26 15:17:31,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:31,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6adf62f83206171a9281d HTTP/1.1" 200 None 2025-09-26 15:17:31,217 - lava_callback - DEBUG - Processing node 68d6adf62f83206171a9281d: baseline-arm64 2025-09-26 15:17:31,351 - lava_callback - INFO - Received callback for node 68d407e0cd36afa834e16b14 INFO: 172.20.0.1:49190 - "POST /node/68d407e0cd36afa834e16b14 HTTP/1.0" 202 Accepted 2025-09-26 15:17:31,383 - lava_callback - INFO - Starting async job submit for node 68d407e0cd36afa834e16b14 2025-09-26 15:17:31,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:31,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d407e0cd36afa834e16b14 HTTP/1.1" 200 None 2025-09-26 15:17:31,550 - lava_callback - DEBUG - Processing node 68d407e0cd36afa834e16b14: baseline-arm64 2025-09-26 15:17:31,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:17:32,070 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:17:32,146 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6adf62f83206171a9281d/log.txt.gz 2025-09-26 15:17:32,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:17:32,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:17:32,570 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6adf62f83206171a9281d/lava_callback.json.gz 2025-09-26 15:17:32,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:32,644 - lava_callback - ERROR - Error processing callback for node 68d407e0cd36afa834e16b14: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:17:32,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6adf62f83206171a9281d HTTP/1.1" 200 None 2025-09-26 15:17:32,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:32,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:17:32,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:32,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6adf62f83206171a9281d HTTP/1.1" 200 None 2025-09-26 15:17:32,701 - lava_callback - INFO - Completed processing callback for node 68d6adf62f83206171a9281d INFO: 172.20.0.1:49200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36192 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:17:55,780 - lava_callback - INFO - Received callback for node 68d6ae232f83206171a92873 INFO: 172.20.0.1:34136 - "POST /node/68d6ae232f83206171a92873 HTTP/1.0" 202 Accepted 2025-09-26 15:17:55,786 - lava_callback - INFO - Starting async job submit for node 68d6ae232f83206171a92873 2025-09-26 15:17:55,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:55,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae232f83206171a92873 HTTP/1.1" 200 None 2025-09-26 15:17:55,824 - lava_callback - DEBUG - Processing node 68d6ae232f83206171a92873: baseline-arm64-baylibre 2025-09-26 15:17:56,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:17:56,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:17:56,245 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6ae232f83206171a92873/log.txt.gz 2025-09-26 15:17:56,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:17:56,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:17:56,387 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6ae232f83206171a92873/lava_callback.json.gz 2025-09-26 15:17:56,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:56,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae232f83206171a92873 HTTP/1.1" 200 None 2025-09-26 15:17:56,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:56,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:17:56,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:56,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae232f83206171a92873 HTTP/1.1" 200 None 2025-09-26 15:17:56,493 - lava_callback - INFO - Completed processing callback for node 68d6ae232f83206171a92873 INFO: 172.20.0.1:34152 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:17:58,021 - lava_callback - INFO - Received callback for node 68d6adfd2f83206171a92829 INFO: 172.20.0.1:34154 - "POST /node/68d6adfd2f83206171a92829 HTTP/1.0" 202 Accepted 2025-09-26 15:17:58,027 - lava_callback - INFO - Starting async job submit for node 68d6adfd2f83206171a92829 2025-09-26 15:17:58,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:58,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6adfd2f83206171a92829 HTTP/1.1" 200 None 2025-09-26 15:17:58,065 - lava_callback - DEBUG - Processing node 68d6adfd2f83206171a92829: baseline-arm64 2025-09-26 15:17:58,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:17:58,520 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:17:58,521 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6adfd2f83206171a92829/log.txt.gz 2025-09-26 15:17:58,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:17:58,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:17:58,651 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6adfd2f83206171a92829/lava_callback.json.gz 2025-09-26 15:17:58,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:58,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6adfd2f83206171a92829 HTTP/1.1" 200 None 2025-09-26 15:17:58,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:58,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:17:58,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:58,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6adfd2f83206171a92829 HTTP/1.1" 200 None 2025-09-26 15:17:58,725 - lava_callback - INFO - Completed processing callback for node 68d6adfd2f83206171a92829 2025-09-26 15:17:59,252 - lava_callback - INFO - Received callback for node 68d6ae192f83206171a92863 INFO: 172.20.0.1:34162 - "POST /node/68d6ae192f83206171a92863 HTTP/1.0" 202 Accepted 2025-09-26 15:17:59,258 - lava_callback - INFO - Starting async job submit for node 68d6ae192f83206171a92863 2025-09-26 15:17:59,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:59,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae192f83206171a92863 HTTP/1.1" 200 None 2025-09-26 15:17:59,291 - lava_callback - DEBUG - Processing node 68d6ae192f83206171a92863: baseline-arm64 2025-09-26 15:17:59,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:17:59,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:17:59,705 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ae192f83206171a92863/log.txt.gz 2025-09-26 15:17:59,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:17:59,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:17:59,846 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ae192f83206171a92863/lava_callback.json.gz 2025-09-26 15:17:59,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:59,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae192f83206171a92863 HTTP/1.1" 200 None 2025-09-26 15:17:59,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:59,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:17:59,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:17:59,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae192f83206171a92863 HTTP/1.1" 200 None 2025-09-26 15:17:59,920 - lava_callback - INFO - Completed processing callback for node 68d6ae192f83206171a92863 2025-09-26 15:18:01,114 - lava_callback - INFO - Received callback for node 68d6ae7b2f83206171a92901 INFO: 172.20.0.1:32808 - "POST /node/68d6ae7b2f83206171a92901 HTTP/1.0" 202 Accepted 2025-09-26 15:18:01,120 - lava_callback - INFO - Starting async job submit for node 68d6ae7b2f83206171a92901 2025-09-26 15:18:01,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:01,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae7b2f83206171a92901 HTTP/1.1" 200 None 2025-09-26 15:18:01,151 - lava_callback - DEBUG - Processing node 68d6ae7b2f83206171a92901: baseline-arm64-pengutronix 2025-09-26 15:18:01,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:18:01,437 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:01,438 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d6ae7b2f83206171a92901/log.txt.gz 2025-09-26 15:18:01,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:18:01,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:01,597 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d6ae7b2f83206171a92901/lava_callback.json.gz 2025-09-26 15:18:01,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:01,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae7b2f83206171a92901 HTTP/1.1" 200 None 2025-09-26 15:18:01,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:01,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:18:01,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:01,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae7b2f83206171a92901 HTTP/1.1" 200 None 2025-09-26 15:18:01,671 - lava_callback - INFO - Completed processing callback for node 68d6ae7b2f83206171a92901 2025-09-26 15:18:02,418 - lava_callback - INFO - Received callback for node 68d40ba2cd36afa834e170a0 INFO: 172.20.0.1:32822 - "POST /node/68d40ba2cd36afa834e170a0 HTTP/1.0" 202 Accepted 2025-09-26 15:18:02,425 - lava_callback - INFO - Starting async job submit for node 68d40ba2cd36afa834e170a0 2025-09-26 15:18:02,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:02,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40ba2cd36afa834e170a0 HTTP/1.1" 200 None 2025-09-26 15:18:02,438 - lava_callback - DEBUG - Processing node 68d40ba2cd36afa834e170a0: ltp-controllers 2025-09-26 15:18:02,438 - lava_callback - ERROR - Error processing callback for node 68d40ba2cd36afa834e170a0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:18:04,287 - lava_callback - INFO - Received callback for node 68d40c15cd36afa834e17282 INFO: 172.20.0.1:32836 - "POST /node/68d40c15cd36afa834e17282 HTTP/1.0" 202 Accepted 2025-09-26 15:18:04,293 - lava_callback - INFO - Starting async job submit for node 68d40c15cd36afa834e17282 2025-09-26 15:18:04,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:04,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40c15cd36afa834e17282 HTTP/1.1" 200 None 2025-09-26 15:18:04,326 - lava_callback - DEBUG - Processing node 68d40c15cd36afa834e17282: baseline-arm64 2025-09-26 15:18:04,630 - lava_callback - ERROR - Error processing callback for node 68d40c15cd36afa834e17282: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:32844 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:18:10,769 - lava_callback - INFO - Received callback for node 68d6ae192f83206171a92860 INFO: 172.20.0.1:48922 - "POST /node/68d6ae192f83206171a92860 HTTP/1.0" 202 Accepted 2025-09-26 15:18:10,775 - lava_callback - INFO - Starting async job submit for node 68d6ae192f83206171a92860 2025-09-26 15:18:10,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:10,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae192f83206171a92860 HTTP/1.1" 200 None 2025-09-26 15:18:10,808 - lava_callback - DEBUG - Processing node 68d6ae192f83206171a92860: baseline-arm64 2025-09-26 15:18:11,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:18:11,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:11,270 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ae192f83206171a92860/log.txt.gz 2025-09-26 15:18:11,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:18:11,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:11,505 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ae192f83206171a92860/lava_callback.json.gz 2025-09-26 15:18:11,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:11,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae192f83206171a92860 HTTP/1.1" 200 None 2025-09-26 15:18:11,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:11,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:18:11,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:11,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae192f83206171a92860 HTTP/1.1" 200 None 2025-09-26 15:18:11,583 - lava_callback - INFO - Completed processing callback for node 68d6ae192f83206171a92860 INFO: 172.20.0.1:48934 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 15:18:16,450 - lava_callback - INFO - Received callback for node 68d6ae022f83206171a92832 INFO: 172.20.0.1:48946 - "POST /node/68d6ae022f83206171a92832 HTTP/1.0" 202 Accepted 2025-09-26 15:18:16,456 - lava_callback - INFO - Starting async job submit for node 68d6ae022f83206171a92832 2025-09-26 15:18:16,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:16,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae022f83206171a92832 HTTP/1.1" 200 None 2025-09-26 15:18:16,491 - lava_callback - DEBUG - Processing node 68d6ae022f83206171a92832: baseline-arm64 INFO: 172.20.0.1:48950 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:18:16,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:18:16,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:16,884 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ae022f83206171a92832/log.txt.gz 2025-09-26 15:18:16,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:18:17,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:17,032 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ae022f83206171a92832/lava_callback.json.gz 2025-09-26 15:18:17,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:17,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae022f83206171a92832 HTTP/1.1" 200 None 2025-09-26 15:18:17,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:17,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:18:17,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:17,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae022f83206171a92832 HTTP/1.1" 200 None 2025-09-26 15:18:17,108 - lava_callback - INFO - Completed processing callback for node 68d6ae022f83206171a92832 2025-09-26 15:18:19,354 - lava_callback - INFO - Received callback for node 68d6ae132f83206171a92857 INFO: 172.20.0.1:42882 - "POST /node/68d6ae132f83206171a92857 HTTP/1.0" 202 Accepted 2025-09-26 15:18:19,360 - lava_callback - INFO - Starting async job submit for node 68d6ae132f83206171a92857 2025-09-26 15:18:19,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:19,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae132f83206171a92857 HTTP/1.1" 200 None 2025-09-26 15:18:19,392 - lava_callback - DEBUG - Processing node 68d6ae132f83206171a92857: baseline-arm64 2025-09-26 15:18:19,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:18:19,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:19,860 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ae132f83206171a92857/log.txt.gz 2025-09-26 15:18:19,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:18:19,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:19,977 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ae132f83206171a92857/lava_callback.json.gz 2025-09-26 15:18:19,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:20,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae132f83206171a92857 HTTP/1.1" 200 None 2025-09-26 15:18:20,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:20,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:18:20,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:20,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae132f83206171a92857 HTTP/1.1" 200 None 2025-09-26 15:18:20,047 - lava_callback - INFO - Completed processing callback for node 68d6ae132f83206171a92857 2025-09-26 15:18:23,983 - lava_callback - INFO - Received callback for node 68d6ae882f83206171a92912 INFO: 172.20.0.1:42894 - "POST /node/68d6ae882f83206171a92912 HTTP/1.0" 202 Accepted 2025-09-26 15:18:23,991 - lava_callback - INFO - Starting async job submit for node 68d6ae882f83206171a92912 2025-09-26 15:18:24,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:24,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae882f83206171a92912 HTTP/1.1" 200 None 2025-09-26 15:18:24,056 - lava_callback - DEBUG - Processing node 68d6ae882f83206171a92912: baseline-arm64-foundriesio 2025-09-26 15:18:24,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:18:24,553 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:24,554 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6ae882f83206171a92912/log.txt.gz 2025-09-26 15:18:24,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:18:24,701 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:24,702 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6ae882f83206171a92912/lava_callback.json.gz 2025-09-26 15:18:24,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:24,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae882f83206171a92912 HTTP/1.1" 200 None 2025-09-26 15:18:24,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:24,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:18:24,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:24,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae882f83206171a92912 HTTP/1.1" 200 None 2025-09-26 15:18:24,785 - lava_callback - INFO - Completed processing callback for node 68d6ae882f83206171a92912 INFO: 172.20.0.1:42898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42914 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:18:28,213 - lava_callback - INFO - Received callback for node 68d6ae252f83206171a92876 INFO: 172.20.0.1:42924 - "POST /node/68d6ae252f83206171a92876 HTTP/1.0" 202 Accepted 2025-09-26 15:18:28,218 - lava_callback - INFO - Starting async job submit for node 68d6ae252f83206171a92876 2025-09-26 15:18:28,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:28,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae252f83206171a92876 HTTP/1.1" 200 None 2025-09-26 15:18:28,254 - lava_callback - DEBUG - Processing node 68d6ae252f83206171a92876: baseline-arm64-baylibre 2025-09-26 15:18:28,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:18:28,625 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:28,625 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6ae252f83206171a92876/log.txt.gz 2025-09-26 15:18:28,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:18:28,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:28,745 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6ae252f83206171a92876/lava_callback.json.gz 2025-09-26 15:18:28,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:28,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae252f83206171a92876 HTTP/1.1" 200 None 2025-09-26 15:18:28,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:28,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:18:28,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:28,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae252f83206171a92876 HTTP/1.1" 200 None 2025-09-26 15:18:28,823 - lava_callback - INFO - Completed processing callback for node 68d6ae252f83206171a92876 2025-09-26 15:18:29,960 - lava_callback - INFO - Received callback for node 68d6ae852f83206171a9290f INFO: 172.20.0.1:47716 - "POST /node/68d6ae852f83206171a9290f HTTP/1.0" 202 Accepted 2025-09-26 15:18:29,965 - lava_callback - INFO - Starting async job submit for node 68d6ae852f83206171a9290f 2025-09-26 15:18:29,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:29,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae852f83206171a9290f HTTP/1.1" 200 None 2025-09-26 15:18:29,998 - lava_callback - DEBUG - Processing node 68d6ae852f83206171a9290f: baseline-arm64-foundriesio 2025-09-26 15:18:30,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:18:30,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:30,321 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6ae852f83206171a9290f/log.txt.gz 2025-09-26 15:18:30,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:18:30,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:30,435 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-68d6ae852f83206171a9290f/lava_callback.json.gz 2025-09-26 15:18:30,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:30,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae852f83206171a9290f HTTP/1.1" 200 None 2025-09-26 15:18:30,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:30,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:18:30,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:30,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae852f83206171a9290f HTTP/1.1" 200 None 2025-09-26 15:18:30,516 - lava_callback - INFO - Completed processing callback for node 68d6ae852f83206171a9290f INFO: 172.20.0.1:47732 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:18:31,364 - lava_callback - INFO - Received callback for node 68d6ae162f83206171a9285d INFO: 172.20.0.1:47738 - "POST /node/68d6ae162f83206171a9285d HTTP/1.0" 202 Accepted 2025-09-26 15:18:31,370 - lava_callback - INFO - Starting async job submit for node 68d6ae162f83206171a9285d 2025-09-26 15:18:31,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:31,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae162f83206171a9285d HTTP/1.1" 200 None 2025-09-26 15:18:31,407 - lava_callback - DEBUG - Processing node 68d6ae162f83206171a9285d: baseline-arm64 2025-09-26 15:18:31,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:18:31,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:31,914 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ae162f83206171a9285d/log.txt.gz 2025-09-26 15:18:31,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:18:32,026 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:32,027 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ae162f83206171a9285d/lava_callback.json.gz 2025-09-26 15:18:32,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:32,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae162f83206171a9285d HTTP/1.1" 200 None 2025-09-26 15:18:32,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:32,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:18:32,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:32,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae162f83206171a9285d HTTP/1.1" 200 None 2025-09-26 15:18:32,117 - lava_callback - INFO - Completed processing callback for node 68d6ae162f83206171a9285d INFO: 172.20.0.1:47748 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:18:38,489 - lava_callback - INFO - Received callback for node 68d6ae532f83206171a928bb INFO: 172.20.0.1:47750 - "POST /node/68d6ae532f83206171a928bb HTTP/1.0" 202 Accepted 2025-09-26 15:18:38,495 - lava_callback - INFO - Starting async job submit for node 68d6ae532f83206171a928bb 2025-09-26 15:18:38,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:38,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae532f83206171a928bb HTTP/1.1" 200 None 2025-09-26 15:18:38,529 - lava_callback - DEBUG - Processing node 68d6ae532f83206171a928bb: baseline-arm64-broonie 2025-09-26 15:18:38,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:18:38,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:38,891 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6ae532f83206171a928bb/log.txt.gz 2025-09-26 15:18:38,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:18:39,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:39,031 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6ae532f83206171a928bb/lava_callback.json.gz 2025-09-26 15:18:39,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:39,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae532f83206171a928bb HTTP/1.1" 200 None 2025-09-26 15:18:39,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:39,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:18:39,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:39,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae532f83206171a928bb HTTP/1.1" 200 None 2025-09-26 15:18:39,161 - lava_callback - INFO - Completed processing callback for node 68d6ae532f83206171a928bb 2025-09-26 15:18:39,941 - lava_callback - INFO - Received callback for node 68d6ae5c2f83206171a928cc INFO: 172.20.0.1:40050 - "POST /node/68d6ae5c2f83206171a928cc HTTP/1.0" 202 Accepted 2025-09-26 15:18:39,946 - lava_callback - INFO - Starting async job submit for node 68d6ae5c2f83206171a928cc 2025-09-26 15:18:39,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:39,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae5c2f83206171a928cc HTTP/1.1" 200 None 2025-09-26 15:18:39,985 - lava_callback - DEBUG - Processing node 68d6ae5c2f83206171a928cc: baseline-arm64-broonie 2025-09-26 15:18:40,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:18:40,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:40,327 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6ae5c2f83206171a928cc/log.txt.gz 2025-09-26 15:18:40,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:18:40,446 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:40,446 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6ae5c2f83206171a928cc/lava_callback.json.gz 2025-09-26 15:18:40,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:40,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae5c2f83206171a928cc HTTP/1.1" 200 None 2025-09-26 15:18:40,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:40,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:18:40,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:40,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae5c2f83206171a928cc HTTP/1.1" 200 None 2025-09-26 15:18:40,526 - lava_callback - INFO - Completed processing callback for node 68d6ae5c2f83206171a928cc 2025-09-26 15:18:45,110 - lava_callback - INFO - Received callback for node 68d6ae282f83206171a92879 INFO: 172.20.0.1:40066 - "POST /node/68d6ae282f83206171a92879 HTTP/1.0" 202 Accepted 2025-09-26 15:18:45,116 - lava_callback - INFO - Starting async job submit for node 68d6ae282f83206171a92879 2025-09-26 15:18:45,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:45,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae282f83206171a92879 HTTP/1.1" 200 None 2025-09-26 15:18:45,149 - lava_callback - DEBUG - Processing node 68d6ae282f83206171a92879: baseline-arm64-baylibre 2025-09-26 15:18:45,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:18:45,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:45,577 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6ae282f83206171a92879/log.txt.gz 2025-09-26 15:18:45,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:18:45,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:45,692 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6ae282f83206171a92879/lava_callback.json.gz 2025-09-26 15:18:45,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:45,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae282f83206171a92879 HTTP/1.1" 200 None 2025-09-26 15:18:45,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:45,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:18:45,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:45,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae282f83206171a92879 HTTP/1.1" 200 None 2025-09-26 15:18:45,772 - lava_callback - INFO - Completed processing callback for node 68d6ae282f83206171a92879 2025-09-26 15:18:46,124 - lava_callback - INFO - Received callback for node 68d6ae672f83206171a928e0 INFO: 172.20.0.1:40074 - "POST /node/68d6ae672f83206171a928e0 HTTP/1.0" 202 Accepted 2025-09-26 15:18:46,132 - lava_callback - INFO - Starting async job submit for node 68d6ae672f83206171a928e0 2025-09-26 15:18:46,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:46,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae672f83206171a928e0 HTTP/1.1" 200 None 2025-09-26 15:18:46,170 - lava_callback - DEBUG - Processing node 68d6ae672f83206171a928e0: baseline-arm64-clabbe 2025-09-26 15:18:46,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:40082 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:18:46,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:46,600 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d6ae672f83206171a928e0/log.txt.gz 2025-09-26 15:18:46,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:18:46,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:46,711 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d6ae672f83206171a928e0/lava_callback.json.gz 2025-09-26 15:18:46,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:46,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae672f83206171a928e0 HTTP/1.1" 200 None 2025-09-26 15:18:46,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:46,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:18:46,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:46,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae672f83206171a928e0 HTTP/1.1" 200 None 2025-09-26 15:18:46,793 - lava_callback - INFO - Completed processing callback for node 68d6ae672f83206171a928e0 2025-09-26 15:18:47,555 - lava_callback - INFO - Received callback for node 68d6ae782f83206171a928fa INFO: 172.20.0.1:40084 - "POST /node/68d6ae782f83206171a928fa HTTP/1.0" 202 Accepted 2025-09-26 15:18:47,562 - lava_callback - INFO - Starting async job submit for node 68d6ae782f83206171a928fa 2025-09-26 15:18:47,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:47,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae782f83206171a928fa HTTP/1.1" 200 None 2025-09-26 15:18:47,605 - lava_callback - DEBUG - Processing node 68d6ae782f83206171a928fa: baseline-arm64-clabbe 2025-09-26 15:18:47,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:18:47,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:47,930 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d6ae782f83206171a928fa/log.txt.gz 2025-09-26 15:18:47,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:18:48,050 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:18:48,051 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-68d6ae782f83206171a928fa/lava_callback.json.gz 2025-09-26 15:18:48,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:48,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae782f83206171a928fa HTTP/1.1" 200 None 2025-09-26 15:18:48,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:48,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:18:48,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:48,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae782f83206171a928fa HTTP/1.1" 200 None 2025-09-26 15:18:48,144 - lava_callback - INFO - Completed processing callback for node 68d6ae782f83206171a928fa INFO: 172.20.0.1:44474 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:18:57,498 - lava_callback - INFO - Received callback for node 68d40c1bcd36afa834e17288 INFO: 172.20.0.1:44482 - "POST /node/68d40c1bcd36afa834e17288 HTTP/1.0" 202 Accepted 2025-09-26 15:18:57,504 - lava_callback - INFO - Starting async job submit for node 68d40c1bcd36afa834e17288 2025-09-26 15:18:57,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:18:57,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40c1bcd36afa834e17288 HTTP/1.1" 200 None 2025-09-26 15:18:57,547 - lava_callback - DEBUG - Processing node 68d40c1bcd36afa834e17288: baseline-arm64 2025-09-26 15:18:57,862 - lava_callback - ERROR - Error processing callback for node 68d40c1bcd36afa834e17288: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:19:00,598 - lava_callback - INFO - Received callback for node 68d6ae5f2f83206171a928d3 INFO: 172.20.0.1:57686 - "POST /node/68d6ae5f2f83206171a928d3 HTTP/1.0" 202 Accepted 2025-09-26 15:19:00,604 - lava_callback - INFO - Starting async job submit for node 68d6ae5f2f83206171a928d3 2025-09-26 15:19:00,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:19:00,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae5f2f83206171a928d3 HTTP/1.1" 200 None 2025-09-26 15:19:00,638 - lava_callback - DEBUG - Processing node 68d6ae5f2f83206171a928d3: baseline-arm64-broonie 2025-09-26 15:19:00,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:19:00,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:19:00,999 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6ae5f2f83206171a928d3/log.txt.gz 2025-09-26 15:19:01,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:19:01,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:19:01,122 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6ae5f2f83206171a928d3/lava_callback.json.gz 2025-09-26 15:19:01,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:19:01,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae5f2f83206171a928d3 HTTP/1.1" 200 None 2025-09-26 15:19:01,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:19:01,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:19:01,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:19:01,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae5f2f83206171a928d3 HTTP/1.1" 200 None 2025-09-26 15:19:01,222 - lava_callback - INFO - Completed processing callback for node 68d6ae5f2f83206171a928d3 2025-09-26 15:19:01,339 - lava_callback - INFO - Received callback for node 68d40c1ccd36afa834e1728b INFO: 172.20.0.1:57698 - "POST /node/68d40c1ccd36afa834e1728b HTTP/1.0" 202 Accepted 2025-09-26 15:19:01,348 - lava_callback - INFO - Starting async job submit for node 68d40c1ccd36afa834e1728b 2025-09-26 15:19:01,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:19:01,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40c1ccd36afa834e1728b HTTP/1.1" 200 None 2025-09-26 15:19:01,387 - lava_callback - DEBUG - Processing node 68d40c1ccd36afa834e1728b: baseline-arm64 2025-09-26 15:19:01,730 - lava_callback - ERROR - Error processing callback for node 68d40c1ccd36afa834e1728b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:19:04,444 - lava_callback - INFO - Received callback for node 68d42a48a5c2c05277bc78e2 INFO: 172.20.0.1:57708 - "POST /node/68d42a48a5c2c05277bc78e2 HTTP/1.0" 202 Accepted 2025-09-26 15:19:04,450 - lava_callback - INFO - Starting async job submit for node 68d42a48a5c2c05277bc78e2 2025-09-26 15:19:04,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:19:04,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42a48a5c2c05277bc78e2 HTTP/1.1" 200 None 2025-09-26 15:19:04,485 - lava_callback - DEBUG - Processing node 68d42a48a5c2c05277bc78e2: baseline-arm 2025-09-26 15:19:04,533 - lava_callback - INFO - Received callback for node 68d40c20cd36afa834e1728e INFO: 172.20.0.1:57710 - "POST /node/68d40c20cd36afa834e1728e HTTP/1.0" 202 Accepted 2025-09-26 15:19:04,560 - lava_callback - INFO - Starting async job submit for node 68d40c20cd36afa834e1728e 2025-09-26 15:19:04,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:19:04,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40c20cd36afa834e1728e HTTP/1.1" 200 None 2025-09-26 15:19:04,684 - lava_callback - DEBUG - Processing node 68d40c20cd36afa834e1728e: baseline-arm64 2025-09-26 15:19:04,810 - lava_callback - ERROR - Error processing callback for node 68d42a48a5c2c05277bc78e2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:19:05,040 - lava_callback - ERROR - Error processing callback for node 68d40c20cd36afa834e1728e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:57714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46444 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:19:18,322 - lava_callback - INFO - Received callback for node 68d6a8652f83206171a92650 INFO: 172.20.0.1:46452 - "POST /node/68d6a8652f83206171a92650 HTTP/1.0" 202 Accepted 2025-09-26 15:19:18,328 - lava_callback - INFO - Starting async job submit for node 68d6a8652f83206171a92650 2025-09-26 15:19:18,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:19:18,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8652f83206171a92650 HTTP/1.1" 200 None 2025-09-26 15:19:18,372 - lava_callback - DEBUG - Processing node 68d6a8652f83206171a92650: baseline-arm64-broonie 2025-09-26 15:19:18,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:19:18,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:19:18,775 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a8652f83206171a92650/log.txt.gz 2025-09-26 15:19:18,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:19:18,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:19:18,900 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a8652f83206171a92650/lava_callback.json.gz 2025-09-26 15:19:18,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:19:18,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8652f83206171a92650 HTTP/1.1" 200 None 2025-09-26 15:19:18,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:19:18,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 15:19:18,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:19:18,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8652f83206171a92650 HTTP/1.1" 200 None 2025-09-26 15:19:18,987 - lava_callback - INFO - Completed processing callback for node 68d6a8652f83206171a92650 2025-09-26 15:19:20,011 - lava_callback - INFO - Received callback for node 68d694d72f83206171a91f54 INFO: 172.20.0.1:47678 - "POST /node/68d694d72f83206171a91f54 HTTP/1.0" 202 Accepted 2025-09-26 15:19:20,017 - lava_callback - INFO - Starting async job submit for node 68d694d72f83206171a91f54 2025-09-26 15:19:20,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:19:20,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694d72f83206171a91f54 HTTP/1.1" 200 None 2025-09-26 15:19:20,051 - lava_callback - DEBUG - Processing node 68d694d72f83206171a91f54: baseline-arm64-broonie 2025-09-26 15:19:20,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:19:20,376 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:19:20,377 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d694d72f83206171a91f54/log.txt.gz 2025-09-26 15:19:20,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:19:20,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:19:20,520 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d694d72f83206171a91f54/lava_callback.json.gz 2025-09-26 15:19:20,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:19:20,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d694d72f83206171a91f54 HTTP/1.1" 200 None 2025-09-26 15:19:20,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:19:20,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d637475d233c363a761c21 HTTP/1.1" 200 None 2025-09-26 15:19:20,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:19:20,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d694d72f83206171a91f54 HTTP/1.1" 200 None 2025-09-26 15:19:20,596 - lava_callback - INFO - Completed processing callback for node 68d694d72f83206171a91f54 2025-09-26 15:19:22,483 - lava_callback - INFO - Received callback for node 68d6a7612f83206171a9250b INFO: 172.20.0.1:47680 - "POST /node/68d6a7612f83206171a9250b HTTP/1.0" 202 Accepted 2025-09-26 15:19:22,489 - lava_callback - INFO - Starting async job submit for node 68d6a7612f83206171a9250b 2025-09-26 15:19:22,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:19:22,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7612f83206171a9250b HTTP/1.1" 200 None 2025-09-26 15:19:22,524 - lava_callback - DEBUG - Processing node 68d6a7612f83206171a9250b: baseline-arm64-broonie 2025-09-26 15:19:22,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:19:22,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:19:22,997 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a7612f83206171a9250b/log.txt.gz 2025-09-26 15:19:23,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:19:23,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:19:23,147 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a7612f83206171a9250b/lava_callback.json.gz 2025-09-26 15:19:23,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:19:23,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7612f83206171a9250b HTTP/1.1" 200 None 2025-09-26 15:19:23,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:19:23,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 15:19:23,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:19:23,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7612f83206171a9250b HTTP/1.1" 200 None 2025-09-26 15:19:23,236 - lava_callback - INFO - Completed processing callback for node 68d6a7612f83206171a9250b INFO: 172.20.0.1:47696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46774 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:19:39,193 - lava_callback - INFO - Received callback for node 68d40b9dcd36afa834e1709a INFO: 172.20.0.1:46788 - "POST /node/68d40b9dcd36afa834e1709a HTTP/1.0" 202 Accepted 2025-09-26 15:19:39,204 - lava_callback - INFO - Starting async job submit for node 68d40b9dcd36afa834e1709a 2025-09-26 15:19:39,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:19:39,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40b9dcd36afa834e1709a HTTP/1.1" 200 None 2025-09-26 15:19:39,575 - lava_callback - DEBUG - Processing node 68d40b9dcd36afa834e1709a: ltp-controllers 2025-09-26 15:19:40,675 - lava_callback - INFO - Received callback for node 68d6a7552f83206171a924f7 INFO: 172.20.0.1:55136 - "POST /node/68d6a7552f83206171a924f7 HTTP/1.0" 202 Accepted 2025-09-26 15:19:40,697 - lava_callback - INFO - Starting async job submit for node 68d6a7552f83206171a924f7 2025-09-26 15:19:40,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:19:40,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7552f83206171a924f7 HTTP/1.1" 200 None 2025-09-26 15:19:40,830 - lava_callback - DEBUG - Processing node 68d6a7552f83206171a924f7: baseline-arm64-broonie 2025-09-26 15:19:41,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:19:41,670 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:19:41,712 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a7552f83206171a924f7/log.txt.gz 2025-09-26 15:19:41,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:19:42,106 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:19:42,148 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a7552f83206171a924f7/lava_callback.json.gz 2025-09-26 15:19:42,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:19:42,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7552f83206171a924f7 HTTP/1.1" 200 None 2025-09-26 15:19:42,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:19:42,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 15:19:42,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:19:42,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7552f83206171a924f7 HTTP/1.1" 200 None 2025-09-26 15:19:42,457 - lava_callback - INFO - Completed processing callback for node 68d6a7552f83206171a924f7 2025-09-26 15:19:42,855 - lava_callback - ERROR - Error processing callback for node 68d40b9dcd36afa834e1709a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:55146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43164 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:20:02,532 - lava_callback - INFO - Received callback for node 68d40c19cd36afa834e17285 INFO: 172.20.0.1:47266 - "POST /node/68d40c19cd36afa834e17285 HTTP/1.0" 202 Accepted 2025-09-26 15:20:02,538 - lava_callback - INFO - Starting async job submit for node 68d40c19cd36afa834e17285 2025-09-26 15:20:02,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:02,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40c19cd36afa834e17285 HTTP/1.1" 200 None 2025-09-26 15:20:02,572 - lava_callback - DEBUG - Processing node 68d40c19cd36afa834e17285: ltp-cve 2025-09-26 15:20:02,572 - lava_callback - ERROR - Error processing callback for node 68d40c19cd36afa834e17285: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:20:05,087 - lava_callback - INFO - Received callback for node 68d6ae342f83206171a92889 INFO: 172.20.0.1:47280 - "POST /node/68d6ae342f83206171a92889 HTTP/1.0" 202 Accepted 2025-09-26 15:20:05,093 - lava_callback - INFO - Starting async job submit for node 68d6ae342f83206171a92889 2025-09-26 15:20:05,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:05,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae342f83206171a92889 HTTP/1.1" 200 None 2025-09-26 15:20:05,126 - lava_callback - DEBUG - Processing node 68d6ae342f83206171a92889: baseline-arm64-baylibre 2025-09-26 15:20:05,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:20:05,526 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:20:05,527 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6ae342f83206171a92889/log.txt.gz 2025-09-26 15:20:05,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:20:05,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:20:05,668 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6ae342f83206171a92889/lava_callback.json.gz 2025-09-26 15:20:05,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:05,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae342f83206171a92889 HTTP/1.1" 200 None 2025-09-26 15:20:05,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:05,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:20:05,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:05,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae342f83206171a92889 HTTP/1.1" 200 None 2025-09-26 15:20:05,779 - lava_callback - INFO - Completed processing callback for node 68d6ae342f83206171a92889 INFO: 172.20.0.1:47288 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:20:08,496 - lava_callback - INFO - Received callback for node 68d6ae2b2f83206171a9287c INFO: 172.20.0.1:47294 - "POST /node/68d6ae2b2f83206171a9287c HTTP/1.0" 202 Accepted 2025-09-26 15:20:08,502 - lava_callback - INFO - Starting async job submit for node 68d6ae2b2f83206171a9287c 2025-09-26 15:20:08,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:08,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae2b2f83206171a9287c HTTP/1.1" 200 None 2025-09-26 15:20:08,535 - lava_callback - DEBUG - Processing node 68d6ae2b2f83206171a9287c: baseline-arm64-baylibre 2025-09-26 15:20:08,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:20:08,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:20:08,916 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6ae2b2f83206171a9287c/log.txt.gz 2025-09-26 15:20:08,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:20:09,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:20:09,054 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6ae2b2f83206171a9287c/lava_callback.json.gz 2025-09-26 15:20:09,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:09,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae2b2f83206171a9287c HTTP/1.1" 200 None 2025-09-26 15:20:09,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:09,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:20:09,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:09,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae2b2f83206171a9287c HTTP/1.1" 200 None 2025-09-26 15:20:09,155 - lava_callback - INFO - Completed processing callback for node 68d6ae2b2f83206171a9287c INFO: 172.20.0.1:34906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34916 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:20:17,939 - lava_callback - INFO - Received callback for node 68d6ae2e2f83206171a9287f INFO: 172.20.0.1:34918 - "POST /node/68d6ae2e2f83206171a9287f HTTP/1.0" 202 Accepted 2025-09-26 15:20:17,944 - lava_callback - INFO - Starting async job submit for node 68d6ae2e2f83206171a9287f 2025-09-26 15:20:17,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:17,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae2e2f83206171a9287f HTTP/1.1" 200 None 2025-09-26 15:20:17,978 - lava_callback - DEBUG - Processing node 68d6ae2e2f83206171a9287f: baseline-arm64-baylibre 2025-09-26 15:20:18,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:20:18,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:20:18,322 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6ae2e2f83206171a9287f/log.txt.gz 2025-09-26 15:20:18,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:20:18,452 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:20:18,453 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6ae2e2f83206171a9287f/lava_callback.json.gz 2025-09-26 15:20:18,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:18,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae2e2f83206171a9287f HTTP/1.1" 200 None 2025-09-26 15:20:18,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:18,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:20:18,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:18,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae2e2f83206171a9287f HTTP/1.1" 200 None 2025-09-26 15:20:18,537 - lava_callback - INFO - Completed processing callback for node 68d6ae2e2f83206171a9287f 2025-09-26 15:20:19,041 - lava_callback - INFO - Received callback for node 68d40c22cd36afa834e17299 INFO: 172.20.0.1:34932 - "POST /node/68d40c22cd36afa834e17299 HTTP/1.0" 202 Accepted 2025-09-26 15:20:19,048 - lava_callback - INFO - Starting async job submit for node 68d40c22cd36afa834e17299 2025-09-26 15:20:19,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:19,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40c22cd36afa834e17299 HTTP/1.1" 200 None 2025-09-26 15:20:19,086 - lava_callback - DEBUG - Processing node 68d40c22cd36afa834e17299: baseline-arm64 2025-09-26 15:20:19,423 - lava_callback - ERROR - Error processing callback for node 68d40c22cd36afa834e17299: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:20:24,969 - lava_callback - INFO - Received callback for node 68d40c32cd36afa834e172af INFO: 172.20.0.1:53182 - "POST /node/68d40c32cd36afa834e172af HTTP/1.0" 202 Accepted 2025-09-26 15:20:24,975 - lava_callback - INFO - Starting async job submit for node 68d40c32cd36afa834e172af 2025-09-26 15:20:24,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:25,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40c32cd36afa834e172af HTTP/1.1" 200 None 2025-09-26 15:20:25,010 - lava_callback - DEBUG - Processing node 68d40c32cd36afa834e172af: baseline-arm64 2025-09-26 15:20:25,297 - lava_callback - ERROR - Error processing callback for node 68d40c32cd36afa834e172af: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:53194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53206 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:20:27,433 - lava_callback - INFO - Received callback for node 68d40c33cd36afa834e172b2 INFO: 172.20.0.1:53212 - "POST /node/68d40c33cd36afa834e172b2 HTTP/1.0" 202 Accepted 2025-09-26 15:20:27,439 - lava_callback - INFO - Starting async job submit for node 68d40c33cd36afa834e172b2 2025-09-26 15:20:27,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:27,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40c33cd36afa834e172b2 HTTP/1.1" 200 None 2025-09-26 15:20:27,486 - lava_callback - DEBUG - Processing node 68d40c33cd36afa834e172b2: baseline-arm64 2025-09-26 15:20:27,780 - lava_callback - ERROR - Error processing callback for node 68d40c33cd36afa834e172b2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:47308 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:20:31,838 - lava_callback - INFO - Received callback for node 68d6942c2f83206171a91e2a INFO: 172.20.0.1:47322 - "POST /node/68d6942c2f83206171a91e2a HTTP/1.0" 202 Accepted 2025-09-26 15:20:31,845 - lava_callback - INFO - Starting async job submit for node 68d6942c2f83206171a91e2a 2025-09-26 15:20:31,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:31,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6942c2f83206171a91e2a HTTP/1.1" 200 None 2025-09-26 15:20:31,899 - lava_callback - DEBUG - Processing node 68d6942c2f83206171a91e2a: baseline-arm64 2025-09-26 15:20:32,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:20:33,172 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:20:33,172 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6942c2f83206171a91e2a/log.txt.gz 2025-09-26 15:20:33,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:20:33,357 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:20:33,358 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6942c2f83206171a91e2a/lava_callback.json.gz DEBUG: Setup failed for 68d6942c2f83206171a91e2a. Transitting job node result: incomplete -> fail 2025-09-26 15:20:33,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:33,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6942c2f83206171a91e2a HTTP/1.1" 200 None 2025-09-26 15:20:33,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:33,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 15:20:33,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:33,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6942c2f83206171a91e2a HTTP/1.1" 200 None 2025-09-26 15:20:33,521 - lava_callback - INFO - Completed processing callback for node 68d6942c2f83206171a91e2a INFO: 172.20.0.1:47330 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:20:38,928 - lava_callback - INFO - Received callback for node 68d40b99cd36afa834e17094 INFO: 172.20.0.1:47336 - "POST /node/68d40b99cd36afa834e17094 HTTP/1.0" 202 Accepted 2025-09-26 15:20:38,939 - lava_callback - INFO - Starting async job submit for node 68d40b99cd36afa834e17094 2025-09-26 15:20:39,111 - lava_callback - INFO - Received callback for node 68d6942c2f83206171a91e30 INFO: 172.20.0.1:47350 - "POST /node/68d6942c2f83206171a91e30 HTTP/1.0" 202 Accepted 2025-09-26 15:20:39,149 - lava_callback - INFO - Starting async job submit for node 68d6942c2f83206171a91e30 2025-09-26 15:20:39,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:39,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6942c2f83206171a91e30 HTTP/1.1" 200 None 2025-09-26 15:20:39,324 - lava_callback - DEBUG - Processing node 68d6942c2f83206171a91e30: baseline-arm64 2025-09-26 15:20:39,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:39,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40b99cd36afa834e17094 HTTP/1.1" 200 None 2025-09-26 15:20:39,466 - lava_callback - DEBUG - Processing node 68d40b99cd36afa834e17094: ltp-controllers 2025-09-26 15:20:40,232 - lava_callback - INFO - Received callback for node 68d6a75b2f83206171a924fd INFO: 172.20.0.1:43624 - "POST /node/68d6a75b2f83206171a924fd HTTP/1.0" 202 Accepted 2025-09-26 15:20:41,392 - lava_callback - INFO - Starting async job submit for node 68d6a75b2f83206171a924fd 2025-09-26 15:20:41,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:41,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a75b2f83206171a924fd HTTP/1.1" 200 None 2025-09-26 15:20:41,553 - lava_callback - DEBUG - Processing node 68d6a75b2f83206171a924fd: baseline-arm64-broonie 2025-09-26 15:20:42,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:20:42,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:20:42,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:20:42,360 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6942c2f83206171a91e30/log.txt.gz 2025-09-26 15:20:42,403 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:20:42,460 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a75b2f83206171a924fd/log.txt.gz 2025-09-26 15:20:42,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:20:42,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:20:42,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:20:42,796 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6942c2f83206171a91e30/lava_callback.json.gz 2025-09-26 15:20:42,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:20:43,055 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a75b2f83206171a924fd/lava_callback.json.gz DEBUG: Setup failed for 68d6942c2f83206171a91e30. Transitting job node result: incomplete -> fail 2025-09-26 15:20:43,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:43,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:43,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a75b2f83206171a924fd HTTP/1.1" 200 None 2025-09-26 15:20:43,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6942c2f83206171a91e30 HTTP/1.1" 200 None 2025-09-26 15:20:43,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:43,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:43,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 15:20:43,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:43,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 15:20:43,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:43,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a75b2f83206171a924fd HTTP/1.1" 200 None 2025-09-26 15:20:43,357 - lava_callback - INFO - Completed processing callback for node 68d6a75b2f83206171a924fd 2025-09-26 15:20:43,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6942c2f83206171a91e30 HTTP/1.1" 200 None 2025-09-26 15:20:43,426 - lava_callback - INFO - Completed processing callback for node 68d6942c2f83206171a91e30 2025-09-26 15:20:44,085 - lava_callback - ERROR - Error processing callback for node 68d40b99cd36afa834e17094: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:20:45,949 - lava_callback - INFO - Received callback for node 68d40c36cd36afa834e172b5 INFO: 172.20.0.1:43640 - "POST /node/68d40c36cd36afa834e172b5 HTTP/1.0" 202 Accepted 2025-09-26 15:20:45,955 - lava_callback - INFO - Starting async job submit for node 68d40c36cd36afa834e172b5 2025-09-26 15:20:45,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:45,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40c36cd36afa834e172b5 HTTP/1.1" 200 None 2025-09-26 15:20:45,971 - lava_callback - DEBUG - Processing node 68d40c36cd36afa834e172b5: baseline-arm64 2025-09-26 15:20:45,971 - lava_callback - ERROR - Error processing callback for node 68d40c36cd36afa834e172b5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:43646 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:20:46,687 - lava_callback - INFO - Received callback for node 68d40c3acd36afa834e172b8 INFO: 172.20.0.1:43654 - "POST /node/68d40c3acd36afa834e172b8 HTTP/1.0" 202 Accepted 2025-09-26 15:20:46,692 - lava_callback - INFO - Starting async job submit for node 68d40c3acd36afa834e172b8 2025-09-26 15:20:46,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:46,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40c3acd36afa834e172b8 HTTP/1.1" 200 None 2025-09-26 15:20:46,705 - lava_callback - DEBUG - Processing node 68d40c3acd36afa834e172b8: baseline-arm64 2025-09-26 15:20:46,705 - lava_callback - ERROR - Error processing callback for node 68d40c3acd36afa834e172b8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:20:52,804 - lava_callback - INFO - Received callback for node 68d6ae312f83206171a92886 INFO: 172.20.0.1:40782 - "POST /node/68d6ae312f83206171a92886 HTTP/1.0" 202 Accepted 2025-09-26 15:20:52,810 - lava_callback - INFO - Starting async job submit for node 68d6ae312f83206171a92886 2025-09-26 15:20:52,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:52,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae312f83206171a92886 HTTP/1.1" 200 None 2025-09-26 15:20:52,843 - lava_callback - DEBUG - Processing node 68d6ae312f83206171a92886: baseline-arm64-baylibre 2025-09-26 15:20:53,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:20:53,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:20:53,224 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6ae312f83206171a92886/log.txt.gz 2025-09-26 15:20:53,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:20:53,354 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:20:53,355 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-baylibre-68d6ae312f83206171a92886/lava_callback.json.gz 2025-09-26 15:20:53,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:53,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae312f83206171a92886 HTTP/1.1" 200 None 2025-09-26 15:20:53,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:53,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:20:53,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:53,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae312f83206171a92886 HTTP/1.1" 200 None 2025-09-26 15:20:53,433 - lava_callback - INFO - Completed processing callback for node 68d6ae312f83206171a92886 INFO: 172.20.0.1:40784 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:20:58,790 - lava_callback - INFO - Received callback for node 68d6ae472f83206171a928ab INFO: 172.20.0.1:40790 - "POST /node/68d6ae472f83206171a928ab HTTP/1.0" 202 Accepted 2025-09-26 15:20:58,795 - lava_callback - INFO - Starting async job submit for node 68d6ae472f83206171a928ab 2025-09-26 15:20:58,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:58,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae472f83206171a928ab HTTP/1.1" 200 None 2025-09-26 15:20:58,829 - lava_callback - DEBUG - Processing node 68d6ae472f83206171a928ab: baseline-arm64-broonie 2025-09-26 15:20:59,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:20:59,178 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:20:59,179 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6ae472f83206171a928ab/log.txt.gz 2025-09-26 15:20:59,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:20:59,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:20:59,300 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6ae472f83206171a928ab/lava_callback.json.gz 2025-09-26 15:20:59,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:59,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae472f83206171a928ab HTTP/1.1" 200 None 2025-09-26 15:20:59,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:59,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:20:59,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:20:59,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae472f83206171a928ab HTTP/1.1" 200 None 2025-09-26 15:20:59,383 - lava_callback - INFO - Completed processing callback for node 68d6ae472f83206171a928ab 2025-09-26 15:21:06,224 - lava_callback - INFO - Received callback for node 68d6a86b2f83206171a9265e INFO: 172.20.0.1:44376 - "POST /node/68d6a86b2f83206171a9265e HTTP/1.0" 202 Accepted 2025-09-26 15:21:06,230 - lava_callback - INFO - Starting async job submit for node 68d6a86b2f83206171a9265e 2025-09-26 15:21:06,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:21:06,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a86b2f83206171a9265e HTTP/1.1" 200 None 2025-09-26 15:21:06,287 - lava_callback - DEBUG - Processing node 68d6a86b2f83206171a9265e: baseline-arm64-broonie 2025-09-26 15:21:06,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:44382 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:21:06,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:21:06,653 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a86b2f83206171a9265e/log.txt.gz 2025-09-26 15:21:06,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:21:06,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:21:06,793 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a86b2f83206171a9265e/lava_callback.json.gz 2025-09-26 15:21:06,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:21:06,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a86b2f83206171a9265e HTTP/1.1" 200 None 2025-09-26 15:21:06,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:21:06,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 15:21:06,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:21:06,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a86b2f83206171a9265e HTTP/1.1" 200 None 2025-09-26 15:21:06,916 - lava_callback - INFO - Completed processing callback for node 68d6a86b2f83206171a9265e INFO: 172.20.0.1:60684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60688 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:21:23,584 - lava_callback - INFO - Received callback for node 68d42a4ca5c2c05277bc78e8 INFO: 172.20.0.1:50804 - "POST /node/68d42a4ca5c2c05277bc78e8 HTTP/1.0" 202 Accepted 2025-09-26 15:21:23,589 - lava_callback - INFO - Starting async job submit for node 68d42a4ca5c2c05277bc78e8 2025-09-26 15:21:23,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:21:23,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42a4ca5c2c05277bc78e8 HTTP/1.1" 200 None 2025-09-26 15:21:23,631 - lava_callback - DEBUG - Processing node 68d42a4ca5c2c05277bc78e8: baseline-arm 2025-09-26 15:21:23,873 - lava_callback - ERROR - Error processing callback for node 68d42a4ca5c2c05277bc78e8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:50808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58560 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:22:19,264 - lava_callback - INFO - Received callback for node 68d6ae592f83206171a928c5 INFO: 172.20.0.1:58570 - "POST /node/68d6ae592f83206171a928c5 HTTP/1.0" 202 Accepted 2025-09-26 15:22:19,270 - lava_callback - INFO - Starting async job submit for node 68d6ae592f83206171a928c5 2025-09-26 15:22:19,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:22:19,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae592f83206171a928c5 HTTP/1.1" 200 None 2025-09-26 15:22:19,340 - lava_callback - DEBUG - Processing node 68d6ae592f83206171a928c5: baseline-arm64-broonie 2025-09-26 15:22:19,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:22:19,686 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:22:19,687 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6ae592f83206171a928c5/log.txt.gz 2025-09-26 15:22:19,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:22:19,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:22:19,841 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6ae592f83206171a928c5/lava_callback.json.gz 2025-09-26 15:22:19,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:22:19,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae592f83206171a928c5 HTTP/1.1" 200 None 2025-09-26 15:22:19,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:22:19,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:22:19,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:22:19,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae592f83206171a928c5 HTTP/1.1" 200 None 2025-09-26 15:22:19,982 - lava_callback - INFO - Completed processing callback for node 68d6ae592f83206171a928c5 INFO: 172.20.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52738 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:22:59,129 - lava_callback - INFO - Received callback for node 68d6aa6f2f83206171a92727 INFO: 172.20.0.1:52740 - "POST /node/68d6aa6f2f83206171a92727 HTTP/1.0" 202 Accepted 2025-09-26 15:22:59,137 - lava_callback - INFO - Starting async job submit for node 68d6aa6f2f83206171a92727 2025-09-26 15:22:59,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:22:59,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6aa6f2f83206171a92727 HTTP/1.1" 200 None 2025-09-26 15:22:59,183 - lava_callback - DEBUG - Processing node 68d6aa6f2f83206171a92727: blktests-ddp-x86 2025-09-26 15:22:59,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:23:00,124 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:23:00,124 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/blktests-ddp-x86-68d6aa6f2f83206171a92727/log.txt.gz 2025-09-26 15:23:00,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:23:00,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:23:00,311 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/blktests-ddp-x86-68d6aa6f2f83206171a92727/lava_callback.json.gz 2025-09-26 15:23:00,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:23:00,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6aa6f2f83206171a92727 HTTP/1.1" 200 None 2025-09-26 15:23:00,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:23:00,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d649055d233c363a762366 HTTP/1.1" 200 None 2025-09-26 15:23:00,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:23:00,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6aa6f2f83206171a92727 HTTP/1.1" 200 None 2025-09-26 15:23:00,402 - lava_callback - INFO - Completed processing callback for node 68d6aa6f2f83206171a92727 2025-09-26 15:23:04,432 - lava_callback - INFO - Received callback for node 68d6ae4d2f83206171a928b1 INFO: 172.20.0.1:60250 - "POST /node/68d6ae4d2f83206171a928b1 HTTP/1.0" 202 Accepted 2025-09-26 15:23:04,439 - lava_callback - INFO - Starting async job submit for node 68d6ae4d2f83206171a928b1 2025-09-26 15:23:04,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:23:04,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae4d2f83206171a928b1 HTTP/1.1" 200 None 2025-09-26 15:23:04,474 - lava_callback - DEBUG - Processing node 68d6ae4d2f83206171a928b1: baseline-arm64-broonie 2025-09-26 15:23:04,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:23:04,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:23:04,825 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6ae4d2f83206171a928b1/log.txt.gz 2025-09-26 15:23:04,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:23:05,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:23:05,203 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6ae4d2f83206171a928b1/lava_callback.json.gz 2025-09-26 15:23:05,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:23:05,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae4d2f83206171a928b1 HTTP/1.1" 200 None 2025-09-26 15:23:05,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:23:05,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:23:05,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:23:05,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae4d2f83206171a928b1 HTTP/1.1" 200 None 2025-09-26 15:23:05,287 - lava_callback - INFO - Completed processing callback for node 68d6ae4d2f83206171a928b1 INFO: 172.20.0.1:60256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51316 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:23:25,212 - lava_callback - INFO - Received callback for node 68d42a4ea5c2c05277bc78eb INFO: 172.20.0.1:42990 - "POST /node/68d42a4ea5c2c05277bc78eb HTTP/1.0" 202 Accepted 2025-09-26 15:23:25,218 - lava_callback - INFO - Starting async job submit for node 68d42a4ea5c2c05277bc78eb 2025-09-26 15:23:25,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:23:25,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42a4ea5c2c05277bc78eb HTTP/1.1" 200 None 2025-09-26 15:23:25,256 - lava_callback - DEBUG - Processing node 68d42a4ea5c2c05277bc78eb: baseline-arm 2025-09-26 15:23:25,476 - lava_callback - ERROR - Error processing callback for node 68d42a4ea5c2c05277bc78eb: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:43006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43008 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:23:31,625 - lava_callback - INFO - Received callback for node 68d6adfa2f83206171a92823 INFO: 172.20.0.1:45548 - "POST /node/68d6adfa2f83206171a92823 HTTP/1.0" 202 Accepted 2025-09-26 15:23:31,631 - lava_callback - INFO - Starting async job submit for node 68d6adfa2f83206171a92823 2025-09-26 15:23:31,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:23:31,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6adfa2f83206171a92823 HTTP/1.1" 200 None 2025-09-26 15:23:31,686 - lava_callback - DEBUG - Processing node 68d6adfa2f83206171a92823: baseline-arm64 2025-09-26 15:23:31,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:23:32,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:23:32,137 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6adfa2f83206171a92823/log.txt.gz 2025-09-26 15:23:32,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:23:32,303 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:23:32,304 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6adfa2f83206171a92823/lava_callback.json.gz 2025-09-26 15:23:32,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:23:32,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6adfa2f83206171a92823 HTTP/1.1" 200 None 2025-09-26 15:23:32,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:23:32,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:23:32,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:23:32,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6adfa2f83206171a92823 HTTP/1.1" 200 None 2025-09-26 15:23:32,393 - lava_callback - INFO - Completed processing callback for node 68d6adfa2f83206171a92823 INFO: 172.20.0.1:45550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45556 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:23:38,474 - lava_callback - INFO - Received callback for node 68d6a8622f83206171a92649 INFO: 172.20.0.1:45558 - "POST /node/68d6a8622f83206171a92649 HTTP/1.0" 202 Accepted 2025-09-26 15:23:38,479 - lava_callback - INFO - Starting async job submit for node 68d6a8622f83206171a92649 2025-09-26 15:23:38,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:23:38,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8622f83206171a92649 HTTP/1.1" 200 None 2025-09-26 15:23:38,512 - lava_callback - DEBUG - Processing node 68d6a8622f83206171a92649: baseline-arm64-broonie 2025-09-26 15:23:38,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:23:38,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:23:38,893 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a8622f83206171a92649/log.txt.gz 2025-09-26 15:23:38,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:23:39,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:23:39,032 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a8622f83206171a92649/lava_callback.json.gz 2025-09-26 15:23:39,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:23:39,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8622f83206171a92649 HTTP/1.1" 200 None 2025-09-26 15:23:39,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:23:39,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 15:23:39,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:23:39,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8622f83206171a92649 HTTP/1.1" 200 None 2025-09-26 15:23:39,125 - lava_callback - INFO - Completed processing callback for node 68d6a8622f83206171a92649 2025-09-26 15:23:42,663 - lava_callback - INFO - Received callback for node 68d40cf4cd36afa834e17403 INFO: 172.20.0.1:48442 - "POST /node/68d40cf4cd36afa834e17403 HTTP/1.0" 202 Accepted 2025-09-26 15:23:42,669 - lava_callback - INFO - Starting async job submit for node 68d40cf4cd36afa834e17403 2025-09-26 15:23:42,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:23:42,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40cf4cd36afa834e17403 HTTP/1.1" 200 None 2025-09-26 15:23:42,682 - lava_callback - DEBUG - Processing node 68d40cf4cd36afa834e17403: ltp-cap-bounds 2025-09-26 15:23:42,683 - lava_callback - ERROR - Error processing callback for node 68d40cf4cd36afa834e17403: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:48448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41744 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:24:02,727 - lava_callback - INFO - Received callback for node 68d40cffcd36afa834e17414 INFO: 172.20.0.1:43772 - "POST /node/68d40cffcd36afa834e17414 HTTP/1.0" 202 Accepted 2025-09-26 15:24:02,733 - lava_callback - INFO - Starting async job submit for node 68d40cffcd36afa834e17414 2025-09-26 15:24:02,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:24:02,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40cffcd36afa834e17414 HTTP/1.1" 200 None 2025-09-26 15:24:02,749 - lava_callback - DEBUG - Processing node 68d40cffcd36afa834e17414: ltp-containers 2025-09-26 15:24:02,749 - lava_callback - ERROR - Error processing callback for node 68d40cffcd36afa834e17414: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:24:03,555 - lava_callback - INFO - Received callback for node 68d40d02cd36afa834e17417 INFO: 172.20.0.1:43774 - "POST /node/68d40d02cd36afa834e17417 HTTP/1.0" 202 Accepted 2025-09-26 15:24:03,561 - lava_callback - INFO - Starting async job submit for node 68d40d02cd36afa834e17417 2025-09-26 15:24:03,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:24:03,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40d02cd36afa834e17417 HTTP/1.1" 200 None 2025-09-26 15:24:03,578 - lava_callback - DEBUG - Processing node 68d40d02cd36afa834e17417: ltp-cap-bounds 2025-09-26 15:24:03,578 - lava_callback - ERROR - Error processing callback for node 68d40d02cd36afa834e17417: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:43782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37178 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:24:18,728 - lava_callback - INFO - Received callback for node 68d6afac2f83206171a92990 INFO: 172.20.0.1:37192 - "POST /node/68d6afac2f83206171a92990 HTTP/1.0" 202 Accepted 2025-09-26 15:24:18,734 - lava_callback - INFO - Starting async job submit for node 68d6afac2f83206171a92990 2025-09-26 15:24:18,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:24:18,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6afac2f83206171a92990 HTTP/1.1" 200 None 2025-09-26 15:24:18,791 - lava_callback - DEBUG - Processing node 68d6afac2f83206171a92990: baseline-arm64-broonie 2025-09-26 15:24:19,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:24:19,183 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:24:19,184 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6afac2f83206171a92990/log.txt.gz 2025-09-26 15:24:19,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:24:19,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:24:19,325 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6afac2f83206171a92990/lava_callback.json.gz 2025-09-26 15:24:19,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:24:19,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6afac2f83206171a92990 HTTP/1.1" 200 None 2025-09-26 15:24:19,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:24:19,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:24:19,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:24:19,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6afac2f83206171a92990 HTTP/1.1" 200 None 2025-09-26 15:24:19,428 - lava_callback - INFO - Completed processing callback for node 68d6afac2f83206171a92990 2025-09-26 15:24:22,660 - lava_callback - INFO - Received callback for node 68d40d12cd36afa834e17429 INFO: 172.20.0.1:35300 - "POST /node/68d40d12cd36afa834e17429 HTTP/1.0" 202 Accepted 2025-09-26 15:24:22,666 - lava_callback - INFO - Starting async job submit for node 68d40d12cd36afa834e17429 2025-09-26 15:24:22,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:24:22,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40d12cd36afa834e17429 HTTP/1.1" 200 None 2025-09-26 15:24:22,679 - lava_callback - DEBUG - Processing node 68d40d12cd36afa834e17429: ltp-containers 2025-09-26 15:24:22,679 - lava_callback - ERROR - Error processing callback for node 68d40d12cd36afa834e17429: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:24:23,465 - lava_callback - INFO - Received callback for node 68d40d1bcd36afa834e17448 INFO: 172.20.0.1:35312 - "POST /node/68d40d1bcd36afa834e17448 HTTP/1.0" 202 Accepted 2025-09-26 15:24:23,470 - lava_callback - INFO - Starting async job submit for node 68d40d1bcd36afa834e17448 2025-09-26 15:24:23,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:24:23,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40d1bcd36afa834e17448 HTTP/1.1" 200 None 2025-09-26 15:24:23,485 - lava_callback - DEBUG - Processing node 68d40d1bcd36afa834e17448: ltp-controllers 2025-09-26 15:24:23,485 - lava_callback - ERROR - Error processing callback for node 68d40d1bcd36afa834e17448: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:24:24,266 - lava_callback - INFO - Received callback for node 68d40d23cd36afa834e17451 INFO: 172.20.0.1:35326 - "POST /node/68d40d23cd36afa834e17451 HTTP/1.0" 202 Accepted 2025-09-26 15:24:24,272 - lava_callback - INFO - Starting async job submit for node 68d40d23cd36afa834e17451 2025-09-26 15:24:24,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:24:24,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40d23cd36afa834e17451 HTTP/1.1" 200 None 2025-09-26 15:24:24,293 - lava_callback - DEBUG - Processing node 68d40d23cd36afa834e17451: ltp-containers 2025-09-26 15:24:24,293 - lava_callback - ERROR - Error processing callback for node 68d40d23cd36afa834e17451: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:35334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56056 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:24:42,759 - lava_callback - INFO - Received callback for node 68d40d2ecd36afa834e17460 INFO: 172.20.0.1:55728 - "POST /node/68d40d2ecd36afa834e17460 HTTP/1.0" 202 Accepted 2025-09-26 15:24:42,765 - lava_callback - INFO - Starting async job submit for node 68d40d2ecd36afa834e17460 2025-09-26 15:24:42,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:24:42,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40d2ecd36afa834e17460 HTTP/1.1" 200 None 2025-09-26 15:24:42,803 - lava_callback - DEBUG - Processing node 68d40d2ecd36afa834e17460: ltp-controllers 2025-09-26 15:24:42,803 - lava_callback - ERROR - Error processing callback for node 68d40d2ecd36afa834e17460: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:24:45,137 - lava_callback - INFO - Received callback for node 68d6a5e32f83206171a92438 INFO: 172.20.0.1:55738 - "POST /node/68d6a5e32f83206171a92438 HTTP/1.0" 202 Accepted 2025-09-26 15:24:45,145 - lava_callback - INFO - Starting async job submit for node 68d6a5e32f83206171a92438 2025-09-26 15:24:45,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:24:45,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a5e32f83206171a92438 HTTP/1.1" 200 None 2025-09-26 15:24:45,227 - lava_callback - DEBUG - Processing node 68d6a5e32f83206171a92438: ltp-smoketest 2025-09-26 15:24:45,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:24:45,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:24:45,845 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d6a5e32f83206171a92438/log.txt.gz 2025-09-26 15:24:45,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:24:45,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:24:45,989 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d6a5e32f83206171a92438/lava_callback.json.gz 2025-09-26 15:24:46,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:24:46,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a5e32f83206171a92438 HTTP/1.1" 200 None 2025-09-26 15:24:46,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:24:46,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d07a5c3ab168ecc7a34 HTTP/1.1" 200 None 2025-09-26 15:24:46,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:24:46,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a5e32f83206171a92438 HTTP/1.1" 200 None 2025-09-26 15:24:46,159 - lava_callback - INFO - Completed processing callback for node 68d6a5e32f83206171a92438 INFO: 172.20.0.1:55746 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:24:47,072 - lava_callback - INFO - Received callback for node 68d408a0cd36afa834e16cb8 INFO: 172.20.0.1:55756 - "POST /node/68d408a0cd36afa834e16cb8 HTTP/1.0" 202 Accepted 2025-09-26 15:24:47,078 - lava_callback - INFO - Starting async job submit for node 68d408a0cd36afa834e16cb8 2025-09-26 15:24:47,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:24:47,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d408a0cd36afa834e16cb8 HTTP/1.1" 200 None 2025-09-26 15:24:47,133 - lava_callback - DEBUG - Processing node 68d408a0cd36afa834e16cb8: baseline-arm 2025-09-26 15:24:47,493 - lava_callback - ERROR - Error processing callback for node 68d408a0cd36afa834e16cb8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:34936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41574 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:25:38,548 - lava_callback - INFO - Received callback for node 68d6ae442f83206171a928a0 INFO: 172.20.0.1:41584 - "POST /node/68d6ae442f83206171a928a0 HTTP/1.0" 202 Accepted 2025-09-26 15:25:38,553 - lava_callback - INFO - Starting async job submit for node 68d6ae442f83206171a928a0 2025-09-26 15:25:38,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:25:38,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae442f83206171a928a0 HTTP/1.1" 200 None 2025-09-26 15:25:38,589 - lava_callback - DEBUG - Processing node 68d6ae442f83206171a928a0: baseline-arm64-broonie 2025-09-26 15:25:38,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:25:38,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:25:38,961 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6ae442f83206171a928a0/log.txt.gz 2025-09-26 15:25:38,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:25:39,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:25:39,111 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6ae442f83206171a928a0/lava_callback.json.gz 2025-09-26 15:25:39,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:25:39,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae442f83206171a928a0 HTTP/1.1" 200 None 2025-09-26 15:25:39,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:25:39,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:25:39,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:25:39,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae442f83206171a928a0 HTTP/1.1" 200 None 2025-09-26 15:25:39,188 - lava_callback - INFO - Completed processing callback for node 68d6ae442f83206171a928a0 2025-09-26 15:25:42,982 - lava_callback - INFO - Received callback for node 68d40d71cd36afa834e174c3 INFO: 172.20.0.1:44012 - "POST /node/68d40d71cd36afa834e174c3 HTTP/1.0" 202 Accepted 2025-09-26 15:25:42,987 - lava_callback - INFO - Starting async job submit for node 68d40d71cd36afa834e174c3 2025-09-26 15:25:42,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:25:43,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40d71cd36afa834e174c3 HTTP/1.1" 200 None 2025-09-26 15:25:43,001 - lava_callback - DEBUG - Processing node 68d40d71cd36afa834e174c3: ltp-cve 2025-09-26 15:25:43,001 - lava_callback - ERROR - Error processing callback for node 68d40d71cd36afa834e174c3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:25:46,420 - lava_callback - INFO - Received callback for node 68d42a52a5c2c05277bc78ee INFO: 172.20.0.1:44016 - "POST /node/68d42a52a5c2c05277bc78ee HTTP/1.0" 202 Accepted 2025-09-26 15:25:46,426 - lava_callback - INFO - Starting async job submit for node 68d42a52a5c2c05277bc78ee 2025-09-26 15:25:46,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:25:46,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42a52a5c2c05277bc78ee HTTP/1.1" 200 None 2025-09-26 15:25:46,482 - lava_callback - DEBUG - Processing node 68d42a52a5c2c05277bc78ee: baseline-arm INFO: 172.20.0.1:44022 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:25:46,707 - lava_callback - ERROR - Error processing callback for node 68d42a52a5c2c05277bc78ee: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:25:52,073 - lava_callback - INFO - Received callback for node 68d4095dcd36afa834e16dc3 INFO: 172.20.0.1:49274 - "POST /node/68d4095dcd36afa834e16dc3 HTTP/1.0" 202 Accepted 2025-09-26 15:25:52,080 - lava_callback - INFO - Starting async job submit for node 68d4095dcd36afa834e16dc3 2025-09-26 15:25:52,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:25:52,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4095dcd36afa834e16dc3 HTTP/1.1" 200 None 2025-09-26 15:25:52,132 - lava_callback - DEBUG - Processing node 68d4095dcd36afa834e16dc3: baseline-arm64 2025-09-26 15:25:52,982 - lava_callback - ERROR - Error processing callback for node 68d4095dcd36afa834e16dc3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:49278 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:26:03,017 - lava_callback - INFO - Received callback for node 68d40d7bcd36afa834e174cc INFO: 172.20.0.1:54926 - "POST /node/68d40d7bcd36afa834e174cc HTTP/1.0" 202 Accepted 2025-09-26 15:26:03,023 - lava_callback - INFO - Starting async job submit for node 68d40d7bcd36afa834e174cc 2025-09-26 15:26:03,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:26:03,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40d7bcd36afa834e174cc HTTP/1.1" 200 None 2025-09-26 15:26:03,038 - lava_callback - DEBUG - Processing node 68d40d7bcd36afa834e174cc: ltp-controllers 2025-09-26 15:26:03,038 - lava_callback - ERROR - Error processing callback for node 68d40d7bcd36afa834e174cc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:26:06,128 - lava_callback - INFO - Received callback for node 68d40d7dcd36afa834e174cf INFO: 172.20.0.1:54934 - "POST /node/68d40d7dcd36afa834e174cf HTTP/1.0" 202 Accepted 2025-09-26 15:26:06,133 - lava_callback - INFO - Starting async job submit for node 68d40d7dcd36afa834e174cf 2025-09-26 15:26:06,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:26:06,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40d7dcd36afa834e174cf HTTP/1.1" 200 None 2025-09-26 15:26:06,148 - lava_callback - DEBUG - Processing node 68d40d7dcd36afa834e174cf: baseline-arm64 2025-09-26 15:26:06,148 - lava_callback - ERROR - Error processing callback for node 68d40d7dcd36afa834e174cf: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:54946 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:26:06,827 - lava_callback - INFO - Received callback for node 68d40d7fcd36afa834e174d2 INFO: 172.20.0.1:54948 - "POST /node/68d40d7fcd36afa834e174d2 HTTP/1.0" 202 Accepted 2025-09-26 15:26:06,836 - lava_callback - INFO - Starting async job submit for node 68d40d7fcd36afa834e174d2 2025-09-26 15:26:06,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:26:06,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40d7fcd36afa834e174d2 HTTP/1.1" 200 None 2025-09-26 15:26:06,860 - lava_callback - DEBUG - Processing node 68d40d7fcd36afa834e174d2: baseline-arm64 2025-09-26 15:26:06,860 - lava_callback - ERROR - Error processing callback for node 68d40d7fcd36afa834e174d2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:26:07,542 - lava_callback - INFO - Received callback for node 68d40d84cd36afa834e174d5 INFO: 172.20.0.1:54954 - "POST /node/68d40d84cd36afa834e174d5 HTTP/1.0" 202 Accepted 2025-09-26 15:26:07,551 - lava_callback - INFO - Starting async job submit for node 68d40d84cd36afa834e174d5 2025-09-26 15:26:07,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:26:07,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40d84cd36afa834e174d5 HTTP/1.1" 200 None 2025-09-26 15:26:07,581 - lava_callback - DEBUG - Processing node 68d40d84cd36afa834e174d5: baseline-arm64 2025-09-26 15:26:07,581 - lava_callback - ERROR - Error processing callback for node 68d40d84cd36afa834e174d5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:26:08,235 - lava_callback - INFO - Received callback for node 68d40d85cd36afa834e174d8 INFO: 172.20.0.1:54958 - "POST /node/68d40d85cd36afa834e174d8 HTTP/1.0" 202 Accepted 2025-09-26 15:26:08,244 - lava_callback - INFO - Starting async job submit for node 68d40d85cd36afa834e174d8 2025-09-26 15:26:08,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:26:08,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40d85cd36afa834e174d8 HTTP/1.1" 200 None 2025-09-26 15:26:08,262 - lava_callback - DEBUG - Processing node 68d40d85cd36afa834e174d8: baseline-arm64 2025-09-26 15:26:08,262 - lava_callback - ERROR - Error processing callback for node 68d40d85cd36afa834e174d8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:51970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41482 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:26:58,714 - lava_callback - INFO - Received callback for node 68d40ce5cd36afa834e173f1 INFO: 172.20.0.1:41490 - "POST /node/68d40ce5cd36afa834e173f1 HTTP/1.0" 202 Accepted 2025-09-26 15:26:58,721 - lava_callback - INFO - Starting async job submit for node 68d40ce5cd36afa834e173f1 2025-09-26 15:26:58,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:26:58,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40ce5cd36afa834e173f1 HTTP/1.1" 200 None 2025-09-26 15:26:58,796 - lava_callback - DEBUG - Processing node 68d40ce5cd36afa834e173f1: ltp-cap-bounds 2025-09-26 15:26:59,113 - lava_callback - ERROR - Error processing callback for node 68d40ce5cd36afa834e173f1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:27:06,005 - lava_callback - INFO - Received callback for node 68d40db4cd36afa834e1756f INFO: 172.20.0.1:60970 - "POST /node/68d40db4cd36afa834e1756f HTTP/1.0" 202 Accepted 2025-09-26 15:27:06,011 - lava_callback - INFO - Starting async job submit for node 68d40db4cd36afa834e1756f 2025-09-26 15:27:06,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:27:06,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40db4cd36afa834e1756f HTTP/1.1" 200 None 2025-09-26 15:27:06,024 - lava_callback - DEBUG - Processing node 68d40db4cd36afa834e1756f: baseline-arm64 2025-09-26 15:27:06,024 - lava_callback - ERROR - Error processing callback for node 68d40db4cd36afa834e1756f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60978 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:27:06,709 - lava_callback - INFO - Received callback for node 68d40db4cd36afa834e17572 INFO: 172.20.0.1:60982 - "POST /node/68d40db4cd36afa834e17572 HTTP/1.0" 202 Accepted 2025-09-26 15:27:06,714 - lava_callback - INFO - Starting async job submit for node 68d40db4cd36afa834e17572 2025-09-26 15:27:06,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:27:06,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40db4cd36afa834e17572 HTTP/1.1" 200 None 2025-09-26 15:27:06,727 - lava_callback - DEBUG - Processing node 68d40db4cd36afa834e17572: baseline-arm64 2025-09-26 15:27:06,727 - lava_callback - ERROR - Error processing callback for node 68d40db4cd36afa834e17572: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:27:07,404 - lava_callback - INFO - Received callback for node 68d40dc2cd36afa834e1757f INFO: 172.20.0.1:60990 - "POST /node/68d40dc2cd36afa834e1757f HTTP/1.0" 202 Accepted 2025-09-26 15:27:07,409 - lava_callback - INFO - Starting async job submit for node 68d40dc2cd36afa834e1757f 2025-09-26 15:27:07,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:27:07,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40dc2cd36afa834e1757f HTTP/1.1" 200 None 2025-09-26 15:27:07,427 - lava_callback - DEBUG - Processing node 68d40dc2cd36afa834e1757f: baseline-arm64 2025-09-26 15:27:07,427 - lava_callback - ERROR - Error processing callback for node 68d40dc2cd36afa834e1757f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:27:08,101 - lava_callback - INFO - Received callback for node 68d40dc5cd36afa834e17582 INFO: 172.20.0.1:32774 - "POST /node/68d40dc5cd36afa834e17582 HTTP/1.0" 202 Accepted 2025-09-26 15:27:08,106 - lava_callback - INFO - Starting async job submit for node 68d40dc5cd36afa834e17582 2025-09-26 15:27:08,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:27:08,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40dc5cd36afa834e17582 HTTP/1.1" 200 None 2025-09-26 15:27:08,119 - lava_callback - DEBUG - Processing node 68d40dc5cd36afa834e17582: baseline-arm64 2025-09-26 15:27:08,119 - lava_callback - ERROR - Error processing callback for node 68d40dc5cd36afa834e17582: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:33728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33734 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:27:25,306 - lava_callback - INFO - Received callback for node 68d6aa5d2f83206171a9271a INFO: 172.20.0.1:51546 - "POST /node/68d6aa5d2f83206171a9271a HTTP/1.0" 202 Accepted 2025-09-26 15:27:25,312 - lava_callback - INFO - Starting async job submit for node 68d6aa5d2f83206171a9271a 2025-09-26 15:27:25,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:27:25,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6aa5d2f83206171a9271a HTTP/1.1" 200 None 2025-09-26 15:27:25,372 - lava_callback - DEBUG - Processing node 68d6aa5d2f83206171a9271a: baseline-arm 2025-09-26 15:27:25,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:27:25,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:27:25,701 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-68d6aa5d2f83206171a9271a/log.txt.gz 2025-09-26 15:27:25,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:27:25,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:27:25,851 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-68d6aa5d2f83206171a9271a/lava_callback.json.gz 2025-09-26 15:27:25,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:27:25,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6aa5d2f83206171a9271a HTTP/1.1" 200 None 2025-09-26 15:27:25,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:27:25,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651d5cca86fb17472aa18 HTTP/1.1" 200 None 2025-09-26 15:27:25,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:27:25,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6aa5d2f83206171a9271a HTTP/1.1" 200 None 2025-09-26 15:27:25,957 - lava_callback - INFO - Completed processing callback for node 68d6aa5d2f83206171a9271a INFO: 172.20.0.1:51548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41240 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:28:00,072 - lava_callback - INFO - Received callback for node 68d42a53a5c2c05277bc78f1 INFO: 172.20.0.1:55298 - "POST /node/68d42a53a5c2c05277bc78f1 HTTP/1.0" 202 Accepted 2025-09-26 15:28:00,079 - lava_callback - INFO - Starting async job submit for node 68d42a53a5c2c05277bc78f1 2025-09-26 15:28:00,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:28:00,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42a53a5c2c05277bc78f1 HTTP/1.1" 200 None 2025-09-26 15:28:00,116 - lava_callback - DEBUG - Processing node 68d42a53a5c2c05277bc78f1: baseline-arm 2025-09-26 15:28:00,380 - lava_callback - ERROR - Error processing callback for node 68d42a53a5c2c05277bc78f1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:55314 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:28:06,842 - lava_callback - INFO - Received callback for node 68d40df5cd36afa834e175bd INFO: 172.20.0.1:55322 - "POST /node/68d40df5cd36afa834e175bd HTTP/1.0" 202 Accepted 2025-09-26 15:28:06,849 - lava_callback - INFO - Starting async job submit for node 68d40df5cd36afa834e175bd 2025-09-26 15:28:06,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:28:06,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40df5cd36afa834e175bd HTTP/1.1" 200 None 2025-09-26 15:28:06,863 - lava_callback - DEBUG - Processing node 68d40df5cd36afa834e175bd: baseline-arm64 2025-09-26 15:28:06,863 - lava_callback - ERROR - Error processing callback for node 68d40df5cd36afa834e175bd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:28:07,593 - lava_callback - INFO - Received callback for node 68d40df6cd36afa834e175c0 INFO: 172.20.0.1:55328 - "POST /node/68d40df6cd36afa834e175c0 HTTP/1.0" 202 Accepted 2025-09-26 15:28:07,599 - lava_callback - INFO - Starting async job submit for node 68d40df6cd36afa834e175c0 2025-09-26 15:28:07,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:28:07,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40df6cd36afa834e175c0 HTTP/1.1" 200 None 2025-09-26 15:28:07,612 - lava_callback - DEBUG - Processing node 68d40df6cd36afa834e175c0: baseline-arm64 2025-09-26 15:28:07,612 - lava_callback - ERROR - Error processing callback for node 68d40df6cd36afa834e175c0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:40110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40126 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:28:25,594 - lava_callback - INFO - Received callback for node 68d40e09cd36afa834e175d2 INFO: 172.20.0.1:59696 - "POST /node/68d40e09cd36afa834e175d2 HTTP/1.0" 202 Accepted 2025-09-26 15:28:25,600 - lava_callback - INFO - Starting async job submit for node 68d40e09cd36afa834e175d2 2025-09-26 15:28:25,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:28:25,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40e09cd36afa834e175d2 HTTP/1.1" 200 None 2025-09-26 15:28:25,616 - lava_callback - DEBUG - Processing node 68d40e09cd36afa834e175d2: baseline-arm64 2025-09-26 15:28:25,617 - lava_callback - ERROR - Error processing callback for node 68d40e09cd36afa834e175d2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:59710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33804 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:28:41,297 - lava_callback - INFO - Received callback for node 68d6a86e2f83206171a92665 INFO: 172.20.0.1:43894 - "POST /node/68d6a86e2f83206171a92665 HTTP/1.0" 202 Accepted 2025-09-26 15:28:41,303 - lava_callback - INFO - Starting async job submit for node 68d6a86e2f83206171a92665 2025-09-26 15:28:41,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:28:41,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a86e2f83206171a92665 HTTP/1.1" 200 None 2025-09-26 15:28:41,360 - lava_callback - DEBUG - Processing node 68d6a86e2f83206171a92665: baseline-arm64-broonie 2025-09-26 15:28:41,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:28:41,881 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:28:41,881 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a86e2f83206171a92665/log.txt.gz 2025-09-26 15:28:41,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:28:42,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:28:42,019 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a86e2f83206171a92665/lava_callback.json.gz 2025-09-26 15:28:42,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:28:42,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a86e2f83206171a92665 HTTP/1.1" 200 None 2025-09-26 15:28:42,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:28:42,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 15:28:42,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:28:42,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a86e2f83206171a92665 HTTP/1.1" 200 None 2025-09-26 15:28:42,118 - lava_callback - INFO - Completed processing callback for node 68d6a86e2f83206171a92665 INFO: 172.20.0.1:43908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49926 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:29:18,440 - lava_callback - INFO - Received callback for node 68d6a8682f83206171a92657 INFO: 172.20.0.1:49934 - "POST /node/68d6a8682f83206171a92657 HTTP/1.0" 202 Accepted 2025-09-26 15:29:18,446 - lava_callback - INFO - Starting async job submit for node 68d6a8682f83206171a92657 2025-09-26 15:29:18,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:29:18,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8682f83206171a92657 HTTP/1.1" 200 None 2025-09-26 15:29:18,501 - lava_callback - DEBUG - Processing node 68d6a8682f83206171a92657: baseline-arm64-broonie 2025-09-26 15:29:18,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:29:18,872 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:29:18,873 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a8682f83206171a92657/log.txt.gz 2025-09-26 15:29:18,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:29:19,015 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:29:19,015 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6a8682f83206171a92657/lava_callback.json.gz 2025-09-26 15:29:19,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:29:19,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8682f83206171a92657 HTTP/1.1" 200 None 2025-09-26 15:29:19,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:29:19,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 15:29:19,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:29:19,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8682f83206171a92657 HTTP/1.1" 200 None 2025-09-26 15:29:19,095 - lava_callback - INFO - Completed processing callback for node 68d6a8682f83206171a92657 INFO: 172.20.0.1:44592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44600 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:29:31,577 - lava_callback - INFO - Received callback for node 68d6958d2f83206171a920da INFO: 172.20.0.1:38702 - "POST /node/68d6958d2f83206171a920da HTTP/1.0" 202 Accepted 2025-09-26 15:29:31,584 - lava_callback - INFO - Starting async job submit for node 68d6958d2f83206171a920da 2025-09-26 15:29:31,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:29:31,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6958d2f83206171a920da HTTP/1.1" 200 None 2025-09-26 15:29:31,639 - lava_callback - DEBUG - Processing node 68d6958d2f83206171a920da: baseline-arm64 2025-09-26 15:29:32,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:29:32,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:29:32,804 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6958d2f83206171a920da/log.txt.gz 2025-09-26 15:29:32,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:29:32,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:29:32,983 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6958d2f83206171a920da/lava_callback.json.gz DEBUG: Setup failed for 68d6958d2f83206171a920da. Transitting job node result: incomplete -> fail 2025-09-26 15:29:33,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:29:33,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6958d2f83206171a920da HTTP/1.1" 200 None 2025-09-26 15:29:33,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:29:33,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 15:29:33,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:29:33,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6958d2f83206171a920da HTTP/1.1" 200 None 2025-09-26 15:29:33,134 - lava_callback - INFO - Completed processing callback for node 68d6958d2f83206171a920da INFO: 172.20.0.1:38712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38724 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:29:40,091 - lava_callback - INFO - Received callback for node 68d40e05cd36afa834e175cf INFO: 172.20.0.1:39420 - "POST /node/68d40e05cd36afa834e175cf HTTP/1.0" 202 Accepted 2025-09-26 15:29:40,097 - lava_callback - INFO - Starting async job submit for node 68d40e05cd36afa834e175cf 2025-09-26 15:29:40,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:29:40,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40e05cd36afa834e175cf HTTP/1.1" 200 None 2025-09-26 15:29:40,131 - lava_callback - DEBUG - Processing node 68d40e05cd36afa834e175cf: baseline-arm64 2025-09-26 15:29:40,421 - lava_callback - ERROR - Error processing callback for node 68d40e05cd36afa834e175cf: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:29:46,179 - lava_callback - INFO - Received callback for node 68d40e58cd36afa834e17647 INFO: 172.20.0.1:39434 - "POST /node/68d40e58cd36afa834e17647 HTTP/1.0" 202 Accepted 2025-09-26 15:29:46,185 - lava_callback - INFO - Starting async job submit for node 68d40e58cd36afa834e17647 2025-09-26 15:29:46,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:29:46,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40e58cd36afa834e17647 HTTP/1.1" 200 None 2025-09-26 15:29:46,204 - lava_callback - DEBUG - Processing node 68d40e58cd36afa834e17647: baseline-arm64 2025-09-26 15:29:46,204 - lava_callback - ERROR - Error processing callback for node 68d40e58cd36afa834e17647: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:39446 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:29:46,892 - lava_callback - INFO - Received callback for node 68d40e63cd36afa834e17650 INFO: 172.20.0.1:39460 - "POST /node/68d40e63cd36afa834e17650 HTTP/1.0" 202 Accepted 2025-09-26 15:29:46,898 - lava_callback - INFO - Starting async job submit for node 68d40e63cd36afa834e17650 2025-09-26 15:29:46,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:29:46,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40e63cd36afa834e17650 HTTP/1.1" 200 None 2025-09-26 15:29:46,912 - lava_callback - DEBUG - Processing node 68d40e63cd36afa834e17650: baseline-arm64 2025-09-26 15:29:46,912 - lava_callback - ERROR - Error processing callback for node 68d40e63cd36afa834e17650: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:29:47,611 - lava_callback - INFO - Received callback for node 68d40e64cd36afa834e17653 INFO: 172.20.0.1:39476 - "POST /node/68d40e64cd36afa834e17653 HTTP/1.0" 202 Accepted 2025-09-26 15:29:47,617 - lava_callback - INFO - Starting async job submit for node 68d40e64cd36afa834e17653 2025-09-26 15:29:47,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:29:47,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40e64cd36afa834e17653 HTTP/1.1" 200 None 2025-09-26 15:29:47,633 - lava_callback - DEBUG - Processing node 68d40e64cd36afa834e17653: baseline-arm64 2025-09-26 15:29:47,633 - lava_callback - ERROR - Error processing callback for node 68d40e64cd36afa834e17653: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:42114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46536 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:30:07,125 - lava_callback - INFO - Received callback for node 68d42a57a5c2c05277bc78f4 INFO: 172.20.0.1:46540 - "POST /node/68d42a57a5c2c05277bc78f4 HTTP/1.0" 202 Accepted 2025-09-26 15:30:07,131 - lava_callback - INFO - Starting async job submit for node 68d42a57a5c2c05277bc78f4 2025-09-26 15:30:07,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:30:07,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42a57a5c2c05277bc78f4 HTTP/1.1" 200 None 2025-09-26 15:30:07,183 - lava_callback - DEBUG - Processing node 68d42a57a5c2c05277bc78f4: baseline-arm 2025-09-26 15:30:07,430 - lava_callback - ERROR - Error processing callback for node 68d42a57a5c2c05277bc78f4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:47766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45050 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:30:38,492 - lava_callback - INFO - Received callback for node 68d6958d2f83206171a920dd INFO: 172.20.0.1:45062 - "POST /node/68d6958d2f83206171a920dd HTTP/1.0" 202 Accepted 2025-09-26 15:30:38,498 - lava_callback - INFO - Starting async job submit for node 68d6958d2f83206171a920dd 2025-09-26 15:30:38,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:30:38,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6958d2f83206171a920dd HTTP/1.1" 200 None 2025-09-26 15:30:38,566 - lava_callback - DEBUG - Processing node 68d6958d2f83206171a920dd: baseline-arm64 2025-09-26 15:30:39,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:30:39,231 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:30:39,232 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6958d2f83206171a920dd/log.txt.gz 2025-09-26 15:30:39,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:30:39,390 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:30:39,390 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6958d2f83206171a920dd/lava_callback.json.gz DEBUG: Setup failed for 68d6958d2f83206171a920dd. Transitting job node result: incomplete -> fail 2025-09-26 15:30:39,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:30:39,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6958d2f83206171a920dd HTTP/1.1" 200 None 2025-09-26 15:30:39,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:30:39,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 15:30:39,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:30:39,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6958d2f83206171a920dd HTTP/1.1" 200 None 2025-09-26 15:30:39,561 - lava_callback - INFO - Completed processing callback for node 68d6958d2f83206171a920dd 2025-09-26 15:30:46,241 - lava_callback - INFO - Received callback for node 68d40e93cd36afa834e1768f INFO: 172.20.0.1:33966 - "POST /node/68d40e93cd36afa834e1768f HTTP/1.0" 202 Accepted 2025-09-26 15:30:46,246 - lava_callback - INFO - Starting async job submit for node 68d40e93cd36afa834e1768f 2025-09-26 15:30:46,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:30:46,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40e93cd36afa834e1768f HTTP/1.1" 200 None 2025-09-26 15:30:46,260 - lava_callback - DEBUG - Processing node 68d40e93cd36afa834e1768f: baseline-arm64 2025-09-26 15:30:46,260 - lava_callback - ERROR - Error processing callback for node 68d40e93cd36afa834e1768f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:33970 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:30:46,948 - lava_callback - INFO - Received callback for node 68d40e96cd36afa834e17692 INFO: 172.20.0.1:33978 - "POST /node/68d40e96cd36afa834e17692 HTTP/1.0" 202 Accepted 2025-09-26 15:30:46,954 - lava_callback - INFO - Starting async job submit for node 68d40e96cd36afa834e17692 2025-09-26 15:30:46,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:30:46,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40e96cd36afa834e17692 HTTP/1.1" 200 None 2025-09-26 15:30:46,967 - lava_callback - DEBUG - Processing node 68d40e96cd36afa834e17692: baseline-arm64 2025-09-26 15:30:46,967 - lava_callback - ERROR - Error processing callback for node 68d40e96cd36afa834e17692: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:53398 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:30:57,580 - lava_callback - INFO - Received callback for node 68d40e57cd36afa834e17644 INFO: 172.20.0.1:53408 - "POST /node/68d40e57cd36afa834e17644 HTTP/1.0" 202 Accepted 2025-09-26 15:30:57,586 - lava_callback - INFO - Starting async job submit for node 68d40e57cd36afa834e17644 2025-09-26 15:30:57,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:30:57,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40e57cd36afa834e17644 HTTP/1.1" 200 None 2025-09-26 15:30:57,620 - lava_callback - DEBUG - Processing node 68d40e57cd36afa834e17644: baseline-arm64 2025-09-26 15:30:57,945 - lava_callback - ERROR - Error processing callback for node 68d40e57cd36afa834e17644: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:44232 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:31:06,703 - lava_callback - INFO - Received callback for node 68d40eb4cd36afa834e176b3 INFO: 172.20.0.1:44248 - "POST /node/68d40eb4cd36afa834e176b3 HTTP/1.0" 202 Accepted 2025-09-26 15:31:06,708 - lava_callback - INFO - Starting async job submit for node 68d40eb4cd36afa834e176b3 2025-09-26 15:31:06,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:31:06,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40eb4cd36afa834e176b3 HTTP/1.1" 200 None 2025-09-26 15:31:06,727 - lava_callback - DEBUG - Processing node 68d40eb4cd36afa834e176b3: baseline-arm64 2025-09-26 15:31:06,727 - lava_callback - ERROR - Error processing callback for node 68d40eb4cd36afa834e176b3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:44750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44756 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:31:25,854 - lava_callback - INFO - Received callback for node 68d40e86cd36afa834e17673 INFO: 172.20.0.1:58172 - "POST /node/68d40e86cd36afa834e17673 HTTP/1.0" 202 Accepted 2025-09-26 15:31:25,860 - lava_callback - INFO - Starting async job submit for node 68d40e86cd36afa834e17673 2025-09-26 15:31:25,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:31:25,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40e86cd36afa834e17673 HTTP/1.1" 200 None 2025-09-26 15:31:25,913 - lava_callback - DEBUG - Processing node 68d40e86cd36afa834e17673: baseline-arm64 2025-09-26 15:31:26,201 - lava_callback - INFO - Received callback for node 68d40ebbcd36afa834e176b9 INFO: 172.20.0.1:58180 - "POST /node/68d40ebbcd36afa834e176b9 HTTP/1.0" 202 Accepted 2025-09-26 15:31:26,202 - lava_callback - ERROR - Error processing callback for node 68d40e86cd36afa834e17673: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:31:26,207 - lava_callback - INFO - Starting async job submit for node 68d40ebbcd36afa834e176b9 2025-09-26 15:31:26,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:31:26,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40ebbcd36afa834e176b9 HTTP/1.1" 200 None 2025-09-26 15:31:26,222 - lava_callback - DEBUG - Processing node 68d40ebbcd36afa834e176b9: baseline-arm64 2025-09-26 15:31:26,222 - lava_callback - ERROR - Error processing callback for node 68d40ebbcd36afa834e176b9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:58192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52994 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:31:40,084 - lava_callback - INFO - Received callback for node 68d40e88cd36afa834e17676 INFO: 172.20.0.1:56840 - "POST /node/68d40e88cd36afa834e17676 HTTP/1.0" 202 Accepted 2025-09-26 15:31:40,090 - lava_callback - INFO - Starting async job submit for node 68d40e88cd36afa834e17676 2025-09-26 15:31:40,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:31:40,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40e88cd36afa834e17676 HTTP/1.1" 200 None 2025-09-26 15:31:40,123 - lava_callback - DEBUG - Processing node 68d40e88cd36afa834e17676: baseline-arm64 2025-09-26 15:31:40,413 - lava_callback - ERROR - Error processing callback for node 68d40e88cd36afa834e17676: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:56842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43054 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:32:17,135 - lava_callback - INFO - Received callback for node 68d40eb1cd36afa834e176b0 INFO: 172.20.0.1:43056 - "POST /node/68d40eb1cd36afa834e176b0 HTTP/1.0" 202 Accepted 2025-09-26 15:32:17,141 - lava_callback - INFO - Starting async job submit for node 68d40eb1cd36afa834e176b0 2025-09-26 15:32:17,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:32:17,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40eb1cd36afa834e176b0 HTTP/1.1" 200 None 2025-09-26 15:32:17,198 - lava_callback - DEBUG - Processing node 68d40eb1cd36afa834e176b0: baseline-arm64 2025-09-26 15:32:17,505 - lava_callback - ERROR - Error processing callback for node 68d40eb1cd36afa834e176b0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:32:20,958 - lava_callback - INFO - Received callback for node 68d42a57a5c2c05277bc78f7 INFO: 172.20.0.1:60514 - "POST /node/68d42a57a5c2c05277bc78f7 HTTP/1.0" 202 Accepted 2025-09-26 15:32:20,964 - lava_callback - INFO - Starting async job submit for node 68d42a57a5c2c05277bc78f7 2025-09-26 15:32:20,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:32:20,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42a57a5c2c05277bc78f7 HTTP/1.1" 200 None 2025-09-26 15:32:20,996 - lava_callback - DEBUG - Processing node 68d42a57a5c2c05277bc78f7: baseline-arm 2025-09-26 15:32:21,216 - lava_callback - ERROR - Error processing callback for node 68d42a57a5c2c05277bc78f7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:60524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60530 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:32:33,161 - lava_callback - INFO - Received callback for node 68d40eb8cd36afa834e176b6 INFO: 172.20.0.1:54916 - "POST /node/68d40eb8cd36afa834e176b6 HTTP/1.0" 202 Accepted 2025-09-26 15:32:33,167 - lava_callback - INFO - Starting async job submit for node 68d40eb8cd36afa834e176b6 2025-09-26 15:32:33,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:32:33,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40eb8cd36afa834e176b6 HTTP/1.1" 200 None 2025-09-26 15:32:33,219 - lava_callback - DEBUG - Processing node 68d40eb8cd36afa834e176b6: baseline-arm64 2025-09-26 15:32:33,531 - lava_callback - ERROR - Error processing callback for node 68d40eb8cd36afa834e176b6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:54918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32878 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:33:07,447 - lava_callback - INFO - Received callback for node 68d6ae822f83206171a9290c INFO: 172.20.0.1:32888 - "POST /node/68d6ae822f83206171a9290c HTTP/1.0" 202 Accepted 2025-09-26 15:33:07,453 - lava_callback - INFO - Starting async job submit for node 68d6ae822f83206171a9290c 2025-09-26 15:33:07,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:33:07,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae822f83206171a9290c HTTP/1.1" 200 None 2025-09-26 15:33:07,486 - lava_callback - DEBUG - Processing node 68d6ae822f83206171a9290c: baseline-arm64-pengutronix 2025-09-26 15:33:07,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:33:07,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:33:07,828 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d6ae822f83206171a9290c/log.txt.gz 2025-09-26 15:33:07,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:33:08,005 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:33:08,005 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-68d6ae822f83206171a9290c/lava_callback.json.gz 2025-09-26 15:33:08,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:33:08,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae822f83206171a9290c HTTP/1.1" 200 None 2025-09-26 15:33:08,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:33:08,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:33:08,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:33:08,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae822f83206171a9290c HTTP/1.1" 200 None 2025-09-26 15:33:08,076 - lava_callback - INFO - Completed processing callback for node 68d6ae822f83206171a9290c INFO: 172.20.0.1:60682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60686 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:33:21,943 - lava_callback - INFO - Received callback for node 68d6ae4a2f83206171a928ae INFO: 172.20.0.1:52538 - "POST /node/68d6ae4a2f83206171a928ae HTTP/1.0" 202 Accepted 2025-09-26 15:33:21,949 - lava_callback - INFO - Starting async job submit for node 68d6ae4a2f83206171a928ae 2025-09-26 15:33:21,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:33:21,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae4a2f83206171a928ae HTTP/1.1" 200 None 2025-09-26 15:33:21,993 - lava_callback - DEBUG - Processing node 68d6ae4a2f83206171a928ae: baseline-arm64-broonie 2025-09-26 15:33:22,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:33:22,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:33:22,404 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6ae4a2f83206171a928ae/log.txt.gz 2025-09-26 15:33:22,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:33:22,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:33:22,560 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6ae4a2f83206171a928ae/lava_callback.json.gz 2025-09-26 15:33:22,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:33:22,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae4a2f83206171a928ae HTTP/1.1" 200 None 2025-09-26 15:33:22,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:33:22,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:33:22,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:33:22,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae4a2f83206171a928ae HTTP/1.1" 200 None 2025-09-26 15:33:22,634 - lava_callback - INFO - Completed processing callback for node 68d6ae4a2f83206171a928ae INFO: 172.20.0.1:52544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55012 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:33:42,527 - lava_callback - INFO - Received callback for node 68d410d1cd36afa834e17ef1 INFO: 172.20.0.1:34348 - "POST /node/68d410d1cd36afa834e17ef1 HTTP/1.0" 202 Accepted 2025-09-26 15:33:42,533 - lava_callback - INFO - Starting async job submit for node 68d410d1cd36afa834e17ef1 2025-09-26 15:33:42,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:33:42,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d410d1cd36afa834e17ef1 HTTP/1.1" 200 None 2025-09-26 15:33:42,593 - lava_callback - DEBUG - Processing node 68d410d1cd36afa834e17ef1: baseline-arm64 2025-09-26 15:33:42,912 - lava_callback - ERROR - Error processing callback for node 68d410d1cd36afa834e17ef1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:33:44,842 - lava_callback - INFO - Received callback for node 68d410d1cd36afa834e17ef4 INFO: 172.20.0.1:34352 - "POST /node/68d410d1cd36afa834e17ef4 HTTP/1.0" 202 Accepted 2025-09-26 15:33:44,848 - lava_callback - INFO - Starting async job submit for node 68d410d1cd36afa834e17ef4 2025-09-26 15:33:44,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:33:44,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d410d1cd36afa834e17ef4 HTTP/1.1" 200 None 2025-09-26 15:33:44,881 - lava_callback - DEBUG - Processing node 68d410d1cd36afa834e17ef4: baseline-arm64 2025-09-26 15:33:45,173 - lava_callback - ERROR - Error processing callback for node 68d410d1cd36afa834e17ef4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:34356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34460 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:34:16,521 - lava_callback - INFO - Received callback for node 68d40f64cd36afa834e17cf2 INFO: 172.20.0.1:34476 - "POST /node/68d40f64cd36afa834e17cf2 HTTP/1.0" 202 Accepted 2025-09-26 15:34:16,527 - lava_callback - INFO - Starting async job submit for node 68d40f64cd36afa834e17cf2 2025-09-26 15:34:16,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:34:16,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40f64cd36afa834e17cf2 HTTP/1.1" 200 None 2025-09-26 15:34:16,551 - lava_callback - DEBUG - Processing node 68d40f64cd36afa834e17cf2: baseline-arm64-baylibre 2025-09-26 15:34:16,551 - lava_callback - ERROR - Error processing callback for node 68d40f64cd36afa834e17cf2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:34:25,325 - lava_callback - INFO - Received callback for node 68d42a59a5c2c05277bc78fa INFO: 172.20.0.1:42816 - "POST /node/68d42a59a5c2c05277bc78fa HTTP/1.0" 202 Accepted 2025-09-26 15:34:25,331 - lava_callback - INFO - Starting async job submit for node 68d42a59a5c2c05277bc78fa 2025-09-26 15:34:25,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:34:25,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42a59a5c2c05277bc78fa HTTP/1.1" 200 None 2025-09-26 15:34:25,364 - lava_callback - DEBUG - Processing node 68d42a59a5c2c05277bc78fa: baseline-arm 2025-09-26 15:34:25,583 - lava_callback - ERROR - Error processing callback for node 68d42a59a5c2c05277bc78fa: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:42832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44932 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:34:43,137 - lava_callback - INFO - Received callback for node 68d410d4cd36afa834e17ef7 INFO: 172.20.0.1:58570 - "POST /node/68d410d4cd36afa834e17ef7 HTTP/1.0" 202 Accepted 2025-09-26 15:34:43,143 - lava_callback - INFO - Starting async job submit for node 68d410d4cd36afa834e17ef7 2025-09-26 15:34:43,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:34:43,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d410d4cd36afa834e17ef7 HTTP/1.1" 200 None 2025-09-26 15:34:43,180 - lava_callback - DEBUG - Processing node 68d410d4cd36afa834e17ef7: baseline-arm64 2025-09-26 15:34:43,518 - lava_callback - ERROR - Error processing callback for node 68d410d4cd36afa834e17ef7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:58584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40616 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:34:57,593 - lava_callback - INFO - Received callback for node 68d410d7cd36afa834e17efa INFO: 172.20.0.1:40628 - "POST /node/68d410d7cd36afa834e17efa HTTP/1.0" 202 Accepted 2025-09-26 15:34:57,599 - lava_callback - INFO - Starting async job submit for node 68d410d7cd36afa834e17efa 2025-09-26 15:34:57,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:34:57,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d410d7cd36afa834e17efa HTTP/1.1" 200 None 2025-09-26 15:34:57,650 - lava_callback - DEBUG - Processing node 68d410d7cd36afa834e17efa: baseline-arm64 2025-09-26 15:34:57,938 - lava_callback - ERROR - Error processing callback for node 68d410d7cd36afa834e17efa: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:34:59,403 - lava_callback - INFO - Received callback for node 68d410fccd36afa834e17f31 INFO: 172.20.0.1:38620 - "POST /node/68d410fccd36afa834e17f31 HTTP/1.0" 202 Accepted 2025-09-26 15:34:59,409 - lava_callback - INFO - Starting async job submit for node 68d410fccd36afa834e17f31 2025-09-26 15:34:59,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:34:59,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d410fccd36afa834e17f31 HTTP/1.1" 200 None 2025-09-26 15:34:59,443 - lava_callback - DEBUG - Processing node 68d410fccd36afa834e17f31: baseline-arm64 2025-09-26 15:34:59,735 - lava_callback - ERROR - Error processing callback for node 68d410fccd36afa834e17f31: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:38622 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:35:10,453 - lava_callback - INFO - Received callback for node 68d410fdcd36afa834e17f34 INFO: 172.20.0.1:57160 - "POST /node/68d410fdcd36afa834e17f34 HTTP/1.0" 202 Accepted 2025-09-26 15:35:10,460 - lava_callback - INFO - Starting async job submit for node 68d410fdcd36afa834e17f34 2025-09-26 15:35:10,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:35:10,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d410fdcd36afa834e17f34 HTTP/1.1" 200 None 2025-09-26 15:35:10,603 - lava_callback - DEBUG - Processing node 68d410fdcd36afa834e17f34: baseline-arm64 2025-09-26 15:35:11,296 - lava_callback - ERROR - Error processing callback for node 68d410fdcd36afa834e17f34: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:57176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57180 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:35:16,583 - lava_callback - INFO - Received callback for node 68d40f9fcd36afa834e17d61 INFO: 172.20.0.1:57192 - "POST /node/68d40f9fcd36afa834e17d61 HTTP/1.0" 202 Accepted 2025-09-26 15:35:16,588 - lava_callback - INFO - Starting async job submit for node 68d40f9fcd36afa834e17d61 2025-09-26 15:35:16,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:35:16,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40f9fcd36afa834e17d61 HTTP/1.1" 200 None 2025-09-26 15:35:16,602 - lava_callback - DEBUG - Processing node 68d40f9fcd36afa834e17d61: baseline-arm64-baylibre 2025-09-26 15:35:16,602 - lava_callback - ERROR - Error processing callback for node 68d40f9fcd36afa834e17d61: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:35:17,265 - lava_callback - INFO - Received callback for node 68d40faacd36afa834e17d6a INFO: 172.20.0.1:57204 - "POST /node/68d40faacd36afa834e17d6a HTTP/1.0" 202 Accepted 2025-09-26 15:35:17,271 - lava_callback - INFO - Starting async job submit for node 68d40faacd36afa834e17d6a 2025-09-26 15:35:17,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:35:17,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40faacd36afa834e17d6a HTTP/1.1" 200 None 2025-09-26 15:35:17,284 - lava_callback - DEBUG - Processing node 68d40faacd36afa834e17d6a: baseline-arm64-baylibre 2025-09-26 15:35:17,284 - lava_callback - ERROR - Error processing callback for node 68d40faacd36afa834e17d6a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:49754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58096 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:35:44,005 - lava_callback - INFO - Received callback for node 68d6ae502f83206171a928b8 INFO: 172.20.0.1:38152 - "POST /node/68d6ae502f83206171a928b8 HTTP/1.0" 202 Accepted 2025-09-26 15:35:44,012 - lava_callback - INFO - Starting async job submit for node 68d6ae502f83206171a928b8 2025-09-26 15:35:44,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:35:44,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae502f83206171a928b8 HTTP/1.1" 200 None 2025-09-26 15:35:44,087 - lava_callback - DEBUG - Processing node 68d6ae502f83206171a928b8: baseline-arm64-broonie 2025-09-26 15:35:44,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:35:44,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:35:44,870 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6ae502f83206171a928b8/log.txt.gz 2025-09-26 15:35:44,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:35:45,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:35:45,019 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6ae502f83206171a928b8/lava_callback.json.gz 2025-09-26 15:35:45,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:35:45,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae502f83206171a928b8 HTTP/1.1" 200 None 2025-09-26 15:35:45,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:35:45,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:35:45,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:35:45,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae502f83206171a928b8 HTTP/1.1" 200 None 2025-09-26 15:35:45,132 - lava_callback - INFO - Completed processing callback for node 68d6ae502f83206171a928b8 INFO: 172.20.0.1:38168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37768 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:35:58,443 - lava_callback - INFO - Received callback for node 68d41103cd36afa834e17f3a INFO: 172.20.0.1:37782 - "POST /node/68d41103cd36afa834e17f3a HTTP/1.0" 202 Accepted 2025-09-26 15:35:58,454 - lava_callback - INFO - Starting async job submit for node 68d41103cd36afa834e17f3a 2025-09-26 15:35:58,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:35:58,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41103cd36afa834e17f3a HTTP/1.1" 200 None 2025-09-26 15:35:58,499 - lava_callback - DEBUG - Processing node 68d41103cd36afa834e17f3a: baseline-arm64 2025-09-26 15:35:58,788 - lava_callback - ERROR - Error processing callback for node 68d41103cd36afa834e17f3a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:40818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58812 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:36:18,611 - lava_callback - INFO - Received callback for node 68d4111fcd36afa834e17f52 INFO: 172.20.0.1:58826 - "POST /node/68d4111fcd36afa834e17f52 HTTP/1.0" 202 Accepted 2025-09-26 15:36:18,617 - lava_callback - INFO - Starting async job submit for node 68d4111fcd36afa834e17f52 2025-09-26 15:36:18,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:36:18,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4111fcd36afa834e17f52 HTTP/1.1" 200 None 2025-09-26 15:36:18,659 - lava_callback - DEBUG - Processing node 68d4111fcd36afa834e17f52: baseline-arm64 2025-09-26 15:36:18,969 - lava_callback - ERROR - Error processing callback for node 68d4111fcd36afa834e17f52: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:36:19,999 - lava_callback - INFO - Received callback for node 68d41105cd36afa834e17f3d INFO: 172.20.0.1:41416 - "POST /node/68d41105cd36afa834e17f3d HTTP/1.0" 202 Accepted 2025-09-26 15:36:20,005 - lava_callback - INFO - Starting async job submit for node 68d41105cd36afa834e17f3d 2025-09-26 15:36:20,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:36:20,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41105cd36afa834e17f3d HTTP/1.1" 200 None 2025-09-26 15:36:20,040 - lava_callback - DEBUG - Processing node 68d41105cd36afa834e17f3d: baseline-arm64 2025-09-26 15:36:20,329 - lava_callback - ERROR - Error processing callback for node 68d41105cd36afa834e17f3d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:41428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41434 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:36:29,013 - lava_callback - INFO - Received callback for node 68d41120cd36afa834e17f55 INFO: 172.20.0.1:41446 - "POST /node/68d41120cd36afa834e17f55 HTTP/1.0" 202 Accepted 2025-09-26 15:36:29,019 - lava_callback - INFO - Starting async job submit for node 68d41120cd36afa834e17f55 2025-09-26 15:36:29,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:36:29,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41120cd36afa834e17f55 HTTP/1.1" 200 None 2025-09-26 15:36:29,052 - lava_callback - DEBUG - Processing node 68d41120cd36afa834e17f55: baseline-arm64 2025-09-26 15:36:29,339 - lava_callback - ERROR - Error processing callback for node 68d41120cd36afa834e17f55: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:47642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47646 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:36:44,619 - lava_callback - INFO - Received callback for node 68d42a5ba5c2c05277bc78fd INFO: 172.20.0.1:53600 - "POST /node/68d42a5ba5c2c05277bc78fd HTTP/1.0" 202 Accepted 2025-09-26 15:36:44,624 - lava_callback - INFO - Starting async job submit for node 68d42a5ba5c2c05277bc78fd 2025-09-26 15:36:44,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:36:44,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d42a5ba5c2c05277bc78fd HTTP/1.1" 200 None 2025-09-26 15:36:44,675 - lava_callback - DEBUG - Processing node 68d42a5ba5c2c05277bc78fd: baseline-arm 2025-09-26 15:36:44,893 - lava_callback - ERROR - Error processing callback for node 68d42a5ba5c2c05277bc78fd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:53608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41272 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:37:17,046 - lava_callback - INFO - Received callback for node 68d41129cd36afa834e17f5b INFO: 172.20.0.1:41286 - "POST /node/68d41129cd36afa834e17f5b HTTP/1.0" 202 Accepted 2025-09-26 15:37:17,052 - lava_callback - INFO - Starting async job submit for node 68d41129cd36afa834e17f5b 2025-09-26 15:37:17,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:37:17,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41129cd36afa834e17f5b HTTP/1.1" 200 None 2025-09-26 15:37:17,104 - lava_callback - DEBUG - Processing node 68d41129cd36afa834e17f5b: baseline-arm64 2025-09-26 15:37:17,400 - lava_callback - ERROR - Error processing callback for node 68d41129cd36afa834e17f5b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:37:23,411 - lava_callback - INFO - Received callback for node 68d41028cd36afa834e17df7 INFO: 172.20.0.1:42396 - "POST /node/68d41028cd36afa834e17df7 HTTP/1.0" 202 Accepted 2025-09-26 15:37:23,417 - lava_callback - INFO - Starting async job submit for node 68d41028cd36afa834e17df7 2025-09-26 15:37:23,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:37:23,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41028cd36afa834e17df7 HTTP/1.1" 200 None 2025-09-26 15:37:23,434 - lava_callback - DEBUG - Processing node 68d41028cd36afa834e17df7: ltp-fs-bind 2025-09-26 15:37:23,434 - lava_callback - ERROR - Error processing callback for node 68d41028cd36afa834e17df7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:42412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58662 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:37:36,444 - lava_callback - INFO - Received callback for node 68d4112bcd36afa834e17f5e INFO: 172.20.0.1:58678 - "POST /node/68d4112bcd36afa834e17f5e HTTP/1.0" 202 Accepted 2025-09-26 15:37:36,450 - lava_callback - INFO - Starting async job submit for node 68d4112bcd36afa834e17f5e 2025-09-26 15:37:36,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:37:36,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4112bcd36afa834e17f5e HTTP/1.1" 200 None 2025-09-26 15:37:36,485 - lava_callback - DEBUG - Processing node 68d4112bcd36afa834e17f5e: baseline-arm64 INFO: 172.20.0.1:58686 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:37:36,812 - lava_callback - ERROR - Error processing callback for node 68d4112bcd36afa834e17f5e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:51404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37964 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:38:28,303 - lava_callback - INFO - Received callback for node 68d6b2d12f83206171a92a52 INFO: 172.20.0.1:37974 - "POST /node/68d6b2d12f83206171a92a52 HTTP/1.0" 202 Accepted 2025-09-26 15:38:28,309 - lava_callback - INFO - Starting async job submit for node 68d6b2d12f83206171a92a52 2025-09-26 15:38:28,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:38:28,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b2d12f83206171a92a52 HTTP/1.1" 200 None 2025-09-26 15:38:28,350 - lava_callback - DEBUG - Processing node 68d6b2d12f83206171a92a52: baseline-arm64-broonie 2025-09-26 15:38:28,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:38:28,906 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:38:28,907 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6b2d12f83206171a92a52/log.txt.gz 2025-09-26 15:38:28,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:38:29,070 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:38:29,071 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-68d6b2d12f83206171a92a52/lava_callback.json.gz 2025-09-26 15:38:29,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:38:29,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b2d12f83206171a92a52 HTTP/1.1" 200 None 2025-09-26 15:38:29,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:38:29,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 15:38:29,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:38:29,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6b2d12f83206171a92a52 HTTP/1.1" 200 None 2025-09-26 15:38:29,177 - lava_callback - INFO - Completed processing callback for node 68d6b2d12f83206171a92a52 INFO: 172.20.0.1:58994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58996 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:38:36,800 - lava_callback - INFO - Received callback for node 68d41070cd36afa834e17e52 INFO: 172.20.0.1:59012 - "POST /node/68d41070cd36afa834e17e52 HTTP/1.0" 202 Accepted 2025-09-26 15:38:36,805 - lava_callback - INFO - Starting async job submit for node 68d41070cd36afa834e17e52 2025-09-26 15:38:36,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:38:36,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41070cd36afa834e17e52 HTTP/1.1" 200 None 2025-09-26 15:38:36,829 - lava_callback - DEBUG - Processing node 68d41070cd36afa834e17e52: baseline-arm64-baylibre 2025-09-26 15:38:36,829 - lava_callback - ERROR - Error processing callback for node 68d41070cd36afa834e17e52: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:38:37,160 - lava_callback - INFO - Received callback for node 68d415cdcd36afa834e18621 INFO: 172.20.0.1:59028 - "POST /node/68d415cdcd36afa834e18621 HTTP/1.0" 202 Accepted 2025-09-26 15:38:37,166 - lava_callback - INFO - Starting async job submit for node 68d415cdcd36afa834e18621 2025-09-26 15:38:37,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:38:37,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d415cdcd36afa834e18621 HTTP/1.1" 200 None 2025-09-26 15:38:37,199 - lava_callback - DEBUG - Processing node 68d415cdcd36afa834e18621: baseline-arm64 2025-09-26 15:38:37,491 - lava_callback - ERROR - Error processing callback for node 68d415cdcd36afa834e18621: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:40752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57548 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:38:56,779 - lava_callback - INFO - Received callback for node 68d41085cd36afa834e17e7d INFO: 172.20.0.1:57562 - "POST /node/68d41085cd36afa834e17e7d HTTP/1.0" 202 Accepted 2025-09-26 15:38:56,785 - lava_callback - INFO - Starting async job submit for node 68d41085cd36afa834e17e7d 2025-09-26 15:38:56,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:38:56,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41085cd36afa834e17e7d HTTP/1.1" 200 None 2025-09-26 15:38:56,803 - lava_callback - DEBUG - Processing node 68d41085cd36afa834e17e7d: baseline-arm64-baylibre 2025-09-26 15:38:56,803 - lava_callback - ERROR - Error processing callback for node 68d41085cd36afa834e17e7d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:38:59,606 - lava_callback - INFO - Received callback for node 68d415cfcd36afa834e18624 INFO: 172.20.0.1:59010 - "POST /node/68d415cfcd36afa834e18624 HTTP/1.0" 202 Accepted 2025-09-26 15:38:59,612 - lava_callback - INFO - Starting async job submit for node 68d415cfcd36afa834e18624 2025-09-26 15:38:59,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:38:59,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d415cfcd36afa834e18624 HTTP/1.1" 200 None 2025-09-26 15:38:59,663 - lava_callback - DEBUG - Processing node 68d415cfcd36afa834e18624: baseline-arm64 2025-09-26 15:38:59,951 - lava_callback - ERROR - Error processing callback for node 68d415cfcd36afa834e18624: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:39:06,352 - lava_callback - INFO - Received callback for node 68d415d7cd36afa834e1862d INFO: 172.20.0.1:59020 - "POST /node/68d415d7cd36afa834e1862d HTTP/1.0" 202 Accepted 2025-09-26 15:39:06,358 - lava_callback - INFO - Starting async job submit for node 68d415d7cd36afa834e1862d 2025-09-26 15:39:06,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:39:06,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d415d7cd36afa834e1862d HTTP/1.1" 200 None 2025-09-26 15:39:06,394 - lava_callback - DEBUG - Processing node 68d415d7cd36afa834e1862d: baseline-arm64 INFO: 172.20.0.1:59034 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:39:06,690 - lava_callback - ERROR - Error processing callback for node 68d415d7cd36afa834e1862d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:39:06,914 - lava_callback - INFO - Received callback for node 68d40b9fcd36afa834e1709d INFO: 172.20.0.1:59038 - "POST /node/68d40b9fcd36afa834e1709d HTTP/1.0" 202 Accepted 2025-09-26 15:39:06,921 - lava_callback - INFO - Starting async job submit for node 68d40b9fcd36afa834e1709d 2025-09-26 15:39:07,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:39:07,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40b9fcd36afa834e1709d HTTP/1.1" 200 None 2025-09-26 15:39:07,201 - lava_callback - DEBUG - Processing node 68d40b9fcd36afa834e1709d: ltp-cve 2025-09-26 15:39:07,928 - lava_callback - ERROR - Error processing callback for node 68d40b9fcd36afa834e1709d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:41444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41450 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:39:19,400 - lava_callback - INFO - Received callback for node 68d415d8cd36afa834e18630 INFO: 172.20.0.1:34408 - "POST /node/68d415d8cd36afa834e18630 HTTP/1.0" 202 Accepted 2025-09-26 15:39:19,406 - lava_callback - INFO - Starting async job submit for node 68d415d8cd36afa834e18630 2025-09-26 15:39:19,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:39:19,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d415d8cd36afa834e18630 HTTP/1.1" 200 None 2025-09-26 15:39:19,438 - lava_callback - DEBUG - Processing node 68d415d8cd36afa834e18630: baseline-arm64 2025-09-26 15:39:19,748 - lava_callback - ERROR - Error processing callback for node 68d415d8cd36afa834e18630: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:34416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60808 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:39:59,546 - lava_callback - INFO - Received callback for node 68d415e1cd36afa834e18646 INFO: 172.20.0.1:48800 - "POST /node/68d415e1cd36afa834e18646 HTTP/1.0" 202 Accepted 2025-09-26 15:39:59,552 - lava_callback - INFO - Starting async job submit for node 68d415e1cd36afa834e18646 2025-09-26 15:39:59,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:39:59,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d415e1cd36afa834e18646 HTTP/1.1" 200 None 2025-09-26 15:39:59,586 - lava_callback - DEBUG - Processing node 68d415e1cd36afa834e18646: baseline-arm64 2025-09-26 15:39:59,876 - lava_callback - ERROR - Error processing callback for node 68d415e1cd36afa834e18646: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:48802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44118 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:40:19,817 - lava_callback - INFO - Received callback for node 68d415e2cd36afa834e18649 INFO: 172.20.0.1:53826 - "POST /node/68d415e2cd36afa834e18649 HTTP/1.0" 202 Accepted 2025-09-26 15:40:19,823 - lava_callback - INFO - Starting async job submit for node 68d415e2cd36afa834e18649 2025-09-26 15:40:19,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:40:19,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d415e2cd36afa834e18649 HTTP/1.1" 200 None 2025-09-26 15:40:19,861 - lava_callback - DEBUG - Processing node 68d415e2cd36afa834e18649: baseline-arm64 2025-09-26 15:40:20,188 - lava_callback - ERROR - Error processing callback for node 68d415e2cd36afa834e18649: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:40:24,917 - lava_callback - INFO - Received callback for node 68d415e6cd36afa834e1864c INFO: 172.20.0.1:53832 - "POST /node/68d415e6cd36afa834e1864c HTTP/1.0" 202 Accepted 2025-09-26 15:40:24,923 - lava_callback - INFO - Starting async job submit for node 68d415e6cd36afa834e1864c 2025-09-26 15:40:24,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:40:24,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d415e6cd36afa834e1864c HTTP/1.1" 200 None 2025-09-26 15:40:24,994 - lava_callback - DEBUG - Processing node 68d415e6cd36afa834e1864c: baseline-arm64 2025-09-26 15:40:25,277 - lava_callback - ERROR - Error processing callback for node 68d415e6cd36afa834e1864c: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:53846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43268 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:40:38,337 - lava_callback - INFO - Received callback for node 68d415eacd36afa834e1864f INFO: 172.20.0.1:43274 - "POST /node/68d415eacd36afa834e1864f HTTP/1.0" 202 Accepted 2025-09-26 15:40:38,344 - lava_callback - INFO - Starting async job submit for node 68d415eacd36afa834e1864f 2025-09-26 15:40:38,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:40:38,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d415eacd36afa834e1864f HTTP/1.1" 200 None 2025-09-26 15:40:38,394 - lava_callback - DEBUG - Processing node 68d415eacd36afa834e1864f: baseline-arm64 2025-09-26 15:40:38,815 - lava_callback - ERROR - Error processing callback for node 68d415eacd36afa834e1864f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:57788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57298 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:41:30,685 - lava_callback - INFO - Received callback for node 68d417afcd36afa834e188d2 INFO: 172.20.0.1:36892 - "POST /node/68d417afcd36afa834e188d2 HTTP/1.0" 202 Accepted 2025-09-26 15:41:30,691 - lava_callback - INFO - Starting async job submit for node 68d417afcd36afa834e188d2 2025-09-26 15:41:30,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:41:30,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d417afcd36afa834e188d2 HTTP/1.1" 200 None 2025-09-26 15:41:30,724 - lava_callback - DEBUG - Processing node 68d417afcd36afa834e188d2: baseline-arm64 2025-09-26 15:41:31,032 - lava_callback - ERROR - Error processing callback for node 68d417afcd36afa834e188d2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:36898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36204 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:41:59,492 - lava_callback - INFO - Received callback for node 68d417b2cd36afa834e188d5 INFO: 172.20.0.1:54920 - "POST /node/68d417b2cd36afa834e188d5 HTTP/1.0" 202 Accepted 2025-09-26 15:41:59,500 - lava_callback - INFO - Starting async job submit for node 68d417b2cd36afa834e188d5 2025-09-26 15:41:59,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:41:59,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d417b2cd36afa834e188d5 HTTP/1.1" 200 None 2025-09-26 15:41:59,536 - lava_callback - DEBUG - Processing node 68d417b2cd36afa834e188d5: baseline-arm64 2025-09-26 15:42:00,693 - lava_callback - ERROR - Error processing callback for node 68d417b2cd36afa834e188d5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:54926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52518 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:42:34,023 - lava_callback - INFO - Received callback for node 68d6a25d2f83206171a923b7 INFO: 172.20.0.1:44838 - "POST /node/68d6a25d2f83206171a923b7 HTTP/1.0" 202 Accepted 2025-09-26 15:42:34,028 - lava_callback - INFO - Starting async job submit for node 68d6a25d2f83206171a923b7 2025-09-26 15:42:34,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:42:34,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a25d2f83206171a923b7 HTTP/1.1" 200 None 2025-09-26 15:42:34,070 - lava_callback - DEBUG - Processing node 68d6a25d2f83206171a923b7: baseline-x86-kcidebug-intel 2025-09-26 15:42:34,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:42:34,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:42:34,473 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d6a25d2f83206171a923b7/log.txt.gz 2025-09-26 15:42:34,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:42:34,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:42:34,689 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d6a25d2f83206171a923b7/lava_callback.json.gz DEBUG: Setup failed for 68d6a25d2f83206171a923b7. Transitting job node result: incomplete -> fail 2025-09-26 15:42:34,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:42:34,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a25d2f83206171a923b7 HTTP/1.1" 200 None 2025-09-26 15:42:34,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:42:34,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d649095d233c363a762369 HTTP/1.1" 200 None 2025-09-26 15:42:34,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:42:34,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a25d2f83206171a923b7 HTTP/1.1" 200 None 2025-09-26 15:42:34,807 - lava_callback - INFO - Completed processing callback for node 68d6a25d2f83206171a923b7 INFO: 172.20.0.1:44846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44852 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:42:43,829 - lava_callback - INFO - Received callback for node 68d431d1a5c2c05277bc853e INFO: 172.20.0.1:41680 - "POST /node/68d431d1a5c2c05277bc853e HTTP/1.0" 202 Accepted 2025-09-26 15:42:43,835 - lava_callback - INFO - Starting async job submit for node 68d431d1a5c2c05277bc853e 2025-09-26 15:42:43,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:42:43,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d431d1a5c2c05277bc853e HTTP/1.1" 200 None 2025-09-26 15:42:43,870 - lava_callback - DEBUG - Processing node 68d431d1a5c2c05277bc853e: baseline-arm 2025-09-26 15:42:44,093 - lava_callback - ERROR - Error processing callback for node 68d431d1a5c2c05277bc853e: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:41694 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:42:47,963 - lava_callback - INFO - Received callback for node 68d417becd36afa834e188de INFO: 172.20.0.1:41698 - "POST /node/68d417becd36afa834e188de HTTP/1.0" 202 Accepted 2025-09-26 15:42:47,970 - lava_callback - INFO - Starting async job submit for node 68d417becd36afa834e188de 2025-09-26 15:42:47,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:42:48,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d417becd36afa834e188de HTTP/1.1" 200 None 2025-09-26 15:42:48,005 - lava_callback - DEBUG - Processing node 68d417becd36afa834e188de: baseline-arm64 2025-09-26 15:42:48,303 - lava_callback - ERROR - Error processing callback for node 68d417becd36afa834e188de: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:55348 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:42:56,905 - lava_callback - INFO - Received callback for node 68d41177cd36afa834e17ffe INFO: 172.20.0.1:55362 - "POST /node/68d41177cd36afa834e17ffe HTTP/1.0" 202 Accepted 2025-09-26 15:42:56,910 - lava_callback - INFO - Starting async job submit for node 68d41177cd36afa834e17ffe 2025-09-26 15:42:56,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:42:56,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41177cd36afa834e17ffe HTTP/1.1" 200 None 2025-09-26 15:42:56,925 - lava_callback - DEBUG - Processing node 68d41177cd36afa834e17ffe: baseline-arm64-baylibre 2025-09-26 15:42:56,925 - lava_callback - ERROR - Error processing callback for node 68d41177cd36afa834e17ffe: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:42:57,038 - lava_callback - INFO - Received callback for node 68d417bfcd36afa834e188e1 INFO: 172.20.0.1:55366 - "POST /node/68d417bfcd36afa834e188e1 HTTP/1.0" 202 Accepted 2025-09-26 15:42:57,044 - lava_callback - INFO - Starting async job submit for node 68d417bfcd36afa834e188e1 2025-09-26 15:42:57,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:42:57,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d417bfcd36afa834e188e1 HTTP/1.1" 200 None 2025-09-26 15:42:57,106 - lava_callback - DEBUG - Processing node 68d417bfcd36afa834e188e1: baseline-arm64 2025-09-26 15:42:57,413 - lava_callback - ERROR - Error processing callback for node 68d417bfcd36afa834e188e1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:43:06,288 - lava_callback - INFO - Received callback for node 68d6a4fa2f83206171a923fa INFO: 172.20.0.1:55918 - "POST /node/68d6a4fa2f83206171a923fa HTTP/1.0" 202 Accepted 2025-09-26 15:43:06,294 - lava_callback - INFO - Starting async job submit for node 68d6a4fa2f83206171a923fa 2025-09-26 15:43:06,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:43:06,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a4fa2f83206171a923fa HTTP/1.1" 200 None 2025-09-26 15:43:06,323 - lava_callback - DEBUG - Processing node 68d6a4fa2f83206171a923fa: baseline-x86 INFO: 172.20.0.1:55922 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:43:06,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:43:06,902 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:43:06,902 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d6a4fa2f83206171a923fa/log.txt.gz 2025-09-26 15:43:06,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:43:07,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:43:07,031 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d6a4fa2f83206171a923fa/lava_callback.json.gz 2025-09-26 15:43:07,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:43:07,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a4fa2f83206171a923fa HTTP/1.1" 200 None 2025-09-26 15:43:07,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:43:07,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d649055d233c363a762366 HTTP/1.1" 200 None 2025-09-26 15:43:07,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:43:07,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a4fa2f83206171a923fa HTTP/1.1" 200 None 2025-09-26 15:43:07,154 - lava_callback - INFO - Completed processing callback for node 68d6a4fa2f83206171a923fa INFO: 172.20.0.1:51030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51046 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:43:18,860 - lava_callback - INFO - Received callback for node 68d417c4cd36afa834e188e7 INFO: 172.20.0.1:51056 - "POST /node/68d417c4cd36afa834e188e7 HTTP/1.0" 202 Accepted 2025-09-26 15:43:18,866 - lava_callback - INFO - Starting async job submit for node 68d417c4cd36afa834e188e7 2025-09-26 15:43:18,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:43:18,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d417c4cd36afa834e188e7 HTTP/1.1" 200 None 2025-09-26 15:43:18,899 - lava_callback - DEBUG - Processing node 68d417c4cd36afa834e188e7: baseline-arm64 2025-09-26 15:43:19,229 - lava_callback - ERROR - Error processing callback for node 68d417c4cd36afa834e188e7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:43:20,238 - lava_callback - INFO - Received callback for node 68d417c4cd36afa834e188e4 INFO: 172.20.0.1:35600 - "POST /node/68d417c4cd36afa834e188e4 HTTP/1.0" 202 Accepted 2025-09-26 15:43:20,244 - lava_callback - INFO - Starting async job submit for node 68d417c4cd36afa834e188e4 2025-09-26 15:43:20,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:43:20,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d417c4cd36afa834e188e4 HTTP/1.1" 200 None 2025-09-26 15:43:20,276 - lava_callback - DEBUG - Processing node 68d417c4cd36afa834e188e4: baseline-arm64 2025-09-26 15:43:20,574 - lava_callback - ERROR - Error processing callback for node 68d417c4cd36afa834e188e4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:35610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38252 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:44:08,466 - lava_callback - INFO - Received callback for node 68d417c8cd36afa834e188fd INFO: 172.20.0.1:38260 - "POST /node/68d417c8cd36afa834e188fd HTTP/1.0" 202 Accepted 2025-09-26 15:44:08,472 - lava_callback - INFO - Starting async job submit for node 68d417c8cd36afa834e188fd 2025-09-26 15:44:08,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:44:08,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d417c8cd36afa834e188fd HTTP/1.1" 200 None 2025-09-26 15:44:08,529 - lava_callback - DEBUG - Processing node 68d417c8cd36afa834e188fd: baseline-arm64 2025-09-26 15:44:08,824 - lava_callback - ERROR - Error processing callback for node 68d417c8cd36afa834e188fd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:44:10,197 - lava_callback - INFO - Received callback for node 68d6a6262f83206171a92440 INFO: 172.20.0.1:57428 - "POST /node/68d6a6262f83206171a92440 HTTP/1.0" 202 Accepted 2025-09-26 15:44:10,203 - lava_callback - INFO - Starting async job submit for node 68d6a6262f83206171a92440 2025-09-26 15:44:10,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:44:10,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a6262f83206171a92440 HTTP/1.1" 200 None 2025-09-26 15:44:10,266 - lava_callback - DEBUG - Processing node 68d6a6262f83206171a92440: baseline-x86 2025-09-26 15:44:10,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:44:10,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:44:10,697 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d6a6262f83206171a92440/log.txt.gz 2025-09-26 15:44:10,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:44:10,847 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:44:10,848 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d6a6262f83206171a92440/lava_callback.json.gz 2025-09-26 15:44:10,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:44:10,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a6262f83206171a92440 HTTP/1.1" 200 None 2025-09-26 15:44:10,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:44:10,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d24a5c3ab168ecc7a4d HTTP/1.1" 200 None 2025-09-26 15:44:10,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:44:10,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a6262f83206171a92440 HTTP/1.1" 200 None 2025-09-26 15:44:10,939 - lava_callback - INFO - Completed processing callback for node 68d6a6262f83206171a92440 INFO: 172.20.0.1:57440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57442 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:44:18,315 - lava_callback - INFO - Received callback for node 68d417cbcd36afa834e18900 INFO: 172.20.0.1:57456 - "POST /node/68d417cbcd36afa834e18900 HTTP/1.0" 202 Accepted 2025-09-26 15:44:18,321 - lava_callback - INFO - Starting async job submit for node 68d417cbcd36afa834e18900 2025-09-26 15:44:18,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:44:18,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d417cbcd36afa834e18900 HTTP/1.1" 200 None 2025-09-26 15:44:18,354 - lava_callback - DEBUG - Processing node 68d417cbcd36afa834e18900: baseline-arm64 2025-09-26 15:44:18,643 - lava_callback - ERROR - Error processing callback for node 68d417cbcd36afa834e18900: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:50652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53444 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:44:39,386 - lava_callback - INFO - Received callback for node 68d4184dcd36afa834e189b0 INFO: 172.20.0.1:43698 - "POST /node/68d4184dcd36afa834e189b0 HTTP/1.0" 202 Accepted 2025-09-26 15:44:39,393 - lava_callback - INFO - Starting async job submit for node 68d4184dcd36afa834e189b0 2025-09-26 15:44:39,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:44:39,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4184dcd36afa834e189b0 HTTP/1.1" 200 None 2025-09-26 15:44:39,434 - lava_callback - DEBUG - Processing node 68d4184dcd36afa834e189b0: baseline-arm64 2025-09-26 15:44:39,721 - lava_callback - ERROR - Error processing callback for node 68d4184dcd36afa834e189b0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:44:40,049 - lava_callback - INFO - Received callback for node 68d431d3a5c2c05277bc8555 INFO: 172.20.0.1:43706 - "POST /node/68d431d3a5c2c05277bc8555 HTTP/1.0" 202 Accepted 2025-09-26 15:44:40,055 - lava_callback - INFO - Starting async job submit for node 68d431d3a5c2c05277bc8555 2025-09-26 15:44:40,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:44:40,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d431d3a5c2c05277bc8555 HTTP/1.1" 200 None 2025-09-26 15:44:40,088 - lava_callback - DEBUG - Processing node 68d431d3a5c2c05277bc8555: baseline-arm 2025-09-26 15:44:40,324 - lava_callback - ERROR - Error processing callback for node 68d431d3a5c2c05277bc8555: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:44:40,742 - lava_callback - INFO - Received callback for node 68d41850cd36afa834e189b3 INFO: 172.20.0.1:43714 - "POST /node/68d41850cd36afa834e189b3 HTTP/1.0" 202 Accepted 2025-09-26 15:44:40,748 - lava_callback - INFO - Starting async job submit for node 68d41850cd36afa834e189b3 2025-09-26 15:44:40,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:44:40,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41850cd36afa834e189b3 HTTP/1.1" 200 None 2025-09-26 15:44:40,781 - lava_callback - DEBUG - Processing node 68d41850cd36afa834e189b3: baseline-arm64 2025-09-26 15:44:41,075 - lava_callback - ERROR - Error processing callback for node 68d41850cd36afa834e189b3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:44:42,495 - lava_callback - INFO - Received callback for node 68d6ab562f83206171a9274b INFO: 172.20.0.1:43724 - "POST /node/68d6ab562f83206171a9274b HTTP/1.0" 202 Accepted 2025-09-26 15:44:42,501 - lava_callback - INFO - Starting async job submit for node 68d6ab562f83206171a9274b 2025-09-26 15:44:42,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:44:42,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ab562f83206171a9274b HTTP/1.1" 200 None 2025-09-26 15:44:42,553 - lava_callback - DEBUG - Processing node 68d6ab562f83206171a9274b: baseline-x86 2025-09-26 15:44:42,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:44:42,957 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:44:42,957 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-68d6ab562f83206171a9274b/log.txt.gz 2025-09-26 15:44:42,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:44:43,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:44:43,089 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-68d6ab562f83206171a9274b/lava_callback.json.gz 2025-09-26 15:44:43,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:44:43,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ab562f83206171a9274b HTTP/1.1" 200 None 2025-09-26 15:44:43,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:44:43,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651efcca86fb17472aa39 HTTP/1.1" 200 None 2025-09-26 15:44:43,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:44:43,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ab562f83206171a9274b HTTP/1.1" 200 None 2025-09-26 15:44:43,158 - lava_callback - INFO - Completed processing callback for node 68d6ab562f83206171a9274b INFO: 172.20.0.1:43730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41986 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:45:27,392 - lava_callback - INFO - Received callback for node 68d6aa5e2f83206171a9271d INFO: 172.20.0.1:41994 - "POST /node/68d6aa5e2f83206171a9271d HTTP/1.0" 202 Accepted 2025-09-26 15:45:27,399 - lava_callback - INFO - Starting async job submit for node 68d6aa5e2f83206171a9271d 2025-09-26 15:45:27,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:45:27,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6aa5e2f83206171a9271d HTTP/1.1" 200 None 2025-09-26 15:45:27,495 - lava_callback - DEBUG - Processing node 68d6aa5e2f83206171a9271d: ltp-smoketest 2025-09-26 15:45:27,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:45:28,122 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:45:28,123 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d6aa5e2f83206171a9271d/log.txt.gz 2025-09-26 15:45:28,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:45:28,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:45:28,250 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d6aa5e2f83206171a9271d/lava_callback.json.gz 2025-09-26 15:45:28,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:45:28,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6aa5e2f83206171a9271d HTTP/1.1" 200 None 2025-09-26 15:45:28,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:45:28,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651d5cca86fb17472aa18 HTTP/1.1" 200 None 2025-09-26 15:45:28,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:45:28,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6aa5e2f83206171a9271d HTTP/1.1" 200 None 2025-09-26 15:45:28,436 - lava_callback - INFO - Completed processing callback for node 68d6aa5e2f83206171a9271d INFO: 172.20.0.1:44022 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:45:37,064 - lava_callback - INFO - Received callback for node 68d41219cd36afa834e180ce INFO: 172.20.0.1:44032 - "POST /node/68d41219cd36afa834e180ce HTTP/1.0" 202 Accepted 2025-09-26 15:45:37,070 - lava_callback - INFO - Starting async job submit for node 68d41219cd36afa834e180ce 2025-09-26 15:45:37,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:45:37,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41219cd36afa834e180ce HTTP/1.1" 200 None 2025-09-26 15:45:37,084 - lava_callback - DEBUG - Processing node 68d41219cd36afa834e180ce: baseline-arm64-baylibre 2025-09-26 15:45:37,084 - lava_callback - ERROR - Error processing callback for node 68d41219cd36afa834e180ce: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:44048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57866 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:45:47,144 - lava_callback - INFO - Received callback for node 68d41853cd36afa834e189b6 INFO: 172.20.0.1:57872 - "POST /node/68d41853cd36afa834e189b6 HTTP/1.0" 202 Accepted 2025-09-26 15:45:47,150 - lava_callback - INFO - Starting async job submit for node 68d41853cd36afa834e189b6 2025-09-26 15:45:47,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:45:47,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41853cd36afa834e189b6 HTTP/1.1" 200 None 2025-09-26 15:45:47,182 - lava_callback - DEBUG - Processing node 68d41853cd36afa834e189b6: baseline-arm64 2025-09-26 15:45:47,498 - lava_callback - ERROR - Error processing callback for node 68d41853cd36afa834e189b6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:45:54,865 - lava_callback - INFO - Received callback for node 68d41855cd36afa834e189b9 INFO: 172.20.0.1:51992 - "POST /node/68d41855cd36afa834e189b9 HTTP/1.0" 202 Accepted 2025-09-26 15:45:54,872 - lava_callback - INFO - Starting async job submit for node 68d41855cd36afa834e189b9 2025-09-26 15:45:54,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:45:54,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41855cd36afa834e189b9 HTTP/1.1" 200 None 2025-09-26 15:45:54,928 - lava_callback - DEBUG - Processing node 68d41855cd36afa834e189b9: baseline-arm64 2025-09-26 15:45:55,406 - lava_callback - ERROR - Error processing callback for node 68d41855cd36afa834e189b9: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:52000 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:45:57,369 - lava_callback - INFO - Received callback for node 68d6afd82f83206171a92997 INFO: 172.20.0.1:52014 - "POST /node/68d6afd82f83206171a92997 HTTP/1.0" 202 Accepted 2025-09-26 15:45:57,377 - lava_callback - INFO - Starting async job submit for node 68d6afd82f83206171a92997 2025-09-26 15:45:57,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:45:57,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6afd82f83206171a92997 HTTP/1.1" 200 None 2025-09-26 15:45:57,419 - lava_callback - DEBUG - Processing node 68d6afd82f83206171a92997: blktests-ddp-x86 2025-09-26 15:45:57,912 - lava_callback - INFO - Received callback for node 68d41860cd36afa834e189c2 INFO: 172.20.0.1:52026 - "POST /node/68d41860cd36afa834e189c2 HTTP/1.0" 202 Accepted 2025-09-26 15:45:57,945 - lava_callback - INFO - Starting async job submit for node 68d41860cd36afa834e189c2 2025-09-26 15:45:58,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:45:58,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41860cd36afa834e189c2 HTTP/1.1" 200 None 2025-09-26 15:45:58,094 - lava_callback - DEBUG - Processing node 68d41860cd36afa834e189c2: baseline-arm64 2025-09-26 15:45:58,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:45:58,771 - lava_callback - ERROR - Error processing callback for node 68d41860cd36afa834e189c2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:45:58,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:45:58,942 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/blktests-ddp-x86-68d6afd82f83206171a92997/log.txt.gz 2025-09-26 15:45:58,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:45:59,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:45:59,138 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/blktests-ddp-x86-68d6afd82f83206171a92997/lava_callback.json.gz 2025-09-26 15:45:59,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:45:59,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6afd82f83206171a92997 HTTP/1.1" 200 None 2025-09-26 15:45:59,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:45:59,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d649055d233c363a762366 HTTP/1.1" 200 None 2025-09-26 15:45:59,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:45:59,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6afd82f83206171a92997 HTTP/1.1" 200 None 2025-09-26 15:45:59,255 - lava_callback - INFO - Completed processing callback for node 68d6afd82f83206171a92997 2025-09-26 15:46:03,171 - lava_callback - INFO - Received callback for node 68d4185ecd36afa834e189bf INFO: 172.20.0.1:40238 - "POST /node/68d4185ecd36afa834e189bf HTTP/1.0" 202 Accepted 2025-09-26 15:46:03,178 - lava_callback - INFO - Starting async job submit for node 68d4185ecd36afa834e189bf 2025-09-26 15:46:03,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:46:03,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4185ecd36afa834e189bf HTTP/1.1" 200 None 2025-09-26 15:46:03,216 - lava_callback - DEBUG - Processing node 68d4185ecd36afa834e189bf: baseline-arm64 2025-09-26 15:46:03,607 - lava_callback - ERROR - Error processing callback for node 68d4185ecd36afa834e189bf: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:40252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32830 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:46:17,121 - lava_callback - INFO - Received callback for node 68d41245cd36afa834e18120 INFO: 172.20.0.1:32834 - "POST /node/68d41245cd36afa834e18120 HTTP/1.0" 202 Accepted 2025-09-26 15:46:17,126 - lava_callback - INFO - Starting async job submit for node 68d41245cd36afa834e18120 2025-09-26 15:46:17,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:46:17,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41245cd36afa834e18120 HTTP/1.1" 200 None 2025-09-26 15:46:17,140 - lava_callback - DEBUG - Processing node 68d41245cd36afa834e18120: baseline-arm64-baylibre 2025-09-26 15:46:17,140 - lava_callback - ERROR - Error processing callback for node 68d41245cd36afa834e18120: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:46:17,802 - lava_callback - INFO - Received callback for node 68d4123acd36afa834e18117 INFO: 172.20.0.1:32850 - "POST /node/68d4123acd36afa834e18117 HTTP/1.0" 202 Accepted 2025-09-26 15:46:17,808 - lava_callback - INFO - Starting async job submit for node 68d4123acd36afa834e18117 2025-09-26 15:46:17,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:46:17,821 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4123acd36afa834e18117 HTTP/1.1" 200 None 2025-09-26 15:46:17,822 - lava_callback - DEBUG - Processing node 68d4123acd36afa834e18117: baseline-arm64-baylibre 2025-09-26 15:46:17,822 - lava_callback - ERROR - Error processing callback for node 68d4123acd36afa834e18117: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:46:23,499 - lava_callback - INFO - Received callback for node 68d4123ecd36afa834e1811a INFO: 172.20.0.1:59110 - "POST /node/68d4123ecd36afa834e1811a HTTP/1.0" 202 Accepted 2025-09-26 15:46:23,505 - lava_callback - INFO - Starting async job submit for node 68d4123ecd36afa834e1811a 2025-09-26 15:46:23,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:46:23,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4123ecd36afa834e1811a HTTP/1.1" 200 None 2025-09-26 15:46:23,519 - lava_callback - DEBUG - Processing node 68d4123ecd36afa834e1811a: ltp-fs-bind 2025-09-26 15:46:23,519 - lava_callback - ERROR - Error processing callback for node 68d4123ecd36afa834e1811a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:59124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39280 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:46:43,043 - lava_callback - INFO - Received callback for node 68d431e4a5c2c05277bc858a INFO: 172.20.0.1:34422 - "POST /node/68d431e4a5c2c05277bc858a HTTP/1.0" 202 Accepted 2025-09-26 15:46:43,049 - lava_callback - INFO - Starting async job submit for node 68d431e4a5c2c05277bc858a 2025-09-26 15:46:43,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:46:43,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d431e4a5c2c05277bc858a HTTP/1.1" 200 None 2025-09-26 15:46:43,101 - lava_callback - DEBUG - Processing node 68d431e4a5c2c05277bc858a: baseline-arm 2025-09-26 15:46:43,317 - lava_callback - ERROR - Error processing callback for node 68d431e4a5c2c05277bc858a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:34438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33034 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:47:05,607 - lava_callback - INFO - Received callback for node 68d41863cd36afa834e189c5 INFO: 172.20.0.1:46206 - "POST /node/68d41863cd36afa834e189c5 HTTP/1.0" 202 Accepted 2025-09-26 15:47:05,615 - lava_callback - INFO - Starting async job submit for node 68d41863cd36afa834e189c5 2025-09-26 15:47:05,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:47:05,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41863cd36afa834e189c5 HTTP/1.1" 200 None 2025-09-26 15:47:05,678 - lava_callback - DEBUG - Processing node 68d41863cd36afa834e189c5: baseline-arm64 2025-09-26 15:47:06,069 - lava_callback - ERROR - Error processing callback for node 68d41863cd36afa834e189c5: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:46222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52068 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:47:20,982 - lava_callback - INFO - Received callback for node 68d4186bcd36afa834e189cb INFO: 172.20.0.1:51470 - "POST /node/68d4186bcd36afa834e189cb HTTP/1.0" 202 Accepted 2025-09-26 15:47:20,988 - lava_callback - INFO - Starting async job submit for node 68d4186bcd36afa834e189cb 2025-09-26 15:47:21,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:47:21,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4186bcd36afa834e189cb HTTP/1.1" 200 None 2025-09-26 15:47:21,027 - lava_callback - DEBUG - Processing node 68d4186bcd36afa834e189cb: baseline-arm64 2025-09-26 15:47:21,313 - lava_callback - ERROR - Error processing callback for node 68d4186bcd36afa834e189cb: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:47:22,401 - lava_callback - INFO - Received callback for node 68d41866cd36afa834e189c8 INFO: 172.20.0.1:51482 - "POST /node/68d41866cd36afa834e189c8 HTTP/1.0" 202 Accepted 2025-09-26 15:47:22,407 - lava_callback - INFO - Starting async job submit for node 68d41866cd36afa834e189c8 2025-09-26 15:47:22,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:47:22,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41866cd36afa834e189c8 HTTP/1.1" 200 None 2025-09-26 15:47:22,440 - lava_callback - DEBUG - Processing node 68d41866cd36afa834e189c8: baseline-arm64 2025-09-26 15:47:22,733 - lava_callback - ERROR - Error processing callback for node 68d41866cd36afa834e189c8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:47:23,717 - lava_callback - INFO - Received callback for node 68d4186bcd36afa834e189ce INFO: 172.20.0.1:51494 - "POST /node/68d4186bcd36afa834e189ce HTTP/1.0" 202 Accepted 2025-09-26 15:47:23,723 - lava_callback - INFO - Starting async job submit for node 68d4186bcd36afa834e189ce 2025-09-26 15:47:23,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:47:23,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4186bcd36afa834e189ce HTTP/1.1" 200 None 2025-09-26 15:47:23,755 - lava_callback - DEBUG - Processing node 68d4186bcd36afa834e189ce: baseline-arm64 2025-09-26 15:47:24,065 - lava_callback - ERROR - Error processing callback for node 68d4186bcd36afa834e189ce: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:51504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49662 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:47:52,017 - lava_callback - INFO - Received callback for node 68d6a7172f83206171a92480 INFO: 172.20.0.1:56124 - "POST /node/68d6a7172f83206171a92480 HTTP/1.0" 202 Accepted 2025-09-26 15:47:52,023 - lava_callback - INFO - Starting async job submit for node 68d6a7172f83206171a92480 2025-09-26 15:47:52,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:47:52,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7172f83206171a92480 HTTP/1.1" 200 None 2025-09-26 15:47:52,056 - lava_callback - DEBUG - Processing node 68d6a7172f83206171a92480: baseline-arm64 2025-09-26 15:47:52,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:47:52,551 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:47:52,552 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7172f83206171a92480/log.txt.gz 2025-09-26 15:47:52,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:47:52,708 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:47:52,709 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7172f83206171a92480/lava_callback.json.gz 2025-09-26 15:47:52,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:47:52,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7172f83206171a92480 HTTP/1.1" 200 None 2025-09-26 15:47:52,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:47:52,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 15:47:52,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:47:52,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7172f83206171a92480 HTTP/1.1" 200 None 2025-09-26 15:47:52,783 - lava_callback - INFO - Completed processing callback for node 68d6a7172f83206171a92480 INFO: 172.20.0.1:56134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33248 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:48:23,723 - lava_callback - INFO - Received callback for node 68d412b4cd36afa834e181cd INFO: 172.20.0.1:52244 - "POST /node/68d412b4cd36afa834e181cd HTTP/1.0" 202 Accepted 2025-09-26 15:48:23,729 - lava_callback - INFO - Starting async job submit for node 68d412b4cd36afa834e181cd 2025-09-26 15:48:23,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:48:23,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d412b4cd36afa834e181cd HTTP/1.1" 200 None 2025-09-26 15:48:23,753 - lava_callback - DEBUG - Processing node 68d412b4cd36afa834e181cd: ltp-fsx 2025-09-26 15:48:23,753 - lava_callback - ERROR - Error processing callback for node 68d412b4cd36afa834e181cd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:48:25,784 - lava_callback - INFO - Received callback for node 68d41876cd36afa834e189d7 INFO: 172.20.0.1:52246 - "POST /node/68d41876cd36afa834e189d7 HTTP/1.0" 202 Accepted 2025-09-26 15:48:25,790 - lava_callback - INFO - Starting async job submit for node 68d41876cd36afa834e189d7 2025-09-26 15:48:25,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:48:25,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41876cd36afa834e189d7 HTTP/1.1" 200 None 2025-09-26 15:48:25,823 - lava_callback - DEBUG - Processing node 68d41876cd36afa834e189d7: baseline-arm64 2025-09-26 15:48:26,153 - lava_callback - ERROR - Error processing callback for node 68d41876cd36afa834e189d7: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:52256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40620 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:48:41,748 - lava_callback - INFO - Received callback for node 68d41876cd36afa834e189da INFO: 172.20.0.1:38718 - "POST /node/68d41876cd36afa834e189da HTTP/1.0" 202 Accepted 2025-09-26 15:48:41,754 - lava_callback - INFO - Starting async job submit for node 68d41876cd36afa834e189da 2025-09-26 15:48:41,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:48:41,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41876cd36afa834e189da HTTP/1.1" 200 None 2025-09-26 15:48:41,789 - lava_callback - DEBUG - Processing node 68d41876cd36afa834e189da: baseline-arm64 2025-09-26 15:48:42,079 - lava_callback - ERROR - Error processing callback for node 68d41876cd36afa834e189da: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:48:43,336 - lava_callback - INFO - Received callback for node 68d41871cd36afa834e189d4 INFO: 172.20.0.1:38732 - "POST /node/68d41871cd36afa834e189d4 HTTP/1.0" 202 Accepted 2025-09-26 15:48:43,342 - lava_callback - INFO - Starting async job submit for node 68d41871cd36afa834e189d4 2025-09-26 15:48:43,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:48:43,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41871cd36afa834e189d4 HTTP/1.1" 200 None 2025-09-26 15:48:43,375 - lava_callback - DEBUG - Processing node 68d41871cd36afa834e189d4: baseline-arm64 2025-09-26 15:48:43,714 - lava_callback - ERROR - Error processing callback for node 68d41871cd36afa834e189d4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:48:44,453 - lava_callback - INFO - Received callback for node 68d412d5cd36afa834e181e5 INFO: 172.20.0.1:38744 - "POST /node/68d412d5cd36afa834e181e5 HTTP/1.0" 202 Accepted 2025-09-26 15:48:44,459 - lava_callback - INFO - Starting async job submit for node 68d412d5cd36afa834e181e5 2025-09-26 15:48:44,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:48:44,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d412d5cd36afa834e181e5 HTTP/1.1" 200 None 2025-09-26 15:48:44,477 - lava_callback - DEBUG - Processing node 68d412d5cd36afa834e181e5: ltp-fs-bind 2025-09-26 15:48:44,477 - lava_callback - ERROR - Error processing callback for node 68d412d5cd36afa834e181e5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:48:45,821 - lava_callback - INFO - Received callback for node 68d4186ecd36afa834e189d1 INFO: 172.20.0.1:38750 - "POST /node/68d4186ecd36afa834e189d1 HTTP/1.0" 202 Accepted 2025-09-26 15:48:45,827 - lava_callback - INFO - Starting async job submit for node 68d4186ecd36afa834e189d1 2025-09-26 15:48:45,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:48:45,848 - lava_callback - INFO - Received callback for node 68d431e5a5c2c05277bc858d INFO: 172.20.0.1:38754 - "POST /node/68d431e5a5c2c05277bc858d HTTP/1.0" 202 Accepted 2025-09-26 15:48:45,853 - lava_callback - INFO - Starting async job submit for node 68d431e5a5c2c05277bc858d 2025-09-26 15:48:45,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:48:45,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4186ecd36afa834e189d1 HTTP/1.1" 200 None 2025-09-26 15:48:45,884 - lava_callback - DEBUG - Processing node 68d4186ecd36afa834e189d1: baseline-arm64 2025-09-26 15:48:45,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d431e5a5c2c05277bc858d HTTP/1.1" 200 None 2025-09-26 15:48:45,910 - lava_callback - DEBUG - Processing node 68d431e5a5c2c05277bc858d: baseline-arm 2025-09-26 15:48:46,370 - lava_callback - ERROR - Error processing callback for node 68d431e5a5c2c05277bc858d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:48:46,430 - lava_callback - ERROR - Error processing callback for node 68d4186ecd36afa834e189d1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:38764 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:48:47,599 - lava_callback - INFO - Received callback for node 68d6a7182f83206171a92483 INFO: 172.20.0.1:38778 - "POST /node/68d6a7182f83206171a92483 HTTP/1.0" 202 Accepted 2025-09-26 15:48:47,605 - lava_callback - INFO - Starting async job submit for node 68d6a7182f83206171a92483 2025-09-26 15:48:47,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:48:47,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7182f83206171a92483 HTTP/1.1" 200 None 2025-09-26 15:48:47,638 - lava_callback - DEBUG - Processing node 68d6a7182f83206171a92483: baseline-arm64 2025-09-26 15:48:47,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:48:48,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:48:48,127 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7182f83206171a92483/log.txt.gz 2025-09-26 15:48:48,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:48:48,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:48:48,254 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7182f83206171a92483/lava_callback.json.gz 2025-09-26 15:48:48,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:48:48,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7182f83206171a92483 HTTP/1.1" 200 None 2025-09-26 15:48:48,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:48:48,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 15:48:48,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:48:48,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7182f83206171a92483 HTTP/1.1" 200 None 2025-09-26 15:48:48,330 - lava_callback - INFO - Completed processing callback for node 68d6a7182f83206171a92483 INFO: 172.20.0.1:46400 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:49:03,662 - lava_callback - INFO - Received callback for node 68d412ddcd36afa834e181eb INFO: 172.20.0.1:39484 - "POST /node/68d412ddcd36afa834e181eb HTTP/1.0" 202 Accepted 2025-09-26 15:49:03,668 - lava_callback - INFO - Starting async job submit for node 68d412ddcd36afa834e181eb 2025-09-26 15:49:03,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:49:03,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d412ddcd36afa834e181eb HTTP/1.1" 200 None 2025-09-26 15:49:03,706 - lava_callback - DEBUG - Processing node 68d412ddcd36afa834e181eb: ltp-fs-bind 2025-09-26 15:49:03,706 - lava_callback - ERROR - Error processing callback for node 68d412ddcd36afa834e181eb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:49:04,477 - lava_callback - INFO - Received callback for node 68d412e0cd36afa834e181ee INFO: 172.20.0.1:39486 - "POST /node/68d412e0cd36afa834e181ee HTTP/1.0" 202 Accepted 2025-09-26 15:49:04,483 - lava_callback - INFO - Starting async job submit for node 68d412e0cd36afa834e181ee 2025-09-26 15:49:04,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:49:04,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d412e0cd36afa834e181ee HTTP/1.1" 200 None 2025-09-26 15:49:04,505 - lava_callback - DEBUG - Processing node 68d412e0cd36afa834e181ee: ltp-fsx 2025-09-26 15:49:04,506 - lava_callback - ERROR - Error processing callback for node 68d412e0cd36afa834e181ee: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:49:05,216 - lava_callback - INFO - Received callback for node 68d412e6cd36afa834e181f4 INFO: 172.20.0.1:39488 - "POST /node/68d412e6cd36afa834e181f4 HTTP/1.0" 202 Accepted 2025-09-26 15:49:05,222 - lava_callback - INFO - Starting async job submit for node 68d412e6cd36afa834e181f4 2025-09-26 15:49:05,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:49:05,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d412e6cd36afa834e181f4 HTTP/1.1" 200 None 2025-09-26 15:49:05,235 - lava_callback - DEBUG - Processing node 68d412e6cd36afa834e181f4: ltp-input 2025-09-26 15:49:05,235 - lava_callback - ERROR - Error processing callback for node 68d412e6cd36afa834e181f4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:39494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37208 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:49:37,290 - lava_callback - INFO - Received callback for node 68d412fdcd36afa834e18237 INFO: 172.20.0.1:37216 - "POST /node/68d412fdcd36afa834e18237 HTTP/1.0" 202 Accepted 2025-09-26 15:49:37,296 - lava_callback - INFO - Starting async job submit for node 68d412fdcd36afa834e18237 2025-09-26 15:49:37,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:49:37,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d412fdcd36afa834e18237 HTTP/1.1" 200 None 2025-09-26 15:49:37,309 - lava_callback - DEBUG - Processing node 68d412fdcd36afa834e18237: baseline-arm64-baylibre 2025-09-26 15:49:37,309 - lava_callback - ERROR - Error processing callback for node 68d412fdcd36afa834e18237: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:49:37,963 - lava_callback - INFO - Received callback for node 68d4130acd36afa834e18241 INFO: 172.20.0.1:37232 - "POST /node/68d4130acd36afa834e18241 HTTP/1.0" 202 Accepted 2025-09-26 15:49:37,969 - lava_callback - INFO - Starting async job submit for node 68d4130acd36afa834e18241 2025-09-26 15:49:37,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:49:37,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4130acd36afa834e18241 HTTP/1.1" 200 None 2025-09-26 15:49:37,982 - lava_callback - DEBUG - Processing node 68d4130acd36afa834e18241: baseline-arm64-baylibre 2025-09-26 15:49:37,982 - lava_callback - ERROR - Error processing callback for node 68d4130acd36afa834e18241: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:40946 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:49:41,077 - lava_callback - INFO - Received callback for node 68d6a7352f83206171a924bd INFO: 172.20.0.1:40956 - "POST /node/68d6a7352f83206171a924bd HTTP/1.0" 202 Accepted 2025-09-26 15:49:41,083 - lava_callback - INFO - Starting async job submit for node 68d6a7352f83206171a924bd 2025-09-26 15:49:41,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:49:41,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7352f83206171a924bd HTTP/1.1" 200 None 2025-09-26 15:49:41,135 - lava_callback - DEBUG - Processing node 68d6a7352f83206171a924bd: baseline-arm64 2025-09-26 15:49:41,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:49:41,625 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:49:41,625 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7352f83206171a924bd/log.txt.gz 2025-09-26 15:49:41,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:49:41,766 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:49:41,767 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7352f83206171a924bd/lava_callback.json.gz 2025-09-26 15:49:41,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:49:41,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7352f83206171a924bd HTTP/1.1" 200 None 2025-09-26 15:49:41,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:49:41,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 15:49:41,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:49:41,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7352f83206171a924bd HTTP/1.1" 200 None 2025-09-26 15:49:41,856 - lava_callback - INFO - Completed processing callback for node 68d6a7352f83206171a924bd INFO: 172.20.0.1:40962 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:49:47,189 - lava_callback - INFO - Received callback for node 68d6a7352f83206171a924c0 INFO: 172.20.0.1:40972 - "POST /node/68d6a7352f83206171a924c0 HTTP/1.0" 202 Accepted 2025-09-26 15:49:47,195 - lava_callback - INFO - Starting async job submit for node 68d6a7352f83206171a924c0 2025-09-26 15:49:47,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:49:47,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7352f83206171a924c0 HTTP/1.1" 200 None 2025-09-26 15:49:47,236 - lava_callback - DEBUG - Processing node 68d6a7352f83206171a924c0: baseline-arm64 2025-09-26 15:49:47,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:49:47,702 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:49:47,703 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7352f83206171a924c0/log.txt.gz 2025-09-26 15:49:47,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:49:47,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:49:47,835 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a7352f83206171a924c0/lava_callback.json.gz 2025-09-26 15:49:47,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:49:47,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a7352f83206171a924c0 HTTP/1.1" 200 None 2025-09-26 15:49:47,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:49:47,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d648ed5d233c363a762351 HTTP/1.1" 200 None 2025-09-26 15:49:47,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:49:47,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a7352f83206171a924c0 HTTP/1.1" 200 None 2025-09-26 15:49:47,916 - lava_callback - INFO - Completed processing callback for node 68d6a7352f83206171a924c0 2025-09-26 15:49:49,179 - lava_callback - INFO - Received callback for node 68d41905cd36afa834e18a97 INFO: 172.20.0.1:40982 - "POST /node/68d41905cd36afa834e18a97 HTTP/1.0" 202 Accepted 2025-09-26 15:49:49,186 - lava_callback - INFO - Starting async job submit for node 68d41905cd36afa834e18a97 2025-09-26 15:49:49,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:49:49,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41905cd36afa834e18a97 HTTP/1.1" 200 None 2025-09-26 15:49:49,237 - lava_callback - DEBUG - Processing node 68d41905cd36afa834e18a97: baseline-arm64 2025-09-26 15:49:49,620 - lava_callback - ERROR - Error processing callback for node 68d41905cd36afa834e18a97: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:34930 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:50:02,908 - lava_callback - INFO - Received callback for node 68d4187fcd36afa834e189e6 INFO: 172.20.0.1:35716 - "POST /node/68d4187fcd36afa834e189e6 HTTP/1.0" 202 Accepted 2025-09-26 15:50:02,914 - lava_callback - INFO - Starting async job submit for node 68d4187fcd36afa834e189e6 2025-09-26 15:50:02,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:50:02,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4187fcd36afa834e189e6 HTTP/1.1" 200 None 2025-09-26 15:50:02,947 - lava_callback - DEBUG - Processing node 68d4187fcd36afa834e189e6: baseline-arm64 2025-09-26 15:50:03,238 - lava_callback - ERROR - Error processing callback for node 68d4187fcd36afa834e189e6: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:50:04,598 - lava_callback - INFO - Received callback for node 68d4187dcd36afa834e189e3 INFO: 172.20.0.1:35720 - "POST /node/68d4187dcd36afa834e189e3 HTTP/1.0" 202 Accepted 2025-09-26 15:50:04,603 - lava_callback - INFO - Starting async job submit for node 68d4187dcd36afa834e189e3 2025-09-26 15:50:04,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:50:04,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4187dcd36afa834e189e3 HTTP/1.1" 200 None 2025-09-26 15:50:04,636 - lava_callback - DEBUG - Processing node 68d4187dcd36afa834e189e3: baseline-arm64 2025-09-26 15:50:04,947 - lava_callback - ERROR - Error processing callback for node 68d4187dcd36afa834e189e3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:35722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60510 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60514 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:50:22,896 - lava_callback - INFO - Received callback for node 68d41908cd36afa834e18a9a INFO: 172.20.0.1:55864 - "POST /node/68d41908cd36afa834e18a9a HTTP/1.0" 202 Accepted 2025-09-26 15:50:22,902 - lava_callback - INFO - Starting async job submit for node 68d41908cd36afa834e18a9a 2025-09-26 15:50:22,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:50:22,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41908cd36afa834e18a9a HTTP/1.1" 200 None 2025-09-26 15:50:22,946 - lava_callback - DEBUG - Processing node 68d41908cd36afa834e18a9a: baseline-arm64 2025-09-26 15:50:23,240 - lava_callback - ERROR - Error processing callback for node 68d41908cd36afa834e18a9a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:55874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38996 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:50:50,802 - lava_callback - INFO - Received callback for node 68d6a80b2f83206171a925c1 INFO: 172.20.0.1:44558 - "POST /node/68d6a80b2f83206171a925c1 HTTP/1.0" 202 Accepted 2025-09-26 15:50:50,810 - lava_callback - INFO - Starting async job submit for node 68d6a80b2f83206171a925c1 2025-09-26 15:50:50,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:50:50,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a80b2f83206171a925c1 HTTP/1.1" 200 None 2025-09-26 15:50:50,848 - lava_callback - DEBUG - Processing node 68d6a80b2f83206171a925c1: baseline-arm64 2025-09-26 15:50:51,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:50:51,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:50:51,328 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a80b2f83206171a925c1/log.txt.gz 2025-09-26 15:50:51,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:50:51,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:50:51,483 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a80b2f83206171a925c1/lava_callback.json.gz 2025-09-26 15:50:51,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:50:51,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a80b2f83206171a925c1 HTTP/1.1" 200 None 2025-09-26 15:50:51,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:50:51,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 15:50:51,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:50:51,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a80b2f83206171a925c1 HTTP/1.1" 200 None 2025-09-26 15:50:51,590 - lava_callback - INFO - Completed processing callback for node 68d6a80b2f83206171a925c1 INFO: 172.20.0.1:44566 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:51:00,059 - lava_callback - INFO - Received callback for node 68d40ea1cd36afa834e1769b INFO: 172.20.0.1:34340 - "POST /node/68d40ea1cd36afa834e1769b HTTP/1.0" 202 Accepted 2025-09-26 15:51:00,066 - lava_callback - INFO - Starting async job submit for node 68d40ea1cd36afa834e1769b 2025-09-26 15:51:00,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:51:00,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40ea1cd36afa834e1769b HTTP/1.1" 200 None 2025-09-26 15:51:00,198 - lava_callback - DEBUG - Processing node 68d40ea1cd36afa834e1769b: ltp-cve 2025-09-26 15:51:00,919 - lava_callback - ERROR - Error processing callback for node 68d40ea1cd36afa834e1769b: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:34354 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:51:06,782 - lava_callback - INFO - Received callback for node 68d437f4a5c2c05277bc9076 INFO: 172.20.0.1:34364 - "POST /node/68d437f4a5c2c05277bc9076 HTTP/1.0" 202 Accepted 2025-09-26 15:51:06,787 - lava_callback - INFO - Starting async job submit for node 68d437f4a5c2c05277bc9076 2025-09-26 15:51:06,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:51:06,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d437f4a5c2c05277bc9076 HTTP/1.1" 200 None 2025-09-26 15:51:06,821 - lava_callback - DEBUG - Processing node 68d437f4a5c2c05277bc9076: baseline-arm 2025-09-26 15:51:07,051 - lava_callback - ERROR - Error processing callback for node 68d437f4a5c2c05277bc9076: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:51:12,301 - lava_callback - INFO - Received callback for node 68d698be2f83206171a921cc INFO: 172.20.0.1:51914 - "POST /node/68d698be2f83206171a921cc HTTP/1.0" 202 Accepted 2025-09-26 15:51:12,308 - lava_callback - INFO - Starting async job submit for node 68d698be2f83206171a921cc 2025-09-26 15:51:12,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:51:12,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d698be2f83206171a921cc HTTP/1.1" 200 None 2025-09-26 15:51:12,360 - lava_callback - DEBUG - Processing node 68d698be2f83206171a921cc: baseline-arm64 2025-09-26 15:51:13,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:51:13,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:51:13,775 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d698be2f83206171a921cc/log.txt.gz 2025-09-26 15:51:13,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:51:13,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:51:13,961 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d698be2f83206171a921cc/lava_callback.json.gz DEBUG: Setup failed for 68d698be2f83206171a921cc. Transitting job node result: incomplete -> fail 2025-09-26 15:51:14,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:51:14,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d698be2f83206171a921cc HTTP/1.1" 200 None 2025-09-26 15:51:14,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:51:14,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 15:51:14,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:51:14,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d698be2f83206171a921cc HTTP/1.1" 200 None 2025-09-26 15:51:14,094 - lava_callback - INFO - Completed processing callback for node 68d698be2f83206171a921cc INFO: 172.20.0.1:51922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51934 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:51:25,657 - lava_callback - INFO - Received callback for node 68d41912cd36afa834e18aa3 INFO: 172.20.0.1:45762 - "POST /node/68d41912cd36afa834e18aa3 HTTP/1.0" 202 Accepted 2025-09-26 15:51:25,663 - lava_callback - INFO - Starting async job submit for node 68d41912cd36afa834e18aa3 2025-09-26 15:51:25,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:51:25,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41912cd36afa834e18aa3 HTTP/1.1" 200 None 2025-09-26 15:51:25,696 - lava_callback - DEBUG - Processing node 68d41912cd36afa834e18aa3: baseline-arm64 2025-09-26 15:51:26,007 - lava_callback - ERROR - Error processing callback for node 68d41912cd36afa834e18aa3: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:45774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45782 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:51:26,895 - lava_callback - INFO - Received callback for node 68d41379cd36afa834e182f6 INFO: 172.20.0.1:45796 - "POST /node/68d41379cd36afa834e182f6 HTTP/1.0" 202 Accepted 2025-09-26 15:51:26,901 - lava_callback - INFO - Starting async job submit for node 68d41379cd36afa834e182f6 2025-09-26 15:51:26,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:51:26,902 - lava_callback - INFO - Received callback for node 68d6a80b2f83206171a925c4 INFO: 172.20.0.1:45810 - "POST /node/68d6a80b2f83206171a925c4 HTTP/1.0" 202 Accepted 2025-09-26 15:51:26,909 - lava_callback - INFO - Starting async job submit for node 68d6a80b2f83206171a925c4 2025-09-26 15:51:26,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:51:26,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41379cd36afa834e182f6 HTTP/1.1" 200 None 2025-09-26 15:51:26,940 - lava_callback - DEBUG - Processing node 68d41379cd36afa834e182f6: baseline-arm-clabbe 2025-09-26 15:51:26,941 - lava_callback - ERROR - Error processing callback for node 68d41379cd36afa834e182f6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:51:26,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a80b2f83206171a925c4 HTTP/1.1" 200 None 2025-09-26 15:51:26,945 - lava_callback - DEBUG - Processing node 68d6a80b2f83206171a925c4: baseline-arm64 2025-09-26 15:51:27,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:51:27,400 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:51:27,400 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a80b2f83206171a925c4/log.txt.gz 2025-09-26 15:51:27,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:51:27,522 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:51:27,523 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a80b2f83206171a925c4/lava_callback.json.gz 2025-09-26 15:51:27,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:51:27,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a80b2f83206171a925c4 HTTP/1.1" 200 None 2025-09-26 15:51:27,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:51:27,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 15:51:27,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:51:27,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a80b2f83206171a925c4 HTTP/1.1" 200 None 2025-09-26 15:51:27,613 - lava_callback - INFO - Completed processing callback for node 68d6a80b2f83206171a925c4 2025-09-26 15:51:28,203 - lava_callback - INFO - Received callback for node 68d41915cd36afa834e18aa8 INFO: 172.20.0.1:45816 - "POST /node/68d41915cd36afa834e18aa8 HTTP/1.0" 202 Accepted 2025-09-26 15:51:28,209 - lava_callback - INFO - Starting async job submit for node 68d41915cd36afa834e18aa8 2025-09-26 15:51:28,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:51:28,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41915cd36afa834e18aa8 HTTP/1.1" 200 None 2025-09-26 15:51:28,241 - lava_callback - DEBUG - Processing node 68d41915cd36afa834e18aa8: baseline-arm64 2025-09-26 15:51:28,563 - lava_callback - ERROR - Error processing callback for node 68d41915cd36afa834e18aa8: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:59368 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:51:37,001 - lava_callback - INFO - Received callback for node 68d41920cd36afa834e18ab4 INFO: 172.20.0.1:59380 - "POST /node/68d41920cd36afa834e18ab4 HTTP/1.0" 202 Accepted 2025-09-26 15:51:37,007 - lava_callback - INFO - Starting async job submit for node 68d41920cd36afa834e18ab4 2025-09-26 15:51:37,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:51:37,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41920cd36afa834e18ab4 HTTP/1.1" 200 None 2025-09-26 15:51:37,041 - lava_callback - DEBUG - Processing node 68d41920cd36afa834e18ab4: baseline-arm64 2025-09-26 15:51:37,331 - lava_callback - ERROR - Error processing callback for node 68d41920cd36afa834e18ab4: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:46532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46536 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:51:46,773 - lava_callback - INFO - Received callback for node 68d4137fcd36afa834e182fc INFO: 172.20.0.1:46546 - "POST /node/68d4137fcd36afa834e182fc HTTP/1.0" 202 Accepted 2025-09-26 15:51:46,778 - lava_callback - INFO - Starting async job submit for node 68d4137fcd36afa834e182fc 2025-09-26 15:51:46,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:51:46,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4137fcd36afa834e182fc HTTP/1.1" 200 None 2025-09-26 15:51:46,792 - lava_callback - DEBUG - Processing node 68d4137fcd36afa834e182fc: baseline-arm-clabbe 2025-09-26 15:51:46,792 - lava_callback - ERROR - Error processing callback for node 68d4137fcd36afa834e182fc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:56354 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:51:57,448 - lava_callback - INFO - Received callback for node 68d4138ccd36afa834e1830b INFO: 172.20.0.1:56358 - "POST /node/68d4138ccd36afa834e1830b HTTP/1.0" 202 Accepted 2025-09-26 15:51:57,453 - lava_callback - INFO - Starting async job submit for node 68d4138ccd36afa834e1830b 2025-09-26 15:51:57,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:51:57,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4138ccd36afa834e1830b HTTP/1.1" 200 None 2025-09-26 15:51:57,495 - lava_callback - DEBUG - Processing node 68d4138ccd36afa834e1830b: baseline-arm64-baylibre 2025-09-26 15:51:57,495 - lava_callback - ERROR - Error processing callback for node 68d4138ccd36afa834e1830b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:51:59,002 - lava_callback - INFO - Received callback for node 68d698bf2f83206171a921cf INFO: 172.20.0.1:56364 - "POST /node/68d698bf2f83206171a921cf HTTP/1.0" 202 Accepted 2025-09-26 15:51:59,010 - lava_callback - INFO - Starting async job submit for node 68d698bf2f83206171a921cf 2025-09-26 15:51:59,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:51:59,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d698bf2f83206171a921cf HTTP/1.1" 200 None 2025-09-26 15:51:59,063 - lava_callback - DEBUG - Processing node 68d698bf2f83206171a921cf: baseline-arm64 2025-09-26 15:52:00,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:52:00,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:52:00,269 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d698bf2f83206171a921cf/log.txt.gz 2025-09-26 15:52:00,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:52:00,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:52:00,480 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d698bf2f83206171a921cf/lava_callback.json.gz DEBUG: Setup failed for 68d698bf2f83206171a921cf. Transitting job node result: incomplete -> fail 2025-09-26 15:52:00,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:52:00,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d698bf2f83206171a921cf HTTP/1.1" 200 None 2025-09-26 15:52:00,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:52:00,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 15:52:00,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:52:00,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d698bf2f83206171a921cf HTTP/1.1" 200 None 2025-09-26 15:52:00,612 - lava_callback - INFO - Completed processing callback for node 68d698bf2f83206171a921cf INFO: 172.20.0.1:48246 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:52:06,783 - lava_callback - INFO - Received callback for node 68d41395cd36afa834e18314 INFO: 172.20.0.1:48258 - "POST /node/68d41395cd36afa834e18314 HTTP/1.0" 202 Accepted 2025-09-26 15:52:06,789 - lava_callback - INFO - Starting async job submit for node 68d41395cd36afa834e18314 2025-09-26 15:52:06,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:52:06,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41395cd36afa834e18314 HTTP/1.1" 200 None 2025-09-26 15:52:06,802 - lava_callback - DEBUG - Processing node 68d41395cd36afa834e18314: baseline-arm-clabbe 2025-09-26 15:52:06,802 - lava_callback - ERROR - Error processing callback for node 68d41395cd36afa834e18314: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:52:10,523 - lava_callback - INFO - Received callback for node 68d6a8282f83206171a925f7 INFO: 172.20.0.1:51788 - "POST /node/68d6a8282f83206171a925f7 HTTP/1.0" 202 Accepted 2025-09-26 15:52:10,529 - lava_callback - INFO - Starting async job submit for node 68d6a8282f83206171a925f7 2025-09-26 15:52:10,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:52:10,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8282f83206171a925f7 HTTP/1.1" 200 None 2025-09-26 15:52:10,562 - lava_callback - DEBUG - Processing node 68d6a8282f83206171a925f7: baseline-arm64 2025-09-26 15:52:10,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:52:11,051 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:52:11,052 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8282f83206171a925f7/log.txt.gz 2025-09-26 15:52:11,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:52:11,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:52:11,180 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8282f83206171a925f7/lava_callback.json.gz 2025-09-26 15:52:11,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:52:11,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8282f83206171a925f7 HTTP/1.1" 200 None 2025-09-26 15:52:11,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:52:11,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 15:52:11,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:52:11,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8282f83206171a925f7 HTTP/1.1" 200 None 2025-09-26 15:52:11,255 - lava_callback - INFO - Completed processing callback for node 68d6a8282f83206171a925f7 INFO: 172.20.0.1:51790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38172 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:52:26,830 - lava_callback - INFO - Received callback for node 68d413adcd36afa834e1832f INFO: 172.20.0.1:38184 - "POST /node/68d413adcd36afa834e1832f HTTP/1.0" 202 Accepted 2025-09-26 15:52:26,836 - lava_callback - INFO - Starting async job submit for node 68d413adcd36afa834e1832f 2025-09-26 15:52:26,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:52:26,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d413adcd36afa834e1832f HTTP/1.1" 200 None 2025-09-26 15:52:26,853 - lava_callback - DEBUG - Processing node 68d413adcd36afa834e1832f: baseline-arm-clabbe 2025-09-26 15:52:26,853 - lava_callback - ERROR - Error processing callback for node 68d413adcd36afa834e1832f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:52:35,683 - lava_callback - INFO - Received callback for node 68d41920cd36afa834e18ab1 INFO: 172.20.0.1:35852 - "POST /node/68d41920cd36afa834e18ab1 HTTP/1.0" 202 Accepted 2025-09-26 15:52:35,752 - lava_callback - INFO - Starting async job submit for node 68d41920cd36afa834e18ab1 2025-09-26 15:52:35,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:52:35,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41920cd36afa834e18ab1 HTTP/1.1" 200 None 2025-09-26 15:52:35,785 - lava_callback - DEBUG - Processing node 68d41920cd36afa834e18ab1: baseline-arm64 INFO: 172.20.0.1:35866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39130 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:52:43,812 - lava_callback - INFO - Received callback for node 68d6a8292f83206171a925fa INFO: 172.20.0.1:39144 - "POST /node/68d6a8292f83206171a925fa HTTP/1.0" 202 Accepted 2025-09-26 15:52:43,843 - lava_callback - INFO - Starting async job submit for node 68d6a8292f83206171a925fa 2025-09-26 15:52:43,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:52:43,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8292f83206171a925fa HTTP/1.1" 200 None 2025-09-26 15:52:43,992 - lava_callback - DEBUG - Processing node 68d6a8292f83206171a925fa: baseline-arm64 2025-09-26 15:52:44,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:52:44,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:52:44,966 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8292f83206171a925fa/log.txt.gz 2025-09-26 15:52:45,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:52:45,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:52:45,540 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6a8292f83206171a925fa/lava_callback.json.gz 2025-09-26 15:52:45,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:52:45,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6a8292f83206171a925fa HTTP/1.1" 200 None 2025-09-26 15:52:45,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:52:45,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d64d12a5c3ab168ecc7a3d HTTP/1.1" 200 None 2025-09-26 15:52:45,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:52:45,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6a8292f83206171a925fa HTTP/1.1" 200 None 2025-09-26 15:52:45,868 - lava_callback - INFO - Completed processing callback for node 68d6a8292f83206171a925fa INFO: 172.20.0.1:39156 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:52:46,841 - lava_callback - INFO - Received callback for node 68d413bacd36afa834e18363 INFO: 172.20.0.1:39168 - "POST /node/68d413bacd36afa834e18363 HTTP/1.0" 202 Accepted 2025-09-26 15:52:46,856 - lava_callback - INFO - Starting async job submit for node 68d413bacd36afa834e18363 2025-09-26 15:52:46,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:52:46,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d413bacd36afa834e18363 HTTP/1.1" 200 None 2025-09-26 15:52:46,958 - lava_callback - DEBUG - Processing node 68d413bacd36afa834e18363: baseline-arm-clabbe 2025-09-26 15:52:46,958 - lava_callback - ERROR - Error processing callback for node 68d413bacd36afa834e18363: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:35372 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:53:02,165 - lava_callback - INFO - Received callback for node 68d4192bcd36afa834e18ac0 INFO: 172.20.0.1:41210 - "POST /node/68d4192bcd36afa834e18ac0 HTTP/1.0" 202 Accepted 2025-09-26 15:53:02,197 - lava_callback - INFO - Starting async job submit for node 68d4192bcd36afa834e18ac0 2025-09-26 15:53:02,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:53:02,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4192bcd36afa834e18ac0 HTTP/1.1" 200 None 2025-09-26 15:53:02,326 - lava_callback - DEBUG - Processing node 68d4192bcd36afa834e18ac0: baseline-arm64 2025-09-26 15:53:02,932 - lava_callback - ERROR - Error processing callback for node 68d4192bcd36afa834e18ac0: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 15:53:05,569 - lava_callback - ERROR - Error processing callback for node 68d41920cd36afa834e18ab1: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:41226 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:53:08,312 - lava_callback - INFO - Received callback for node 68d4192acd36afa834e18abd INFO: 172.20.0.1:41232 - "POST /node/68d4192acd36afa834e18abd HTTP/1.0" 202 Accepted 2025-09-26 15:53:08,318 - lava_callback - INFO - Starting async job submit for node 68d4192acd36afa834e18abd 2025-09-26 15:53:08,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:53:08,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4192acd36afa834e18abd HTTP/1.1" 200 None 2025-09-26 15:53:08,374 - lava_callback - DEBUG - Processing node 68d4192acd36afa834e18abd: baseline-arm64 2025-09-26 15:53:08,661 - lava_callback - ERROR - Error processing callback for node 68d4192acd36afa834e18abd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:46106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46122 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:53:23,907 - lava_callback - INFO - Received callback for node 68d413eccd36afa834e1838b INFO: 172.20.0.1:49056 - "POST /node/68d413eccd36afa834e1838b HTTP/1.0" 202 Accepted 2025-09-26 15:53:23,912 - lava_callback - INFO - Starting async job submit for node 68d413eccd36afa834e1838b 2025-09-26 15:53:23,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:53:23,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d413eccd36afa834e1838b HTTP/1.1" 200 None 2025-09-26 15:53:23,926 - lava_callback - DEBUG - Processing node 68d413eccd36afa834e1838b: ltp-fs-bind 2025-09-26 15:53:23,927 - lava_callback - ERROR - Error processing callback for node 68d413eccd36afa834e1838b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:53:25,344 - lava_callback - INFO - Received callback for node 68d437fba5c2c05277bc9088 INFO: 172.20.0.1:49068 - "POST /node/68d437fba5c2c05277bc9088 HTTP/1.0" 202 Accepted 2025-09-26 15:53:25,350 - lava_callback - INFO - Starting async job submit for node 68d437fba5c2c05277bc9088 2025-09-26 15:53:25,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:53:25,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d437fba5c2c05277bc9088 HTTP/1.1" 200 None 2025-09-26 15:53:25,383 - lava_callback - DEBUG - Processing node 68d437fba5c2c05277bc9088: baseline-arm 2025-09-26 15:53:25,608 - lava_callback - ERROR - Error processing callback for node 68d437fba5c2c05277bc9088: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:49078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49082 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:53:26,908 - lava_callback - INFO - Received callback for node 68d413e9cd36afa834e18388 INFO: 172.20.0.1:49084 - "POST /node/68d413e9cd36afa834e18388 HTTP/1.0" 202 Accepted 2025-09-26 15:53:26,914 - lava_callback - INFO - Starting async job submit for node 68d413e9cd36afa834e18388 2025-09-26 15:53:26,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:53:26,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d413e9cd36afa834e18388 HTTP/1.1" 200 None 2025-09-26 15:53:26,927 - lava_callback - DEBUG - Processing node 68d413e9cd36afa834e18388: baseline-arm-clabbe 2025-09-26 15:53:26,927 - lava_callback - ERROR - Error processing callback for node 68d413e9cd36afa834e18388: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:39246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38160 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:53:43,885 - lava_callback - INFO - Received callback for node 68d413facd36afa834e183b5 INFO: 172.20.0.1:38170 - "POST /node/68d413facd36afa834e183b5 HTTP/1.0" 202 Accepted 2025-09-26 15:53:43,891 - lava_callback - INFO - Starting async job submit for node 68d413facd36afa834e183b5 2025-09-26 15:53:43,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:53:43,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d413facd36afa834e183b5 HTTP/1.1" 200 None 2025-09-26 15:53:43,904 - lava_callback - DEBUG - Processing node 68d413facd36afa834e183b5: ltp-fsx 2025-09-26 15:53:43,904 - lava_callback - ERROR - Error processing callback for node 68d413facd36afa834e183b5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:53:44,653 - lava_callback - INFO - Received callback for node 68d41401cd36afa834e183bb INFO: 172.20.0.1:38176 - "POST /node/68d41401cd36afa834e183bb HTTP/1.0" 202 Accepted 2025-09-26 15:53:44,659 - lava_callback - INFO - Starting async job submit for node 68d41401cd36afa834e183bb 2025-09-26 15:53:44,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:53:44,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41401cd36afa834e183bb HTTP/1.1" 200 None 2025-09-26 15:53:44,679 - lava_callback - DEBUG - Processing node 68d41401cd36afa834e183bb: ltp-input 2025-09-26 15:53:44,680 - lava_callback - ERROR - Error processing callback for node 68d41401cd36afa834e183bb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:53:45,383 - lava_callback - INFO - Received callback for node 68d41403cd36afa834e183be INFO: 172.20.0.1:38182 - "POST /node/68d41403cd36afa834e183be HTTP/1.0" 202 Accepted 2025-09-26 15:53:45,389 - lava_callback - INFO - Starting async job submit for node 68d41403cd36afa834e183be 2025-09-26 15:53:45,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:53:45,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41403cd36afa834e183be HTTP/1.1" 200 None 2025-09-26 15:53:45,405 - lava_callback - DEBUG - Processing node 68d41403cd36afa834e183be: ltp-ipc 2025-09-26 15:53:45,405 - lava_callback - ERROR - Error processing callback for node 68d41403cd36afa834e183be: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:38196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56466 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:54:03,876 - lava_callback - INFO - Received callback for node 68d4140acd36afa834e183cc INFO: 172.20.0.1:45824 - "POST /node/68d4140acd36afa834e183cc HTTP/1.0" 202 Accepted 2025-09-26 15:54:03,882 - lava_callback - INFO - Starting async job submit for node 68d4140acd36afa834e183cc 2025-09-26 15:54:03,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:54:03,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4140acd36afa834e183cc HTTP/1.1" 200 None 2025-09-26 15:54:03,895 - lava_callback - DEBUG - Processing node 68d4140acd36afa834e183cc: ltp-input 2025-09-26 15:54:03,895 - lava_callback - ERROR - Error processing callback for node 68d4140acd36afa834e183cc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:54:04,687 - lava_callback - INFO - Received callback for node 68d41411cd36afa834e183d2 INFO: 172.20.0.1:45838 - "POST /node/68d41411cd36afa834e183d2 HTTP/1.0" 202 Accepted 2025-09-26 15:54:04,693 - lava_callback - INFO - Starting async job submit for node 68d41411cd36afa834e183d2 2025-09-26 15:54:04,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:54:04,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41411cd36afa834e183d2 HTTP/1.1" 200 None 2025-09-26 15:54:04,736 - lava_callback - DEBUG - Processing node 68d41411cd36afa834e183d2: ltp-ipc 2025-09-26 15:54:04,736 - lava_callback - ERROR - Error processing callback for node 68d41411cd36afa834e183d2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:54:05,666 - lava_callback - INFO - Received callback for node 68d41416cd36afa834e183d8 INFO: 172.20.0.1:45848 - "POST /node/68d41416cd36afa834e183d8 HTTP/1.0" 202 Accepted 2025-09-26 15:54:05,671 - lava_callback - INFO - Starting async job submit for node 68d41416cd36afa834e183d8 2025-09-26 15:54:05,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:54:05,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41416cd36afa834e183d8 HTTP/1.1" 200 None 2025-09-26 15:54:05,685 - lava_callback - DEBUG - Processing node 68d41416cd36afa834e183d8: ltp-pty 2025-09-26 15:54:05,685 - lava_callback - ERROR - Error processing callback for node 68d41416cd36afa834e183d8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:54:06,459 - lava_callback - INFO - Received callback for node 68d4141acd36afa834e183db INFO: 172.20.0.1:45860 - "POST /node/68d4141acd36afa834e183db HTTP/1.0" 202 Accepted 2025-09-26 15:54:06,465 - lava_callback - INFO - Starting async job submit for node 68d4141acd36afa834e183db 2025-09-26 15:54:06,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:54:06,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4141acd36afa834e183db HTTP/1.1" 200 None 2025-09-26 15:54:06,478 - lava_callback - DEBUG - Processing node 68d4141acd36afa834e183db: ltp-ipc 2025-09-26 15:54:06,478 - lava_callback - ERROR - Error processing callback for node 68d4141acd36afa834e183db: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:45862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57788 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:54:18,779 - lava_callback - INFO - Received callback for node 68d698ee2f83206171a921dc INFO: 172.20.0.1:57792 - "POST /node/68d698ee2f83206171a921dc HTTP/1.0" 202 Accepted 2025-09-26 15:54:18,786 - lava_callback - INFO - Starting async job submit for node 68d698ee2f83206171a921dc 2025-09-26 15:54:18,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:54:18,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d698ee2f83206171a921dc HTTP/1.1" 200 None 2025-09-26 15:54:18,851 - lava_callback - DEBUG - Processing node 68d698ee2f83206171a921dc: baseline-arm64 2025-09-26 15:54:19,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:54:19,581 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:54:19,582 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d698ee2f83206171a921dc/log.txt.gz 2025-09-26 15:54:19,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:54:20,031 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:54:20,032 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d698ee2f83206171a921dc/lava_callback.json.gz DEBUG: Setup failed for 68d698ee2f83206171a921dc. Transitting job node result: incomplete -> fail 2025-09-26 15:54:20,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:54:20,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d698ee2f83206171a921dc HTTP/1.1" 200 None 2025-09-26 15:54:20,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:54:20,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 15:54:20,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:54:20,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d698ee2f83206171a921dc HTTP/1.1" 200 None 2025-09-26 15:54:20,174 - lava_callback - INFO - Completed processing callback for node 68d698ee2f83206171a921dc 2025-09-26 15:54:23,833 - lava_callback - INFO - Received callback for node 68d41420cd36afa834e183e1 INFO: 172.20.0.1:50264 - "POST /node/68d41420cd36afa834e183e1 HTTP/1.0" 202 Accepted 2025-09-26 15:54:23,839 - lava_callback - INFO - Starting async job submit for node 68d41420cd36afa834e183e1 2025-09-26 15:54:23,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:54:23,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41420cd36afa834e183e1 HTTP/1.1" 200 None 2025-09-26 15:54:23,853 - lava_callback - DEBUG - Processing node 68d41420cd36afa834e183e1: ltp-pty 2025-09-26 15:54:23,853 - lava_callback - ERROR - Error processing callback for node 68d41420cd36afa834e183e1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:54:24,593 - lava_callback - INFO - Received callback for node 68d41423cd36afa834e183e4 INFO: 172.20.0.1:50278 - "POST /node/68d41423cd36afa834e183e4 HTTP/1.0" 202 Accepted 2025-09-26 15:54:24,599 - lava_callback - INFO - Starting async job submit for node 68d41423cd36afa834e183e4 2025-09-26 15:54:24,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:54:24,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41423cd36afa834e183e4 HTTP/1.1" 200 None 2025-09-26 15:54:24,612 - lava_callback - DEBUG - Processing node 68d41423cd36afa834e183e4: ltp-sched 2025-09-26 15:54:24,612 - lava_callback - ERROR - Error processing callback for node 68d41423cd36afa834e183e4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:54:25,376 - lava_callback - INFO - Received callback for node 68d4142acd36afa834e183ea INFO: 172.20.0.1:50280 - "POST /node/68d4142acd36afa834e183ea HTTP/1.0" 202 Accepted 2025-09-26 15:54:25,382 - lava_callback - INFO - Starting async job submit for node 68d4142acd36afa834e183ea 2025-09-26 15:54:25,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:54:25,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4142acd36afa834e183ea HTTP/1.1" 200 None 2025-09-26 15:54:25,396 - lava_callback - DEBUG - Processing node 68d4142acd36afa834e183ea: ltp-pty 2025-09-26 15:54:25,396 - lava_callback - ERROR - Error processing callback for node 68d4142acd36afa834e183ea: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:54:26,337 - lava_callback - INFO - Received callback for node 68d4142ccd36afa834e183ed INFO: 172.20.0.1:50284 - "POST /node/68d4142ccd36afa834e183ed HTTP/1.0" 202 Accepted 2025-09-26 15:54:26,343 - lava_callback - INFO - Starting async job submit for node 68d4142ccd36afa834e183ed 2025-09-26 15:54:26,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:54:26,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4142ccd36afa834e183ed HTTP/1.1" 200 None 2025-09-26 15:54:26,356 - lava_callback - DEBUG - Processing node 68d4142ccd36afa834e183ed: ltp-syscalls-ipc 2025-09-26 15:54:26,356 - lava_callback - ERROR - Error processing callback for node 68d4142ccd36afa834e183ed: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:50300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50304 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:54:27,092 - lava_callback - INFO - Received callback for node 68d41430cd36afa834e1840d INFO: 172.20.0.1:50310 - "POST /node/68d41430cd36afa834e1840d HTTP/1.0" 202 Accepted 2025-09-26 15:54:27,098 - lava_callback - INFO - Starting async job submit for node 68d41430cd36afa834e1840d 2025-09-26 15:54:27,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:54:27,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41430cd36afa834e1840d HTTP/1.1" 200 None 2025-09-26 15:54:27,111 - lava_callback - DEBUG - Processing node 68d41430cd36afa834e1840d: ltp-sched 2025-09-26 15:54:27,111 - lava_callback - ERROR - Error processing callback for node 68d41430cd36afa834e1840d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:54:33,139 - lava_callback - INFO - Received callback for node 68d698ed2f83206171a921d9 INFO: 172.20.0.1:36274 - "POST /node/68d698ed2f83206171a921d9 HTTP/1.0" 202 Accepted 2025-09-26 15:54:33,146 - lava_callback - INFO - Starting async job submit for node 68d698ed2f83206171a921d9 2025-09-26 15:54:33,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:54:33,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d698ed2f83206171a921d9 HTTP/1.1" 200 None 2025-09-26 15:54:33,200 - lava_callback - DEBUG - Processing node 68d698ed2f83206171a921d9: baseline-arm64 2025-09-26 15:54:34,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:54:34,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:54:34,318 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d698ed2f83206171a921d9/log.txt.gz 2025-09-26 15:54:34,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 15:54:34,498 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 15:54:34,498 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d698ed2f83206171a921d9/lava_callback.json.gz DEBUG: Setup failed for 68d698ed2f83206171a921d9. Transitting job node result: incomplete -> fail 2025-09-26 15:54:34,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:54:34,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d698ed2f83206171a921d9 HTTP/1.1" 200 None 2025-09-26 15:54:34,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:54:34,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 15:54:34,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:54:34,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d698ed2f83206171a921d9 HTTP/1.1" 200 None 2025-09-26 15:54:34,630 - lava_callback - INFO - Completed processing callback for node 68d698ed2f83206171a921d9 INFO: 172.20.0.1:36282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59316 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:54:43,877 - lava_callback - INFO - Received callback for node 68d41436cd36afa834e18414 INFO: 172.20.0.1:59318 - "POST /node/68d41436cd36afa834e18414 HTTP/1.0" 202 Accepted 2025-09-26 15:54:43,886 - lava_callback - INFO - Starting async job submit for node 68d41436cd36afa834e18414 2025-09-26 15:54:43,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:54:43,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41436cd36afa834e18414 HTTP/1.1" 200 None 2025-09-26 15:54:43,902 - lava_callback - DEBUG - Processing node 68d41436cd36afa834e18414: ltp-smoketest 2025-09-26 15:54:43,902 - lava_callback - ERROR - Error processing callback for node 68d41436cd36afa834e18414: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:54:44,719 - lava_callback - INFO - Received callback for node 68d41439cd36afa834e18417 INFO: 172.20.0.1:59332 - "POST /node/68d41439cd36afa834e18417 HTTP/1.0" 202 Accepted 2025-09-26 15:54:44,724 - lava_callback - INFO - Starting async job submit for node 68d41439cd36afa834e18417 2025-09-26 15:54:44,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:54:44,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41439cd36afa834e18417 HTTP/1.1" 200 None 2025-09-26 15:54:44,738 - lava_callback - DEBUG - Processing node 68d41439cd36afa834e18417: ltp-sched 2025-09-26 15:54:44,738 - lava_callback - ERROR - Error processing callback for node 68d41439cd36afa834e18417: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:59342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39172 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:55:04,092 - lava_callback - INFO - Received callback for node 68d41446cd36afa834e18426 INFO: 172.20.0.1:59014 - "POST /node/68d41446cd36afa834e18426 HTTP/1.0" 202 Accepted 2025-09-26 15:55:04,098 - lava_callback - INFO - Starting async job submit for node 68d41446cd36afa834e18426 2025-09-26 15:55:04,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:55:04,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41446cd36afa834e18426 HTTP/1.1" 200 None 2025-09-26 15:55:04,112 - lava_callback - DEBUG - Processing node 68d41446cd36afa834e18426: ltp-smoketest 2025-09-26 15:55:04,112 - lava_callback - ERROR - Error processing callback for node 68d41446cd36afa834e18426: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:55:04,820 - lava_callback - INFO - Received callback for node 68d4144acd36afa834e1842c INFO: 172.20.0.1:59016 - "POST /node/68d4144acd36afa834e1842c HTTP/1.0" 202 Accepted 2025-09-26 15:55:04,826 - lava_callback - INFO - Starting async job submit for node 68d4144acd36afa834e1842c 2025-09-26 15:55:04,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:55:04,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4144acd36afa834e1842c HTTP/1.1" 200 None 2025-09-26 15:55:04,842 - lava_callback - DEBUG - Processing node 68d4144acd36afa834e1842c: ltp-syscalls 2025-09-26 15:55:04,842 - lava_callback - ERROR - Error processing callback for node 68d4144acd36afa834e1842c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:55:05,691 - lava_callback - INFO - Received callback for node 68d4144bcd36afa834e1842f INFO: 172.20.0.1:59024 - "POST /node/68d4144bcd36afa834e1842f HTTP/1.0" 202 Accepted 2025-09-26 15:55:05,697 - lava_callback - INFO - Starting async job submit for node 68d4144bcd36afa834e1842f 2025-09-26 15:55:05,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:55:05,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4144bcd36afa834e1842f HTTP/1.1" 200 None 2025-09-26 15:55:05,721 - lava_callback - DEBUG - Processing node 68d4144bcd36afa834e1842f: ltp-fsx 2025-09-26 15:55:05,721 - lava_callback - ERROR - Error processing callback for node 68d4144bcd36afa834e1842f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:55:06,495 - lava_callback - INFO - Received callback for node 68d41453cd36afa834e18435 INFO: 172.20.0.1:59038 - "POST /node/68d41453cd36afa834e18435 HTTP/1.0" 202 Accepted 2025-09-26 15:55:06,501 - lava_callback - INFO - Starting async job submit for node 68d41453cd36afa834e18435 2025-09-26 15:55:06,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:59052 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:55:06,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41453cd36afa834e18435 HTTP/1.1" 200 None 2025-09-26 15:55:06,535 - lava_callback - DEBUG - Processing node 68d41453cd36afa834e18435: ltp-smoketest 2025-09-26 15:55:06,535 - lava_callback - ERROR - Error processing callback for node 68d41453cd36afa834e18435: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:55:07,244 - lava_callback - INFO - Received callback for node 68d41456cd36afa834e18438 INFO: 172.20.0.1:59058 - "POST /node/68d41456cd36afa834e18438 HTTP/1.0" 202 Accepted 2025-09-26 15:55:07,250 - lava_callback - INFO - Starting async job submit for node 68d41456cd36afa834e18438 2025-09-26 15:55:07,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:55:07,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41456cd36afa834e18438 HTTP/1.1" 200 None 2025-09-26 15:55:07,263 - lava_callback - DEBUG - Processing node 68d41456cd36afa834e18438: ltp-syscalls 2025-09-26 15:55:07,263 - lava_callback - ERROR - Error processing callback for node 68d41456cd36afa834e18438: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:36334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39452 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:55:43,969 - lava_callback - INFO - Received callback for node 68d4146fcd36afa834e18464 INFO: 172.20.0.1:39464 - "POST /node/68d4146fcd36afa834e18464 HTTP/1.0" 202 Accepted 2025-09-26 15:55:43,975 - lava_callback - INFO - Starting async job submit for node 68d4146fcd36afa834e18464 2025-09-26 15:55:43,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:55:43,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4146fcd36afa834e18464 HTTP/1.1" 200 None 2025-09-26 15:55:43,988 - lava_callback - DEBUG - Processing node 68d4146fcd36afa834e18464: ltp-fs-bind 2025-09-26 15:55:43,988 - lava_callback - ERROR - Error processing callback for node 68d4146fcd36afa834e18464: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:55:44,724 - lava_callback - INFO - Received callback for node 68d41471cd36afa834e18467 INFO: 172.20.0.1:39468 - "POST /node/68d41471cd36afa834e18467 HTTP/1.0" 202 Accepted 2025-09-26 15:55:44,730 - lava_callback - INFO - Starting async job submit for node 68d41471cd36afa834e18467 2025-09-26 15:55:44,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:55:44,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41471cd36afa834e18467 HTTP/1.1" 200 None 2025-09-26 15:55:44,742 - lava_callback - DEBUG - Processing node 68d41471cd36afa834e18467: ltp-fsx 2025-09-26 15:55:44,742 - lava_callback - ERROR - Error processing callback for node 68d41471cd36afa834e18467: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:55:45,721 - lava_callback - INFO - Received callback for node 68d41473cd36afa834e1846a INFO: 172.20.0.1:39474 - "POST /node/68d41473cd36afa834e1846a HTTP/1.0" 202 Accepted 2025-09-26 15:55:45,727 - lava_callback - INFO - Starting async job submit for node 68d41473cd36afa834e1846a 2025-09-26 15:55:45,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:55:45,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41473cd36afa834e1846a HTTP/1.1" 200 None 2025-09-26 15:55:45,741 - lava_callback - DEBUG - Processing node 68d41473cd36afa834e1846a: ltp-input 2025-09-26 15:55:45,741 - lava_callback - ERROR - Error processing callback for node 68d41473cd36afa834e1846a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:55:45,837 - lava_callback - INFO - Received callback for node 68d4550ea5c2c05277bca91a INFO: 172.20.0.1:39478 - "POST /node/68d4550ea5c2c05277bca91a HTTP/1.0" 202 Accepted 2025-09-26 15:55:45,843 - lava_callback - INFO - Starting async job submit for node 68d4550ea5c2c05277bca91a 2025-09-26 15:55:45,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:55:45,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4550ea5c2c05277bca91a HTTP/1.1" 200 None 2025-09-26 15:55:45,877 - lava_callback - DEBUG - Processing node 68d4550ea5c2c05277bca91a: baseline-arm 2025-09-26 15:55:46,117 - lava_callback - ERROR - Error processing callback for node 68d4550ea5c2c05277bca91a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:39492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49232 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:56:24,065 - lava_callback - INFO - Received callback for node 68d4149bcd36afa834e1848e INFO: 172.20.0.1:54468 - "POST /node/68d4149bcd36afa834e1848e HTTP/1.0" 202 Accepted 2025-09-26 15:56:24,071 - lava_callback - INFO - Starting async job submit for node 68d4149bcd36afa834e1848e 2025-09-26 15:56:24,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:56:24,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4149bcd36afa834e1848e HTTP/1.1" 200 None 2025-09-26 15:56:24,085 - lava_callback - DEBUG - Processing node 68d4149bcd36afa834e1848e: ltp-syscalls-ipc 2025-09-26 15:56:24,085 - lava_callback - ERROR - Error processing callback for node 68d4149bcd36afa834e1848e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:56:24,820 - lava_callback - INFO - Received callback for node 68d414a2cd36afa834e18494 INFO: 172.20.0.1:54484 - "POST /node/68d414a2cd36afa834e18494 HTTP/1.0" 202 Accepted 2025-09-26 15:56:24,826 - lava_callback - INFO - Starting async job submit for node 68d414a2cd36afa834e18494 2025-09-26 15:56:24,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:56:24,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d414a2cd36afa834e18494 HTTP/1.1" 200 None 2025-09-26 15:56:24,845 - lava_callback - DEBUG - Processing node 68d414a2cd36afa834e18494: ltp-syscalls 2025-09-26 15:56:24,845 - lava_callback - ERROR - Error processing callback for node 68d414a2cd36afa834e18494: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:54492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58754 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:56:44,169 - lava_callback - INFO - Received callback for node 68d414a9cd36afa834e1849a INFO: 172.20.0.1:58768 - "POST /node/68d414a9cd36afa834e1849a HTTP/1.0" 202 Accepted 2025-09-26 15:56:44,175 - lava_callback - INFO - Starting async job submit for node 68d414a9cd36afa834e1849a 2025-09-26 15:56:44,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:56:44,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d414a9cd36afa834e1849a HTTP/1.1" 200 None 2025-09-26 15:56:44,208 - lava_callback - DEBUG - Processing node 68d414a9cd36afa834e1849a: ltp-syscalls-ipc 2025-09-26 15:56:44,208 - lava_callback - ERROR - Error processing callback for node 68d414a9cd36afa834e1849a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:56:44,937 - lava_callback - INFO - Received callback for node 68d414aecd36afa834e184b2 INFO: 172.20.0.1:58770 - "POST /node/68d414aecd36afa834e184b2 HTTP/1.0" 202 Accepted 2025-09-26 15:56:44,943 - lava_callback - INFO - Starting async job submit for node 68d414aecd36afa834e184b2 2025-09-26 15:56:44,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:56:44,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d414aecd36afa834e184b2 HTTP/1.1" 200 None 2025-09-26 15:56:44,959 - lava_callback - DEBUG - Processing node 68d414aecd36afa834e184b2: ltp-timers 2025-09-26 15:56:44,959 - lava_callback - ERROR - Error processing callback for node 68d414aecd36afa834e184b2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:56:45,690 - lava_callback - INFO - Received callback for node 68d414b5cd36afa834e184b8 INFO: 172.20.0.1:58776 - "POST /node/68d414b5cd36afa834e184b8 HTTP/1.0" 202 Accepted 2025-09-26 15:56:45,696 - lava_callback - INFO - Starting async job submit for node 68d414b5cd36afa834e184b8 2025-09-26 15:56:45,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:56:45,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d414b5cd36afa834e184b8 HTTP/1.1" 200 None 2025-09-26 15:56:45,734 - lava_callback - DEBUG - Processing node 68d414b5cd36afa834e184b8: ltp-syscalls-ipc 2025-09-26 15:56:45,735 - lava_callback - ERROR - Error processing callback for node 68d414b5cd36afa834e184b8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:58792 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:56:46,528 - lava_callback - INFO - Received callback for node 68d414b9cd36afa834e184bb INFO: 172.20.0.1:58802 - "POST /node/68d414b9cd36afa834e184bb HTTP/1.0" 202 Accepted 2025-09-26 15:56:46,533 - lava_callback - INFO - Starting async job submit for node 68d414b9cd36afa834e184bb 2025-09-26 15:56:46,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:56:46,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d414b9cd36afa834e184bb HTTP/1.1" 200 None 2025-09-26 15:56:46,547 - lava_callback - DEBUG - Processing node 68d414b9cd36afa834e184bb: ltp-timers 2025-09-26 15:56:46,547 - lava_callback - ERROR - Error processing callback for node 68d414b9cd36afa834e184bb: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:53504 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:57:04,072 - lava_callback - INFO - Received callback for node 68d414c0cd36afa834e184c1 INFO: 172.20.0.1:46048 - "POST /node/68d414c0cd36afa834e184c1 HTTP/1.0" 202 Accepted 2025-09-26 15:57:04,078 - lava_callback - INFO - Starting async job submit for node 68d414c0cd36afa834e184c1 2025-09-26 15:57:04,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:57:04,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d414c0cd36afa834e184c1 HTTP/1.1" 200 None 2025-09-26 15:57:04,092 - lava_callback - DEBUG - Processing node 68d414c0cd36afa834e184c1: ltp-watchqueue 2025-09-26 15:57:04,092 - lava_callback - ERROR - Error processing callback for node 68d414c0cd36afa834e184c1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:57:04,819 - lava_callback - INFO - Received callback for node 68d414c3cd36afa834e184c4 INFO: 172.20.0.1:46050 - "POST /node/68d414c3cd36afa834e184c4 HTTP/1.0" 202 Accepted 2025-09-26 15:57:04,825 - lava_callback - INFO - Starting async job submit for node 68d414c3cd36afa834e184c4 2025-09-26 15:57:04,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:57:04,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d414c3cd36afa834e184c4 HTTP/1.1" 200 None 2025-09-26 15:57:04,840 - lava_callback - DEBUG - Processing node 68d414c3cd36afa834e184c4: ltp-timers 2025-09-26 15:57:04,840 - lava_callback - ERROR - Error processing callback for node 68d414c3cd36afa834e184c4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:57:05,674 - lava_callback - INFO - Received callback for node 68d414cacd36afa834e184ca INFO: 172.20.0.1:46054 - "POST /node/68d414cacd36afa834e184ca HTTP/1.0" 202 Accepted 2025-09-26 15:57:05,679 - lava_callback - INFO - Starting async job submit for node 68d414cacd36afa834e184ca 2025-09-26 15:57:05,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:57:05,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d414cacd36afa834e184ca HTTP/1.1" 200 None 2025-09-26 15:57:05,697 - lava_callback - DEBUG - Processing node 68d414cacd36afa834e184ca: ltp-watchqueue 2025-09-26 15:57:05,697 - lava_callback - ERROR - Error processing callback for node 68d414cacd36afa834e184ca: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:46062 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:57:07,129 - lava_callback - INFO - Received callback for node 68d414cccd36afa834e184cd INFO: 172.20.0.1:46074 - "POST /node/68d414cccd36afa834e184cd HTTP/1.0" 202 Accepted 2025-09-26 15:57:07,134 - lava_callback - INFO - Starting async job submit for node 68d414cccd36afa834e184cd 2025-09-26 15:57:07,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:57:07,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d414cccd36afa834e184cd HTTP/1.1" 200 None 2025-09-26 15:57:07,147 - lava_callback - DEBUG - Processing node 68d414cccd36afa834e184cd: baseline-arm64-clabbe 2025-09-26 15:57:07,147 - lava_callback - ERROR - Error processing callback for node 68d414cccd36afa834e184cd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:36544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36560 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:57:24,106 - lava_callback - INFO - Received callback for node 68d414e2cd36afa834e184d9 INFO: 172.20.0.1:44226 - "POST /node/68d414e2cd36afa834e184d9 HTTP/1.0" 202 Accepted 2025-09-26 15:57:24,111 - lava_callback - INFO - Starting async job submit for node 68d414e2cd36afa834e184d9 2025-09-26 15:57:24,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:57:24,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d414e2cd36afa834e184d9 HTTP/1.1" 200 None 2025-09-26 15:57:24,134 - lava_callback - DEBUG - Processing node 68d414e2cd36afa834e184d9: ltp-watchqueue 2025-09-26 15:57:24,134 - lava_callback - ERROR - Error processing callback for node 68d414e2cd36afa834e184d9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:44232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44238 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:57:27,086 - lava_callback - INFO - Received callback for node 68d414dacd36afa834e184d6 INFO: 172.20.0.1:44242 - "POST /node/68d414dacd36afa834e184d6 HTTP/1.0" 202 Accepted 2025-09-26 15:57:27,092 - lava_callback - INFO - Starting async job submit for node 68d414dacd36afa834e184d6 2025-09-26 15:57:27,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:57:27,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d414dacd36afa834e184d6 HTTP/1.1" 200 None 2025-09-26 15:57:27,105 - lava_callback - DEBUG - Processing node 68d414dacd36afa834e184d6: baseline-arm64-clabbe 2025-09-26 15:57:27,105 - lava_callback - ERROR - Error processing callback for node 68d414dacd36afa834e184d6: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:57:27,730 - lava_callback - INFO - Received callback for node 68d414e3cd36afa834e184dc INFO: 172.20.0.1:44258 - "POST /node/68d414e3cd36afa834e184dc HTTP/1.0" 202 Accepted 2025-09-26 15:57:27,735 - lava_callback - INFO - Starting async job submit for node 68d414e3cd36afa834e184dc 2025-09-26 15:57:27,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:57:27,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d414e3cd36afa834e184dc HTTP/1.1" 200 None 2025-09-26 15:57:27,773 - lava_callback - DEBUG - Processing node 68d414e3cd36afa834e184dc: baseline-arm64-clabbe 2025-09-26 15:57:27,773 - lava_callback - ERROR - Error processing callback for node 68d414e3cd36afa834e184dc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:48068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44866 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:57:47,100 - lava_callback - INFO - Received callback for node 68d414f0cd36afa834e18500 INFO: 172.20.0.1:44876 - "POST /node/68d414f0cd36afa834e18500 HTTP/1.0" 202 Accepted 2025-09-26 15:57:47,106 - lava_callback - INFO - Starting async job submit for node 68d414f0cd36afa834e18500 2025-09-26 15:57:47,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:57:47,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d414f0cd36afa834e18500 HTTP/1.1" 200 None 2025-09-26 15:57:47,128 - lava_callback - DEBUG - Processing node 68d414f0cd36afa834e18500: baseline-arm-clabbe 2025-09-26 15:57:47,128 - lava_callback - ERROR - Error processing callback for node 68d414f0cd36afa834e18500: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:57:47,752 - lava_callback - INFO - Received callback for node 68d414edcd36afa834e184fd INFO: 172.20.0.1:44892 - "POST /node/68d414edcd36afa834e184fd HTTP/1.0" 202 Accepted 2025-09-26 15:57:47,758 - lava_callback - INFO - Starting async job submit for node 68d414edcd36afa834e184fd 2025-09-26 15:57:47,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:57:47,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d414edcd36afa834e184fd HTTP/1.1" 200 None 2025-09-26 15:57:47,781 - lava_callback - DEBUG - Processing node 68d414edcd36afa834e184fd: baseline-arm-clabbe 2025-09-26 15:57:47,781 - lava_callback - ERROR - Error processing callback for node 68d414edcd36afa834e184fd: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:46084 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:58:00,521 - lava_callback - INFO - Received callback for node 68d4550fa5c2c05277bca91d INFO: 172.20.0.1:40732 - "POST /node/68d4550fa5c2c05277bca91d HTTP/1.0" 202 Accepted 2025-09-26 15:58:00,527 - lava_callback - INFO - Starting async job submit for node 68d4550fa5c2c05277bca91d 2025-09-26 15:58:00,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:58:00,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4550fa5c2c05277bca91d HTTP/1.1" 200 None 2025-09-26 15:58:00,580 - lava_callback - DEBUG - Processing node 68d4550fa5c2c05277bca91d: baseline-arm 2025-09-26 15:58:00,814 - lava_callback - ERROR - Error processing callback for node 68d4550fa5c2c05277bca91d: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:40742 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:58:07,116 - lava_callback - INFO - Received callback for node 68d41503cd36afa834e18512 INFO: 172.20.0.1:40754 - "POST /node/68d41503cd36afa834e18512 HTTP/1.0" 202 Accepted 2025-09-26 15:58:07,121 - lava_callback - INFO - Starting async job submit for node 68d41503cd36afa834e18512 2025-09-26 15:58:07,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:58:07,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41503cd36afa834e18512 HTTP/1.1" 200 None 2025-09-26 15:58:07,138 - lava_callback - DEBUG - Processing node 68d41503cd36afa834e18512: baseline-arm-clabbe 2025-09-26 15:58:07,138 - lava_callback - ERROR - Error processing callback for node 68d41503cd36afa834e18512: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:49964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56560 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:58:27,090 - lava_callback - INFO - Received callback for node 68d4151ecd36afa834e1852d INFO: 172.20.0.1:56574 - "POST /node/68d4151ecd36afa834e1852d HTTP/1.0" 202 Accepted 2025-09-26 15:58:27,095 - lava_callback - INFO - Starting async job submit for node 68d4151ecd36afa834e1852d 2025-09-26 15:58:27,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:58:27,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4151ecd36afa834e1852d HTTP/1.1" 200 None 2025-09-26 15:58:27,132 - lava_callback - DEBUG - Processing node 68d4151ecd36afa834e1852d: baseline-arm-clabbe 2025-09-26 15:58:27,132 - lava_callback - ERROR - Error processing callback for node 68d4151ecd36afa834e1852d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:57056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53072 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:58:47,101 - lava_callback - INFO - Received callback for node 68d41522cd36afa834e18530 INFO: 172.20.0.1:53088 - "POST /node/68d41522cd36afa834e18530 HTTP/1.0" 202 Accepted 2025-09-26 15:58:47,107 - lava_callback - INFO - Starting async job submit for node 68d41522cd36afa834e18530 2025-09-26 15:58:47,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:58:47,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41522cd36afa834e18530 HTTP/1.1" 200 None 2025-09-26 15:58:47,124 - lava_callback - DEBUG - Processing node 68d41522cd36afa834e18530: baseline-arm64-clabbe 2025-09-26 15:58:47,125 - lava_callback - ERROR - Error processing callback for node 68d41522cd36afa834e18530: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:58:47,745 - lava_callback - INFO - Received callback for node 68d41525cd36afa834e18533 INFO: 172.20.0.1:53104 - "POST /node/68d41525cd36afa834e18533 HTTP/1.0" 202 Accepted 2025-09-26 15:58:47,751 - lava_callback - INFO - Starting async job submit for node 68d41525cd36afa834e18533 2025-09-26 15:58:47,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:58:47,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41525cd36afa834e18533 HTTP/1.1" 200 None 2025-09-26 15:58:47,764 - lava_callback - DEBUG - Processing node 68d41525cd36afa834e18533: baseline-arm-clabbe 2025-09-26 15:58:47,764 - lava_callback - ERROR - Error processing callback for node 68d41525cd36afa834e18533: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:58:48,410 - lava_callback - INFO - Received callback for node 68d4152acd36afa834e18550 INFO: 172.20.0.1:53118 - "POST /node/68d4152acd36afa834e18550 HTTP/1.0" 202 Accepted 2025-09-26 15:58:48,415 - lava_callback - INFO - Starting async job submit for node 68d4152acd36afa834e18550 2025-09-26 15:58:48,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:58:48,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4152acd36afa834e18550 HTTP/1.1" 200 None 2025-09-26 15:58:48,434 - lava_callback - DEBUG - Processing node 68d4152acd36afa834e18550: baseline-arm64-clabbe 2025-09-26 15:58:48,434 - lava_callback - ERROR - Error processing callback for node 68d4152acd36afa834e18550: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:58:49,068 - lava_callback - INFO - Received callback for node 68d41532cd36afa834e18556 INFO: 172.20.0.1:53134 - "POST /node/68d41532cd36afa834e18556 HTTP/1.0" 202 Accepted 2025-09-26 15:58:49,073 - lava_callback - INFO - Starting async job submit for node 68d41532cd36afa834e18556 2025-09-26 15:58:49,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:58:49,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41532cd36afa834e18556 HTTP/1.1" 200 None 2025-09-26 15:58:49,098 - lava_callback - DEBUG - Processing node 68d41532cd36afa834e18556: baseline-arm64-clabbe 2025-09-26 15:58:49,098 - lava_callback - ERROR - Error processing callback for node 68d41532cd36afa834e18556: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:33574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45076 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:59:07,150 - lava_callback - INFO - Received callback for node 68d4153fcd36afa834e18562 INFO: 172.20.0.1:45090 - "POST /node/68d4153fcd36afa834e18562 HTTP/1.0" 202 Accepted 2025-09-26 15:59:07,156 - lava_callback - INFO - Starting async job submit for node 68d4153fcd36afa834e18562 2025-09-26 15:59:07,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:59:07,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4153fcd36afa834e18562 HTTP/1.1" 200 None 2025-09-26 15:59:07,174 - lava_callback - DEBUG - Processing node 68d4153fcd36afa834e18562: baseline-arm64-clabbe 2025-09-26 15:59:07,174 - lava_callback - ERROR - Error processing callback for node 68d4153fcd36afa834e18562: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:59:07,797 - lava_callback - INFO - Received callback for node 68d41542cd36afa834e18565 INFO: 172.20.0.1:45094 - "POST /node/68d41542cd36afa834e18565 HTTP/1.0" 202 Accepted 2025-09-26 15:59:07,802 - lava_callback - INFO - Starting async job submit for node 68d41542cd36afa834e18565 2025-09-26 15:59:07,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:59:07,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41542cd36afa834e18565 HTTP/1.1" 200 None 2025-09-26 15:59:07,833 - lava_callback - DEBUG - Processing node 68d41542cd36afa834e18565: baseline-arm-clabbe 2025-09-26 15:59:07,833 - lava_callback - ERROR - Error processing callback for node 68d41542cd36afa834e18565: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:59:08,442 - lava_callback - INFO - Received callback for node 68d4153acd36afa834e1855c INFO: 172.20.0.1:45096 - "POST /node/68d4153acd36afa834e1855c HTTP/1.0" 202 Accepted 2025-09-26 15:59:08,448 - lava_callback - INFO - Starting async job submit for node 68d4153acd36afa834e1855c 2025-09-26 15:59:08,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:59:08,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4153acd36afa834e1855c HTTP/1.1" 200 None 2025-09-26 15:59:08,481 - lava_callback - DEBUG - Processing node 68d4153acd36afa834e1855c: baseline-arm64-clabbe 2025-09-26 15:59:08,481 - lava_callback - ERROR - Error processing callback for node 68d4153acd36afa834e1855c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:59:09,110 - lava_callback - INFO - Received callback for node 68d41545cd36afa834e18568 INFO: 172.20.0.1:45102 - "POST /node/68d41545cd36afa834e18568 HTTP/1.0" 202 Accepted 2025-09-26 15:59:09,115 - lava_callback - INFO - Starting async job submit for node 68d41545cd36afa834e18568 2025-09-26 15:59:09,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:59:09,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41545cd36afa834e18568 HTTP/1.1" 200 None 2025-09-26 15:59:09,145 - lava_callback - DEBUG - Processing node 68d41545cd36afa834e18568: baseline-arm64-clabbe 2025-09-26 15:59:09,145 - lava_callback - ERROR - Error processing callback for node 68d41545cd36afa834e18568: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:52884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52896 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:59:24,267 - lava_callback - INFO - Received callback for node 68d4154fcd36afa834e1856e INFO: 172.20.0.1:43086 - "POST /node/68d4154fcd36afa834e1856e HTTP/1.0" 202 Accepted 2025-09-26 15:59:24,273 - lava_callback - INFO - Starting async job submit for node 68d4154fcd36afa834e1856e 2025-09-26 15:59:24,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:59:24,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4154fcd36afa834e1856e HTTP/1.1" 200 None 2025-09-26 15:59:24,286 - lava_callback - DEBUG - Processing node 68d4154fcd36afa834e1856e: ltp-fsx 2025-09-26 15:59:24,286 - lava_callback - ERROR - Error processing callback for node 68d4154fcd36afa834e1856e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:59:25,010 - lava_callback - INFO - Received callback for node 68d41552cd36afa834e18571 INFO: 172.20.0.1:43094 - "POST /node/68d41552cd36afa834e18571 HTTP/1.0" 202 Accepted 2025-09-26 15:59:25,016 - lava_callback - INFO - Starting async job submit for node 68d41552cd36afa834e18571 2025-09-26 15:59:25,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:59:25,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41552cd36afa834e18571 HTTP/1.1" 200 None 2025-09-26 15:59:25,031 - lava_callback - DEBUG - Processing node 68d41552cd36afa834e18571: ltp-input 2025-09-26 15:59:25,031 - lava_callback - ERROR - Error processing callback for node 68d41552cd36afa834e18571: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:43108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43122 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:59:27,117 - lava_callback - INFO - Received callback for node 68d41549cd36afa834e1856b INFO: 172.20.0.1:43136 - "POST /node/68d41549cd36afa834e1856b HTTP/1.0" 202 Accepted 2025-09-26 15:59:27,122 - lava_callback - INFO - Starting async job submit for node 68d41549cd36afa834e1856b 2025-09-26 15:59:27,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:59:27,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41549cd36afa834e1856b HTTP/1.1" 200 None 2025-09-26 15:59:27,134 - lava_callback - DEBUG - Processing node 68d41549cd36afa834e1856b: baseline-arm64-clabbe 2025-09-26 15:59:27,134 - lava_callback - ERROR - Error processing callback for node 68d41549cd36afa834e1856b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:35090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36186 - "GET / HTTP/1.0" 200 OK 2025-09-26 15:59:44,381 - lava_callback - INFO - Received callback for node 68d41560cd36afa834e18580 INFO: 172.20.0.1:36196 - "POST /node/68d41560cd36afa834e18580 HTTP/1.0" 202 Accepted 2025-09-26 15:59:44,386 - lava_callback - INFO - Starting async job submit for node 68d41560cd36afa834e18580 2025-09-26 15:59:44,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:59:44,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41560cd36afa834e18580 HTTP/1.1" 200 None 2025-09-26 15:59:44,425 - lava_callback - DEBUG - Processing node 68d41560cd36afa834e18580: ltp-ipc 2025-09-26 15:59:44,426 - lava_callback - ERROR - Error processing callback for node 68d41560cd36afa834e18580: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 15:59:45,163 - lava_callback - INFO - Received callback for node 68d41563cd36afa834e18583 INFO: 172.20.0.1:36198 - "POST /node/68d41563cd36afa834e18583 HTTP/1.0" 202 Accepted 2025-09-26 15:59:45,170 - lava_callback - INFO - Starting async job submit for node 68d41563cd36afa834e18583 2025-09-26 15:59:45,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 15:59:45,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41563cd36afa834e18583 HTTP/1.1" 200 None 2025-09-26 15:59:45,212 - lava_callback - DEBUG - Processing node 68d41563cd36afa834e18583: ltp-input 2025-09-26 15:59:45,213 - lava_callback - ERROR - Error processing callback for node 68d41563cd36afa834e18583: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:36214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36166 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:00:04,188 - lava_callback - INFO - Received callback for node 68d41574cd36afa834e185aa INFO: 172.20.0.1:46140 - "POST /node/68d41574cd36afa834e185aa HTTP/1.0" 202 Accepted 2025-09-26 16:00:04,194 - lava_callback - INFO - Starting async job submit for node 68d41574cd36afa834e185aa 2025-09-26 16:00:04,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:00:04,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41574cd36afa834e185aa HTTP/1.1" 200 None 2025-09-26 16:00:04,208 - lava_callback - DEBUG - Processing node 68d41574cd36afa834e185aa: ltp-ipc 2025-09-26 16:00:04,208 - lava_callback - ERROR - Error processing callback for node 68d41574cd36afa834e185aa: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:00:04,939 - lava_callback - INFO - Received callback for node 68d41577cd36afa834e185ad INFO: 172.20.0.1:46142 - "POST /node/68d41577cd36afa834e185ad HTTP/1.0" 202 Accepted 2025-09-26 16:00:04,944 - lava_callback - INFO - Starting async job submit for node 68d41577cd36afa834e185ad 2025-09-26 16:00:04,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:00:04,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41577cd36afa834e185ad HTTP/1.1" 200 None 2025-09-26 16:00:04,957 - lava_callback - DEBUG - Processing node 68d41577cd36afa834e185ad: ltp-pty 2025-09-26 16:00:04,957 - lava_callback - ERROR - Error processing callback for node 68d41577cd36afa834e185ad: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:00:05,755 - lava_callback - INFO - Received callback for node 68d4157fcd36afa834e185b3 INFO: 172.20.0.1:46144 - "POST /node/68d4157fcd36afa834e185b3 HTTP/1.0" 202 Accepted 2025-09-26 16:00:05,761 - lava_callback - INFO - Starting async job submit for node 68d4157fcd36afa834e185b3 2025-09-26 16:00:05,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:00:05,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4157fcd36afa834e185b3 HTTP/1.1" 200 None 2025-09-26 16:00:05,774 - lava_callback - DEBUG - Processing node 68d4157fcd36afa834e185b3: ltp-ipc 2025-09-26 16:00:05,774 - lava_callback - ERROR - Error processing callback for node 68d4157fcd36afa834e185b3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:46148 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:00:06,815 - lava_callback - INFO - Received callback for node 68d45522a5c2c05277bca932 INFO: 172.20.0.1:46158 - "POST /node/68d45522a5c2c05277bca932 HTTP/1.0" 202 Accepted 2025-09-26 16:00:06,821 - lava_callback - INFO - Starting async job submit for node 68d45522a5c2c05277bca932 2025-09-26 16:00:06,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:00:06,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d45522a5c2c05277bca932 HTTP/1.1" 200 None 2025-09-26 16:00:06,853 - lava_callback - DEBUG - Processing node 68d45522a5c2c05277bca932: baseline-arm 2025-09-26 16:00:07,077 - lava_callback - ERROR - Error processing callback for node 68d45522a5c2c05277bca932: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 16:00:07,413 - lava_callback - INFO - Received callback for node 68d41578cd36afa834e185b0 INFO: 172.20.0.1:46170 - "POST /node/68d41578cd36afa834e185b0 HTTP/1.0" 202 Accepted 2025-09-26 16:00:07,418 - lava_callback - INFO - Starting async job submit for node 68d41578cd36afa834e185b0 2025-09-26 16:00:07,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:00:07,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41578cd36afa834e185b0 HTTP/1.1" 200 None 2025-09-26 16:00:07,432 - lava_callback - DEBUG - Processing node 68d41578cd36afa834e185b0: baseline-arm64-clabbe 2025-09-26 16:00:07,433 - lava_callback - ERROR - Error processing callback for node 68d41578cd36afa834e185b0: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:56234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56238 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:00:24,320 - lava_callback - INFO - Received callback for node 68d41586cd36afa834e185bc INFO: 172.20.0.1:34454 - "POST /node/68d41586cd36afa834e185bc HTTP/1.0" 202 Accepted 2025-09-26 16:00:24,326 - lava_callback - INFO - Starting async job submit for node 68d41586cd36afa834e185bc 2025-09-26 16:00:24,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:00:24,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41586cd36afa834e185bc HTTP/1.1" 200 None 2025-09-26 16:00:24,351 - lava_callback - DEBUG - Processing node 68d41586cd36afa834e185bc: ltp-pty 2025-09-26 16:00:24,351 - lava_callback - ERROR - Error processing callback for node 68d41586cd36afa834e185bc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:00:25,089 - lava_callback - INFO - Received callback for node 68d4158dcd36afa834e185c5 INFO: 172.20.0.1:34464 - "POST /node/68d4158dcd36afa834e185c5 HTTP/1.0" 202 Accepted 2025-09-26 16:00:25,095 - lava_callback - INFO - Starting async job submit for node 68d4158dcd36afa834e185c5 2025-09-26 16:00:25,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:00:25,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4158dcd36afa834e185c5 HTTP/1.1" 200 None 2025-09-26 16:00:25,120 - lava_callback - DEBUG - Processing node 68d4158dcd36afa834e185c5: ltp-sched 2025-09-26 16:00:25,120 - lava_callback - ERROR - Error processing callback for node 68d4158dcd36afa834e185c5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:00:25,964 - lava_callback - INFO - Received callback for node 68d41593cd36afa834e185ce INFO: 172.20.0.1:34478 - "POST /node/68d41593cd36afa834e185ce HTTP/1.0" 202 Accepted 2025-09-26 16:00:25,970 - lava_callback - INFO - Starting async job submit for node 68d41593cd36afa834e185ce 2025-09-26 16:00:25,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:00:25,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41593cd36afa834e185ce HTTP/1.1" 200 None 2025-09-26 16:00:25,983 - lava_callback - DEBUG - Processing node 68d41593cd36afa834e185ce: ltp-pty 2025-09-26 16:00:25,983 - lava_callback - ERROR - Error processing callback for node 68d41593cd36afa834e185ce: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:34490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52746 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:00:44,315 - lava_callback - INFO - Received callback for node 68d4159ccd36afa834e185d7 INFO: 172.20.0.1:52750 - "POST /node/68d4159ccd36afa834e185d7 HTTP/1.0" 202 Accepted 2025-09-26 16:00:44,321 - lava_callback - INFO - Starting async job submit for node 68d4159ccd36afa834e185d7 2025-09-26 16:00:44,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:00:44,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4159ccd36afa834e185d7 HTTP/1.1" 200 None 2025-09-26 16:00:44,342 - lava_callback - DEBUG - Processing node 68d4159ccd36afa834e185d7: ltp-sched 2025-09-26 16:00:44,342 - lava_callback - ERROR - Error processing callback for node 68d4159ccd36afa834e185d7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:00:45,050 - lava_callback - INFO - Received callback for node 68d415a5cd36afa834e185f1 INFO: 172.20.0.1:52766 - "POST /node/68d415a5cd36afa834e185f1 HTTP/1.0" 202 Accepted 2025-09-26 16:00:45,056 - lava_callback - INFO - Starting async job submit for node 68d415a5cd36afa834e185f1 2025-09-26 16:00:45,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:00:45,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d415a5cd36afa834e185f1 HTTP/1.1" 200 None 2025-09-26 16:00:45,098 - lava_callback - DEBUG - Processing node 68d415a5cd36afa834e185f1: ltp-smoketest 2025-09-26 16:00:45,098 - lava_callback - ERROR - Error processing callback for node 68d415a5cd36afa834e185f1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:00:45,810 - lava_callback - INFO - Received callback for node 68d415abcd36afa834e185fa INFO: 172.20.0.1:52768 - "POST /node/68d415abcd36afa834e185fa HTTP/1.0" 202 Accepted 2025-09-26 16:00:45,816 - lava_callback - INFO - Starting async job submit for node 68d415abcd36afa834e185fa 2025-09-26 16:00:45,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:00:45,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d415abcd36afa834e185fa HTTP/1.1" 200 None 2025-09-26 16:00:45,835 - lava_callback - DEBUG - Processing node 68d415abcd36afa834e185fa: ltp-sched 2025-09-26 16:00:45,835 - lava_callback - ERROR - Error processing callback for node 68d415abcd36afa834e185fa: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:52778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41428 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:01:04,327 - lava_callback - INFO - Received callback for node 68d415b7cd36afa834e1860f INFO: 172.20.0.1:42376 - "POST /node/68d415b7cd36afa834e1860f HTTP/1.0" 202 Accepted 2025-09-26 16:01:04,333 - lava_callback - INFO - Starting async job submit for node 68d415b7cd36afa834e1860f 2025-09-26 16:01:04,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:01:04,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d415b7cd36afa834e1860f HTTP/1.1" 200 None 2025-09-26 16:01:04,375 - lava_callback - DEBUG - Processing node 68d415b7cd36afa834e1860f: ltp-smoketest 2025-09-26 16:01:04,375 - lava_callback - ERROR - Error processing callback for node 68d415b7cd36afa834e1860f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:42378 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:01:07,225 - lava_callback - INFO - Received callback for node 68d415bbcd36afa834e18615 INFO: 172.20.0.1:42392 - "POST /node/68d415bbcd36afa834e18615 HTTP/1.0" 202 Accepted 2025-09-26 16:01:07,230 - lava_callback - INFO - Starting async job submit for node 68d415bbcd36afa834e18615 2025-09-26 16:01:07,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:01:07,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d415bbcd36afa834e18615 HTTP/1.1" 200 None 2025-09-26 16:01:07,244 - lava_callback - DEBUG - Processing node 68d415bbcd36afa834e18615: baseline-arm64-clabbe 2025-09-26 16:01:07,244 - lava_callback - ERROR - Error processing callback for node 68d415bbcd36afa834e18615: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:37680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37686 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:01:24,253 - lava_callback - INFO - Received callback for node 68d415c1cd36afa834e18618 INFO: 172.20.0.1:37884 - "POST /node/68d415c1cd36afa834e18618 HTTP/1.0" 202 Accepted 2025-09-26 16:01:24,259 - lava_callback - INFO - Starting async job submit for node 68d415c1cd36afa834e18618 2025-09-26 16:01:24,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:01:24,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d415c1cd36afa834e18618 HTTP/1.1" 200 None 2025-09-26 16:01:24,292 - lava_callback - DEBUG - Processing node 68d415c1cd36afa834e18618: ltp-syscalls 2025-09-26 16:01:24,292 - lava_callback - ERROR - Error processing callback for node 68d415c1cd36afa834e18618: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:01:24,996 - lava_callback - INFO - Received callback for node 68d415cacd36afa834e1861e INFO: 172.20.0.1:37898 - "POST /node/68d415cacd36afa834e1861e HTTP/1.0" 202 Accepted 2025-09-26 16:01:25,002 - lava_callback - INFO - Starting async job submit for node 68d415cacd36afa834e1861e 2025-09-26 16:01:25,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:01:25,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d415cacd36afa834e1861e HTTP/1.1" 200 None 2025-09-26 16:01:25,037 - lava_callback - DEBUG - Processing node 68d415cacd36afa834e1861e: ltp-smoketest 2025-09-26 16:01:25,037 - lava_callback - ERROR - Error processing callback for node 68d415cacd36afa834e1861e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:37914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37918 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:01:27,209 - lava_callback - INFO - Received callback for node 68d415c3cd36afa834e1861b INFO: 172.20.0.1:37934 - "POST /node/68d415c3cd36afa834e1861b HTTP/1.0" 202 Accepted 2025-09-26 16:01:27,214 - lava_callback - INFO - Starting async job submit for node 68d415c3cd36afa834e1861b 2025-09-26 16:01:27,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:01:27,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d415c3cd36afa834e1861b HTTP/1.1" 200 None 2025-09-26 16:01:27,228 - lava_callback - DEBUG - Processing node 68d415c3cd36afa834e1861b: baseline-arm64-clabbe 2025-09-26 16:01:27,228 - lava_callback - ERROR - Error processing callback for node 68d415c3cd36afa834e1861b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:38684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50160 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:01:44,528 - lava_callback - INFO - Received callback for node 68d415d4cd36afa834e1862a INFO: 172.20.0.1:50168 - "POST /node/68d415d4cd36afa834e1862a HTTP/1.0" 202 Accepted 2025-09-26 16:01:44,533 - lava_callback - INFO - Starting async job submit for node 68d415d4cd36afa834e1862a 2025-09-26 16:01:44,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:01:44,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d415d4cd36afa834e1862a HTTP/1.1" 200 None 2025-09-26 16:01:44,552 - lava_callback - DEBUG - Processing node 68d415d4cd36afa834e1862a: ltp-syscalls 2025-09-26 16:01:44,552 - lava_callback - ERROR - Error processing callback for node 68d415d4cd36afa834e1862a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:50178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40584 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:02:05,616 - lava_callback - INFO - Received callback for node 68d45524a5c2c05277bca935 INFO: 172.20.0.1:35048 - "POST /node/68d45524a5c2c05277bca935 HTTP/1.0" 202 Accepted 2025-09-26 16:02:05,621 - lava_callback - INFO - Starting async job submit for node 68d45524a5c2c05277bca935 2025-09-26 16:02:05,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:02:05,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d45524a5c2c05277bca935 HTTP/1.1" 200 None 2025-09-26 16:02:05,699 - lava_callback - DEBUG - Processing node 68d45524a5c2c05277bca935: baseline-arm 2025-09-26 16:02:05,938 - lava_callback - ERROR - Error processing callback for node 68d45524a5c2c05277bca935: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:35050 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:02:07,262 - lava_callback - INFO - Received callback for node 68d415f6cd36afa834e1865b INFO: 172.20.0.1:35058 - "POST /node/68d415f6cd36afa834e1865b HTTP/1.0" 202 Accepted 2025-09-26 16:02:07,267 - lava_callback - INFO - Starting async job submit for node 68d415f6cd36afa834e1865b 2025-09-26 16:02:07,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:02:07,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d415f6cd36afa834e1865b HTTP/1.1" 200 None 2025-09-26 16:02:07,280 - lava_callback - DEBUG - Processing node 68d415f6cd36afa834e1865b: baseline-arm64-clabbe 2025-09-26 16:02:07,280 - lava_callback - ERROR - Error processing callback for node 68d415f6cd36afa834e1865b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:43598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42582 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42594 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:03:18,484 - lava_callback - INFO - Received callback for node 68d6ab602f83206171a92752 INFO: 172.20.0.1:42606 - "POST /node/68d6ab602f83206171a92752 HTTP/1.0" 202 Accepted 2025-09-26 16:03:18,491 - lava_callback - INFO - Starting async job submit for node 68d6ab602f83206171a92752 2025-09-26 16:03:18,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:03:18,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ab602f83206171a92752 HTTP/1.1" 200 None 2025-09-26 16:03:18,563 - lava_callback - DEBUG - Processing node 68d6ab602f83206171a92752: ltp-smoketest 2025-09-26 16:03:19,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 16:03:19,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 16:03:19,160 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d6ab602f83206171a92752/log.txt.gz 2025-09-26 16:03:19,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 16:03:19,336 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 16:03:19,336 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoketest-68d6ab602f83206171a92752/lava_callback.json.gz 2025-09-26 16:03:19,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:03:19,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ab602f83206171a92752 HTTP/1.1" 200 None 2025-09-26 16:03:19,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:03:19,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6373d5d233c363a761c18 HTTP/1.1" 200 None 2025-09-26 16:03:19,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:03:19,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ab602f83206171a92752 HTTP/1.1" 200 None 2025-09-26 16:03:19,552 - lava_callback - INFO - Completed processing callback for node 68d6ab602f83206171a92752 2025-09-26 16:03:24,365 - lava_callback - INFO - Received callback for node 68d41641cd36afa834e186a9 INFO: 172.20.0.1:60932 - "POST /node/68d41641cd36afa834e186a9 HTTP/1.0" 202 Accepted 2025-09-26 16:03:24,371 - lava_callback - INFO - Starting async job submit for node 68d41641cd36afa834e186a9 2025-09-26 16:03:24,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:03:24,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41641cd36afa834e186a9 HTTP/1.1" 200 None 2025-09-26 16:03:24,384 - lava_callback - DEBUG - Processing node 68d41641cd36afa834e186a9: ltp-syscalls-ipc 2025-09-26 16:03:24,385 - lava_callback - ERROR - Error processing callback for node 68d41641cd36afa834e186a9: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60964 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:03:27,329 - lava_callback - INFO - Received callback for node 68d41645cd36afa834e186ac INFO: 172.20.0.1:60980 - "POST /node/68d41645cd36afa834e186ac HTTP/1.0" 202 Accepted 2025-09-26 16:03:27,334 - lava_callback - INFO - Starting async job submit for node 68d41645cd36afa834e186ac 2025-09-26 16:03:27,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:03:27,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41645cd36afa834e186ac HTTP/1.1" 200 None 2025-09-26 16:03:27,348 - lava_callback - DEBUG - Processing node 68d41645cd36afa834e186ac: baseline-arm64-clabbe 2025-09-26 16:03:27,348 - lava_callback - ERROR - Error processing callback for node 68d41645cd36afa834e186ac: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:38080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41484 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:03:44,597 - lava_callback - INFO - Received callback for node 68d4164ccd36afa834e186b5 INFO: 172.20.0.1:41488 - "POST /node/68d4164ccd36afa834e186b5 HTTP/1.0" 202 Accepted 2025-09-26 16:03:44,603 - lava_callback - INFO - Starting async job submit for node 68d4164ccd36afa834e186b5 2025-09-26 16:03:44,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:03:44,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4164ccd36afa834e186b5 HTTP/1.1" 200 None 2025-09-26 16:03:44,616 - lava_callback - DEBUG - Processing node 68d4164ccd36afa834e186b5: ltp-syscalls 2025-09-26 16:03:44,616 - lava_callback - ERROR - Error processing callback for node 68d4164ccd36afa834e186b5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:03:45,364 - lava_callback - INFO - Received callback for node 68d41652cd36afa834e186c1 INFO: 172.20.0.1:41498 - "POST /node/68d41652cd36afa834e186c1 HTTP/1.0" 202 Accepted 2025-09-26 16:03:45,370 - lava_callback - INFO - Starting async job submit for node 68d41652cd36afa834e186c1 2025-09-26 16:03:45,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:03:45,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41652cd36afa834e186c1 HTTP/1.1" 200 None 2025-09-26 16:03:45,383 - lava_callback - DEBUG - Processing node 68d41652cd36afa834e186c1: ltp-syscalls-ipc 2025-09-26 16:03:45,383 - lava_callback - ERROR - Error processing callback for node 68d41652cd36afa834e186c1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:03:46,130 - lava_callback - INFO - Received callback for node 68d4165dcd36afa834e186e8 INFO: 172.20.0.1:41508 - "POST /node/68d4165dcd36afa834e186e8 HTTP/1.0" 202 Accepted 2025-09-26 16:03:46,136 - lava_callback - INFO - Starting async job submit for node 68d4165dcd36afa834e186e8 2025-09-26 16:03:46,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:03:46,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4165dcd36afa834e186e8 HTTP/1.1" 200 None 2025-09-26 16:03:46,149 - lava_callback - DEBUG - Processing node 68d4165dcd36afa834e186e8: ltp-timers 2025-09-26 16:03:46,149 - lava_callback - ERROR - Error processing callback for node 68d4165dcd36afa834e186e8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:41516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42680 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:04:04,557 - lava_callback - INFO - Received callback for node 68d4166dcd36afa834e18703 INFO: 172.20.0.1:42862 - "POST /node/68d4166dcd36afa834e18703 HTTP/1.0" 202 Accepted 2025-09-26 16:04:04,563 - lava_callback - INFO - Starting async job submit for node 68d4166dcd36afa834e18703 2025-09-26 16:04:04,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:04:04,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4166dcd36afa834e18703 HTTP/1.1" 200 None 2025-09-26 16:04:04,600 - lava_callback - DEBUG - Processing node 68d4166dcd36afa834e18703: ltp-syscalls-ipc 2025-09-26 16:04:04,600 - lava_callback - ERROR - Error processing callback for node 68d4166dcd36afa834e18703: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:04:05,313 - lava_callback - INFO - Received callback for node 68d41670cd36afa834e18709 INFO: 172.20.0.1:42870 - "POST /node/68d41670cd36afa834e18709 HTTP/1.0" 202 Accepted 2025-09-26 16:04:05,320 - lava_callback - INFO - Starting async job submit for node 68d41670cd36afa834e18709 2025-09-26 16:04:05,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:04:05,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41670cd36afa834e18709 HTTP/1.1" 200 None 2025-09-26 16:04:05,334 - lava_callback - DEBUG - Processing node 68d41670cd36afa834e18709: ltp-timers 2025-09-26 16:04:05,334 - lava_callback - ERROR - Error processing callback for node 68d41670cd36afa834e18709: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:42878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42202 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:04:24,586 - lava_callback - INFO - Received callback for node 68d4167dcd36afa834e1871e INFO: 172.20.0.1:52586 - "POST /node/68d4167dcd36afa834e1871e HTTP/1.0" 202 Accepted 2025-09-26 16:04:24,592 - lava_callback - INFO - Starting async job submit for node 68d4167dcd36afa834e1871e 2025-09-26 16:04:24,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:04:24,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4167dcd36afa834e1871e HTTP/1.1" 200 None 2025-09-26 16:04:24,615 - lava_callback - DEBUG - Processing node 68d4167dcd36afa834e1871e: ltp-watchqueue 2025-09-26 16:04:24,615 - lava_callback - ERROR - Error processing callback for node 68d4167dcd36afa834e1871e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:04:25,342 - lava_callback - INFO - Received callback for node 68d41687cd36afa834e1872f INFO: 172.20.0.1:52592 - "POST /node/68d41687cd36afa834e1872f HTTP/1.0" 202 Accepted 2025-09-26 16:04:25,347 - lava_callback - INFO - Starting async job submit for node 68d41687cd36afa834e1872f 2025-09-26 16:04:25,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:04:25,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41687cd36afa834e1872f HTTP/1.1" 200 None 2025-09-26 16:04:25,361 - lava_callback - DEBUG - Processing node 68d41687cd36afa834e1872f: ltp-timers 2025-09-26 16:04:25,361 - lava_callback - ERROR - Error processing callback for node 68d41687cd36afa834e1872f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:52594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44688 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:04:44,755 - lava_callback - INFO - Received callback for node 68d4168acd36afa834e1873f INFO: 172.20.0.1:44702 - "POST /node/68d4168acd36afa834e1873f HTTP/1.0" 202 Accepted 2025-09-26 16:04:44,761 - lava_callback - INFO - Starting async job submit for node 68d4168acd36afa834e1873f 2025-09-26 16:04:44,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:04:44,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4168acd36afa834e1873f HTTP/1.1" 200 None 2025-09-26 16:04:44,776 - lava_callback - DEBUG - Processing node 68d4168acd36afa834e1873f: ltp-watchqueue 2025-09-26 16:04:44,776 - lava_callback - ERROR - Error processing callback for node 68d4168acd36afa834e1873f: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:04:45,386 - lava_callback - INFO - Received callback for node 68d6b46b2f83206171a92a5d INFO: 172.20.0.1:44706 - "POST /node/68d6b46b2f83206171a92a5d HTTP/1.0" 202 Accepted 2025-09-26 16:04:45,392 - lava_callback - INFO - Starting async job submit for node 68d6b46b2f83206171a92a5d 2025-09-26 16:04:45,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:04:45,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b46b2f83206171a92a5d HTTP/1.1" 200 None 2025-09-26 16:04:45,435 - lava_callback - DEBUG - Processing node 68d6b46b2f83206171a92a5d: baseline-x86-kcidebug-intel 2025-09-26 16:04:45,533 - lava_callback - INFO - Received callback for node 68d4168ecd36afa834e1874e INFO: 172.20.0.1:44720 - "POST /node/68d4168ecd36afa834e1874e HTTP/1.0" 202 Accepted 2025-09-26 16:04:45,543 - lava_callback - INFO - Starting async job submit for node 68d4168ecd36afa834e1874e 2025-09-26 16:04:45,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:04:45,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4168ecd36afa834e1874e HTTP/1.1" 200 None 2025-09-26 16:04:45,620 - lava_callback - DEBUG - Processing node 68d4168ecd36afa834e1874e: baseline-arm-broonie 2025-09-26 16:04:45,620 - lava_callback - ERROR - Error processing callback for node 68d4168ecd36afa834e1874e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:04:45,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 16:04:45,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 16:04:45,931 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d6b46b2f83206171a92a5d/log.txt.gz 2025-09-26 16:04:45,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 16:04:46,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 16:04:46,116 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-kcidebug-intel-68d6b46b2f83206171a92a5d/lava_callback.json.gz DEBUG: Setup failed for 68d6b46b2f83206171a92a5d. Transitting job node result: incomplete -> fail 2025-09-26 16:04:46,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:04:46,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6b46b2f83206171a92a5d HTTP/1.1" 200 None 2025-09-26 16:04:46,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:04:46,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d649095d233c363a762369 HTTP/1.1" 200 None 2025-09-26 16:04:46,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:04:46,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6b46b2f83206171a92a5d HTTP/1.1" 200 None 2025-09-26 16:04:46,253 - lava_callback - INFO - Completed processing callback for node 68d6b46b2f83206171a92a5d 2025-09-26 16:04:46,308 - lava_callback - INFO - Received callback for node 68d41690cd36afa834e18758 INFO: 172.20.0.1:44734 - "POST /node/68d41690cd36afa834e18758 HTTP/1.0" 202 Accepted 2025-09-26 16:04:46,324 - lava_callback - INFO - Starting async job submit for node 68d41690cd36afa834e18758 2025-09-26 16:04:46,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:04:46,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41690cd36afa834e18758 HTTP/1.1" 200 None 2025-09-26 16:04:46,377 - lava_callback - DEBUG - Processing node 68d41690cd36afa834e18758: baseline-arm-broonie 2025-09-26 16:04:46,377 - lava_callback - ERROR - Error processing callback for node 68d41690cd36afa834e18758: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:44742 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:04:47,079 - lava_callback - INFO - Received callback for node 68d4169bcd36afa834e18786 INFO: 172.20.0.1:44758 - "POST /node/68d4169bcd36afa834e18786 HTTP/1.0" 202 Accepted 2025-09-26 16:04:47,085 - lava_callback - INFO - Starting async job submit for node 68d4169bcd36afa834e18786 2025-09-26 16:04:47,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:04:47,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4169bcd36afa834e18786 HTTP/1.1" 200 None 2025-09-26 16:04:47,102 - lava_callback - DEBUG - Processing node 68d4169bcd36afa834e18786: ltp-cap-bounds 2025-09-26 16:04:47,102 - lava_callback - ERROR - Error processing callback for node 68d4169bcd36afa834e18786: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:04:47,408 - lava_callback - INFO - Received callback for node 68d41699cd36afa834e18781 INFO: 172.20.0.1:44768 - "POST /node/68d41699cd36afa834e18781 HTTP/1.0" 202 Accepted 2025-09-26 16:04:47,417 - lava_callback - INFO - Starting async job submit for node 68d41699cd36afa834e18781 2025-09-26 16:04:47,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:04:47,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41699cd36afa834e18781 HTTP/1.1" 200 None 2025-09-26 16:04:47,431 - lava_callback - DEBUG - Processing node 68d41699cd36afa834e18781: baseline-arm64-clabbe 2025-09-26 16:04:47,431 - lava_callback - ERROR - Error processing callback for node 68d41699cd36afa834e18781: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:04:47,808 - lava_callback - INFO - Received callback for node 68d4168acd36afa834e18742 INFO: 172.20.0.1:44770 - "POST /node/68d4168acd36afa834e18742 HTTP/1.0" 202 Accepted 2025-09-26 16:04:47,813 - lava_callback - INFO - Starting async job submit for node 68d4168acd36afa834e18742 2025-09-26 16:04:47,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:04:47,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4168acd36afa834e18742 HTTP/1.1" 200 None 2025-09-26 16:04:47,837 - lava_callback - DEBUG - Processing node 68d4168acd36afa834e18742: baseline-arm 2025-09-26 16:04:47,837 - lava_callback - ERROR - Error processing callback for node 68d4168acd36afa834e18742: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:04:47,838 - lava_callback - INFO - Received callback for node 68d4169dcd36afa834e1878c INFO: 172.20.0.1:44772 - "POST /node/68d4169dcd36afa834e1878c HTTP/1.0" 202 Accepted 2025-09-26 16:04:47,845 - lava_callback - INFO - Starting async job submit for node 68d4169dcd36afa834e1878c 2025-09-26 16:04:47,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:04:47,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4169dcd36afa834e1878c HTTP/1.1" 200 None 2025-09-26 16:04:47,862 - lava_callback - DEBUG - Processing node 68d4169dcd36afa834e1878c: ltp-containers 2025-09-26 16:04:47,862 - lava_callback - ERROR - Error processing callback for node 68d4169dcd36afa834e1878c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:04:48,593 - lava_callback - INFO - Received callback for node 68d4169ecd36afa834e18792 INFO: 172.20.0.1:44776 - "POST /node/68d4169ecd36afa834e18792 HTTP/1.0" 202 Accepted 2025-09-26 16:04:48,602 - lava_callback - INFO - Starting async job submit for node 68d4169ecd36afa834e18792 2025-09-26 16:04:48,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:04:48,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4169ecd36afa834e18792 HTTP/1.1" 200 None 2025-09-26 16:04:48,616 - lava_callback - DEBUG - Processing node 68d4169ecd36afa834e18792: ltp-controllers 2025-09-26 16:04:48,616 - lava_callback - ERROR - Error processing callback for node 68d4169ecd36afa834e18792: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:04:49,334 - lava_callback - INFO - Received callback for node 68d4169fcd36afa834e18796 INFO: 172.20.0.1:45712 - "POST /node/68d4169fcd36afa834e18796 HTTP/1.0" 202 Accepted 2025-09-26 16:04:49,340 - lava_callback - INFO - Starting async job submit for node 68d4169fcd36afa834e18796 2025-09-26 16:04:49,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:04:49,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4169fcd36afa834e18796 HTTP/1.1" 200 None 2025-09-26 16:04:49,357 - lava_callback - DEBUG - Processing node 68d4169fcd36afa834e18796: ltp-cve 2025-09-26 16:04:49,357 - lava_callback - ERROR - Error processing callback for node 68d4169fcd36afa834e18796: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:45714 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:05:04,599 - lava_callback - INFO - Received callback for node 68d416a0cd36afa834e1879c INFO: 172.20.0.1:60744 - "POST /node/68d416a0cd36afa834e1879c HTTP/1.0" 202 Accepted 2025-09-26 16:05:04,605 - lava_callback - INFO - Starting async job submit for node 68d416a0cd36afa834e1879c 2025-09-26 16:05:04,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:05:04,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d416a0cd36afa834e1879c HTTP/1.1" 200 None 2025-09-26 16:05:04,621 - lava_callback - DEBUG - Processing node 68d416a0cd36afa834e1879c: ltp-fs-bind 2025-09-26 16:05:04,622 - lava_callback - ERROR - Error processing callback for node 68d416a0cd36afa834e1879c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:05:05,392 - lava_callback - INFO - Received callback for node 68d416a3cd36afa834e187a2 INFO: 172.20.0.1:60748 - "POST /node/68d416a3cd36afa834e187a2 HTTP/1.0" 202 Accepted 2025-09-26 16:05:05,399 - lava_callback - INFO - Starting async job submit for node 68d416a3cd36afa834e187a2 2025-09-26 16:05:05,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:05:05,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d416a3cd36afa834e187a2 HTTP/1.1" 200 None 2025-09-26 16:05:05,415 - lava_callback - DEBUG - Processing node 68d416a3cd36afa834e187a2: ltp-fsx 2025-09-26 16:05:05,415 - lava_callback - ERROR - Error processing callback for node 68d416a3cd36afa834e187a2: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:05:06,140 - lava_callback - INFO - Received callback for node 68d416a4cd36afa834e187a8 INFO: 172.20.0.1:60756 - "POST /node/68d416a4cd36afa834e187a8 HTTP/1.0" 202 Accepted 2025-09-26 16:05:06,148 - lava_callback - INFO - Starting async job submit for node 68d416a4cd36afa834e187a8 2025-09-26 16:05:06,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:05:06,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d416a4cd36afa834e187a8 HTTP/1.1" 200 None 2025-09-26 16:05:06,163 - lava_callback - DEBUG - Processing node 68d416a4cd36afa834e187a8: ltp-input 2025-09-26 16:05:06,163 - lava_callback - ERROR - Error processing callback for node 68d416a4cd36afa834e187a8: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:60762 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:05:06,893 - lava_callback - INFO - Received callback for node 68d416a5cd36afa834e187ab INFO: 172.20.0.1:60774 - "POST /node/68d416a5cd36afa834e187ab HTTP/1.0" 202 Accepted 2025-09-26 16:05:06,899 - lava_callback - INFO - Starting async job submit for node 68d416a5cd36afa834e187ab 2025-09-26 16:05:06,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:05:06,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d416a5cd36afa834e187ab HTTP/1.1" 200 None 2025-09-26 16:05:06,914 - lava_callback - DEBUG - Processing node 68d416a5cd36afa834e187ab: ltp-ipc 2025-09-26 16:05:06,914 - lava_callback - ERROR - Error processing callback for node 68d416a5cd36afa834e187ab: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:05:07,496 - lava_callback - INFO - Received callback for node 68d416a9cd36afa834e187bc INFO: 172.20.0.1:60782 - "POST /node/68d416a9cd36afa834e187bc HTTP/1.0" 202 Accepted 2025-09-26 16:05:07,502 - lava_callback - INFO - Starting async job submit for node 68d416a9cd36afa834e187bc 2025-09-26 16:05:07,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:05:07,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d416a9cd36afa834e187bc HTTP/1.1" 200 None 2025-09-26 16:05:07,524 - lava_callback - DEBUG - Processing node 68d416a9cd36afa834e187bc: baseline-arm64-clabbe 2025-09-26 16:05:07,524 - lava_callback - ERROR - Error processing callback for node 68d416a9cd36afa834e187bc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:05:07,639 - lava_callback - INFO - Received callback for node 68d416a6cd36afa834e187ae INFO: 172.20.0.1:60786 - "POST /node/68d416a6cd36afa834e187ae HTTP/1.0" 202 Accepted 2025-09-26 16:05:07,645 - lava_callback - INFO - Starting async job submit for node 68d416a6cd36afa834e187ae 2025-09-26 16:05:07,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:05:07,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d416a6cd36afa834e187ae HTTP/1.1" 200 None 2025-09-26 16:05:07,660 - lava_callback - DEBUG - Processing node 68d416a6cd36afa834e187ae: ltp-pty 2025-09-26 16:05:07,660 - lava_callback - ERROR - Error processing callback for node 68d416a6cd36afa834e187ae: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:05:08,384 - lava_callback - INFO - Received callback for node 68d416a7cd36afa834e187b1 INFO: 172.20.0.1:60792 - "POST /node/68d416a7cd36afa834e187b1 HTTP/1.0" 202 Accepted 2025-09-26 16:05:08,390 - lava_callback - INFO - Starting async job submit for node 68d416a7cd36afa834e187b1 2025-09-26 16:05:08,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:05:08,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d416a7cd36afa834e187b1 HTTP/1.1" 200 None 2025-09-26 16:05:08,405 - lava_callback - DEBUG - Processing node 68d416a7cd36afa834e187b1: ltp-sched 2025-09-26 16:05:08,405 - lava_callback - ERROR - Error processing callback for node 68d416a7cd36afa834e187b1: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:05:09,121 - lava_callback - INFO - Received callback for node 68d416a8cd36afa834e187b4 INFO: 172.20.0.1:60798 - "POST /node/68d416a8cd36afa834e187b4 HTTP/1.0" 202 Accepted 2025-09-26 16:05:09,130 - lava_callback - INFO - Starting async job submit for node 68d416a8cd36afa834e187b4 2025-09-26 16:05:09,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:05:09,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d416a8cd36afa834e187b4 HTTP/1.1" 200 None 2025-09-26 16:05:09,150 - lava_callback - DEBUG - Processing node 68d416a8cd36afa834e187b4: ltp-smoketest 2025-09-26 16:05:09,150 - lava_callback - ERROR - Error processing callback for node 68d416a8cd36afa834e187b4: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:05:09,901 - lava_callback - INFO - Received callback for node 68d416a8cd36afa834e187b7 INFO: 172.20.0.1:38294 - "POST /node/68d416a8cd36afa834e187b7 HTTP/1.0" 202 Accepted 2025-09-26 16:05:09,910 - lava_callback - INFO - Starting async job submit for node 68d416a8cd36afa834e187b7 2025-09-26 16:05:09,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:05:09,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d416a8cd36afa834e187b7 HTTP/1.1" 200 None 2025-09-26 16:05:09,925 - lava_callback - DEBUG - Processing node 68d416a8cd36afa834e187b7: ltp-syscalls 2025-09-26 16:05:09,925 - lava_callback - ERROR - Error processing callback for node 68d416a8cd36afa834e187b7: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:05:10,696 - lava_callback - INFO - Received callback for node 68d416a9cd36afa834e187ba INFO: 172.20.0.1:38300 - "POST /node/68d416a9cd36afa834e187ba HTTP/1.0" 202 Accepted 2025-09-26 16:05:10,704 - lava_callback - INFO - Starting async job submit for node 68d416a9cd36afa834e187ba 2025-09-26 16:05:10,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:05:10,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d416a9cd36afa834e187ba HTTP/1.1" 200 None 2025-09-26 16:05:10,719 - lava_callback - DEBUG - Processing node 68d416a9cd36afa834e187ba: ltp-syscalls-ipc 2025-09-26 16:05:10,719 - lava_callback - ERROR - Error processing callback for node 68d416a9cd36afa834e187ba: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:05:11,460 - lava_callback - INFO - Received callback for node 68d416aacd36afa834e187bf INFO: 172.20.0.1:38308 - "POST /node/68d416aacd36afa834e187bf HTTP/1.0" 202 Accepted 2025-09-26 16:05:11,469 - lava_callback - INFO - Starting async job submit for node 68d416aacd36afa834e187bf 2025-09-26 16:05:11,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:05:11,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d416aacd36afa834e187bf HTTP/1.1" 200 None 2025-09-26 16:05:11,484 - lava_callback - DEBUG - Processing node 68d416aacd36afa834e187bf: ltp-timers 2025-09-26 16:05:11,484 - lava_callback - ERROR - Error processing callback for node 68d416aacd36afa834e187bf: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:05:12,211 - lava_callback - INFO - Received callback for node 68d416aacd36afa834e187c3 INFO: 172.20.0.1:38316 - "POST /node/68d416aacd36afa834e187c3 HTTP/1.0" 202 Accepted 2025-09-26 16:05:12,218 - lava_callback - INFO - Starting async job submit for node 68d416aacd36afa834e187c3 2025-09-26 16:05:12,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:05:12,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d416aacd36afa834e187c3 HTTP/1.1" 200 None 2025-09-26 16:05:12,232 - lava_callback - DEBUG - Processing node 68d416aacd36afa834e187c3: ltp-watchqueue 2025-09-26 16:05:12,232 - lava_callback - ERROR - Error processing callback for node 68d416aacd36afa834e187c3: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:05:12,966 - lava_callback - INFO - Received callback for node 68d416adcd36afa834e187c5 INFO: 172.20.0.1:38330 - "POST /node/68d416adcd36afa834e187c5 HTTP/1.0" 202 Accepted 2025-09-26 16:05:12,973 - lava_callback - INFO - Starting async job submit for node 68d416adcd36afa834e187c5 2025-09-26 16:05:12,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:05:13,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d416adcd36afa834e187c5 HTTP/1.1" 200 None 2025-09-26 16:05:13,010 - lava_callback - DEBUG - Processing node 68d416adcd36afa834e187c5: ltp-watchqueue 2025-09-26 16:05:13,010 - lava_callback - ERROR - Error processing callback for node 68d416adcd36afa834e187c5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:38338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34224 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:05:27,397 - lava_callback - INFO - Received callback for node 68d416b8cd36afa834e187d5 INFO: 172.20.0.1:34226 - "POST /node/68d416b8cd36afa834e187d5 HTTP/1.0" 202 Accepted 2025-09-26 16:05:27,402 - lava_callback - INFO - Starting async job submit for node 68d416b8cd36afa834e187d5 2025-09-26 16:05:27,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:05:27,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d416b8cd36afa834e187d5 HTTP/1.1" 200 None 2025-09-26 16:05:27,415 - lava_callback - DEBUG - Processing node 68d416b8cd36afa834e187d5: baseline-arm64-clabbe 2025-09-26 16:05:27,415 - lava_callback - ERROR - Error processing callback for node 68d416b8cd36afa834e187d5: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:53636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48302 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:05:57,346 - lava_callback - INFO - Received callback for node 68d6adec2f83206171a9280b INFO: 172.20.0.1:48304 - "POST /node/68d6adec2f83206171a9280b HTTP/1.0" 202 Accepted 2025-09-26 16:05:57,358 - lava_callback - INFO - Starting async job submit for node 68d6adec2f83206171a9280b 2025-09-26 16:05:57,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:05:57,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6adec2f83206171a9280b HTTP/1.1" 200 None 2025-09-26 16:05:57,442 - lava_callback - DEBUG - Processing node 68d6adec2f83206171a9280b: baseline-arm64 2025-09-26 16:05:58,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 16:05:58,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 16:05:58,909 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6adec2f83206171a9280b/log.txt.gz 2025-09-26 16:05:58,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 16:05:59,128 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 16:05:59,129 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6adec2f83206171a9280b/lava_callback.json.gz DEBUG: Setup failed for 68d6adec2f83206171a9280b. Transitting job node result: incomplete -> fail 2025-09-26 16:05:59,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:05:59,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6adec2f83206171a9280b HTTP/1.1" 200 None 2025-09-26 16:05:59,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:05:59,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 16:05:59,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:05:59,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6adec2f83206171a9280b HTTP/1.1" 200 None 2025-09-26 16:05:59,317 - lava_callback - INFO - Completed processing callback for node 68d6adec2f83206171a9280b INFO: 172.20.0.1:36868 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:06:10,767 - lava_callback - INFO - Received callback for node 68d6adec2f83206171a92808 INFO: 172.20.0.1:44148 - "POST /node/68d6adec2f83206171a92808 HTTP/1.0" 202 Accepted 2025-09-26 16:06:10,775 - lava_callback - INFO - Starting async job submit for node 68d6adec2f83206171a92808 2025-09-26 16:06:10,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:06:10,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6adec2f83206171a92808 HTTP/1.1" 200 None 2025-09-26 16:06:10,825 - lava_callback - DEBUG - Processing node 68d6adec2f83206171a92808: baseline-arm64 2025-09-26 16:06:11,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 16:06:12,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 16:06:12,031 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6adec2f83206171a92808/log.txt.gz 2025-09-26 16:06:12,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 16:06:12,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 16:06:12,209 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6adec2f83206171a92808/lava_callback.json.gz DEBUG: Setup failed for 68d6adec2f83206171a92808. Transitting job node result: incomplete -> fail 2025-09-26 16:06:12,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:06:12,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6adec2f83206171a92808 HTTP/1.1" 200 None 2025-09-26 16:06:12,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:06:12,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 16:06:12,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:06:12,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6adec2f83206171a92808 HTTP/1.1" 200 None 2025-09-26 16:06:12,348 - lava_callback - INFO - Completed processing callback for node 68d6adec2f83206171a92808 INFO: 172.20.0.1:44152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60162 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:06:36,464 - lava_callback - INFO - Received callback for node 68d6ae092f83206171a92842 INFO: 172.20.0.1:60414 - "POST /node/68d6ae092f83206171a92842 HTTP/1.0" 202 Accepted 2025-09-26 16:06:36,471 - lava_callback - INFO - Starting async job submit for node 68d6ae092f83206171a92842 2025-09-26 16:06:36,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:60428 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:06:36,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae092f83206171a92842 HTTP/1.1" 200 None 2025-09-26 16:06:36,537 - lava_callback - DEBUG - Processing node 68d6ae092f83206171a92842: baseline-arm64 2025-09-26 16:06:37,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 16:06:37,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 16:06:37,840 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ae092f83206171a92842/log.txt.gz 2025-09-26 16:06:37,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 16:06:38,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 16:06:38,039 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ae092f83206171a92842/lava_callback.json.gz DEBUG: Setup failed for 68d6ae092f83206171a92842. Transitting job node result: incomplete -> fail 2025-09-26 16:06:38,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:06:38,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae092f83206171a92842 HTTP/1.1" 200 None 2025-09-26 16:06:38,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:06:38,158 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 16:06:38,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:06:38,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae092f83206171a92842 HTTP/1.1" 200 None 2025-09-26 16:06:38,215 - lava_callback - INFO - Completed processing callback for node 68d6ae092f83206171a92842 INFO: 172.20.0.1:37814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47552 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:07:07,522 - lava_callback - INFO - Received callback for node 68d41723cd36afa834e18839 INFO: 172.20.0.1:47554 - "POST /node/68d41723cd36afa834e18839 HTTP/1.0" 202 Accepted 2025-09-26 16:07:07,531 - lava_callback - INFO - Starting async job submit for node 68d41723cd36afa834e18839 2025-09-26 16:07:07,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:07:07,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41723cd36afa834e18839 HTTP/1.1" 200 None 2025-09-26 16:07:07,549 - lava_callback - DEBUG - Processing node 68d41723cd36afa834e18839: baseline-arm64-clabbe 2025-09-26 16:07:07,549 - lava_callback - ERROR - Error processing callback for node 68d41723cd36afa834e18839: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:07:08,188 - lava_callback - INFO - Received callback for node 68d41728cd36afa834e1883c INFO: 172.20.0.1:47558 - "POST /node/68d41728cd36afa834e1883c HTTP/1.0" 202 Accepted 2025-09-26 16:07:08,195 - lava_callback - INFO - Starting async job submit for node 68d41728cd36afa834e1883c 2025-09-26 16:07:08,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:07:08,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41728cd36afa834e1883c HTTP/1.1" 200 None 2025-09-26 16:07:08,212 - lava_callback - DEBUG - Processing node 68d41728cd36afa834e1883c: baseline-arm64-clabbe 2025-09-26 16:07:08,212 - lava_callback - ERROR - Error processing callback for node 68d41728cd36afa834e1883c: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:53384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44534 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44550 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:07:27,486 - lava_callback - INFO - Received callback for node 68d41737cd36afa834e1884b INFO: 172.20.0.1:44562 - "POST /node/68d41737cd36afa834e1884b HTTP/1.0" 202 Accepted 2025-09-26 16:07:27,491 - lava_callback - INFO - Starting async job submit for node 68d41737cd36afa834e1884b 2025-09-26 16:07:27,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:07:27,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41737cd36afa834e1884b HTTP/1.1" 200 None 2025-09-26 16:07:27,513 - lava_callback - DEBUG - Processing node 68d41737cd36afa834e1884b: baseline-arm64-clabbe 2025-09-26 16:07:27,513 - lava_callback - ERROR - Error processing callback for node 68d41737cd36afa834e1884b: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:51458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49424 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:08:07,540 - lava_callback - INFO - Received callback for node 68d41754cd36afa834e1886e INFO: 172.20.0.1:49438 - "POST /node/68d41754cd36afa834e1886e HTTP/1.0" 202 Accepted 2025-09-26 16:08:07,550 - lava_callback - INFO - Starting async job submit for node 68d41754cd36afa834e1886e 2025-09-26 16:08:07,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:08:07,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41754cd36afa834e1886e HTTP/1.1" 200 None 2025-09-26 16:08:07,568 - lava_callback - DEBUG - Processing node 68d41754cd36afa834e1886e: baseline-arm64-clabbe 2025-09-26 16:08:07,568 - lava_callback - ERROR - Error processing callback for node 68d41754cd36afa834e1886e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:58726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37340 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:08:27,560 - lava_callback - INFO - Received callback for node 68d41768cd36afa834e1887d INFO: 172.20.0.1:37356 - "POST /node/68d41768cd36afa834e1887d HTTP/1.0" 202 Accepted 2025-09-26 16:08:27,566 - lava_callback - INFO - Starting async job submit for node 68d41768cd36afa834e1887d 2025-09-26 16:08:27,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:08:27,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41768cd36afa834e1887d HTTP/1.1" 200 None 2025-09-26 16:08:27,579 - lava_callback - DEBUG - Processing node 68d41768cd36afa834e1887d: baseline-arm64-clabbe 2025-09-26 16:08:27,579 - lava_callback - ERROR - Error processing callback for node 68d41768cd36afa834e1887d: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:08:35,628 - lava_callback - INFO - Received callback for node 68d4119dcd36afa834e1801f INFO: 172.20.0.1:58122 - "POST /node/68d4119dcd36afa834e1801f HTTP/1.0" 202 Accepted 2025-09-26 16:08:35,635 - lava_callback - INFO - Starting async job submit for node 68d4119dcd36afa834e1801f 2025-09-26 16:08:35,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:08:35,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4119dcd36afa834e1801f HTTP/1.1" 200 None 2025-09-26 16:08:35,749 - lava_callback - DEBUG - Processing node 68d4119dcd36afa834e1801f: ltp-cve 2025-09-26 16:08:36,418 - lava_callback - ERROR - Error processing callback for node 68d4119dcd36afa834e1801f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:58124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38092 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:08:47,533 - lava_callback - INFO - Received callback for node 68d41785cd36afa834e18898 INFO: 172.20.0.1:38108 - "POST /node/68d41785cd36afa834e18898 HTTP/1.0" 202 Accepted 2025-09-26 16:08:47,538 - lava_callback - INFO - Starting async job submit for node 68d41785cd36afa834e18898 2025-09-26 16:08:47,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:08:47,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41785cd36afa834e18898 HTTP/1.1" 200 None 2025-09-26 16:08:47,553 - lava_callback - DEBUG - Processing node 68d41785cd36afa834e18898: baseline-arm64-clabbe 2025-09-26 16:08:47,553 - lava_callback - ERROR - Error processing callback for node 68d41785cd36afa834e18898: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:58046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36596 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:11:47,717 - lava_callback - INFO - Received callback for node 68d4183fcd36afa834e1898e INFO: 172.20.0.1:36612 - "POST /node/68d4183fcd36afa834e1898e HTTP/1.0" 202 Accepted 2025-09-26 16:11:47,722 - lava_callback - INFO - Starting async job submit for node 68d4183fcd36afa834e1898e 2025-09-26 16:11:47,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:11:47,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d4183fcd36afa834e1898e HTTP/1.1" 200 None 2025-09-26 16:11:47,736 - lava_callback - DEBUG - Processing node 68d4183fcd36afa834e1898e: baseline-arm64-clabbe 2025-09-26 16:11:47,737 - lava_callback - ERROR - Error processing callback for node 68d4183fcd36afa834e1898e: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:11:53,305 - lava_callback - INFO - Received callback for node 68d699b32f83206171a921f0 INFO: 172.20.0.1:39250 - "POST /node/68d699b32f83206171a921f0 HTTP/1.0" 202 Accepted 2025-09-26 16:11:53,313 - lava_callback - INFO - Starting async job submit for node 68d699b32f83206171a921f0 2025-09-26 16:11:53,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:11:53,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d699b32f83206171a921f0 HTTP/1.1" 200 None 2025-09-26 16:11:53,372 - lava_callback - DEBUG - Processing node 68d699b32f83206171a921f0: baseline-arm64 2025-09-26 16:11:54,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 16:11:54,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 16:11:54,712 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d699b32f83206171a921f0/log.txt.gz 2025-09-26 16:11:54,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 16:11:54,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 16:11:54,951 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d699b32f83206171a921f0/lava_callback.json.gz DEBUG: Setup failed for 68d699b32f83206171a921f0. Transitting job node result: incomplete -> fail 2025-09-26 16:11:55,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:11:55,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d699b32f83206171a921f0 HTTP/1.1" 200 None 2025-09-26 16:11:55,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:11:55,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 16:11:55,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:11:55,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d699b32f83206171a921f0 HTTP/1.1" 200 None 2025-09-26 16:11:55,147 - lava_callback - INFO - Completed processing callback for node 68d699b32f83206171a921f0 INFO: 172.20.0.1:39266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33460 - "GET /api/metrics HTTP/1.0" 200 OK 2025-09-26 16:12:15,768 - lava_callback - INFO - Received callback for node 68d41c37a5c2c05277bc5d9f INFO: 172.20.0.1:33472 - "POST /node/68d41c37a5c2c05277bc5d9f HTTP/1.0" 202 Accepted 2025-09-26 16:12:15,775 - lava_callback - INFO - Starting async job submit for node 68d41c37a5c2c05277bc5d9f 2025-09-26 16:12:15,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:12:15,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41c37a5c2c05277bc5d9f HTTP/1.1" 200 None 2025-09-26 16:12:15,859 - lava_callback - DEBUG - Processing node 68d41c37a5c2c05277bc5d9f: baseline-arm64 INFO: 172.20.0.1:33474 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:12:16,722 - lava_callback - ERROR - Error processing callback for node 68d41c37a5c2c05277bc5d9f: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None 2025-09-26 16:12:20,894 - lava_callback - INFO - Received callback for node 68d699b42f83206171a921f3 INFO: 172.20.0.1:43398 - "POST /node/68d699b42f83206171a921f3 HTTP/1.0" 202 Accepted 2025-09-26 16:12:20,901 - lava_callback - INFO - Starting async job submit for node 68d699b42f83206171a921f3 2025-09-26 16:12:20,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:12:20,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d699b42f83206171a921f3 HTTP/1.1" 200 None 2025-09-26 16:12:20,954 - lava_callback - DEBUG - Processing node 68d699b42f83206171a921f3: baseline-arm64 2025-09-26 16:12:21,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 16:12:22,129 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 16:12:22,130 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d699b42f83206171a921f3/log.txt.gz 2025-09-26 16:12:22,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 16:12:22,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 16:12:22,306 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d699b42f83206171a921f3/lava_callback.json.gz DEBUG: Setup failed for 68d699b42f83206171a921f3. Transitting job node result: incomplete -> fail 2025-09-26 16:12:22,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:12:22,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d699b42f83206171a921f3 HTTP/1.1" 200 None 2025-09-26 16:12:22,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:12:22,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d62c44c1bc82a30b37a916 HTTP/1.1" 200 None 2025-09-26 16:12:22,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:12:22,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d699b42f83206171a921f3 HTTP/1.1" 200 None 2025-09-26 16:12:22,437 - lava_callback - INFO - Completed processing callback for node 68d699b42f83206171a921f3 INFO: 172.20.0.1:43404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43412 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:12:27,708 - lava_callback - INFO - Received callback for node 68d41859cd36afa834e189bc INFO: 172.20.0.1:43424 - "POST /node/68d41859cd36afa834e189bc HTTP/1.0" 202 Accepted 2025-09-26 16:12:27,714 - lava_callback - INFO - Starting async job submit for node 68d41859cd36afa834e189bc 2025-09-26 16:12:27,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:12:27,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41859cd36afa834e189bc HTTP/1.1" 200 None 2025-09-26 16:12:27,735 - lava_callback - DEBUG - Processing node 68d41859cd36afa834e189bc: baseline-arm64-clabbe 2025-09-26 16:12:27,735 - lava_callback - ERROR - Error processing callback for node 68d41859cd36afa834e189bc: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:51516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33148 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:12:53,368 - lava_callback - INFO - Received callback for node 68d6ae092f83206171a92845 INFO: 172.20.0.1:51872 - "POST /node/68d6ae092f83206171a92845 HTTP/1.0" 202 Accepted 2025-09-26 16:12:53,376 - lava_callback - INFO - Starting async job submit for node 68d6ae092f83206171a92845 2025-09-26 16:12:53,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:12:53,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae092f83206171a92845 HTTP/1.1" 200 None 2025-09-26 16:12:53,430 - lava_callback - DEBUG - Processing node 68d6ae092f83206171a92845: baseline-arm64 2025-09-26 16:12:54,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 16:12:54,590 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 16:12:54,591 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ae092f83206171a92845/log.txt.gz 2025-09-26 16:12:54,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2025-09-26 16:12:54,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2025-09-26 16:12:54,806 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-68d6ae092f83206171a92845/lava_callback.json.gz DEBUG: Setup failed for 68d6ae092f83206171a92845. Transitting job node result: incomplete -> fail 2025-09-26 16:12:54,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:12:54,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d6ae092f83206171a92845 HTTP/1.1" 200 None 2025-09-26 16:12:54,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:12:54,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d651ddcca86fb17472aa24 HTTP/1.1" 200 None 2025-09-26 16:12:54,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:12:54,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/68d6ae092f83206171a92845 HTTP/1.1" 200 None 2025-09-26 16:12:54,981 - lava_callback - INFO - Completed processing callback for node 68d6ae092f83206171a92845 INFO: 172.20.0.1:51882 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:13:00,774 - lava_callback - INFO - Received callback for node 68d41c3aa5c2c05277bc5da2 INFO: 172.20.0.1:58340 - "POST /node/68d41c3aa5c2c05277bc5da2 HTTP/1.0" 202 Accepted 2025-09-26 16:13:00,781 - lava_callback - INFO - Starting async job submit for node 68d41c3aa5c2c05277bc5da2 2025-09-26 16:13:00,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:13:00,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41c3aa5c2c05277bc5da2 HTTP/1.1" 200 None 2025-09-26 16:13:00,834 - lava_callback - DEBUG - Processing node 68d41c3aa5c2c05277bc5da2: baseline-arm64 2025-09-26 16:13:01,734 - lava_callback - ERROR - Error processing callback for node 68d41c3aa5c2c05277bc5da2: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:58346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49700 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:13:27,807 - lava_callback - INFO - Received callback for node 68d41892cd36afa834e18a0a INFO: 172.20.0.1:49710 - "POST /node/68d41892cd36afa834e18a0a HTTP/1.0" 202 Accepted 2025-09-26 16:13:27,812 - lava_callback - INFO - Starting async job submit for node 68d41892cd36afa834e18a0a 2025-09-26 16:13:27,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:13:27,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41892cd36afa834e18a0a HTTP/1.1" 200 None 2025-09-26 16:13:27,854 - lava_callback - DEBUG - Processing node 68d41892cd36afa834e18a0a: baseline-arm64-clabbe 2025-09-26 16:13:27,854 - lava_callback - ERROR - Error processing callback for node 68d41892cd36afa834e18a0a: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' 2025-09-26 16:13:33,624 - lava_callback - INFO - Received callback for node 68d41c77a5c2c05277bc5dca INFO: 172.20.0.1:46796 - "POST /node/68d41c77a5c2c05277bc5dca HTTP/1.0" 202 Accepted 2025-09-26 16:13:33,631 - lava_callback - INFO - Starting async job submit for node 68d41c77a5c2c05277bc5dca 2025-09-26 16:13:33,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:13:33,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41c77a5c2c05277bc5dca HTTP/1.1" 200 None 2025-09-26 16:13:33,683 - lava_callback - DEBUG - Processing node 68d41c77a5c2c05277bc5dca: baseline-arm64 2025-09-26 16:13:34,533 - lava_callback - ERROR - Error processing callback for node 68d41c77a5c2c05277bc5dca: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:46798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43650 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:13:52,510 - lava_callback - INFO - Received callback for node 68d41c7aa5c2c05277bc5dcd INFO: 172.20.0.1:35710 - "POST /node/68d41c7aa5c2c05277bc5dcd HTTP/1.0" 202 Accepted 2025-09-26 16:13:52,517 - lava_callback - INFO - Starting async job submit for node 68d41c7aa5c2c05277bc5dcd 2025-09-26 16:13:52,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:13:52,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d41c7aa5c2c05277bc5dcd HTTP/1.1" 200 None 2025-09-26 16:13:52,582 - lava_callback - DEBUG - Processing node 68d41c7aa5c2c05277bc5dcd: baseline-arm64 2025-09-26 16:13:53,486 - lava_callback - ERROR - Error processing callback for node 68d41c7aa5c2c05277bc5dcd: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:35724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39644 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:15:08,047 - lava_callback - INFO - Received callback for node 68d418f6cd36afa834e18a72 INFO: 172.20.0.1:39646 - "POST /node/68d418f6cd36afa834e18a72 HTTP/1.0" 202 Accepted 2025-09-26 16:15:08,052 - lava_callback - INFO - Starting async job submit for node 68d418f6cd36afa834e18a72 2025-09-26 16:15:08,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:15:08,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d418f6cd36afa834e18a72 HTTP/1.1" 200 None 2025-09-26 16:15:08,069 - lava_callback - DEBUG - Processing node 68d418f6cd36afa834e18a72: baseline-arm64-clabbe 2025-09-26 16:15:08,069 - lava_callback - ERROR - Error processing callback for node 68d418f6cd36afa834e18a72: 'log' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 281, in async_job_submit log_parser = job_callback.get_log_parser() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 283, in get_log_parser return LogParser(self._data['log']) ~~~~~~~~~~^^^^^^^ KeyError: 'log' INFO: 172.20.0.1:40128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40136 - "GET / HTTP/1.0" 200 OK 2025-09-26 16:15:20,622 - lava_callback - INFO - Received callback for node 68d40e7dcd36afa834e1766a INFO: 172.20.0.1:33958 - "POST /node/68d40e7dcd36afa834e1766a HTTP/1.0" 202 Accepted 2025-09-26 16:15:20,629 - lava_callback - INFO - Starting async job submit for node 68d40e7dcd36afa834e1766a 2025-09-26 16:15:20,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2025-09-26 16:15:20,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/68d40e7dcd36afa834e1766a HTTP/1.1" 200 None 2025-09-26 16:15:20,700 - lava_callback - DEBUG - Processing node 68d40e7dcd36afa834e1766a: ltp-cve 2025-09-26 16:15:21,206 - lava_callback - ERROR - Error processing callback for node 68d40e7dcd36afa834e1766a: None Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 285, in async_job_submit storage = _get_storage(storage_config_name) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/home/kernelci/pipeline/lava_callback.py", line 177, in _get_storage storage_config = CONFIGS['storage_configs'][storage_config_name] ~~~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^ KeyError: None INFO: 172.20.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45228 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]